-- Logs begin at Sat 2022-04-09 20:01:14 UTC, end at Sat 2022-04-09 22:21:29 UTC. -- Apr 09 20:37:20.031883 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Apr 09 20:37:20.039529 ncdv-master-1 devstack@keystone.service[102516]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 9 20:37:20 2022] *** Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: nodename: ncdv-master-1 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: machine: x86_64 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: clock source: unix Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: pcre jit disabled Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: detected number of CPU cores: 4 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: current working directory: / Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: detected binary path: /usr/bin/uwsgi-core Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: your processes number limit is 47680 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: your memory page size is 4096 bytes Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: detected max file descriptor number: 2048 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: lock engine: pthread robust mutexes Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: thunder lock: enabled Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 09 20:37:20.043347 ncdv-master-1 devstack@keystone.service[102516]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 09 20:37:20.096365 ncdv-master-1 devstack@keystone.service[102516]: Python main interpreter initialized at 0x5569fa0729c0 Apr 09 20:37:20.096365 ncdv-master-1 devstack@keystone.service[102516]: python threads support enabled Apr 09 20:37:20.096365 ncdv-master-1 devstack@keystone.service[102516]: your server socket listen backlog is limited to 100 connections Apr 09 20:37:20.096365 ncdv-master-1 devstack@keystone.service[102516]: your mercy for graceful operations on workers is 90 seconds Apr 09 20:37:20.096708 ncdv-master-1 devstack@keystone.service[102516]: mapped 403077 bytes (393 KB) for 2 cores Apr 09 20:37:20.096826 ncdv-master-1 devstack@keystone.service[102516]: *** Operational MODE: preforking *** Apr 09 20:37:20.097078 ncdv-master-1 devstack@keystone.service[102516]: *** uWSGI is running in multiple interpreter mode *** Apr 09 20:37:20.097078 ncdv-master-1 devstack@keystone.service[102516]: spawned uWSGI master process (pid: 102516) Apr 09 20:37:20.097279 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Apr 09 20:37:20.099752 ncdv-master-1 devstack@keystone.service[102516]: spawned uWSGI worker 1 (pid: 102531, cores: 1) Apr 09 20:37:20.099752 ncdv-master-1 devstack@keystone.service[102516]: spawned uWSGI worker 2 (pid: 102532, cores: 1) Apr 09 20:37:20.099752 ncdv-master-1 devstack@keystone.service[102516]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 09 20:37:25.916020 ncdv-master-1 devstack@keystone.service[102531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:37:25.916020 ncdv-master-1 devstack@keystone.service[102531]: from cryptography.utils import int_from_bytes Apr 09 20:37:25.916826 ncdv-master-1 devstack@keystone.service[102531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:37:25.916826 ncdv-master-1 devstack@keystone.service[102531]: from cryptography.utils import int_from_bytes Apr 09 20:37:25.916946 ncdv-master-1 devstack@keystone.service[102532]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:37:25.916946 ncdv-master-1 devstack@keystone.service[102532]: from cryptography.utils import int_from_bytes Apr 09 20:37:25.916946 ncdv-master-1 devstack@keystone.service[102532]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:37:25.916946 ncdv-master-1 devstack@keystone.service[102532]: from cryptography.utils import int_from_bytes Apr 09 20:37:25.966962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 09 20:37:25.967149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 09 20:37:25.967239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 09 20:37:25.967321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 09 20:37:25.967386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] command line args: [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 09 20:37:25.967444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] command line args: [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 09 20:37:25.967680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 09 20:37:25.967769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 09 20:37:25.967830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ================================================================================ {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 09 20:37:25.967886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ================================================================================ {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 09 20:37:25.968062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] admin_token = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] admin_token = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] config_dir = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] config_dir = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] config_source = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] config_source = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] debug = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.968920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] debug = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.969005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.969268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.969356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.969527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] insecure_debug = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.969769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] list_limit = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] log_config_append = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] log_dir = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] log_file = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] insecure_debug = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.971873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.972115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.972204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.972342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.972562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.972705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] list_limit = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.972831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.972970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] log_config_append = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.973122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.973276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.973416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.973550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] log_dir = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.973676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.973808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.973940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] log_file = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.974065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.974190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.974321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.974446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] notification_format = cadf {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.974576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.974706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.974957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] publish_errors = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.975986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.976236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.976368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.976518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.976645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.976769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.976894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] standard_threads = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] strict_password_check = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] use_eventlog = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] use_journal = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.977995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.978130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] use_json = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.978319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] notification_format = cadf {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.978460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] use_stderr = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.978460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] use_syslog = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.978705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.978845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] watch_log_file = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.978845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.979092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.979219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.979353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] publish_errors = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.979479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.979603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.979732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.979857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.979857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.980111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.980111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.980355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.980355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.980596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.980740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] standard_threads = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.980866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.980990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] strict_password_check = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.981155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.981289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.981415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.981556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] use_eventlog = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.981683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.981812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] use_journal = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.981947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.982071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] use_json = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.982071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] use_stderr = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.982393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.982527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] use_syslog = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.982653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.982777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] watch_log_file = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:37:25.982907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.983038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.983172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.983298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.983423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.983546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.984731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.984871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.985980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.986104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.986228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.986358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.986510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.986637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.986763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.986892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.987917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.988960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.989139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.989139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.989377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.989607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.989851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.989991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.990124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.990266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.990392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.990517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.990649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.990776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.990907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.991920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.992940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.993093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.993224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.993349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.993474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.993599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.993748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.993877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.994880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.995966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.996995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.997153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.997293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.997418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.997551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.997678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.997811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.997938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.998073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.998283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.998443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.998572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.998707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.998846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.998983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.999129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.999257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.999382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.999516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.999643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.999778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:25.999903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.000028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.000159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.000293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.000421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.enabled = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.000546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.000683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.000829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.001091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.001247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.001376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.001502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.001627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.001758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.001885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.002993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.003127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.003254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.003439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.003571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.003711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.003839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.003964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.004090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.004221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.enabled = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.004349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.004483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.004621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.004753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.004879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.005982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.006118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.006245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.006380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.006526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.006653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.006779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.006913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.007953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] auth.external = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] auth.mapped = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.008996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.009144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.009270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.009410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] auth.password = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.009539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.009665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] auth.token = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.009790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.009916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] catalog.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.010990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.011118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.011253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.011381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.011507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.011633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.011770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] credential.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.011897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] auth.external = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] credential.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] auth.mapped = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.012982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] auth.password = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.013144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.013272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] auth.token = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.013399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.013526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.013673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.013803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] catalog.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.013930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.014971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.015107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.015235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] credential.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.015370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.015498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] credential.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.015624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.015750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.015889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.016922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.017977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.018104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.018307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.018437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.018564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.018691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.018817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.018961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.019101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.019229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.019362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.019489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.019615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.019742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.019881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.020917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.021967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.022110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.022336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.022484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.022683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.022817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.022944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.023071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.023218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.023348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.023475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.023607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.023748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.023887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.024922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.025115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.025249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.025379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.025517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.025645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.025771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.025897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.026930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.027980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.028106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.028232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.028358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.028486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.028620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.028748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.028874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.password = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.029944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.030980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.031153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.031285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.031412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.031557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.031686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.031821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.031949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.032081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.032247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.password = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.032383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.032511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.032647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.032776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.032902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.033979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.034106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.034241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.034369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.034495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.034622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.034749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.034884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.035915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.036946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.037977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.038104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.038231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.038357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.038483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.038609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.038753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.038881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.039910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] policy.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.040941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.041133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.041266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.041393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.041526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] receipt.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.041659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.041792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.041939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.042075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.042209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.042357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.042497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.042633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.042781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.042916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.043049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] policy.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.043184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.043317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.043450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.043670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.043806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.043939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.044072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.044207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] receipt.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.044352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.044494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.044629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.044762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.044895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] revoke.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.045028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.045184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.045330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.045466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.045600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.045733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] role.cache_time = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.045867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] role.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] role.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] role.list_limit = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.046975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.047109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.047243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.047376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.047509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] revoke.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.047642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.047808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.047950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.048095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.048229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.048363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] role.cache_time = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.048363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] role.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.048624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.048757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] role.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.048890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.049048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] role.list_limit = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.049188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.049333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.049471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.049606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.049739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.049883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.050966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.051100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.051233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.051365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.051500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.051642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.051784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.051918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.052994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.053186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.053320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.053479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.053624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.053624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.053877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.054933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.055067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.055211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.055345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.cache_time = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.055484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.055618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.055760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.055894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.provider = fernet {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.056973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.057182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.057324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.057469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.057604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.057743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.057879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.cache_time = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] trust.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.provider = fernet {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.058981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.059125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.059260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.059392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.059525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.059657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.059790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.059933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.060068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.060237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.060374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.060509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.060642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.connection = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.060642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.060931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] trust.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.061083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.061223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.061358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.061492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.061625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.061770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.061905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.062040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.062173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.062306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.062446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.062589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.062725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.062869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.063003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.063137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.063270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.063445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.connection = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.063620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.063768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.063904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.064993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.065165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.065300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.065515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.065652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.065786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.065920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.066054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.067324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:37:26.067324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 09 20:37:26.081789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.082311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.082541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.082777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.083004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.083373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.092551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.092862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.123020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.123335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.124146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.124572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.176763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.177350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.226271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.226494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.227760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.228202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.293970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.294425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.294720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.294921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.295140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.295427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.295527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.295837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.295972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.296256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.296443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.296651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.320294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.320567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.320749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.321086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.321222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.321297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.321512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.321723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.322074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.322292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.322475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.323021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.323642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.324045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.333720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.334982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.346771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.346996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.347212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.347424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.347631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.347835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.347924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.348041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.348227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.348610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.348962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.349329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.349677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.350021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 09 20:37:26.365613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.365815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 09 20:37:26.366151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.366346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 09 20:37:26.366605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.366859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.367110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.367293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.367392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.367705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 09 20:37:26.368170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.368510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 09 20:37:26.368903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.369314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.369697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.370076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.378121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.378388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.378653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.378932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.382077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.382520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.382970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.383417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.387148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.390403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.390672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.390947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.391220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.391543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.391816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.392079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.392346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.392609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.392876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.393171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.394199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.397729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.398192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.398637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.399080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.399520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.399944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.400392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.400824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.401276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.401711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.402139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.419856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.421487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.421764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.427363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.428447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.428726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.430371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.432135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.432605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.438242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.438774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.439753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.440816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.441137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.445608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.445887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.446162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.448311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.448791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.451480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.451804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.452088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.452361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.454526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.454905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.455511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.456003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.456474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.456928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.457400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.457850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.460160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.474521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.474832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.480356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.481059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.481547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.484285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.484594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.487071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.489905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.491766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.492303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.494352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.497964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.498667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.498979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.499263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.499545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.499833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.500110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.501786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.505516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.505796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.506079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.506354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.506636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.506910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.519719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.520014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.520300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.520571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.526410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.526720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.526983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.527247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.528748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.530649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.530923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.534142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.534429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.534779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.535000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.535253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.535339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.537159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.537429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.540469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.540755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.541050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.541342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.541615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.549575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.549898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.550113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.550423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.550709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.550947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.551260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.555129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.555398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.555697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.555982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.556244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.556532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.556806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.569977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.573808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.578388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.578581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.578912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.579249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.580879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.581203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.581490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.582598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.584203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.585859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.586135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.586407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.588748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.590385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.593695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.593852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.594158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.594435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.594751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.595325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.599000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.599299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.599574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.599851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.604161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.604444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.604744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.608861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.609163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.609439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.612795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=102532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.613072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.613370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.613622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.613927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.614182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.614467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.614705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.615004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.615291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.615561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.615839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.616052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.616342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=102532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.617492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=102531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 09 20:37:26.617768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.618039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.618306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.618581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.618845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.619112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.619380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.619648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.619914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.620191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.620466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.620722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.620972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=102531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 09 20:37:26.654167 ncdv-master-1 devstack@keystone.service[102532]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569fa0729c0 pid: 102532 (default app) Apr 09 20:37:26.657772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef95c5-0555-4cf2-b938-c43bcc35508d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:26.658063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef95c5-0555-4cf2-b938-c43bcc35508d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:26.658337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef95c5-0555-4cf2-b938-c43bcc35508d None None] PATH_INFO: `/v3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:26.658536 ncdv-master-1 devstack@keystone.service[102531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569fa0729c0 pid: 102531 (default app) Apr 09 20:37:26.662544 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Sat Apr 9 20:37:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:35.010473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f0b9-e8c5-4940-86a6-4650b8879f9c None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:35.011061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f0b9-e8c5-4940-86a6-4650b8879f9c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:35.011061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f0b9-e8c5-4940-86a6-4650b8879f9c None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:35.017996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:35.023570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:35.024026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:35.024117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:35.168084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG oslo_db.sqlalchemy.engines [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:37:35.351533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG passlib.handlers.bcrypt [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=102532) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 09 20:37:35.351874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG passlib.handlers.bcrypt [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=102532) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 09 20:37:35.407394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:35.409061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:35.540725 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 09 20:37:35.670742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77f0b9-e8c5-4940-86a6-4650b8879f9c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:35.814804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG oslo_db.sqlalchemy.engines [None req-5a77f0b9-e8c5-4940-86a6-4650b8879f9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:37:35.942336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77f0b9-e8c5-4940-86a6-4650b8879f9c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:35.947713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a70a-8939-43ab-a44d-ce66852d0a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:35.948373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a70a-8939-43ab-a44d-ce66852d0a8b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:35.948660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a70a-8939-43ab-a44d-ce66852d0a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:35.948929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a70a-8939-43ab-a44d-ce66852d0a8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:35.958108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5a70a-8939-43ab-a44d-ce66852d0a8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:36.008524 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d9b5a70a-8939-43ab-a44d-ce66852d0a8b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 09 20:37:36.008859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5a70a-8939-43ab-a44d-ce66852d0a8b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:36.018963 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Apr 9 20:37:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 20:37:36.028883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:36.050541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a903d-2637-4754-92b5-1cf0e0b7d208 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:36.056972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3627-2a77-4ea7-b7bd-81ba962af987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:36.058236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3627-2a77-4ea7-b7bd-81ba962af987 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:36.058598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3627-2a77-4ea7-b7bd-81ba962af987 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:36.058975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3627-2a77-4ea7-b7bd-81ba962af987 admin admin] PATH_INFO: `/v3/projects/ac45ac4c5799419597fa1b4dd7090c85` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:36.060797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3627-2a77-4ea7-b7bd-81ba962af987 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac45ac4c5799419597fa1b4dd7090c85)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:36.112532 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8cda3627-2a77-4ea7-b7bd-81ba962af987 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 09 20:37:36.112864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3627-2a77-4ea7-b7bd-81ba962af987 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:36.117691 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Apr 9 20:37:36 2022] GET /identity/v3/projects/ac45ac4c5799419597fa1b4dd7090c85 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:38.415148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec353-6145-473e-8aab-6b6aa91d9a52 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:38.416014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec353-6145-473e-8aab-6b6aa91d9a52 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:38.416014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec353-6145-473e-8aab-6b6aa91d9a52 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:38.422517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:38.429108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0f42-5012-45c3-9658-440a246430d5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:38.429518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0f42-5012-45c3-9658-440a246430d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:38.429656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0f42-5012-45c3-9658-440a246430d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:38.451403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cd4c0f42-5012-45c3-9658-440a246430d5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:38.452964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cd4c0f42-5012-45c3-9658-440a246430d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:38.461467 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 09 20:37:38.486404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec353-6145-473e-8aab-6b6aa91d9a52 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:38.507239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec353-6145-473e-8aab-6b6aa91d9a52 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:38.515948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0f7b-cfc9-4d19-a8dc-9f1442866bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:38.516583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0f7b-cfc9-4d19-a8dc-9f1442866bfb admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:38.516858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0f7b-cfc9-4d19-a8dc-9f1442866bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:38.517173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0f7b-cfc9-4d19-a8dc-9f1442866bfb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:38.525288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0f7b-cfc9-4d19-a8dc-9f1442866bfb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:38.527110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0f7b-cfc9-4d19-a8dc-9f1442866bfb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:38.535947 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Apr 9 20:37:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 20:37:38.541525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0f42-5012-45c3-9658-440a246430d5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:38.552607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0f42-5012-45c3-9658-440a246430d5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:38.561795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ad95c-0a3a-410f-9de8-3034cafbfa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:38.563292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ad95c-0a3a-410f-9de8-3034cafbfa30 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:38.563752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ad95c-0a3a-410f-9de8-3034cafbfa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:38.564202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ad95c-0a3a-410f-9de8-3034cafbfa30 admin admin] PATH_INFO: `/v3/users/81850984797948c9a3a57c5bfc417a12` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:38.566694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ad95c-0a3a-410f-9de8-3034cafbfa30 admin admin] RBAC: Authorizing `identity:get_user(user_id=81850984797948c9a3a57c5bfc417a12)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:38.569760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ad95c-0a3a-410f-9de8-3034cafbfa30 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:38.572295 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Apr 9 20:37:38 2022] GET /identity/v3/users/81850984797948c9a3a57c5bfc417a12 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:40.976786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef97ca-343d-4d9c-8fad-82bf7b91fbbf None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:40.977411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef97ca-343d-4d9c-8fad-82bf7b91fbbf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:40.977411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef97ca-343d-4d9c-8fad-82bf7b91fbbf None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:40.978414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a97ba-0701-44db-af43-577b7c32295d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:40.978819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a97ba-0701-44db-af43-577b7c32295d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:40.978894 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:40.978959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a97ba-0701-44db-af43-577b7c32295d None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:40.980277 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:37:40.984038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:40.984303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:40.984672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:40.986000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c085b-80a8-46d9-b6b7-eaae11b85f4d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:40.986442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c085b-80a8-46d9-b6b7-eaae11b85f4d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:40.986837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c085b-80a8-46d9-b6b7-eaae11b85f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.007299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9d2c085b-80a8-46d9-b6b7-eaae11b85f4d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:41.008480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9d2c085b-80a8-46d9-b6b7-eaae11b85f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:41.031601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG passlib.handlers.bcrypt [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=102531) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 09 20:37:41.032012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG passlib.handlers.bcrypt [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=102531) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 09 20:37:41.078209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:41.079826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:41.089002 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:41.112000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c085b-80a8-46d9-b6b7-eaae11b85f4d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.179342 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 6/13] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:41.203425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.210183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c085b-80a8-46d9-b6b7-eaae11b85f4d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.244129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.244725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.245009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.245305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.302149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa1dd9-9c98-46c5-991a-f2ffe7bccf50 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.308666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:41.310217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:41.337844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.338910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.339188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.339458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.351845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:37:41.358773 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:37:41.360230 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:37:41.366004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.405389 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:37:41.411299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.459519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e717d9-1a02-4863-a459-060c7ab6a65c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.492387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.493081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.493372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.493640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.494457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:41.494699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:41.496159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:41.505289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2336cd-ded2-4980-9a46-4f2a2664f58e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.508334 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 8/16] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:37:41.513869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.537312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.538120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.538401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.538671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.549336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:41.550873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:41.567926 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:37:41.569342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:37:41.574898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.610723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fef23-3332-4a51-80a3-0ed1d2e8c0ef None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.650463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.651345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.651621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.651873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] PATH_INFO: `/v3/users/81850984797948c9a3a57c5bfc417a12` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.653478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] RBAC: Authorizing `identity:get_user(user_id=81850984797948c9a3a57c5bfc417a12)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:41.654960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:41.656645 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/users/81850984797948c9a3a57c5bfc417a12 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:41.661961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.673648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b806b5-5243-4ffa-b70c-eb8b8ebf8e45 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.707916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.708609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.708885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.709191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.709911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:41.710213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:41.711622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:41.729506 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:41.757397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee0db-5411-4bf6-97be-0b2a7329007a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.793210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47d2b9-3c9b-4797-9ad7-5256652d0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.794036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47d2b9-3c9b-4797-9ad7-5256652d0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.794382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47d2b9-3c9b-4797-9ad7-5256652d0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.794659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47d2b9-3c9b-4797-9ad7-5256652d0ae6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.795968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47d2b9-3c9b-4797-9ad7-5256652d0ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:41.797533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47d2b9-3c9b-4797-9ad7-5256652d0ae6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:41.799189 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:37:41.805272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:41.908933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295085cb-accb-40fc-8f14-abf717ccfded None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:41.942234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4fa58-c60a-4a8c-9d83-932561fcaf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:41.942903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fa58-c60a-4a8c-9d83-932561fcaf2e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:41.943178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fa58-c60a-4a8c-9d83-932561fcaf2e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:41.943448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fa58-c60a-4a8c-9d83-932561fcaf2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:41.944273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4fa58-c60a-4a8c-9d83-932561fcaf2e None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.domain.id=default, user.id=81850984797948c9a3a57c5bfc417a12) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:41.944595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4fa58-c60a-4a8c-9d83-932561fcaf2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:41.946150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4fa58-c60a-4a8c-9d83-932561fcaf2e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:41.953024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1322 bytes} [Sat Apr 9 20:37:41 2022] GET /identity/v3/role_assignments?user.id=81850984797948c9a3a57c5bfc417a12&scope.domain.id=default&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:44.839202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa95faf-8422-4c00-8752-24e1c5b982cd None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:44.840214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa95faf-8422-4c00-8752-24e1c5b982cd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:44.840703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa95faf-8422-4c00-8752-24e1c5b982cd None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:44.842573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:44.847930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d47db-a067-4392-ac90-d3c0c852dde2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:44.848768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d47db-a067-4392-ac90-d3c0c852dde2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:44.849275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d47db-a067-4392-ac90-d3c0c852dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:44.873756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ae0d47db-a067-4392-ac90-d3c0c852dde2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:44.875398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ae0d47db-a067-4392-ac90-d3c0c852dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:44.957696 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:44.984620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7dfa7-b543-44e7-a89c-79156115b9a3 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:44.984620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7dfa7-b543-44e7-a89c-79156115b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:44.984620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7dfa7-b543-44e7-a89c-79156115b9a3 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:44.985334 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:44.990057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec309-e933-43ad-a172-0575e76ec40a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:44.990357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec309-e933-43ad-a172-0575e76ec40a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:44.990638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec309-e933-43ad-a172-0575e76ec40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:44.992012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7dfa7-b543-44e7-a89c-79156115b9a3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:45.018082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c26ec309-e933-43ad-a172-0575e76ec40a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:45.019455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c26ec309-e933-43ad-a172-0575e76ec40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:45.118618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7dfa7-b543-44e7-a89c-79156115b9a3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:45.123584 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:45.125124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18300-8f59-47b6-b106-e719f3fdc1b7 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.129055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18300-8f59-47b6-b106-e719f3fdc1b7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.129055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18300-8f59-47b6-b106-e719f3fdc1b7 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.131181 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 14/26] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:45.132489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3941d-52cf-4316-b021-9f427e5f4a35 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.132902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3941d-52cf-4316-b021-9f427e5f4a35 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.133332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3941d-52cf-4316-b021-9f427e5f4a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.169618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:45.170728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.171191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.171597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.181424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9eb3941d-52cf-4316-b021-9f427e5f4a35 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:45.182628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9eb3941d-52cf-4316-b021-9f427e5f4a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:45.205969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:37:45.213206 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:37:45.221376 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 13/27] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:37:45.221376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:45.268667 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 15/28] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:45.270179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3941d-52cf-4316-b021-9f427e5f4a35 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:45.326723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609cb59-c49b-4972-b9c8-85d3659339d2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:45.360552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:45.361657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.362132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.362595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.363561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:45.365248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:45.378112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3941d-52cf-4316-b021-9f427e5f4a35 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:45.413244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d78d5-aa2d-4a93-8c4a-815cea548445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:45.414203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d78d5-aa2d-4a93-8c4a-815cea548445 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.414682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d78d5-aa2d-4a93-8c4a-815cea548445 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.415095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d78d5-aa2d-4a93-8c4a-815cea548445 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.415986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d78d5-aa2d-4a93-8c4a-815cea548445 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:45.416431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d78d5-aa2d-4a93-8c4a-815cea548445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:45.418072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d78d5-aa2d-4a93-8c4a-815cea548445 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:45.431097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 16/29] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:45.432692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbc6a-9b8c-492d-b8ba-ffc73b1f16c1 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.433196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbc6a-9b8c-492d-b8ba-ffc73b1f16c1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.433614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbc6a-9b8c-492d-b8ba-ffc73b1f16c1 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.435487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 17/30] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:45.436406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fbc6a-9b8c-492d-b8ba-ffc73b1f16c1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:45.515028 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 14/31] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Apr 9 20:37:45 2022] POST /identity/v3/roles => generated 219 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:37:45.516208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:45.553919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fbc6a-9b8c-492d-b8ba-ffc73b1f16c1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:45.597515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:45.599949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.600651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.601215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.602241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:45.603976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:45.686850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f332816-30ed-46a2-8f7a-87b8a872e73c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:45.735804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41777f76-997a-4a49-ae34-8b5752f67524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:45.736726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777f76-997a-4a49-ae34-8b5752f67524 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.737077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777f76-997a-4a49-ae34-8b5752f67524 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.737366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777f76-997a-4a49-ae34-8b5752f67524 None admin] PATH_INFO: `/v3/users/81850984797948c9a3a57c5bfc417a12` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.739412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41777f76-997a-4a49-ae34-8b5752f67524 None admin] RBAC: Authorizing `identity:get_user(user_id=81850984797948c9a3a57c5bfc417a12)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:45.741231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41777f76-997a-4a49-ae34-8b5752f67524 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:45.743125 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 15/32] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:37:45 2022] GET /identity/v3/users/81850984797948c9a3a57c5bfc417a12 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:45.744463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aadd53-a9eb-4bd5-ad64-c024d351cbf9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:45.744801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aadd53-a9eb-4bd5-ad64-c024d351cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:45.745144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aadd53-a9eb-4bd5-ad64-c024d351cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:45.778450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f5aadd53-a9eb-4bd5-ad64-c024d351cbf9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:45.780167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f5aadd53-a9eb-4bd5-ad64-c024d351cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:45.799610 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 18/33] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Apr 9 20:37:45 2022] POST /identity/v3/roles => generated 225 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:37:45.801017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:45.934537 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 16/34] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:45.990189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329e121-5d15-4ece-9dee-9a1c593589e2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.020000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a4293-6ba9-40b9-a2e8-3b8038a63718 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.020609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a4293-6ba9-40b9-a2e8-3b8038a63718 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.021132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a4293-6ba9-40b9-a2e8-3b8038a63718 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.023061 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 17/35] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:46.025462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a4293-6ba9-40b9-a2e8-3b8038a63718 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:46.039683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0e3aa-fbe1-4230-afde-6799981811e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.040834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e3aa-fbe1-4230-afde-6799981811e8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.041321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e3aa-fbe1-4230-afde-6799981811e8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.041876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e3aa-fbe1-4230-afde-6799981811e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.043216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0e3aa-fbe1-4230-afde-6799981811e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.044993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0e3aa-fbe1-4230-afde-6799981811e8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.046982 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 19/36] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:46.048518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9cbc-2722-4b88-83bb-029a7856f08e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.048959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9cbc-2722-4b88-83bb-029a7856f08e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.049456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9cbc-2722-4b88-83bb-029a7856f08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.071546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-beab9cbc-2722-4b88-83bb-029a7856f08e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:46.073546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-beab9cbc-2722-4b88-83bb-029a7856f08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:46.142655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a4293-6ba9-40b9-a2e8-3b8038a63718 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.142845 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 20/37] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:46.143639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9cbc-2722-4b88-83bb-029a7856f08e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:46.175647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a736ad-e299-40ae-9730-1fe3613f02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.176454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a736ad-e299-40ae-9730-1fe3613f02d8 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.176740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a736ad-e299-40ae-9730-1fe3613f02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.177017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a736ad-e299-40ae-9730-1fe3613f02d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.195214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a736ad-e299-40ae-9730-1fe3613f02d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.196708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a736ad-e299-40ae-9730-1fe3613f02d8 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.213191 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-f6a736ad-e299-40ae-9730-1fe3613f02d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:37:46.214411 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 18/38] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:37:46.215625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e27791-526b-492e-bf56-64616e54fd51 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.215905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e27791-526b-492e-bf56-64616e54fd51 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.216180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e27791-526b-492e-bf56-64616e54fd51 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.217696 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 19/39] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:46.218229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e27791-526b-492e-bf56-64616e54fd51 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:46.235805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9cbc-2722-4b88-83bb-029a7856f08e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.270059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.270899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.271177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.271451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] PATH_INFO: `/v3/domains/default/users/81850984797948c9a3a57c5bfc417a12/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.273531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=81850984797948c9a3a57c5bfc417a12, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.275017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.289772 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Apr 9 20:37:46 2022] PUT /identity/v3/domains/default/users/81850984797948c9a3a57c5bfc417a12/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:37:46.290588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:46.323753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e27791-526b-492e-bf56-64616e54fd51 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.364354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b48c0-46dc-4265-b709-2bf5b41ed87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.365073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b48c0-46dc-4265-b709-2bf5b41ed87d None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.365353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b48c0-46dc-4265-b709-2bf5b41ed87d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.365624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b48c0-46dc-4265-b709-2bf5b41ed87d None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.366439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b48c0-46dc-4265-b709-2bf5b41ed87d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.367921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b48c0-46dc-4265-b709-2bf5b41ed87d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.387656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Apr 9 20:37:46 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:37:46.389115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e629ff-906e-42fd-b400-d0ea14841c7e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.389446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e629ff-906e-42fd-b400-d0ea14841c7e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.389725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e629ff-906e-42fd-b400-d0ea14841c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.413989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-27e629ff-906e-42fd-b400-d0ea14841c7e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:46.415312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-27e629ff-906e-42fd-b400-d0ea14841c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:46.423724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bafc0-a5b5-4224-afa5-183a4e3f5c2d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.468603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.470366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.470920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.471508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.472819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:46.473438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.475295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.492684 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 22/42] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:46.496565 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:46.502512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:46.524357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e629ff-906e-42fd-b400-d0ea14841c7e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:46.639632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5828-5384-466d-8923-6576a9754edb None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.646198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e629ff-906e-42fd-b400-d0ea14841c7e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.686607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528088f1-62fe-4036-b79d-af560a8b922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.687300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528088f1-62fe-4036-b79d-af560a8b922e None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.687597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528088f1-62fe-4036-b79d-af560a8b922e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.687875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528088f1-62fe-4036-b79d-af560a8b922e None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.688375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.688600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528088f1-62fe-4036-b79d-af560a8b922e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.689250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.689534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.689803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.690181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528088f1-62fe-4036-b79d-af560a8b922e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.690986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.692423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.694239 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 22/44] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:46.699397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:46.719193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 23/45] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:37:46 2022] POST /identity/v3/projects => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:37:46.802231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf4a0-90b5-4d8c-8ef2-6100f3970a39 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:46.838651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4da698-c8a2-4df1-865c-0589116135b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:46.839331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4da698-c8a2-4df1-865c-0589116135b3 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:46.839610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4da698-c8a2-4df1-865c-0589116135b3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:46.839877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4da698-c8a2-4df1-865c-0589116135b3 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:46.840595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4da698-c8a2-4df1-865c-0589116135b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:46.842092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4da698-c8a2-4df1-865c-0589116135b3 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:46.872230 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:37:46 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:37:48.680239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09985-9f19-4285-9949-36ff66d1511b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:48.680774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09985-9f19-4285-9949-36ff66d1511b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:48.680774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09985-9f19-4285-9949-36ff66d1511b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:48.682196 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 24/47] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:48.687595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11230e2-5a95-4585-ba3e-2afb880b8b20 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:48.688000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11230e2-5a95-4585-ba3e-2afb880b8b20 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:48.688122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11230e2-5a95-4585-ba3e-2afb880b8b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:48.705978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b11230e2-5a95-4585-ba3e-2afb880b8b20 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:48.707185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b11230e2-5a95-4585-ba3e-2afb880b8b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:48.776030 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:48.800195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d09985-9f19-4285-9949-36ff66d1511b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:48.904747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d09985-9f19-4285-9949-36ff66d1511b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:48.939445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:48.940268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:48.940550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:48.940824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:48.952704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:37:48.959701 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:37:48.960890 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 25/49] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:37:48.966761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11230e2-5a95-4585-ba3e-2afb880b8b20 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:49.064858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11230e2-5a95-4585-ba3e-2afb880b8b20 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:49.098769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7cdf-c95f-4883-b2aa-4fc26d544078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:49.099436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7cdf-c95f-4883-b2aa-4fc26d544078 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.099713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7cdf-c95f-4883-b2aa-4fc26d544078 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.099987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7cdf-c95f-4883-b2aa-4fc26d544078 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.100734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da7cdf-c95f-4883-b2aa-4fc26d544078 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:49.101052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da7cdf-c95f-4883-b2aa-4fc26d544078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:49.102442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da7cdf-c95f-4883-b2aa-4fc26d544078 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:49.110519 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 25/50] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:49.116103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:49.214351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c156d6e-dd59-4dc6-b404-af46b991a668 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:49.225353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dd968-06bc-4910-a46b-1d6610c702f5 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.225625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dd968-06bc-4910-a46b-1d6610c702f5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.225912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dd968-06bc-4910-a46b-1d6610c702f5 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.227294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 26/51] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:37:49.232307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2494a-90bf-42f1-a71b-56e48de6cb91 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.232675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2494a-90bf-42f1-a71b-56e48de6cb91 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.232957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2494a-90bf-42f1-a71b-56e48de6cb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.247977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:49.248926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.249242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.249521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] PATH_INFO: `/v3/users/81850984797948c9a3a57c5bfc417a12` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.249811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-56b2494a-90bf-42f1-a71b-56e48de6cb91 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:49.250735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] RBAC: Authorizing `identity:get_user(user_id=81850984797948c9a3a57c5bfc417a12)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:49.251000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-56b2494a-90bf-42f1-a71b-56e48de6cb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:49.252226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:49.254057 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 26/52] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:37:49 2022] GET /identity/v3/users/81850984797948c9a3a57c5bfc417a12 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:49.259546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:49.317876 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 27/53] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:49.341858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2494a-90bf-42f1-a71b-56e48de6cb91 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:49.355792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001983a-2488-4065-b5bc-c5fd02fc24e8 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:49.387533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:49.388343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.388631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.388910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.390204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:49.391679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:49.393357 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 27/54] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:37:49.399196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:49.437797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2494a-90bf-42f1-a71b-56e48de6cb91 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:49.472253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:49.472992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.473310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.473586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.474804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:49.476293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:49.478004 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 28/55] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:37:49.483502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:49.498147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561367d4-0509-4940-b750-47026fbfe321 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:49.530219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501513b4-33b9-4266-b1a5-296ac89626f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:49.530887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501513b4-33b9-4266-b1a5-296ac89626f3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.531174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501513b4-33b9-4266-b1a5-296ac89626f3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.531446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501513b4-33b9-4266-b1a5-296ac89626f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.532275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501513b4-33b9-4266-b1a5-296ac89626f3 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.domain.id=default, user.id=81850984797948c9a3a57c5bfc417a12) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:49.532586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501513b4-33b9-4266-b1a5-296ac89626f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:49.534079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501513b4-33b9-4266-b1a5-296ac89626f3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:49.540023 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 28/56] 10.222.0.30 () {56 vars in 1322 bytes} [Sat Apr 9 20:37:49 2022] GET /identity/v3/role_assignments?user.id=81850984797948c9a3a57c5bfc417a12&scope.domain.id=default&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:37:49.581185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2949-9ebc-472c-9054-41f9dd180b25 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:49.620423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901f93-336c-4066-b40f-4ea188c4e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:49.621139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901f93-336c-4066-b40f-4ea188c4e6da None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:49.621429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901f93-336c-4066-b40f-4ea188c4e6da None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:49.621700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901f93-336c-4066-b40f-4ea188c4e6da None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:49.622453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8901f93-336c-4066-b40f-4ea188c4e6da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:49.624025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8901f93-336c-4066-b40f-4ea188c4e6da None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:49.652283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 29/57] 10.222.0.30 () {60 vars in 1140 bytes} [Sat Apr 9 20:37:49 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:37:52.006665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb5dbd-1732-457a-ab7c-bd51f3aabd14 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:52.007505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb5dbd-1732-457a-ab7c-bd51f3aabd14 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:52.007505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb5dbd-1732-457a-ab7c-bd51f3aabd14 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:52.009813 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 29/58] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:52.017665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d243c-73c2-47f0-9095-292ae1689087 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:52.018090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d243c-73c2-47f0-9095-292ae1689087 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:52.018300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d243c-73c2-47f0-9095-292ae1689087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:52.046198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-216d243c-73c2-47f0-9095-292ae1689087 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:52.047766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-216d243c-73c2-47f0-9095-292ae1689087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:52.128201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:52.154091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb5dbd-1732-457a-ab7c-bd51f3aabd14 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:52.274222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb5dbd-1732-457a-ab7c-bd51f3aabd14 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:52.312136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8bf5-3a34-4a6b-9c02-12ebe2b2e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:52.312936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8bf5-3a34-4a6b-9c02-12ebe2b2e107 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:52.313257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8bf5-3a34-4a6b-9c02-12ebe2b2e107 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:52.313536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8bf5-3a34-4a6b-9c02-12ebe2b2e107 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:52.314800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b8bf5-3a34-4a6b-9c02-12ebe2b2e107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:52.316292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b8bf5-3a34-4a6b-9c02-12ebe2b2e107 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:52.317952 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 30/60] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:52.326146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d243c-73c2-47f0-9095-292ae1689087 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:52.439080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d243c-73c2-47f0-9095-292ae1689087 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:52.485245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9d3dd-0a47-476c-bf38-6c56163a5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:52.485920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9d3dd-0a47-476c-bf38-6c56163a5fc8 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:52.486206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9d3dd-0a47-476c-bf38-6c56163a5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:52.486479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9d3dd-0a47-476c-bf38-6c56163a5fc8 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:52.487184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9d3dd-0a47-476c-bf38-6c56163a5fc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:52.488662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9d3dd-0a47-476c-bf38-6c56163a5fc8 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:52.514703 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 31/61] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:37:52 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:37:56.069426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c98db-5fcb-429b-a938-ef378acd96c2 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.069974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c98db-5fcb-429b-a938-ef378acd96c2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.069974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c98db-5fcb-429b-a938-ef378acd96c2 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.071347 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 31/62] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:56.076688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b57b-5da3-41b7-aec9-5ab66ad3de33 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.077105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b57b-5da3-41b7-aec9-5ab66ad3de33 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.077269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b57b-5da3-41b7-aec9-5ab66ad3de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.086886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92186ea-fc65-4a1c-8b32-363d87af4495 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.087194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92186ea-fc65-4a1c-8b32-363d87af4495 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.087461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92186ea-fc65-4a1c-8b32-363d87af4495 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.089226 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 32/63] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:37:56.095237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa8dcc-f0e6-46b8-b9eb-a5335bd04061 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.095528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa8dcc-f0e6-46b8-b9eb-a5335bd04061 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.095794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa8dcc-f0e6-46b8-b9eb-a5335bd04061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.099930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-be57b57b-5da3-41b7-aec9-5ab66ad3de33 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:56.101168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-be57b57b-5da3-41b7-aec9-5ab66ad3de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:56.113596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8eaa8dcc-f0e6-46b8-b9eb-a5335bd04061 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:56.114828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8eaa8dcc-f0e6-46b8-b9eb-a5335bd04061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:56.182317 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 33/64] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:37:56.206840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa8dcc-f0e6-46b8-b9eb-a5335bd04061 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.213759 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 32/65] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:56.238269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b57b-5da3-41b7-aec9-5ab66ad3de33 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.333753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b57b-5da3-41b7-aec9-5ab66ad3de33 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.371160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd666f-cabe-4838-8384-1015f1a2e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.372010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd666f-cabe-4838-8384-1015f1a2e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.372290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd666f-cabe-4838-8384-1015f1a2e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.373011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd666f-cabe-4838-8384-1015f1a2e3f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.379385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa8dcc-f0e6-46b8-b9eb-a5335bd04061 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.387475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd666f-cabe-4838-8384-1015f1a2e3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:37:56.396934 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c4bd666f-cabe-4838-8384-1015f1a2e3f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:37:56.398602 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 33/66] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:37:56.404620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4b60-6689-4e11-b164-3e22a240d03a None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.406069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4b60-6689-4e11-b164-3e22a240d03a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.406359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4b60-6689-4e11-b164-3e22a240d03a None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.407997 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 34/67] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:56.408614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df4b60-6689-4e11-b164-3e22a240d03a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.433565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874f0af-5832-4e93-baad-de303f8b6fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.434723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f0af-5832-4e93-baad-de303f8b6fc1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.435231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f0af-5832-4e93-baad-de303f8b6fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.435693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f0af-5832-4e93-baad-de303f8b6fc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.446800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874f0af-5832-4e93-baad-de303f8b6fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:37:56.454190 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-1874f0af-5832-4e93-baad-de303f8b6fc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:37:56.455717 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 34/68] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:37:56.457132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b8a3f-ec62-4417-acfd-f42cf462bcd3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.457632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b8a3f-ec62-4417-acfd-f42cf462bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.458093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b8a3f-ec62-4417-acfd-f42cf462bcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.476836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-776b8a3f-ec62-4417-acfd-f42cf462bcd3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:56.478364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-776b8a3f-ec62-4417-acfd-f42cf462bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:56.534975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df4b60-6689-4e11-b164-3e22a240d03a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.543276 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 35/69] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:56.544316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b8a3f-ec62-4417-acfd-f42cf462bcd3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.578254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012242-5870-464a-8a6e-e07504ad7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.578942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012242-5870-464a-8a6e-e07504ad7827 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.579223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012242-5870-464a-8a6e-e07504ad7827 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.579496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012242-5870-464a-8a6e-e07504ad7827 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.580251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012242-5870-464a-8a6e-e07504ad7827 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:56.580556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012242-5870-464a-8a6e-e07504ad7827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:56.581986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012242-5870-464a-8a6e-e07504ad7827 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:56.591051 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 35/70] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:56.592176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284e5f9-b051-4c87-b8fa-0ee47e4a42c3 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.592462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284e5f9-b051-4c87-b8fa-0ee47e4a42c3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.593076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284e5f9-b051-4c87-b8fa-0ee47e4a42c3 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.597191 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 36/71] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:56.597974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284e5f9-b051-4c87-b8fa-0ee47e4a42c3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.647684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b8a3f-ec62-4417-acfd-f42cf462bcd3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.679508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.680183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.680465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.680739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.681541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] RBAC: Adding query filter params (name=member) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:56.681846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:56.683256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:56.691504 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 36/72] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:56.692315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.704141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284e5f9-b051-4c87-b8fa-0ee47e4a42c3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.738154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30e74-1c67-4bbd-9378-a3262bcbc1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.738965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30e74-1c67-4bbd-9378-a3262bcbc1d6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.739247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30e74-1c67-4bbd-9378-a3262bcbc1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.739522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30e74-1c67-4bbd-9378-a3262bcbc1d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.751063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde30e74-1c67-4bbd-9378-a3262bcbc1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:37:56.758144 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-cde30e74-1c67-4bbd-9378-a3262bcbc1d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:37:56.759584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 37/73] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:37:56.760592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99571746-149d-4d89-90b3-d5b206b9dec8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.760875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99571746-149d-4d89-90b3-d5b206b9dec8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.761137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99571746-149d-4d89-90b3-d5b206b9dec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.777457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-99571746-149d-4d89-90b3-d5b206b9dec8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:56.778652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-99571746-149d-4d89-90b3-d5b206b9dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:56.795611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1904-451e-41a4-a574-d17638c5c452 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.826791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.827704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.827976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.828242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] PATH_INFO: `/v3/users/81850984797948c9a3a57c5bfc417a12` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.829490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] RBAC: Authorizing `identity:get_user(user_id=81850984797948c9a3a57c5bfc417a12)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:56.831002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:56.832835 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 37/74] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/users/81850984797948c9a3a57c5bfc417a12 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:56.833509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.846576 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 38/75] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:56.847901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a147ad-064b-4e31-8784-211af3583dbe None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.848260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a147ad-064b-4e31-8784-211af3583dbe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.848601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a147ad-064b-4e31-8784-211af3583dbe None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.850135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 39/76] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:37:56.850641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a147ad-064b-4e31-8784-211af3583dbe None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.929850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe9035-822e-47ee-847a-e726cf8a9eaa None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.949403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a147ad-064b-4e31-8784-211af3583dbe None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:56.961152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.962040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.962324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.962597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.975742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:56.977358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:56.979070 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 38/77] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:56.979855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:56.984630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460c7f-8e12-4c66-b053-6fc05ce2b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:56.985342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460c7f-8e12-4c66-b053-6fc05ce2b72d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.985623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460c7f-8e12-4c66-b053-6fc05ce2b72d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.985895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460c7f-8e12-4c66-b053-6fc05ce2b72d None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:56.986644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460c7f-8e12-4c66-b053-6fc05ce2b72d None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:56.986949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460c7f-8e12-4c66-b053-6fc05ce2b72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:56.988345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460c7f-8e12-4c66-b053-6fc05ce2b72d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:56.997105 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 40/78] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:56.998312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67d810-eeef-4a34-8d66-842179022292 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:56.998601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67d810-eeef-4a34-8d66-842179022292 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:56.998876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67d810-eeef-4a34-8d66-842179022292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.016066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5e67d810-eeef-4a34-8d66-842179022292 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:37:57.017317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e67d810-eeef-4a34-8d66-842179022292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:37:57.074511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaba26-0633-4aa4-9cfb-f8739bbf310a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.083972 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 41/79] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:37:57.085508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67d810-eeef-4a34-8d66-842179022292 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.108669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.109309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.109571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.109843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.172021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.173551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.181545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67d810-eeef-4a34-8d66-842179022292 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.214494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.215316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.215597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.215895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.226191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:37:57.233487 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:37:57.239388 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 42/80] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:37:57.239388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.265879 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 39/81] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:37:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:37:57.266923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.328993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6834b-5957-4029-a4df-8e8cfa005bd9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.359718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4e6e7-b83a-414b-9235-adcf655d636e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.361231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.361902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.362180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.362454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.391660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.392534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.392800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.393099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.394321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.395796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.397528 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 40/82] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:57.398269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.427819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.429336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.490765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aef06e-7e7a-4b24-9987-45f3cc06e42a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.519165 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 43/83] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:37:57.519745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.527253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.528067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.528340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.528600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.530011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.531493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.533154 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 41/84] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:57.533993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.612533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aae5c-9d3e-4e5c-be24-4b559df0ad5c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.627168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8038b7-b8e9-4484-8a71-91b22fda2e16 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.645725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.646393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.646671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.646941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.647678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:57.647981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.649401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.657425 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 44/85] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:57.658180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.660393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.661288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.661569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.662022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.663030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.664482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.666330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 42/86] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:57.666954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.754212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33b2a-8ede-4a42-8947-3da3a2361637 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.770321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d282b-ade2-40eb-b4bf-da9318dfb2cc None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.785644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.786299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.786580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.786857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.802730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.803635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.803913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.804211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.805437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.806923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.808682 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 43/87] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:57.809515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.850081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.851558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.904379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ffe7-3d49-426b-9a88-a044c0fe8a92 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:57.937617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:57.938297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:57.938584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:57.938862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:57.939574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:57.941072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:57.949894 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 45/88] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:37:57.950807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:57.970678 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 44/89] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:37:57 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:37:57.971477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:58.050716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c77a8-031d-46b1-978a-7e62e4a31cf7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:58.074848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02f282-8e15-4d5b-9c97-414a15400a17 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:58.086027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fd66-f598-4200-8534-028db0366642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:58.087509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fd66-f598-4200-8534-028db0366642 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:58.087960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fd66-f598-4200-8534-028db0366642 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:58.088370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fd66-f598-4200-8534-028db0366642 None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:58.089956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580fd66-f598-4200-8534-028db0366642 None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:58.091679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580fd66-f598-4200-8534-028db0366642 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:58.093935 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 46/90] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:58.094946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fd66-f598-4200-8534-028db0366642 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:58.111594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:58.112279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:58.112559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:58.112831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:58.113712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=81850984797948c9a3a57c5bfc417a12) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:58.114026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:58.115510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:58.121674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 45/91] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:37:57 2022] GET /identity/v3/role_assignments?user.id=81850984797948c9a3a57c5bfc417a12&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:58.122710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:58.230150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fd66-f598-4200-8534-028db0366642 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:58.259317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766155-e055-4aa2-9f46-40dd11dccad2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:58.276627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:58.277630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:58.277920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:58.278203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:58.279299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=13936368421d4c5888578cca49557609) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:58.279613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:58.281516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:58.293356 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 47/92] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:37:58 2022] GET /identity/v3/role_assignments?user.id=13936368421d4c5888578cca49557609&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:58.294558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:58.298754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:58.299663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:58.299943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:58.300218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] PATH_INFO: `/v3/projects/fe0d8c2fd835403380016ceff0b75cde` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:58.301550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] RBAC: Authorizing `identity:get_project(project_id=fe0d8c2fd835403380016ceff0b75cde)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:58.303102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:58.305212 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 46/93] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:37:58 2022] GET /identity/v3/projects/fe0d8c2fd835403380016ceff0b75cde => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:58.311838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:58.428644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061a0ca-c5d1-473b-97ca-6b344c621796 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:58.458255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c9501-2bc3-4053-849f-a5bc3f292229 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:58.470093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:58.470766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:58.471047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:58.471318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:58.499808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:58.500675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:58.500957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:58.501264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:58.502572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=fe0d8c2fd835403380016ceff0b75cde, user.id=13936368421d4c5888578cca49557609) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:58.502888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:58.505109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:58.515987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 47/94] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:37:58 2022] GET /identity/v3/role_assignments?user.id=13936368421d4c5888578cca49557609&scope.project.id=fe0d8c2fd835403380016ceff0b75cde&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:37:58.581210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:58.582717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:58.706321 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 48/95] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:37:58.712032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:58.821239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9174-4956-4151-b3fa-b697ead7a358 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:58.860492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80efa5f-c2de-4055-b6c4-7e9938c7aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:58.861397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80efa5f-c2de-4055-b6c4-7e9938c7aa0f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:58.861676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80efa5f-c2de-4055-b6c4-7e9938c7aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:58.861949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80efa5f-c2de-4055-b6c4-7e9938c7aa0f None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:58.863209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80efa5f-c2de-4055-b6c4-7e9938c7aa0f None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:58.864751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80efa5f-c2de-4055-b6c4-7e9938c7aa0f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:58.866801 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 48/96] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:37:58 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:37:58.873560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:37:59.007275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb7c87-a7f0-44bb-a007-8a484407fc4e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:37:59.052967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d12975-d8d1-406d-97ee-c2235db1673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:37:59.054099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d12975-d8d1-406d-97ee-c2235db1673f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:37:59.054657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d12975-d8d1-406d-97ee-c2235db1673f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:37:59.055116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d12975-d8d1-406d-97ee-c2235db1673f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:37:59.056238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d12975-d8d1-406d-97ee-c2235db1673f None admin] RBAC: Adding query filter params (role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=13936368421d4c5888578cca49557609) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:37:59.056824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d12975-d8d1-406d-97ee-c2235db1673f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:37:59.058558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d12975-d8d1-406d-97ee-c2235db1673f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:37:59.071887 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 49/97] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:37:58 2022] GET /identity/v3/role_assignments?user.id=13936368421d4c5888578cca49557609&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=1b9f4acaec9249c88996af437afcb462 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:01.340575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186eb46-e1d4-4c21-a2c3-8c048c890477 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:01.341214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186eb46-e1d4-4c21-a2c3-8c048c890477 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:01.341214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186eb46-e1d4-4c21-a2c3-8c048c890477 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:01.343096 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 49/98] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:01.348657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec488e0-34af-4952-acb5-553b6c6ceb33 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:01.349539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec488e0-34af-4952-acb5-553b6c6ceb33 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:01.350031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec488e0-34af-4952-acb5-553b6c6ceb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:01.376108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ec488e0-34af-4952-acb5-553b6c6ceb33 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:01.377705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ec488e0-34af-4952-acb5-553b6c6ceb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:01.469027 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 50/99] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:01.501906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92021622-bca2-4971-80a3-8cb1e78d694e None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:01.502597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92021622-bca2-4971-80a3-8cb1e78d694e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:01.503074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92021622-bca2-4971-80a3-8cb1e78d694e None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:01.504646 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 50/100] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:01.506841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec488e0-34af-4952-acb5-553b6c6ceb33 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:01.510064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98542-e085-4061-9b68-8fc5ea51ed6e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:01.510593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98542-e085-4061-9b68-8fc5ea51ed6e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:01.511069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98542-e085-4061-9b68-8fc5ea51ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:01.539376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-70e98542-e085-4061-9b68-8fc5ea51ed6e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:01.540944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-70e98542-e085-4061-9b68-8fc5ea51ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:01.605762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec488e0-34af-4952-acb5-553b6c6ceb33 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:01.607662 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 51/101] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:01.632226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98542-e085-4061-9b68-8fc5ea51ed6e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:01.671089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:01.671940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:01.672220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:01.672493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:01.705997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:01.713216 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:01.714492 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 51/102] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:01.724510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:01.747861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98542-e085-4061-9b68-8fc5ea51ed6e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:01.788524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:01.790194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:01.790719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:01.791215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:01.803772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:01.812090 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:01.813979 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 52/103] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:01.820901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:01.933128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faec81-f227-4e4a-a372-68737c31e460 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:01.959237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b420-4220-46a1-a5d0-712b4381a1e9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:01.970364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:01.971837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:01.972345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:01.972826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:01.973826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:01.974334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:01.975941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:01.985203 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 53/104] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:01.991528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.048399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d52c1e-c233-47c1-8d54-1381b0a1c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.049644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52c1e-c233-47c1-8d54-1381b0a1c969 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.049931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52c1e-c233-47c1-8d54-1381b0a1c969 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.050237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52c1e-c233-47c1-8d54-1381b0a1c969 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.051002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d52c1e-c233-47c1-8d54-1381b0a1c969 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:02.051308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d52c1e-c233-47c1-8d54-1381b0a1c969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.053119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d52c1e-c233-47c1-8d54-1381b0a1c969 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.072067 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 52/105] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:02.073526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf683d-d5f5-4ff7-98ea-5a987dbb0e78 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.073877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf683d-d5f5-4ff7-98ea-5a987dbb0e78 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.074218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf683d-d5f5-4ff7-98ea-5a987dbb0e78 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.075709 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 53/106] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:02.078935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf683d-d5f5-4ff7-98ea-5a987dbb0e78 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.110154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3403423-745e-4fc4-a74f-85a63d3caeae None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.152861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16719be-cc2a-4b43-98c1-ead17c40ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.154925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16719be-cc2a-4b43-98c1-ead17c40ffcc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.155403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16719be-cc2a-4b43-98c1-ead17c40ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.156040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16719be-cc2a-4b43-98c1-ead17c40ffcc None admin] PATH_INFO: `/v3/users/81850984797948c9a3a57c5bfc417a12` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.157944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16719be-cc2a-4b43-98c1-ead17c40ffcc None admin] RBAC: Authorizing `identity:get_user(user_id=81850984797948c9a3a57c5bfc417a12)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.160458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16719be-cc2a-4b43-98c1-ead17c40ffcc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.162600 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 54/107] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:01 2022] GET /identity/v3/users/81850984797948c9a3a57c5bfc417a12 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:02.164476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f620dce-86ef-4566-a60f-8d2d72d3926b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.170805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f620dce-86ef-4566-a60f-8d2d72d3926b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.170805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f620dce-86ef-4566-a60f-8d2d72d3926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.198208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6f620dce-86ef-4566-a60f-8d2d72d3926b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:02.199741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6f620dce-86ef-4566-a60f-8d2d72d3926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:02.220813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf683d-d5f5-4ff7-98ea-5a987dbb0e78 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.263031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.264852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.265478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.266021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.267992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.270442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.272833 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 54/108] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:02 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:02.273944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.274624 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 55/109] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:02.276029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7130-3350-4571-a24c-5f533071ebaf None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.276385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7130-3350-4571-a24c-5f533071ebaf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.276738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7130-3350-4571-a24c-5f533071ebaf None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.278120 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 56/110] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:02.279398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7130-3350-4571-a24c-5f533071ebaf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.384322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7130-3350-4571-a24c-5f533071ebaf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.394415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0caa15-66e6-4dab-8b94-e8020e207fb7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.416840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9fe98-6995-440b-8aef-3765047b85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.417772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9fe98-6995-440b-8aef-3765047b85f1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.418052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9fe98-6995-440b-8aef-3765047b85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.418338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9fe98-6995-440b-8aef-3765047b85f1 None admin] PATH_INFO: `/v3/projects/fe0d8c2fd835403380016ceff0b75cde` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.419645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9fe98-6995-440b-8aef-3765047b85f1 None admin] RBAC: Authorizing `identity:get_project(project_id=fe0d8c2fd835403380016ceff0b75cde)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.421178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9fe98-6995-440b-8aef-3765047b85f1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.427693 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 57/111] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:02 2022] GET /identity/v3/projects/fe0d8c2fd835403380016ceff0b75cde => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:02.427693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0c42-8b8c-4d0d-a1d5-2204ae4fab06 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.427693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0c42-8b8c-4d0d-a1d5-2204ae4fab06 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.427693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0c42-8b8c-4d0d-a1d5-2204ae4fab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.437482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.437482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.437482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.437482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.438699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.440156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.441898 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 55/112] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:02 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:02.446667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.449645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ffdc0c42-8b8c-4d0d-a1d5-2204ae4fab06 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:02.449645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ffdc0c42-8b8c-4d0d-a1d5-2204ae4fab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:02.514236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 58/113] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:02.515837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae1be-1612-4b95-ae55-b781778e0582 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.516122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae1be-1612-4b95-ae55-b781778e0582 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.516392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae1be-1612-4b95-ae55-b781778e0582 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.517883 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 59/114] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:02.518380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fae1be-1612-4b95-ae55-b781778e0582 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.546454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e841f9-af17-4b61-8b2a-512111ff6ad8 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.578528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.579418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.579705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.579979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.590150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:02.597535 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:02.598902 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 56/115] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:02.600664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.615981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fae1be-1612-4b95-ae55-b781778e0582 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.649345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049b25-9838-4735-b488-40fb51df4829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.650471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049b25-9838-4735-b488-40fb51df4829 None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.650787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049b25-9838-4735-b488-40fb51df4829 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.651101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049b25-9838-4735-b488-40fb51df4829 None admin] PATH_INFO: `/v3/projects/fe0d8c2fd835403380016ceff0b75cde/users/13936368421d4c5888578cca49557609/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.653277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049b25-9838-4735-b488-40fb51df4829 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe0d8c2fd835403380016ceff0b75cde, user_id=13936368421d4c5888578cca49557609, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.654899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049b25-9838-4735-b488-40fb51df4829 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.666872 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 60/116] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:02 2022] PUT /identity/v3/projects/fe0d8c2fd835403380016ceff0b75cde/users/13936368421d4c5888578cca49557609/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:02.668410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abd989-fcf0-4c7d-a8df-d15a7c880299 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.668695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abd989-fcf0-4c7d-a8df-d15a7c880299 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.669000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abd989-fcf0-4c7d-a8df-d15a7c880299 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.670297 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 61/117] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:02.671377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90fb45-c965-4207-9d3f-84b9c1c2744a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.671657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90fb45-c965-4207-9d3f-84b9c1c2744a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.671914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90fb45-c965-4207-9d3f-84b9c1c2744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.695522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4d90fb45-c965-4207-9d3f-84b9c1c2744a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:02.696777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d90fb45-c965-4207-9d3f-84b9c1c2744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:02.702193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276274a-2822-4df0-b7da-53bbf0c48018 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.738078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.738995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.739294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.740105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/81850984797948c9a3a57c5bfc417a12/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.742649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f73da65445eb4c8f8b1dcaa70f191797, user_id=81850984797948c9a3a57c5bfc417a12, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.744835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.764366 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 57/118] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:02 2022] PUT /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/81850984797948c9a3a57c5bfc417a12/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:02.773292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.776720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 62/119] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:02.777731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90fb45-c965-4207-9d3f-84b9c1c2744a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.909547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4a02-3665-49c6-82b8-4d7075317cd7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.912601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90fb45-c965-4207-9d3f-84b9c1c2744a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:02.945802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67989287-509a-4b03-9acd-dcfced66c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.947173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67989287-509a-4b03-9acd-dcfced66c5ef None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.947729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67989287-509a-4b03-9acd-dcfced66c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.948011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67989287-509a-4b03-9acd-dcfced66c5ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.949397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67989287-509a-4b03-9acd-dcfced66c5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.951122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67989287-509a-4b03-9acd-dcfced66c5ef None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.951493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:02.952192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.952530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.952747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.953253 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 58/120] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:02.953542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:02.953850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:02.954535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e8e6-9aee-4f2a-a3fe-afa447e6dc89 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:02.954820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e8e6-9aee-4f2a-a3fe-afa447e6dc89 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:02.955151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e8e6-9aee-4f2a-a3fe-afa447e6dc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:02.955270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:02.969382 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 63/121] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:02.970288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:02.980209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4c28e8e6-9aee-4f2a-a3fe-afa447e6dc89 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:02.981783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4c28e8e6-9aee-4f2a-a3fe-afa447e6dc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:03.050544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 59/122] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:03.051631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28e8e6-9aee-4f2a-a3fe-afa447e6dc89 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.094828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e73915-7c33-49ba-9495-951ce2c5ec79 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.128031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.129144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.129576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.129986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.140361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:03.147518 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:03.148919 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 64/123] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:03.149839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.187627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28e8e6-9aee-4f2a-a3fe-afa447e6dc89 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.233704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.234303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.234608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.235012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.236088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:03.237869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:03.253859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e909-a458-4486-a450-e1d3587b568a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.270526 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 60/124] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:38:03 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:03.271602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.297927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.299071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.299491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.299833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] PATH_INFO: `/v3/users/1e8f26553aa34e30987dc0743c183d73` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.319618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] RBAC: Authorizing `identity:get_user(user_id=1e8f26553aa34e30987dc0743c183d73)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:03.321792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:03.323575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 65/125] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/users/1e8f26553aa34e30987dc0743c183d73 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:03.324893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.380678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a6ca1-856b-44dd-95f8-18a3cd285a63 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.416507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.418033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.418451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.418930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.430527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:03.432484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b097-7067-4a88-9a6b-08f30fa2068c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.439646 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:03.441158 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 61/126] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:03.442069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.475107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.475751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.476032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.476359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.477143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] RBAC: Adding query filter params (name=member) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:03.477551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:03.479028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:03.488208 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 66/127] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:03.493632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.551855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50d59-e123-4947-a009-fa53982e5883 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.605584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707fb16-06d7-4bbc-9ef9-0c71f4c14514 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.618935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.619961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.620242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.620773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.648967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.650033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.650319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.650725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.651362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:03.651671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:03.654137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:03.665945 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 67/128] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:03.667869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.720443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:03.722661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:03.788209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225110c5-074c-43b6-b23f-7e566a3f8ab3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.833779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.834534 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 62/129] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:03.835455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.835552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.835948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.836444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.840166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:03.842826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:03.845053 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 68/130] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:03.845895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:03.950739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba05d0-1800-4bdf-9811-548206226307 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:03.986445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:03.987626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:03.987910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:03.988182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:03.989420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:03.991380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:03.993122 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 69/131] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:03.994383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:04.076000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21c612-7439-40d0-86e9-a1efbe53cc75 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:04.125591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b96bf1-f72a-42d0-952a-6a3a98aa36e6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:04.146454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:04.147848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:04.148688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:04.149260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:04.150675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:04.152446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:04.155057 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 63/132] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:04.156092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:04.193765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:04.194710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:04.195046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:04.195324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:04.199493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:04.201070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:04.202936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 70/133] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:03 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:04.203758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:04.276926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75c51-ba75-4780-9ef6-e353c17e36c4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:04.312309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:04.313457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:04.313954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:04.314412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:04.315431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] RBAC: Adding query filter params (role.id=40a27bb8ebd549c497447b0e5806b7a2, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=1e8f26553aa34e30987dc0743c183d73) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:04.315945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:04.317628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:04.323851 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 64/134] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:04 2022] GET /identity/v3/role_assignments?user.id=1e8f26553aa34e30987dc0743c183d73&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=40a27bb8ebd549c497447b0e5806b7a2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:04.324826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:04.431306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0896fc-fd30-4414-8e1f-4d94a4a7a063 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:04.464121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cd7a-4d39-45e8-911b-db16c7103c9b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:04.515649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:04.516532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:04.516808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:04.517139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:04.518503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:04.520135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:04.522261 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 71/135] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:04 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:04.530127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:04.532519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f56ce4-486c-475a-8355-0aeb8c82b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:04.533471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f56ce4-486c-475a-8355-0aeb8c82b6ea None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:04.533747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f56ce4-486c-475a-8355-0aeb8c82b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:04.534017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f56ce4-486c-475a-8355-0aeb8c82b6ea None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/13936368421d4c5888578cca49557609/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:04.550110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f56ce4-486c-475a-8355-0aeb8c82b6ea None admin] RBAC: Authorizing `identity:create_grant(project_id=f73da65445eb4c8f8b1dcaa70f191797, user_id=13936368421d4c5888578cca49557609, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:04.551618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f56ce4-486c-475a-8355-0aeb8c82b6ea None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:04.579468 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 65/136] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:04 2022] PUT /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/13936368421d4c5888578cca49557609/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:04.692793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbedf-e83b-42e2-8629-928cee022b8f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:04.732889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58546607-73fa-43db-873b-0886fad5413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:04.733861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546607-73fa-43db-873b-0886fad5413e None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:04.734144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546607-73fa-43db-873b-0886fad5413e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:04.734423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546607-73fa-43db-873b-0886fad5413e None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/13936368421d4c5888578cca49557609/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:04.741535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58546607-73fa-43db-873b-0886fad5413e None admin] RBAC: Authorizing `identity:create_grant(project_id=f73da65445eb4c8f8b1dcaa70f191797, user_id=13936368421d4c5888578cca49557609, role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:04.743039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58546607-73fa-43db-873b-0886fad5413e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:04.766274 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 72/137] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:04 2022] PUT /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/13936368421d4c5888578cca49557609/roles/1b9f4acaec9249c88996af437afcb462 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:05.606545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478d04-fb45-4e03-a498-27151a40dcf0 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:05.607046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478d04-fb45-4e03-a498-27151a40dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:05.607144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478d04-fb45-4e03-a498-27151a40dcf0 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:05.608660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 66/138] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:05.613621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9d247-ce81-48e7-b264-5417e3476505 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:05.613995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9d247-ce81-48e7-b264-5417e3476505 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:05.614184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9d247-ce81-48e7-b264-5417e3476505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:05.630966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-81c9d247-ce81-48e7-b264-5417e3476505 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:05.632168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-81c9d247-ce81-48e7-b264-5417e3476505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:05.697211 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 73/139] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:05.721478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7478d04-fb45-4e03-a498-27151a40dcf0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:05.820744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7478d04-fb45-4e03-a498-27151a40dcf0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:05.834074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e494e-75d6-43e8-b2fe-c58cc0d953c1 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:05.834368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e494e-75d6-43e8-b2fe-c58cc0d953c1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:05.834642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e494e-75d6-43e8-b2fe-c58cc0d953c1 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:05.836020 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 74/140] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:05.850052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013908-6b4e-47ab-97bc-e2afbd6800be None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:05.850413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013908-6b4e-47ab-97bc-e2afbd6800be None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:05.850617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013908-6b4e-47ab-97bc-e2afbd6800be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:05.865717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:05.866532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:05.866807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:05.867072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:05.869314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ec013908-6b4e-47ab-97bc-e2afbd6800be None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:05.870497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec013908-6b4e-47ab-97bc-e2afbd6800be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:05.893935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:05.900841 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:05.902321 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 67/141] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:05.910475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:05.957901 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 75/142] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:05.984547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013908-6b4e-47ab-97bc-e2afbd6800be None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:06.094367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013908-6b4e-47ab-97bc-e2afbd6800be None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.124619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f8954-eb31-4fe7-9974-270c384cbe3e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.141931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:06.142766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:06.143047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:06.143319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:06.164460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:06.165227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:06.165563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:06.165842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:06.166602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:06.166909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:06.168472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:06.172174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:06.177959 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 68/143] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:06.179257 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:06.183511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:06.185745 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 76/144] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:06.202054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:06.294759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2fcf-3f29-4e34-9769-ef8464d7828e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.330513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:06.331504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:06.331785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:06.332061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] PATH_INFO: `/v3/users/81850984797948c9a3a57c5bfc417a12` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:06.333337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] RBAC: Authorizing `identity:get_user(user_id=81850984797948c9a3a57c5bfc417a12)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:06.335106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:06.337300 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 69/145] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:06 2022] GET /identity/v3/users/81850984797948c9a3a57c5bfc417a12 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:06.343320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:06.452008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7a425-df37-493f-8443-f9e932269978 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.458955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84b77b-f7ab-48e7-93d0-2945fce8b29c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.485933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:06.486729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:06.487059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:06.487341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:06.549851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:06.550467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:06.550750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:06.551027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:06.551848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] RBAC: Adding query filter params (name=member) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:06.552158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:06.553609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:06.559468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:06.560970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:06.568426 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 77/146] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:06.575446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:06.745060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466796f-68c8-4787-9f52-0bb362ebdb3a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.794216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 70/147] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:06.800366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:06.804504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:06.805440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:06.805725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:06.806013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:06.809748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:06.813825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:06.813825 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 78/148] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:06 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:06.818636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:06.917127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448492-f597-4de5-8a1a-42ebac774798 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.962302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:06.962977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:06.963256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:06.963525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:06.964219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee90b80-cccf-4653-b90b-0f3447e2c3cf None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:06.999122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:07.000408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.000876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.001346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.002700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:07.004324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:07.007487 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 71/149] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:06 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:07.013493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:07.082999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:07.084762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:07.167580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c12fc-67ae-4110-ad30-8a83a23bf2c0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:07.205524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48ddff-fc30-49d9-91fd-0934b239ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:07.206562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48ddff-fc30-49d9-91fd-0934b239ff47 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.207109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48ddff-fc30-49d9-91fd-0934b239ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.207573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48ddff-fc30-49d9-91fd-0934b239ff47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.208623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48ddff-fc30-49d9-91fd-0934b239ff47 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=81850984797948c9a3a57c5bfc417a12) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:07.209151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48ddff-fc30-49d9-91fd-0934b239ff47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:07.211179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48ddff-fc30-49d9-91fd-0934b239ff47 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:07.218699 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 72/150] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:07 2022] GET /identity/v3/role_assignments?user.id=81850984797948c9a3a57c5bfc417a12&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:07.225065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998231b-da9f-4a8f-9cef-b685b303d0db None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.225923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998231b-da9f-4a8f-9cef-b685b303d0db None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.226844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998231b-da9f-4a8f-9cef-b685b303d0db None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.228491 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 73/151] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:07.241478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124292f0-266e-43a9-bdce-aa42077f55b7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.242091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124292f0-266e-43a9-bdce-aa42077f55b7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.242579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124292f0-266e-43a9-bdce-aa42077f55b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.267888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-124292f0-266e-43a9-bdce-aa42077f55b7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:07.269510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-124292f0-266e-43a9-bdce-aa42077f55b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:07.285097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 79/152] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:07.291642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:07.415248 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 74/153] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:07.473961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124292f0-266e-43a9-bdce-aa42077f55b7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:07.514183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4753f20-bb03-4ac9-9e84-e61dfad80d79 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:07.578491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:07.579383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.579660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.579931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] PATH_INFO: `/v3/projects/fe0d8c2fd835403380016ceff0b75cde` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.582530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] RBAC: Authorizing `identity:get_project(project_id=fe0d8c2fd835403380016ceff0b75cde)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:07.584222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:07.587971 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 80/154] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:07 2022] GET /identity/v3/projects/fe0d8c2fd835403380016ceff0b75cde => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:07.591550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:07.664631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124292f0-266e-43a9-bdce-aa42077f55b7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:07.737762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:07.738594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.738876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.739149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.740538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:07.742041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:07.743683 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 75/155] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:07.750154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:07.757576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077cbba-44c3-46b7-8a47-1a04b315386f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:07.798533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2b1da-0794-4505-ba99-61b8dcec2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:07.799215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b1da-0794-4505-ba99-61b8dcec2653 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.799499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b1da-0794-4505-ba99-61b8dcec2653 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.799777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b1da-0794-4505-ba99-61b8dcec2653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.800617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2b1da-0794-4505-ba99-61b8dcec2653 None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=fe0d8c2fd835403380016ceff0b75cde, user.id=13936368421d4c5888578cca49557609) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:07.800927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2b1da-0794-4505-ba99-61b8dcec2653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:07.802426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2b1da-0794-4505-ba99-61b8dcec2653 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:07.811227 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 81/156] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:07 2022] GET /identity/v3/role_assignments?user.id=13936368421d4c5888578cca49557609&scope.project.id=fe0d8c2fd835403380016ceff0b75cde&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:07.813202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750efa91-66ae-42d9-a93e-0d2c10ec5606 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.814020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750efa91-66ae-42d9-a93e-0d2c10ec5606 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.814450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750efa91-66ae-42d9-a93e-0d2c10ec5606 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.815935 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 82/157] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:07.822777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254afeb4-c653-4087-bd92-a0a88d8979e6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.823289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254afeb4-c653-4087-bd92-a0a88d8979e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.823903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254afeb4-c653-4087-bd92-a0a88d8979e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.846128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-254afeb4-c653-4087-bd92-a0a88d8979e6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:07.848514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-254afeb4-c653-4087-bd92-a0a88d8979e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:07.900257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030ae3-6070-455c-9d8e-2781ac86fe95 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:07.967639 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 83/158] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:07.969746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:07.970451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:07.970731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:07.971006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:07.971734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:07.973295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:08.003028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254afeb4-c653-4087-bd92-a0a88d8979e6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.004303 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 76/159] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:07 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:38:08.115169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254afeb4-c653-4087-bd92-a0a88d8979e6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.152894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813e6b9-d5f3-4b40-98af-32452fdc87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.154183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813e6b9-d5f3-4b40-98af-32452fdc87da None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.154650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813e6b9-d5f3-4b40-98af-32452fdc87da None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.155131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813e6b9-d5f3-4b40-98af-32452fdc87da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.167475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813e6b9-d5f3-4b40-98af-32452fdc87da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:08.175136 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a813e6b9-d5f3-4b40-98af-32452fdc87da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:08.177148 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 84/160] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:08.183297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.285863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb97ed-9995-4302-8ee9-cd61a37260b4 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.286155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb97ed-9995-4302-8ee9-cd61a37260b4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.286327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb97ed-9995-4302-8ee9-cd61a37260b4 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.287728 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 85/161] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:08.291040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccaf1-8497-4031-a846-40e6b46d6d93 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.292824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf6c5d-4d63-4a76-ab96-32d721279c7a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.295576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf6c5d-4d63-4a76-ab96-32d721279c7a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.295576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf6c5d-4d63-4a76-ab96-32d721279c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.315933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0edf6c5d-4d63-4a76-ab96-32d721279c7a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:08.317591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0edf6c5d-4d63-4a76-ab96-32d721279c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:08.339593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230c787-805b-46b6-a0ef-19fc071c5e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.340339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230c787-805b-46b6-a0ef-19fc071c5e81 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.340624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230c787-805b-46b6-a0ef-19fc071c5e81 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.340897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230c787-805b-46b6-a0ef-19fc071c5e81 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.342050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230c787-805b-46b6-a0ef-19fc071c5e81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:08.342352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230c787-805b-46b6-a0ef-19fc071c5e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:08.343749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230c787-805b-46b6-a0ef-19fc071c5e81 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:08.352222 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 77/162] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:08.353686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eef762-0711-409c-a16d-0ef25c36f8a4 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.353970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eef762-0711-409c-a16d-0ef25c36f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.354238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eef762-0711-409c-a16d-0ef25c36f8a4 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.355469 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 78/163] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:08.357765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eef762-0711-409c-a16d-0ef25c36f8a4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.400173 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 86/164] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:08.401892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba576-8930-4ceb-96c6-d095d2df7d88 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.402385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba576-8930-4ceb-96c6-d095d2df7d88 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.402694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba576-8930-4ceb-96c6-d095d2df7d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.435709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-09aba576-8930-4ceb-96c6-d095d2df7d88 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:08.436906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-09aba576-8930-4ceb-96c6-d095d2df7d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:08.483446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eef762-0711-409c-a16d-0ef25c36f8a4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.516900 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 87/165] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:08.518400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aba576-8930-4ceb-96c6-d095d2df7d88 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.530235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.531589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.532173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.533006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] PATH_INFO: `/v3/users/1e8f26553aa34e30987dc0743c183d73` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.534994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] RBAC: Authorizing `identity:get_user(user_id=1e8f26553aa34e30987dc0743c183d73)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:08.537026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:08.539906 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 79/166] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/users/1e8f26553aa34e30987dc0743c183d73 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:08.540952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.628905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aba576-8930-4ceb-96c6-d095d2df7d88 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.658779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28564-2faa-475a-b02a-85e495830455 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.662947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.663944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.664358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.664788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.675710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:08.683512 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:08.684976 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 88/167] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:08.690067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.692782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.693611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.693887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.694156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.705186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:08.712440 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:08.713884 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 80/168] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:08.714573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.787486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30c2a-8302-411a-b11a-893ec9bdf130 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.813957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002de5-61cf-4c51-96f4-34c1260dd661 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.819689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.820567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.820863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.821173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.822362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:08.823844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:08.826073 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 89/169] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:08.826842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.855496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.856620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.857193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.857720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.858705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:08.859198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:08.860821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:08.870381 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 81/170] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:08.871499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:08.923097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef8de-ea0e-4258-a44a-865eab8511da None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.965712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:08.967486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:08.968069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:08.968346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:08.969241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:08.969655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:08.971401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:08.973252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7879-46eb-4139-9972-8ced100e0bb2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:08.990978 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 90/171] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:08.995845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:09.009118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.010423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.010906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.011365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/1e8f26553aa34e30987dc0743c183d73/roles/40a27bb8ebd549c497447b0e5806b7a2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.013733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] RBAC: Authorizing `identity:create_grant(project_id=f73da65445eb4c8f8b1dcaa70f191797, user_id=1e8f26553aa34e30987dc0743c183d73, role_id=40a27bb8ebd549c497447b0e5806b7a2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.015414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.038156 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 82/172] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:08 2022] PUT /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/users/1e8f26553aa34e30987dc0743c183d73/roles/40a27bb8ebd549c497447b0e5806b7a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:09.039281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:09.145213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d897d3-bdc3-4a36-a676-a6fc5414d1e3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:09.206424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.207362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.207657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.207908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.209772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.211305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.215544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362803d-0f32-46d4-873e-bafc1d56d76b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:09.217164 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 91/173] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:08 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:09.218965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:09.294035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.294886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.295172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.295450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] PATH_INFO: `/v3/users/13936368421d4c5888578cca49557609` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.296787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] RBAC: Authorizing `identity:get_user(user_id=13936368421d4c5888578cca49557609)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.298319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.300010 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 83/174] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:09 2022] GET /identity/v3/users/13936368421d4c5888578cca49557609 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:09.305644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:09.372678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14978ee7-567b-4b05-a415-07f04ffb50f4 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:09.405846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.406512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.406789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.407061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.475926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.477459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.544874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbe5f-bff3-45f1-8738-15247f8b9f6d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:09.573331 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 92/175] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:09.579607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:09.612407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.613083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.613365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.613634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.680444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef481-5c24-4f77-b045-a0f949dce22b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:09.689573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.691101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.713125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.714003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.714279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.714543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.715780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.717598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.719295 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 93/176] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:09 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:09.739004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:09.793591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 84/177] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:09.799005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:09.845430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f20d-1f43-435f-8754-7b00b9d8f626 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:09.883420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.884096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.884372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.884644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.885507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] RBAC: Adding query filter params (role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=13936368421d4c5888578cca49557609) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:09.885814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.887344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.893526 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 94/178] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:09 2022] GET /identity/v3/role_assignments?user.id=13936368421d4c5888578cca49557609&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=1b9f4acaec9249c88996af437afcb462 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:09.895550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2b9b-a995-4751-b72e-1e6bc8254f9d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:09.932011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7774-33b9-49b3-b59a-8e0d32c4d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:09.932912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7774-33b9-49b3-b59a-8e0d32c4d131 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:09.933220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7774-33b9-49b3-b59a-8e0d32c4d131 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:09.933492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7774-33b9-49b3-b59a-8e0d32c4d131 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:09.934791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7774-33b9-49b3-b59a-8e0d32c4d131 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:09.936266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7774-33b9-49b3-b59a-8e0d32c4d131 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:09.938261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 85/179] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:09 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:09.944202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:10.077230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a322c9-379e-41ee-9fc7-2d117571254e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:10.122621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bdb1a-e89f-4849-b8e3-f1c166c0f895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:10.123295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bdb1a-e89f-4849-b8e3-f1c166c0f895 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:10.123572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bdb1a-e89f-4849-b8e3-f1c166c0f895 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:10.123839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bdb1a-e89f-4849-b8e3-f1c166c0f895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:10.124675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bdb1a-e89f-4849-b8e3-f1c166c0f895 None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=13936368421d4c5888578cca49557609) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:10.124977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bdb1a-e89f-4849-b8e3-f1c166c0f895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:10.126499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bdb1a-e89f-4849-b8e3-f1c166c0f895 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:10.137977 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 95/180] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:09 2022] GET /identity/v3/role_assignments?user.id=13936368421d4c5888578cca49557609&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:11.394340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834b9f-de5a-42db-bab4-b0606e6603c9 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.395036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834b9f-de5a-42db-bab4-b0606e6603c9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.395036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834b9f-de5a-42db-bab4-b0606e6603c9 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.396464 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 86/181] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:11.401779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5591e-f672-4a9d-bf18-62d473274b14 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.402276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5591e-f672-4a9d-bf18-62d473274b14 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.402448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5591e-f672-4a9d-bf18-62d473274b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.419256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-91d5591e-f672-4a9d-bf18-62d473274b14 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:11.420423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91d5591e-f672-4a9d-bf18-62d473274b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:11.427963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549af9-5a8a-401b-a2eb-28e9573c961b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.428239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549af9-5a8a-401b-a2eb-28e9573c961b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.428506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549af9-5a8a-401b-a2eb-28e9573c961b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.429893 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 87/182] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:11.435320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621661ae-6cb1-4472-9cbc-6e2d93aadc47 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.435599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621661ae-6cb1-4472-9cbc-6e2d93aadc47 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.435866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621661ae-6cb1-4472-9cbc-6e2d93aadc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.457585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-621661ae-6cb1-4472-9cbc-6e2d93aadc47 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:11.459098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-621661ae-6cb1-4472-9cbc-6e2d93aadc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:11.509462 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 96/183] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:11.517490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de10fb-3bfc-4d55-9c23-748d30d1197d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.517964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de10fb-3bfc-4d55-9c23-748d30d1197d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.518381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de10fb-3bfc-4d55-9c23-748d30d1197d None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.519968 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 97/184] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:11.524914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da1e2-45ba-4819-9bdd-88905e636c70 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.525400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da1e2-45ba-4819-9bdd-88905e636c70 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.525816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da1e2-45ba-4819-9bdd-88905e636c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.539551 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 88/185] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:11.540449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621661ae-6cb1-4472-9cbc-6e2d93aadc47 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:11.542642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8d2da1e2-45ba-4819-9bdd-88905e636c70 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:11.544069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8d2da1e2-45ba-4819-9bdd-88905e636c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:11.609185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 98/186] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:11.609185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da1e2-45ba-4819-9bdd-88905e636c70 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:11.640503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621661ae-6cb1-4472-9cbc-6e2d93aadc47 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:11.675570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:11.676305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.676587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.676864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.687375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:11.694634 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:11.697079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 89/187] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:11.697079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:11.719435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da1e2-45ba-4819-9bdd-88905e636c70 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:11.751352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:11.752161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.752441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.752704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.753889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:11.755352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:11.756976 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 99/188] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:11.762208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:11.795280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012ef8-012f-4a87-b997-1a1ba59da5bd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:11.840219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:11.841093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.841666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.841945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.853547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:11.861011 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:11.862274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 90/189] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:11.865163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:11.869554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5201602-cc1d-4101-8a91-60b9a474fb5f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:11.907818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:11.908502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:11.908781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:11.909064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:11.909834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:11.910140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:11.911542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:11.924252 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 100/190] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:11.924252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:11.972057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19830f-0a07-4eb3-9ba8-707a7ff85c99 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.009028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.009734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.010013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.010285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.010995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.012517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.028681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd8b5-785a-4823-81c9-7546c75acc9b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.045070 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 91/191] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:11 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:12.045070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.068631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9edf-2671-44c5-bad8-7cff2b180573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.069386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9edf-2671-44c5-bad8-7cff2b180573 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.069688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9edf-2671-44c5-bad8-7cff2b180573 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.069964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9edf-2671-44c5-bad8-7cff2b180573 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.070729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9edf-2671-44c5-bad8-7cff2b180573 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:12.071034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9edf-2671-44c5-bad8-7cff2b180573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.072495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9edf-2671-44c5-bad8-7cff2b180573 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.081496 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 101/192] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:12.084045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24b1a-17b0-4cce-9ff8-2ed210492ed9 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.084331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24b1a-17b0-4cce-9ff8-2ed210492ed9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.085024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24b1a-17b0-4cce-9ff8-2ed210492ed9 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.086785 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 102/193] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:12.090176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b24b1a-17b0-4cce-9ff8-2ed210492ed9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.156109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88858f9-a7f7-4c1d-af96-f175b9155fc0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.191079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba67a-37c5-44cf-b4d4-acfd83952985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.192224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba67a-37c5-44cf-b4d4-acfd83952985 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.192661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba67a-37c5-44cf-b4d4-acfd83952985 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.192930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba67a-37c5-44cf-b4d4-acfd83952985 None admin] PATH_INFO: `/v3/users/dfbcf6bbeb3e45ca88197508881b559f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.194597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b24b1a-17b0-4cce-9ff8-2ed210492ed9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.209786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba67a-37c5-44cf-b4d4-acfd83952985 None admin] RBAC: Authorizing `identity:get_user(user_id=dfbcf6bbeb3e45ca88197508881b559f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.211254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba67a-37c5-44cf-b4d4-acfd83952985 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.213241 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 92/194] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/users/dfbcf6bbeb3e45ca88197508881b559f => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:12.214422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0801f60-c13e-45eb-93ae-a01cf8e9c04d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.214744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0801f60-c13e-45eb-93ae-a01cf8e9c04d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.215012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0801f60-c13e-45eb-93ae-a01cf8e9c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.232766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f0801f60-c13e-45eb-93ae-a01cf8e9c04d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:12.234052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f0801f60-c13e-45eb-93ae-a01cf8e9c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:12.235006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.236267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.236372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.236597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] PATH_INFO: `/v3/users/dfbcf6bbeb3e45ca88197508881b559f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.238152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=dfbcf6bbeb3e45ca88197508881b559f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.239650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.241680 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 103/195] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/users/dfbcf6bbeb3e45ca88197508881b559f => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:12.242077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.303200 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 93/196] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:12.303562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0801f60-c13e-45eb-93ae-a01cf8e9c04d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.376293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58d33-0478-47a4-ad93-ffc3a0d8dfa1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.406156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0801f60-c13e-45eb-93ae-a01cf8e9c04d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.416380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.417089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.417375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.417673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.442453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.443124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.443403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.443677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.498355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.500296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.530788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.533465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.595623 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 104/197] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:12.600354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.660468 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 94/198] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:12.661693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.714880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4888f-dcd1-4ea5-87ca-944832b5a259 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.756887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.758393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.759078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.759492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.760645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237259b-16c1-4a6d-a735-0eb5d992146c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.772198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:12.780546 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:12.781812 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 105/199] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:12.782654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.801707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.802894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.803434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.804305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.806225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.808523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.811308 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 95/200] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:12.812774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.877703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69cb3c-90bc-413c-8b5e-704990868067 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.910640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.911724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.911831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.912128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.913428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.914896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.917003 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 106/201] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:12.918004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:12.927541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3bf4-0bce-4f2c-9911-124adcb00eda None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:12.961122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:12.962218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:12.962710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:12.963189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:12.964129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] RBAC: Adding query filter params (name=reader) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:12.964654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:12.966574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:12.975029 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 96/202] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:12.976056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:13.016169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c0e5d-ff4b-48f4-8862-78056ed7122b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:13.051136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:13.051827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:13.052209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:13.052690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:13.053698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=dfbcf6bbeb3e45ca88197508881b559f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:13.054007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:13.055605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:13.061974 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 107/203] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/role_assignments?user.id=dfbcf6bbeb3e45ca88197508881b559f&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:13.062990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:13.100887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599274-83be-44f6-b3c4-5d2d4ceebabe None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:13.149864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:13.150545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:13.150818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:13.151085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:13.151955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] RBAC: Adding query filter params (role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=dfbcf6bbeb3e45ca88197508881b559f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:13.152549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:13.153775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:13.161457 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 97/204] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:12 2022] GET /identity/v3/role_assignments?user.id=dfbcf6bbeb3e45ca88197508881b559f&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=1b9f4acaec9249c88996af437afcb462 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:13.184006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c29c77-3224-484d-a448-bce7278164dd None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:13.223858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:13.224839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:13.225153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:13.225422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] PATH_INFO: `/v3/users/1e8f26553aa34e30987dc0743c183d73` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:13.226841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] RBAC: Authorizing `identity:get_user(user_id=1e8f26553aa34e30987dc0743c183d73)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:13.228396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:13.230257 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 108/205] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:13 2022] GET /identity/v3/users/1e8f26553aa34e30987dc0743c183d73 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:13.236584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:13.350401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462deb20-4650-43dd-be6b-6afd6d236134 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:13.383795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:13.384452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:13.384728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:13.384997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:13.452780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:13.454338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:13.553491 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 98/206] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:13.559280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:13.659956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1d05b-b023-411d-8af1-e4f5d3b61d50 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:13.692838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bb1a0-9293-4a0a-9319-d2cf7ca8b5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:13.693752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb1a0-9293-4a0a-9319-d2cf7ca8b5d9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:13.694030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb1a0-9293-4a0a-9319-d2cf7ca8b5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:13.694304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb1a0-9293-4a0a-9319-d2cf7ca8b5d9 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:13.695487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bb1a0-9293-4a0a-9319-d2cf7ca8b5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:13.696958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bb1a0-9293-4a0a-9319-d2cf7ca8b5d9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:13.698708 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 109/207] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:13 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:13.704587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:13.801478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9531e-f926-4dd7-97ec-86a65b4e3103 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:13.834310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52991059-7fe9-4e82-8898-86f3e247b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:13.834967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991059-7fe9-4e82-8898-86f3e247b26c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:13.835245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991059-7fe9-4e82-8898-86f3e247b26c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:13.835515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991059-7fe9-4e82-8898-86f3e247b26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:13.836344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52991059-7fe9-4e82-8898-86f3e247b26c None admin] RBAC: Adding query filter params (role.id=40a27bb8ebd549c497447b0e5806b7a2, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797, user.id=1e8f26553aa34e30987dc0743c183d73) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:13.836649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52991059-7fe9-4e82-8898-86f3e247b26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:13.838132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52991059-7fe9-4e82-8898-86f3e247b26c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:13.844240 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 99/208] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:13 2022] GET /identity/v3/role_assignments?user.id=1e8f26553aa34e30987dc0743c183d73&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=40a27bb8ebd549c497447b0e5806b7a2 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:14.726613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd049a-0f1a-45f3-9a8c-88abfc125fd7 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:14.727173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd049a-0f1a-45f3-9a8c-88abfc125fd7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:14.727173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd049a-0f1a-45f3-9a8c-88abfc125fd7 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:14.728860 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 110/209] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:14.734812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4548ad-9c17-479f-82f1-5c14d17193c7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:14.735292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4548ad-9c17-479f-82f1-5c14d17193c7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:14.735483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4548ad-9c17-479f-82f1-5c14d17193c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:14.752942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1e4548ad-9c17-479f-82f1-5c14d17193c7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:14.754180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1e4548ad-9c17-479f-82f1-5c14d17193c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:14.818713 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 100/210] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:14.843225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd049a-0f1a-45f3-9a8c-88abfc125fd7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:14.944419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b195f-3d4d-4422-9bd5-80e2abec4419 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:14.945100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b195f-3d4d-4422-9bd5-80e2abec4419 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:14.945562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b195f-3d4d-4422-9bd5-80e2abec4419 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:14.947132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 101/211] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:14.950746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd049a-0f1a-45f3-9a8c-88abfc125fd7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:14.952357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a098e8-69a8-4ca7-8788-00d919d53936 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:14.952872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a098e8-69a8-4ca7-8788-00d919d53936 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:14.953358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a098e8-69a8-4ca7-8788-00d919d53936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:14.970308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b0a098e8-69a8-4ca7-8788-00d919d53936 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:14.971767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b0a098e8-69a8-4ca7-8788-00d919d53936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:14.983379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:14.984165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:14.984402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:14.984673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:14.994988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:15.002755 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:15.003994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 111/212] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:15.009696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.049021 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 102/213] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:15.067397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a098e8-69a8-4ca7-8788-00d919d53936 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.108711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51d4e4-8a93-43cf-a0d6-5103bdc9bb18 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:15.141892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:15.142570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.142849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.143122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.143873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:15.144367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:15.145607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:15.154572 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 112/214] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:15.160011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.166586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a098e8-69a8-4ca7-8788-00d919d53936 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:15.201905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:15.203070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.203534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.203992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.205629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:15.207353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:15.213137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 103/215] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:15.215201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.258884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef520-efdd-4a70-9fd5-7d58ccf04aa4 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:15.291783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:15.292782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.293084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.293415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] PATH_INFO: `/v3/users/16313731b7de41ac9e2ab817fa80bcf3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.307044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=16313731b7de41ac9e2ab817fa80bcf3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:15.308696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:15.313854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1b450-8bd5-479a-b132-5a1a4a7928f5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:15.315154 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 113/216] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:15 2022] GET /identity/v3/users/16313731b7de41ac9e2ab817fa80bcf3 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:15.316194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.349367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:15.350505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.350968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.351423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.352321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:15.354003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:15.389060 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 104/217] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:15 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:15.431587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828f311-524f-4002-89d4-f03188c1c5b1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:15.484476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3455-3781-410e-ac9e-9cc278302aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:15.485601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3455-3781-410e-ac9e-9cc278302aad None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.486125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3455-3781-410e-ac9e-9cc278302aad None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.486582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3455-3781-410e-ac9e-9cc278302aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.563486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3455-3781-410e-ac9e-9cc278302aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:15.565495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3455-3781-410e-ac9e-9cc278302aad None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:15.663335 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 114/218] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:15.669277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.760454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44f60-fc9d-4d8f-9129-31fbd8eecba9 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.761451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44f60-fc9d-4d8f-9129-31fbd8eecba9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.761944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44f60-fc9d-4d8f-9129-31fbd8eecba9 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.763514 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 115/219] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:15.769023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503954ab-8d97-49d2-a328-ae3655909ad8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.769586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503954ab-8d97-49d2-a328-ae3655909ad8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.769974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f077797-bc00-46d1-addc-de5824767388 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:15.770410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503954ab-8d97-49d2-a328-ae3655909ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.790970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-503954ab-8d97-49d2-a328-ae3655909ad8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:15.792142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-503954ab-8d97-49d2-a328-ae3655909ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:15.805280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:15.806513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.806991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.807458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.808949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:15.810665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:15.812942 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 105/220] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:15 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:15.820739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.864660 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 116/221] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:15.889282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503954ab-8d97-49d2-a328-ae3655909ad8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:15.925295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9b3e-46dd-4f39-8c69-4b71619ff73a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:15.959581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57fe55-4af4-4148-929b-e08a516e4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:15.960611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57fe55-4af4-4148-929b-e08a516e4e7d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.961128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57fe55-4af4-4148-929b-e08a516e4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.961625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57fe55-4af4-4148-929b-e08a516e4e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.962654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57fe55-4af4-4148-929b-e08a516e4e7d None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=16313731b7de41ac9e2ab817fa80bcf3) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:15.963175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57fe55-4af4-4148-929b-e08a516e4e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:15.964944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57fe55-4af4-4148-929b-e08a516e4e7d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:15.971405 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 106/222] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:15 2022] GET /identity/v3/role_assignments?user.id=16313731b7de41ac9e2ab817fa80bcf3&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:15.972940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dcd5e-3a0a-4da8-87ce-a89dae662861 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.973445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dcd5e-3a0a-4da8-87ce-a89dae662861 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.973925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dcd5e-3a0a-4da8-87ce-a89dae662861 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:15.975382 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 107/223] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:15.981348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5a92-c77b-42be-b682-f92ae939c47f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:15.981950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5a92-c77b-42be-b682-f92ae939c47f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:15.983390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5a92-c77b-42be-b682-f92ae939c47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.014599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9f5b5a92-c77b-42be-b682-f92ae939c47f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:16.016799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9f5b5a92-c77b-42be-b682-f92ae939c47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:16.019208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503954ab-8d97-49d2-a328-ae3655909ad8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.099658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.100420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.100700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.100969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.119822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:16.130765 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 108/224] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:16.139435 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:16.139435 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 117/225] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:16.140829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5a92-c77b-42be-b682-f92ae939c47f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.162038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.263957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9eb70a-9c9c-4e19-9937-2ec0702ee7e9 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.267092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5a92-c77b-42be-b682-f92ae939c47f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.299054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.300220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.300504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.300947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.301209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.301494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.301774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.302026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.302526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:16.302855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:16.304401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:16.313169 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 109/226] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:16.313734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:16.318776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.321546 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:16.322983 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 118/227] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:16.329991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.415662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5082a-889e-47cb-9277-e8878c25a2e1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.431028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541caba-f260-4f7e-8755-34fe9051761e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.452073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.452073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.452073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.452073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] PATH_INFO: `/v3/users/dfbcf6bbeb3e45ca88197508881b559f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.452667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] RBAC: Authorizing `identity:get_user(user_id=dfbcf6bbeb3e45ca88197508881b559f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:16.454179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:16.456137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 110/228] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:16 2022] GET /identity/v3/users/dfbcf6bbeb3e45ca88197508881b559f => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:16.461626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.475805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.476837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.477392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.477915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.478858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:16.479399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:16.481190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:16.490829 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 119/229] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:16.496109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.606754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958d6c5-5a4b-4555-8372-41500c3fee2e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.629807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ad077-3cd3-4ba5-9472-781d4a9e17f4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.643180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.645189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.646038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.646618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] PATH_INFO: `/v3/users/dfbcf6bbeb3e45ca88197508881b559f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.648862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] RBAC: Authorizing `identity:get_user(user_id=dfbcf6bbeb3e45ca88197508881b559f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:16.651155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:16.653675 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 120/230] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:16 2022] GET /identity/v3/users/dfbcf6bbeb3e45ca88197508881b559f => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:16.666062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.673846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.674720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.674994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.675261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.676466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:16.678060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:16.679831 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 111/231] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:16 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:16.687725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:16.816355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879d346-3e09-4198-894e-63d2a2e501d2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.852395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18d5a-b0ac-47a4-b9c3-cab0f9794d2d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:16.878086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.879037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.879317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.879585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/dfbcf6bbeb3e45ca88197508881b559f/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.885314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] RBAC: Authorizing `identity:create_grant(project_id=626b2a381ee841dbbe0b0a10a36443ab, user_id=dfbcf6bbeb3e45ca88197508881b559f, role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:16.886881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:16.906087 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 112/232] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:16 2022] PUT /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/dfbcf6bbeb3e45ca88197508881b559f/roles/1b9f4acaec9249c88996af437afcb462 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:38:16.907585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2aa76-916c-435f-9377-69d60c5d758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:16.908482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2aa76-916c-435f-9377-69d60c5d758e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:16.908764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2aa76-916c-435f-9377-69d60c5d758e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:16.909057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2aa76-916c-435f-9377-69d60c5d758e None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:16.913977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2aa76-916c-435f-9377-69d60c5d758e None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:16.915498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2aa76-916c-435f-9377-69d60c5d758e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:16.921140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 121/233] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:16 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:16.927452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:17.038067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f95dc5-1228-40ba-bd3f-9a3eac66901f None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:17.077834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ba8fe-dbdc-4849-9163-80c21d45025b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:17.079008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba8fe-dbdc-4849-9163-80c21d45025b None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:17.079424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba8fe-dbdc-4849-9163-80c21d45025b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:17.079834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba8fe-dbdc-4849-9163-80c21d45025b None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/dfbcf6bbeb3e45ca88197508881b559f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:17.084508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ba8fe-dbdc-4849-9163-80c21d45025b None admin] RBAC: Authorizing `identity:create_grant(project_id=626b2a381ee841dbbe0b0a10a36443ab, user_id=dfbcf6bbeb3e45ca88197508881b559f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:17.086274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ba8fe-dbdc-4849-9163-80c21d45025b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:17.107323 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 113/234] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:16 2022] PUT /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/dfbcf6bbeb3e45ca88197508881b559f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:18.451971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e3ac7-fc9f-4b5f-a8da-0bc13477fa50 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:18.452455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e3ac7-fc9f-4b5f-a8da-0bc13477fa50 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:18.452708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e3ac7-fc9f-4b5f-a8da-0bc13477fa50 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:18.454425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 122/235] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:18.466062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c073adf-ae0f-4e1b-9fde-92e1fe66ed99 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:18.466993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c073adf-ae0f-4e1b-9fde-92e1fe66ed99 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:18.467462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c073adf-ae0f-4e1b-9fde-92e1fe66ed99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:18.490827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5c073adf-ae0f-4e1b-9fde-92e1fe66ed99 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:18.492330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c073adf-ae0f-4e1b-9fde-92e1fe66ed99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:18.583662 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 114/236] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:18.618013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e3ac7-fc9f-4b5f-a8da-0bc13477fa50 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:18.625864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf17708-7a93-4af9-bb69-28267dd8805b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:18.626152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf17708-7a93-4af9-bb69-28267dd8805b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:18.626427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf17708-7a93-4af9-bb69-28267dd8805b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:18.627806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 115/237] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:18.632730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21b00-3f67-4ca8-a789-41373332b143 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:18.633013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21b00-3f67-4ca8-a789-41373332b143 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:18.633339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21b00-3f67-4ca8-a789-41373332b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:18.649711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bcc21b00-3f67-4ca8-a789-41373332b143 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:18.650904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bcc21b00-3f67-4ca8-a789-41373332b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:18.716647 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 116/238] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:18.742217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21b00-3f67-4ca8-a789-41373332b143 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:18.742566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e3ac7-fc9f-4b5f-a8da-0bc13477fa50 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:18.776037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:18.776876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:18.777177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:18.777445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:18.787862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:18.796729 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:18.798767 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 123/239] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:18.804081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:18.913083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500c34-2c63-4798-a364-8f02608e90e3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:18.931684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21b00-3f67-4ca8-a789-41373332b143 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:18.950165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:18.950868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:18.951142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:18.951408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:18.952148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:18.952446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:18.953874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:18.968688 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 124/240] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:18.974855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.017340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da562-3aec-49a7-94bc-b47051f3b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.018494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da562-3aec-49a7-94bc-b47051f3b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.019156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da562-3aec-49a7-94bc-b47051f3b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.020370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da562-3aec-49a7-94bc-b47051f3b9f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.024525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da562-3aec-49a7-94bc-b47051f3b9f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.026531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da562-3aec-49a7-94bc-b47051f3b9f3 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.028433 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 117/241] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:19.034002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04789bf5-382c-42c5-9e84-0ecbb11cc358 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.034474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04789bf5-382c-42c5-9e84-0ecbb11cc358 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.034954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04789bf5-382c-42c5-9e84-0ecbb11cc358 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.036327 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 118/242] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:19.040984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04789bf5-382c-42c5-9e84-0ecbb11cc358 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.113251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f848db-e2ef-4dfd-b051-658fdeffb770 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.146187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04789bf5-382c-42c5-9e84-0ecbb11cc358 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.146401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646213-2b25-4321-8508-1df7831d186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.147251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646213-2b25-4321-8508-1df7831d186c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.147577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646213-2b25-4321-8508-1df7831d186c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.147850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646213-2b25-4321-8508-1df7831d186c None admin] PATH_INFO: `/v3/users/5bcf65ba86674ae59d0b818b52fbc3de` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.161445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646213-2b25-4321-8508-1df7831d186c None admin] RBAC: Authorizing `identity:get_user(user_id=5bcf65ba86674ae59d0b818b52fbc3de)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.162942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646213-2b25-4321-8508-1df7831d186c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.165066 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 125/243] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:18 2022] GET /identity/v3/users/5bcf65ba86674ae59d0b818b52fbc3de => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:19.166324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b21375-3a8d-4de0-89df-c0ce0a7166bb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.166603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b21375-3a8d-4de0-89df-c0ce0a7166bb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.166896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b21375-3a8d-4de0-89df-c0ce0a7166bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.180383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.181079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.181365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.181637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.182356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.183726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-71b21375-3a8d-4de0-89df-c0ce0a7166bb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:19.183902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.184938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-71b21375-3a8d-4de0-89df-c0ce0a7166bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:19.208289 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 119/244] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:19 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:19.209358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.262240 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 126/245] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:19.286582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b21375-3a8d-4de0-89df-c0ce0a7166bb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.333275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f09c30-30d5-436a-bec1-84392dd63f01 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.378203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.378874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.379158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.379434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.411410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b21375-3a8d-4de0-89df-c0ce0a7166bb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.459758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.461302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.482490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.483305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.483578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.483843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.494482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:19.501600 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:19.502828 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 127/246] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:19.508825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.563269 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 120/247] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:19.568603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.613907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5250fe5-0e41-4a75-94d3-70cefe0bd160 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.648516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.649242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.649521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.649789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.650539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] RBAC: Adding query filter params (name=member) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:19.650841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.652308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.660994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 128/248] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:19.666619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.671650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbf15d-f01c-4ed2-8709-f9ded938093a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.707433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.708323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.708605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.708909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.710199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.711715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.713929 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 121/249] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:19 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:19.720285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.775246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc982ec7-9d8f-4798-86db-7e77a092b473 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.808661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.809641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.809921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.810192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] PATH_INFO: `/v3/users/16313731b7de41ac9e2ab817fa80bcf3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.811552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] RBAC: Authorizing `identity:get_user(user_id=16313731b7de41ac9e2ab817fa80bcf3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.813188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.820181 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 129/250] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:19 2022] GET /identity/v3/users/16313731b7de41ac9e2ab817fa80bcf3 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:19.821380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:19.821869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2e36-ca29-43b1-a2f0-a33ca6c2ac7f None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.858291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.858957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.859243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.859521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.860360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] RBAC: Adding query filter params (role.id=40a27bb8ebd549c497447b0e5806b7a2, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=5bcf65ba86674ae59d0b818b52fbc3de) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:19.860672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.862608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:19.870486 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 122/251] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:19 2022] GET /identity/v3/role_assignments?user.id=5bcf65ba86674ae59d0b818b52fbc3de&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=40a27bb8ebd549c497447b0e5806b7a2 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:19.936820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48da29-acfa-4329-bf86-77d901ac88db None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:19.990187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679489-9cbc-4f1c-af8c-8c183a9b8fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:19.991176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679489-9cbc-4f1c-af8c-8c183a9b8fba None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:19.991545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679489-9cbc-4f1c-af8c-8c183a9b8fba None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:19.991816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679489-9cbc-4f1c-af8c-8c183a9b8fba None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:19.995779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71679489-9cbc-4f1c-af8c-8c183a9b8fba None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:19.997451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71679489-9cbc-4f1c-af8c-8c183a9b8fba None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:20.000557 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 130/252] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:19 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:20.005762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.054033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fca9e-0999-4fcb-bcd1-2ead6ea826c6 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.054348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fca9e-0999-4fcb-bcd1-2ead6ea826c6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.054586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fca9e-0999-4fcb-bcd1-2ead6ea826c6 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.056315 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 131/253] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:20.062501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448966f-815c-4c16-b0d9-1b3b29904360 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.062952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448966f-815c-4c16-b0d9-1b3b29904360 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.063114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448966f-815c-4c16-b0d9-1b3b29904360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.086924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7448966f-815c-4c16-b0d9-1b3b29904360 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:20.088826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7448966f-815c-4c16-b0d9-1b3b29904360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:20.126546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146d279-eb98-4b83-8e21-8e5d14ba31fd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:20.166061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590a0bf-629f-41cf-95e9-3929b7e38d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:20.167017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590a0bf-629f-41cf-95e9-3929b7e38d3b None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.167290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590a0bf-629f-41cf-95e9-3929b7e38d3b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.167558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590a0bf-629f-41cf-95e9-3929b7e38d3b None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/16313731b7de41ac9e2ab817fa80bcf3/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.169612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590a0bf-629f-41cf-95e9-3929b7e38d3b None admin] RBAC: Authorizing `identity:create_grant(project_id=626b2a381ee841dbbe0b0a10a36443ab, user_id=16313731b7de41ac9e2ab817fa80bcf3, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:20.171088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590a0bf-629f-41cf-95e9-3929b7e38d3b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:20.182097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 132/254] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:20.184535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe630652-2ee2-4063-a445-211cfd1fbf4b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.185160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe630652-2ee2-4063-a445-211cfd1fbf4b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.185652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe630652-2ee2-4063-a445-211cfd1fbf4b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.191343 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 133/255] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:20.191485 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 123/256] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:20 2022] PUT /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/16313731b7de41ac9e2ab817fa80bcf3/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:20.193078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22708ea1-b1e2-44f6-87d5-abe161237b2c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.193384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22708ea1-b1e2-44f6-87d5-abe161237b2c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.193698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22708ea1-b1e2-44f6-87d5-abe161237b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.214721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-22708ea1-b1e2-44f6-87d5-abe161237b2c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:20.214906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe630652-2ee2-4063-a445-211cfd1fbf4b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.216280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-22708ea1-b1e2-44f6-87d5-abe161237b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:20.355842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 124/257] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:20.380354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe630652-2ee2-4063-a445-211cfd1fbf4b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:20.394539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22708ea1-b1e2-44f6-87d5-abe161237b2c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.416529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:20.425072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.425072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.425072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.436742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:20.444793 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:20.446335 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 134/258] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:20.456307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.553546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22708ea1-b1e2-44f6-87d5-abe161237b2c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:20.565867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785fe4a-cd9f-41ed-bf45-3a0c5a5ebde7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:20.587125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:20.587936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.588212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.588482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.599696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:20.599854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:20.600440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.600720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.601073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.602171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:20.602171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:20.603549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:20.606885 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:20.608371 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 125/259] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:20.614007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.616460 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 135/260] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:20.618903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.724761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733906e-0fac-4332-a2f0-5685e00fb50b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:20.743984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcca1a-0239-4dd9-bc0f-8e6886b247bb None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:20.787796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:20.788694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.788967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.789334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] PATH_INFO: `/v3/users/dfbcf6bbeb3e45ca88197508881b559f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.790813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] RBAC: Authorizing `identity:get_user(user_id=dfbcf6bbeb3e45ca88197508881b559f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:20.792353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:20.805060 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 136/261] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:20 2022] GET /identity/v3/users/dfbcf6bbeb3e45ca88197508881b559f => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:20.805060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.813730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:20.815050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.815532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.816336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.817305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:20.818057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:20.819930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:20.830037 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 126/262] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:20.837965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:20.950719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1f56-f068-4dfa-90c8-7f95f624da50 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:20.988768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:20.990069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:20.990852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:20.991319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] PATH_INFO: `/v3/users/dfbcf6bbeb3e45ca88197508881b559f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:20.992736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] RBAC: Authorizing `identity:get_user(user_id=dfbcf6bbeb3e45ca88197508881b559f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:20.994945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:20.997546 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 127/263] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:20 2022] GET /identity/v3/users/dfbcf6bbeb3e45ca88197508881b559f => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:21.006623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:21.027525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c36b1-5f17-462f-9048-83fed3f7ff05 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:21.116517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:21.117223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:21.117503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:21.117772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:21.168804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91325e99-e450-416a-99ff-0238a8ca3c60 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:21.244719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:21.245354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:21.246043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:21.246043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:21.263941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:21.265549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:21.374070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:21.376973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:21.503068 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 128/264] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:21.503517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 137/265] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:21.508171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:21.509336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:21.643348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c6ee-d9c5-475c-bfea-88dff13116db None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:21.686640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:21.687762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:21.688181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:21.688617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:21.691246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:21.692864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:21.700976 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 129/266] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:21 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:21.706818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:21.772695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6005f-e334-44af-a1bc-e338e383e23f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:21.824546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9c7b-eb05-42e9-8150-20f8443c13c4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:21.873161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:21.874379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:21.874806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:21.875406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:21.876392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=dfbcf6bbeb3e45ca88197508881b559f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:21.876846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:21.878823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:21.893558 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 130/267] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:21 2022] GET /identity/v3/role_assignments?user.id=dfbcf6bbeb3e45ca88197508881b559f&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:21.894987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6654b-2213-4448-a82e-9028315ba7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:21.895895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6654b-2213-4448-a82e-9028315ba7fe None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:21.896166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6654b-2213-4448-a82e-9028315ba7fe None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:21.896432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6654b-2213-4448-a82e-9028315ba7fe None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:21.902156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6654b-2213-4448-a82e-9028315ba7fe None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:21.903704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6654b-2213-4448-a82e-9028315ba7fe None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:21.905857 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 138/268] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:21 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:21.911934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:22.028735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee2193-2f36-453e-89ed-a342ca8a98ff None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:22.068503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00581361-70eb-4638-96fa-ff8913cedb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:22.069481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581361-70eb-4638-96fa-ff8913cedb08 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:22.070086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581361-70eb-4638-96fa-ff8913cedb08 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:22.070567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581361-70eb-4638-96fa-ff8913cedb08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:22.071549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00581361-70eb-4638-96fa-ff8913cedb08 None admin] RBAC: Adding query filter params (role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=dfbcf6bbeb3e45ca88197508881b559f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:22.072003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00581361-70eb-4638-96fa-ff8913cedb08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:22.073700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00581361-70eb-4638-96fa-ff8913cedb08 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:22.080694 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 131/269] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:21 2022] GET /identity/v3/role_assignments?user.id=dfbcf6bbeb3e45ca88197508881b559f&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=1b9f4acaec9249c88996af437afcb462 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:23.078907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2587-75c6-48a6-bcfc-6b86ae3f6053 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.079440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2587-75c6-48a6-bcfc-6b86ae3f6053 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.079440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2587-75c6-48a6-bcfc-6b86ae3f6053 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.081204 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 139/270] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:23.087114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0cbd9-3004-4d15-8ded-357e9ee27b1b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.088196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0cbd9-3004-4d15-8ded-357e9ee27b1b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.088737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0cbd9-3004-4d15-8ded-357e9ee27b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.105924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f5f0cbd9-3004-4d15-8ded-357e9ee27b1b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:23.107376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f5f0cbd9-3004-4d15-8ded-357e9ee27b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:23.171756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 132/271] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:23.185444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218cf85-23eb-4643-9100-fc03242dc84f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.185760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218cf85-23eb-4643-9100-fc03242dc84f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.186035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218cf85-23eb-4643-9100-fc03242dc84f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.187646 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 140/272] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:23.192645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878ffb-f603-478f-b9d5-7eb0f3290590 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.192932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878ffb-f603-478f-b9d5-7eb0f3290590 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.193238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878ffb-f603-478f-b9d5-7eb0f3290590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.201133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218cf85-23eb-4643-9100-fc03242dc84f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.210606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c5878ffb-f603-478f-b9d5-7eb0f3290590 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:23.211566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c5878ffb-f603-478f-b9d5-7eb0f3290590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:23.293418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 133/273] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:23.294622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4417d0-a83c-44a4-ad9e-51c6a9c9d527 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.294907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4417d0-a83c-44a4-ad9e-51c6a9c9d527 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.295175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4417d0-a83c-44a4-ad9e-51c6a9c9d527 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.296580 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 134/274] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:23.301784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50880e-19ba-447a-8d41-8a36086173c7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.302065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50880e-19ba-447a-8d41-8a36086173c7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.302337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50880e-19ba-447a-8d41-8a36086173c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.311291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218cf85-23eb-4643-9100-fc03242dc84f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:23.318779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2a50880e-19ba-447a-8d41-8a36086173c7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:23.319947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2a50880e-19ba-447a-8d41-8a36086173c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:23.345677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:23.346411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.346690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.346962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.348181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:23.349703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:23.351334 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 141/275] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:23.355856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.387245 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 135/276] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:23.388058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50880e-19ba-447a-8d41-8a36086173c7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.464140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bb4c4-42be-4a5e-ba5c-84250bd94642 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:23.488079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50880e-19ba-447a-8d41-8a36086173c7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:23.495964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:23.496780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.497087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.497371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.507062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:23.514125 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:23.515327 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 142/277] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:23.517263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.520231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90773375-537e-462a-a8fe-7cf521fb418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:23.520909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90773375-537e-462a-a8fe-7cf521fb418c None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.521218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90773375-537e-462a-a8fe-7cf521fb418c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.521495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90773375-537e-462a-a8fe-7cf521fb418c None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.522202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90773375-537e-462a-a8fe-7cf521fb418c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:23.523669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90773375-537e-462a-a8fe-7cf521fb418c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:23.553065 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 136/278] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:23 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:23.553065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5fdd5-5fae-473e-a535-322490207110 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.553065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5fdd5-5fae-473e-a535-322490207110 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.553065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5fdd5-5fae-473e-a535-322490207110 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.553065 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 137/279] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:23.553065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5fdd5-5fae-473e-a535-322490207110 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.631126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b9100-8b4a-42f1-98bc-929bcdd7de5f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:23.661637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5fdd5-5fae-473e-a535-322490207110 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:23.666251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62adb44-f3f9-4e58-9bfe-4fbcffb00595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:23.667155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62adb44-f3f9-4e58-9bfe-4fbcffb00595 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.667437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62adb44-f3f9-4e58-9bfe-4fbcffb00595 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.667706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62adb44-f3f9-4e58-9bfe-4fbcffb00595 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.678925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62adb44-f3f9-4e58-9bfe-4fbcffb00595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:23.686375 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e62adb44-f3f9-4e58-9bfe-4fbcffb00595 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:23.692685 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 143/280] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:23.694117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db556-4bfc-41c2-acfd-cc9037ed090d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.694407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db556-4bfc-41c2-acfd-cc9037ed090d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.694684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db556-4bfc-41c2-acfd-cc9037ed090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.696914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:23.697666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.697944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.698214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.699021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:23.699380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:23.700786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:23.709863 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 138/281] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:23.710507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.711953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-063db556-4bfc-41c2-acfd-cc9037ed090d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:23.713197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-063db556-4bfc-41c2-acfd-cc9037ed090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:23.788420 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 144/282] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:23.788420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063db556-4bfc-41c2-acfd-cc9037ed090d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.826156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8f876-07ee-4b05-a550-ad91019a2f78 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:23.871318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:23.871916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.872199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.872472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.874256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:23.874458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:23.875930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:23.889445 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 139/283] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:23.890362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:23.923760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063db556-4bfc-41c2-acfd-cc9037ed090d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:23.958701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:23.959600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:23.959878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:23.960152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] PATH_INFO: `/v3/users/a16b3cb264974a89a02de2e4bebdca34` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:23.975248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] RBAC: Authorizing `identity:get_user(user_id=a16b3cb264974a89a02de2e4bebdca34)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:23.976813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:23.978583 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 145/284] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/users/a16b3cb264974a89a02de2e4bebdca34 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:23.979415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:24.005207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4c8e1-7aa8-4603-bcfb-d8b572b9ad04 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.051219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.052335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.052838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.053124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.067643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:24.076375 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:24.078567 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 140/285] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:24.081226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:24.100634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a068-67a5-445e-ae32-5ad832a29d33 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.134210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.135144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.135499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.135769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] PATH_INFO: `/v3/users/5bcf65ba86674ae59d0b818b52fbc3de` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.137012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] RBAC: Authorizing `identity:get_user(user_id=5bcf65ba86674ae59d0b818b52fbc3de)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:24.138588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:24.140496 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 146/286] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:23 2022] GET /identity/v3/users/5bcf65ba86674ae59d0b818b52fbc3de => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:24.141051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:24.192842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1457dc-26a2-483c-ac34-a15b3d1a31be None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.225977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.226638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.226919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.227193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.228026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, user.id=a16b3cb264974a89a02de2e4bebdca34, scope.system=all) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:24.228338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:24.229929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:24.235246 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 141/287] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Apr 9 20:38:24 2022] GET /identity/v3/role_assignments?user.id=a16b3cb264974a89a02de2e4bebdca34&scope.system=all&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:24.236036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:24.251145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668802b-d016-4698-b545-4455256cd9ab None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.343173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.343866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.344143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.344413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.345202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] RBAC: Adding query filter params (name=member) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:24.345505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:24.346942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:24.350173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccc43-9269-45bb-9019-554777b296a7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.368455 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 147/288] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:24.376828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:24.418453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.419347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.419627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.419902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.421302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:24.422825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:24.425007 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 142/289] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:24 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:24.430752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:24.508913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fd324-ff72-4dfb-8017-b6e285f10238 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.575232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.577005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.577546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.578013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] PATH_INFO: `/v3/users/16313731b7de41ac9e2ab817fa80bcf3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.579428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] RBAC: Authorizing `identity:get_user(user_id=16313731b7de41ac9e2ab817fa80bcf3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:24.581129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:24.583289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 148/290] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:24 2022] GET /identity/v3/users/16313731b7de41ac9e2ab817fa80bcf3 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:24.593985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:24.594851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24095d14-236e-44d3-b6f0-c8025d3c9cb1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.634783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.636953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.638096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.639012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/5bcf65ba86674ae59d0b818b52fbc3de/roles/40a27bb8ebd549c497447b0e5806b7a2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.642738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] RBAC: Authorizing `identity:create_grant(project_id=626b2a381ee841dbbe0b0a10a36443ab, user_id=5bcf65ba86674ae59d0b818b52fbc3de, role_id=40a27bb8ebd549c497447b0e5806b7a2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:24.646202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:24.676480 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 143/291] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:38:24 2022] PUT /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/users/5bcf65ba86674ae59d0b818b52fbc3de/roles/40a27bb8ebd549c497447b0e5806b7a2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:24.726030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4adf16-63a6-4f4d-b41a-6dd6e0cb81b3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:24.760992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:24.761694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:24.761974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:24.762243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:24.832474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:24.834058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:24.938586 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 149/292] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:24.944235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:25.045941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0e5f-ccd8-4116-9ad3-2c62a23ba889 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:25.078603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea84f0a-c2c1-4a68-9490-0723c5f21798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:25.079483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84f0a-c2c1-4a68-9490-0723c5f21798 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:25.079760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84f0a-c2c1-4a68-9490-0723c5f21798 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:25.080035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84f0a-c2c1-4a68-9490-0723c5f21798 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:25.081251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84f0a-c2c1-4a68-9490-0723c5f21798 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:25.082712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84f0a-c2c1-4a68-9490-0723c5f21798 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:25.084421 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 144/293] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:24 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:25.090627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:25.218348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fbbfd-8145-45d1-9772-dd1855e9d1ab None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:25.251615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d358c8-3c29-43c6-ae01-be7731ee16df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:25.252335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d358c8-3c29-43c6-ae01-be7731ee16df None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:25.252618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d358c8-3c29-43c6-ae01-be7731ee16df None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:25.252891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d358c8-3c29-43c6-ae01-be7731ee16df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:25.253744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d358c8-3c29-43c6-ae01-be7731ee16df None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=16313731b7de41ac9e2ab817fa80bcf3) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:25.254053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d358c8-3c29-43c6-ae01-be7731ee16df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:25.255515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d358c8-3c29-43c6-ae01-be7731ee16df None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:25.261906 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 150/294] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:25 2022] GET /identity/v3/role_assignments?user.id=16313731b7de41ac9e2ab817fa80bcf3&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:26.235575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6426fa-c0d1-4fee-a881-d46f89181fc4 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.236083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6426fa-c0d1-4fee-a881-d46f89181fc4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.236083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6426fa-c0d1-4fee-a881-d46f89181fc4 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.237788 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 145/295] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:26.242966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91610d5d-0269-4e77-b715-6460b3e38836 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.243760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91610d5d-0269-4e77-b715-6460b3e38836 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.244332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91610d5d-0269-4e77-b715-6460b3e38836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.261342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-91610d5d-0269-4e77-b715-6460b3e38836 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:26.262866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91610d5d-0269-4e77-b715-6460b3e38836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:26.337138 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 151/296] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:26.355704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6426fa-c0d1-4fee-a881-d46f89181fc4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:26.452041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6575-ea27-4905-8423-335f339fb940 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.452875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6575-ea27-4905-8423-335f339fb940 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.453727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6575-ea27-4905-8423-335f339fb940 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.455979 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 152/297] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:26.461943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd95c-e077-49a3-92ac-67a915f951e8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.462521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd95c-e077-49a3-92ac-67a915f951e8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.463110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd95c-e077-49a3-92ac-67a915f951e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.463410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6426fa-c0d1-4fee-a881-d46f89181fc4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:26.483514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e57fd95c-e077-49a3-92ac-67a915f951e8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:26.485739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e57fd95c-e077-49a3-92ac-67a915f951e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:26.497088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:26.498131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.498414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.498684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.518741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:26.527857 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:26.530786 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 146/298] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:26.537059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:26.615729 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 153/299] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:26.642262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd95c-e077-49a3-92ac-67a915f951e8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:26.699908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d30a-cdca-4ab1-91c6-beee439bf05c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:26.759102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:26.759700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.760020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.760297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.761014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:26.763995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:26.767094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:26.777013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd95c-e077-49a3-92ac-67a915f951e8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:26.789347 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 147/300] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:26.796712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:26.822127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:26.823383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.823855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.824332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.827008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:26.829990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:26.833405 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 154/301] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:26.842446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:26.919257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6f11-f6ab-403c-a055-242d4811c8ab None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:26.959472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95e9e7-5f59-46b2-a54a-74e97ea62cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:26.960358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95e9e7-5f59-46b2-a54a-74e97ea62cd4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.960635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95e9e7-5f59-46b2-a54a-74e97ea62cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.960728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a578f-9172-414c-863d-a71a9a9f13b1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:26.960900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95e9e7-5f59-46b2-a54a-74e97ea62cd4 None admin] PATH_INFO: `/v3/users/9b4168032bde47ccb144eef5a60f198d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.978262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95e9e7-5f59-46b2-a54a-74e97ea62cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=9b4168032bde47ccb144eef5a60f198d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:26.980095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95e9e7-5f59-46b2-a54a-74e97ea62cd4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:26.982069 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 148/302] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:26 2022] GET /identity/v3/users/9b4168032bde47ccb144eef5a60f198d => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:26.987073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcfd92-1880-4fe0-8203-1b436b6fed7c None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:26.987073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcfd92-1880-4fe0-8203-1b436b6fed7c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:26.987073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcfd92-1880-4fe0-8203-1b436b6fed7c None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:26.987073 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 149/303] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:26.992184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcfd92-1880-4fe0-8203-1b436b6fed7c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:27.024563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154054e-bf71-4e71-97a3-20dd6476feae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.026365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154054e-bf71-4e71-97a3-20dd6476feae None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.026718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154054e-bf71-4e71-97a3-20dd6476feae None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.026932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154054e-bf71-4e71-97a3-20dd6476feae None admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.027641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154054e-bf71-4e71-97a3-20dd6476feae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:27.029598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154054e-bf71-4e71-97a3-20dd6476feae None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:27.050827 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 155/304] 10.222.0.30 () {60 vars in 1134 bytes} [Sat Apr 9 20:38:26 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:27.052654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45436bb-26c4-46e5-ab7f-9804a97bfc79 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.052942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45436bb-26c4-46e5-ab7f-9804a97bfc79 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.053232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45436bb-26c4-46e5-ab7f-9804a97bfc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.071415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d45436bb-26c4-46e5-ab7f-9804a97bfc79 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:27.073249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d45436bb-26c4-46e5-ab7f-9804a97bfc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:27.131331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcfd92-1880-4fe0-8203-1b436b6fed7c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:27.161133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 156/305] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:27.179891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.180654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.180935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.181231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.182210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] RBAC: Adding query filter params (role.id=40a27bb8ebd549c497447b0e5806b7a2, user.id=9b4168032bde47ccb144eef5a60f198d, scope.system=all) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:27.182520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:27.184124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:27.186888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45436bb-26c4-46e5-ab7f-9804a97bfc79 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:27.197979 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 150/306] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Apr 9 20:38:26 2022] GET /identity/v3/role_assignments?user.id=9b4168032bde47ccb144eef5a60f198d&scope.system=all&role.id=40a27bb8ebd549c497447b0e5806b7a2 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:27.315908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45436bb-26c4-46e5-ab7f-9804a97bfc79 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:27.351572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1df8d5-a830-444f-94eb-d08f858b4abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.352539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df8d5-a830-444f-94eb-d08f858b4abe None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.352817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df8d5-a830-444f-94eb-d08f858b4abe None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.353116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df8d5-a830-444f-94eb-d08f858b4abe None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.364630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1df8d5-a830-444f-94eb-d08f858b4abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:27.371873 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9a1df8d5-a830-444f-94eb-d08f858b4abe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:27.373510 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 157/307] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:27.379240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:27.477238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab165ce-4b63-42d8-b303-0df2ca68508b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:27.496495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb2d72-cc23-49a3-bbd5-8d9d0827d8a2 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.496792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb2d72-cc23-49a3-bbd5-8d9d0827d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.497064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb2d72-cc23-49a3-bbd5-8d9d0827d8a2 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.498701 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 158/308] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:27.507859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb411d3-4b2c-40c7-98c8-db391eecefa1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.508580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb411d3-4b2c-40c7-98c8-db391eecefa1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.509233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb411d3-4b2c-40c7-98c8-db391eecefa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.517083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.517083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.517343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.517602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.518350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:27.518653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:27.520038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:27.528889 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 151/309] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:27.529369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2fb411d3-4b2c-40c7-98c8-db391eecefa1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:27.530817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2fb411d3-4b2c-40c7-98c8-db391eecefa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:27.535139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:27.605179 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 159/310] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:27.628776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb411d3-4b2c-40c7-98c8-db391eecefa1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:27.638404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa6dc6-4899-4f98-828e-3d248d89e586 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:27.678431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.680016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.680303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.680721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] PATH_INFO: `/v3/users/a16b3cb264974a89a02de2e4bebdca34` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.682337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] RBAC: Authorizing `identity:get_user(user_id=a16b3cb264974a89a02de2e4bebdca34)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:27.684094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:27.686616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 152/311] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:27 2022] GET /identity/v3/users/a16b3cb264974a89a02de2e4bebdca34 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:27.692195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:27.733190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb411d3-4b2c-40c7-98c8-db391eecefa1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:27.766023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.766988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.767364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.767737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.777920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:27.784994 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:27.786611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 160/312] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:27.787929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53e79c-8925-4b50-9df7-06e12b701574 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:27.792408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:27.820665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.822272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.822557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.822833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] PATH_INFO: `/v3/system/users/a16b3cb264974a89a02de2e4bebdca34/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.824316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a16b3cb264974a89a02de2e4bebdca34, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:27.825737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:27.845142 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 153/313] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Apr 9 20:38:27 2022] PUT /identity/v3/system/users/a16b3cb264974a89a02de2e4bebdca34/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:38:27.909197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209559d-c8b2-40f1-9f84-5ca2170cae6a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:27.945962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:27.947040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:27.947540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:27.947977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:27.949100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:27.949630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:27.951753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:27.961226 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 161/314] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:27.967831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:28.074294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1c74-4d95-44ab-9b0e-230fe601ece6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:28.110027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:28.110921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:28.111193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:28.111457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] PATH_INFO: `/v3/users/5bcf65ba86674ae59d0b818b52fbc3de` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:28.112625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] RBAC: Authorizing `identity:get_user(user_id=5bcf65ba86674ae59d0b818b52fbc3de)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:28.114195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:28.116018 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 154/315] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:27 2022] GET /identity/v3/users/5bcf65ba86674ae59d0b818b52fbc3de => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:28.121441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:28.215930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fd791-f7ac-43af-98b7-9d1dd361dc33 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:28.247792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:28.248448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:28.248722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:28.248991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:28.319546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:28.321060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:28.420003 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 162/316] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:28.425384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:28.535499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dd42-6838-43fa-ba98-ea29873a0753 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:28.567807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ea311-13b0-467f-8602-8e16233dd87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:28.568955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea311-13b0-467f-8602-8e16233dd87e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:28.569476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea311-13b0-467f-8602-8e16233dd87e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:28.569936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea311-13b0-467f-8602-8e16233dd87e None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:28.571303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ea311-13b0-467f-8602-8e16233dd87e None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:28.572991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ea311-13b0-467f-8602-8e16233dd87e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:28.575269 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 155/317] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:28 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:28.581280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:28.676374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecad67-9dfd-4714-becf-3b3942213172 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:28.709126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4868b2-c3ce-4f48-b8dd-53cbc6bd13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:28.710092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4868b2-c3ce-4f48-b8dd-53cbc6bd13df None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:28.710562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4868b2-c3ce-4f48-b8dd-53cbc6bd13df None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:28.711143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4868b2-c3ce-4f48-b8dd-53cbc6bd13df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:28.712145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4868b2-c3ce-4f48-b8dd-53cbc6bd13df None admin] RBAC: Adding query filter params (role.id=40a27bb8ebd549c497447b0e5806b7a2, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab, user.id=5bcf65ba86674ae59d0b818b52fbc3de) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:28.712663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4868b2-c3ce-4f48-b8dd-53cbc6bd13df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:28.714314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4868b2-c3ce-4f48-b8dd-53cbc6bd13df None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:28.720985 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 163/318] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:28 2022] GET /identity/v3/role_assignments?user.id=5bcf65ba86674ae59d0b818b52fbc3de&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=40a27bb8ebd549c497447b0e5806b7a2 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:29.523612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36cbc-cfa9-4ebe-b362-f4091220ee39 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:29.524138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36cbc-cfa9-4ebe-b362-f4091220ee39 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:29.524138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36cbc-cfa9-4ebe-b362-f4091220ee39 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:29.525765 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 156/319] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:29.530706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdcdb2-e138-4e15-9e35-7e93ef245c3e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:29.531112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdcdb2-e138-4e15-9e35-7e93ef245c3e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:29.531282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdcdb2-e138-4e15-9e35-7e93ef245c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:29.548583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-46fdcdb2-e138-4e15-9e35-7e93ef245c3e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:29.549789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46fdcdb2-e138-4e15-9e35-7e93ef245c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:29.617267 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 164/320] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:29.640668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec36cbc-cfa9-4ebe-b362-f4091220ee39 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:29.643727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc66de-8b19-45b1-b82a-bd6c6d07758b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:29.644010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc66de-8b19-45b1-b82a-bd6c6d07758b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:29.644280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc66de-8b19-45b1-b82a-bd6c6d07758b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:29.645813 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 165/321] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:29.651087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836b3f-7b46-4fac-9ea3-9297702e53da None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:29.651087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836b3f-7b46-4fac-9ea3-9297702e53da None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:29.651354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836b3f-7b46-4fac-9ea3-9297702e53da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:29.667484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4e836b3f-7b46-4fac-9ea3-9297702e53da None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:29.668635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4e836b3f-7b46-4fac-9ea3-9297702e53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:29.738777 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 166/322] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:29.742694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec36cbc-cfa9-4ebe-b362-f4091220ee39 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:29.761985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836b3f-7b46-4fac-9ea3-9297702e53da None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:29.777978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:29.779093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:29.779562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:29.780031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:29.781308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:29.782778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:29.784746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 157/323] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:29.789874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:29.861055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836b3f-7b46-4fac-9ea3-9297702e53da None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:29.893247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:29.894059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:29.894336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:29.894611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:29.897709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce4319-399e-4691-a137-e1f83c862df9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:29.905557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:29.913957 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:29.921153 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 167/324] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:29.922149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:29.933403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:29.934096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:29.934370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:29.934637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] PATH_INFO: `/v3/groups` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:29.935335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:29.936832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:29.954360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 158/325] 10.222.0.30 () {60 vars in 1134 bytes} [Sat Apr 9 20:38:29 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:38:30.046284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645b7a1-6cc9-4dfc-ad7a-02e72305d6b6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:30.081474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:30.082185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.082460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.082736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.083488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:30.083789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:30.085248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:30.094790 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 168/326] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:30.101176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:30.202254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ec67f-7228-48b4-ad6e-d759a45b1b0b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:30.237321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b39b87-bd4c-481c-a6be-c63c9ccbe399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:30.238243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b39b87-bd4c-481c-a6be-c63c9ccbe399 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.238523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b39b87-bd4c-481c-a6be-c63c9ccbe399 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.238795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b39b87-bd4c-481c-a6be-c63c9ccbe399 None admin] PATH_INFO: `/v3/users/9b4168032bde47ccb144eef5a60f198d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.240016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b39b87-bd4c-481c-a6be-c63c9ccbe399 None admin] RBAC: Authorizing `identity:get_user(user_id=9b4168032bde47ccb144eef5a60f198d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:30.241541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b39b87-bd4c-481c-a6be-c63c9ccbe399 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:30.243192 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 159/327] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:30 2022] GET /identity/v3/users/9b4168032bde47ccb144eef5a60f198d => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:30.249106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:30.312645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56252d-dccf-401e-b8f4-d7b48c0f7be1 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.312833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56252d-dccf-401e-b8f4-d7b48c0f7be1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.313151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56252d-dccf-401e-b8f4-d7b48c0f7be1 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.314518 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 160/328] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:30.322547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c6402-54f6-44ba-a8fc-75a293329eed None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.322825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c6402-54f6-44ba-a8fc-75a293329eed None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.323102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c6402-54f6-44ba-a8fc-75a293329eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.341702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9c8c6402-54f6-44ba-a8fc-75a293329eed None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:30.343035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9c8c6402-54f6-44ba-a8fc-75a293329eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:30.354377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea4e3-585f-450b-a787-fc4d7ed04cc7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:30.390757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:30.391983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.392472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.392940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] PATH_INFO: `/v3/system/users/9b4168032bde47ccb144eef5a60f198d/roles/40a27bb8ebd549c497447b0e5806b7a2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.394673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b4168032bde47ccb144eef5a60f198d, role_id=40a27bb8ebd549c497447b0e5806b7a2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:30.396290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:30.407640 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 169/329] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Apr 9 20:38:30 2022] PUT /identity/v3/system/users/9b4168032bde47ccb144eef5a60f198d/roles/40a27bb8ebd549c497447b0e5806b7a2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:30.431115 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 161/330] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:30.457562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:30.570887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73929-077f-4100-aa49-ffa648adfc2d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:30.607353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:30.608180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.608460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.608831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.619853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:30.626936 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:30.628558 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 170/331] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:30.633951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c6402-54f6-44ba-a8fc-75a293329eed None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:30.736282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c6402-54f6-44ba-a8fc-75a293329eed None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:30.770071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:30.770744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.771026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.771300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.772049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:30.772352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:30.773761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:30.784153 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 162/332] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:30.789347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:30.911035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a035-7096-436a-aef5-832ee4ba7c99 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:30.946180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97d02-5255-422b-bccd-33c6bcd963dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:30.947136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97d02-5255-422b-bccd-33c6bcd963dd None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:30.947419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97d02-5255-422b-bccd-33c6bcd963dd None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:30.947695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97d02-5255-422b-bccd-33c6bcd963dd None admin] PATH_INFO: `/v3/users/a16b3cb264974a89a02de2e4bebdca34` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:30.950176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97d02-5255-422b-bccd-33c6bcd963dd None admin] RBAC: Authorizing `identity:get_user(user_id=a16b3cb264974a89a02de2e4bebdca34)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:30.951712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97d02-5255-422b-bccd-33c6bcd963dd None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:30.953769 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 171/333] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:30 2022] GET /identity/v3/users/a16b3cb264974a89a02de2e4bebdca34 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:30.959112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:31.083441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30e69-3eda-4c73-a8b3-1691969f37f4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:31.128378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f1ec0-fae4-461d-9fc4-6eda9688b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:31.129085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f1ec0-fae4-461d-9fc4-6eda9688b376 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:31.129344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f1ec0-fae4-461d-9fc4-6eda9688b376 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:31.129612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f1ec0-fae4-461d-9fc4-6eda9688b376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:31.130443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f1ec0-fae4-461d-9fc4-6eda9688b376 None admin] RBAC: Adding query filter params (role.id=873544593d0a49c4bcb7d1582e9f0759, user.id=a16b3cb264974a89a02de2e4bebdca34, scope.system=all) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:31.130747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f1ec0-fae4-461d-9fc4-6eda9688b376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:31.132204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f1ec0-fae4-461d-9fc4-6eda9688b376 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:31.144495 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 163/334] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Apr 9 20:38:30 2022] GET /identity/v3/role_assignments?user.id=a16b3cb264974a89a02de2e4bebdca34&scope.system=all&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:33.094636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58be2-e054-4545-a70b-8b04d92f75d5 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.095672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58be2-e054-4545-a70b-8b04d92f75d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.096183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58be2-e054-4545-a70b-8b04d92f75d5 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.098161 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 172/335] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:33.103166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e233d-5be2-4f43-a94d-914f0ea09b6e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.104030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e233d-5be2-4f43-a94d-914f0ea09b6e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.104496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e233d-5be2-4f43-a94d-914f0ea09b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.128055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-888e233d-5be2-4f43-a94d-914f0ea09b6e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:33.129629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-888e233d-5be2-4f43-a94d-914f0ea09b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:33.175685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c5b91-f6cf-4a36-932b-e14760126577 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.175960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c5b91-f6cf-4a36-932b-e14760126577 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.176592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c5b91-f6cf-4a36-932b-e14760126577 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.179408 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 173/336] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:33.184380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95180f-638e-431e-a7fe-b90fee712215 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.185367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95180f-638e-431e-a7fe-b90fee712215 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.185845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95180f-638e-431e-a7fe-b90fee712215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.214784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7b95180f-638e-431e-a7fe-b90fee712215 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:33.218715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b95180f-638e-431e-a7fe-b90fee712215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:33.231647 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 164/337] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:33.266560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e233d-5be2-4f43-a94d-914f0ea09b6e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:33.304793 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 174/338] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:33.337480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95180f-638e-431e-a7fe-b90fee712215 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:33.457517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e233d-5be2-4f43-a94d-914f0ea09b6e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:33.477619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95180f-638e-431e-a7fe-b90fee712215 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:33.517492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:33.518602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.519030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.519438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.531717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:33.538291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:33.539120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.539403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.539677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.540635 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:33.542477 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 175/339] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:33.548268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:33.561007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:33.568620 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:33.572426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 165/340] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:33.577819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:33.730400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c7dc7-db29-4a28-bc80-ecc5cb81b0a5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:33.752070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0fda0-a6d9-4748-a552-add22673ec61 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:33.796434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:33.797148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.797427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.797702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.798449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:33.798748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:33.800163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:33.809635 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 176/341] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:33.815118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:33.818024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:33.820574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:33.821012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:33.823452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:33.824430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:33.826066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:33.827643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:33.847059 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 166/342] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:33.852683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:33.971325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46726da0-7d6b-4656-a91a-06484008354c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.007639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a2669-bbf9-4a4e-a544-227719a66fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.008546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a2669-bbf9-4a4e-a544-227719a66fa1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.009021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a2669-bbf9-4a4e-a544-227719a66fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.009500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a2669-bbf9-4a4e-a544-227719a66fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.015822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f862f-f011-456d-82e2-df978050d631 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.058082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27ae5a-6e9b-4936-8941-5922848f4dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.059258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ae5a-6e9b-4936-8941-5922848f4dbd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.059741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ae5a-6e9b-4936-8941-5922848f4dbd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.060222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ae5a-6e9b-4936-8941-5922848f4dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.080776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a2669-bbf9-4a4e-a544-227719a66fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:34.083583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a2669-bbf9-4a4e-a544-227719a66fa1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:34.131656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27ae5a-6e9b-4936-8941-5922848f4dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:34.133814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27ae5a-6e9b-4936-8941-5922848f4dbd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:34.185401 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 177/343] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:34.187480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47787-38ec-4b76-b283-28f9d87512d2 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.187933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47787-38ec-4b76-b283-28f9d87512d2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.188347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47787-38ec-4b76-b283-28f9d87512d2 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.190154 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 178/344] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:34.191643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47787-38ec-4b76-b283-28f9d87512d2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:34.233853 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 167/345] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:34.235257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4098b-e86f-4b64-bf4a-693f59e2c076 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.235700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4098b-e86f-4b64-bf4a-693f59e2c076 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.236128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4098b-e86f-4b64-bf4a-693f59e2c076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.257375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-92f4098b-e86f-4b64-bf4a-693f59e2c076 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:34.258903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-92f4098b-e86f-4b64-bf4a-693f59e2c076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:34.295283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47787-38ec-4b76-b283-28f9d87512d2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.328503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61249c29-3572-41e8-85a6-dc8209894aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.329686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61249c29-3572-41e8-85a6-dc8209894aa9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.329822 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 168/346] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:34.330367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61249c29-3572-41e8-85a6-dc8209894aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.330785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61249c29-3572-41e8-85a6-dc8209894aa9 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.332136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61249c29-3572-41e8-85a6-dc8209894aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:34.333355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4098b-e86f-4b64-bf4a-693f59e2c076 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:34.333954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61249c29-3572-41e8-85a6-dc8209894aa9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:34.335804 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 179/347] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:34.337268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015ad8-b855-4e72-a0a8-23ece03c3b70 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.337691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015ad8-b855-4e72-a0a8-23ece03c3b70 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.338299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015ad8-b855-4e72-a0a8-23ece03c3b70 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.344269 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 180/348] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:34.345252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015ad8-b855-4e72-a0a8-23ece03c3b70 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:34.449904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015ad8-b855-4e72-a0a8-23ece03c3b70 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.465345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4098b-e86f-4b64-bf4a-693f59e2c076 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.485498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78427df5-b273-403a-86e0-7f97496fbcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.486624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78427df5-b273-403a-86e0-7f97496fbcc0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.487055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78427df5-b273-403a-86e0-7f97496fbcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.487465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78427df5-b273-403a-86e0-7f97496fbcc0 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.494044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78427df5-b273-403a-86e0-7f97496fbcc0 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:34.495707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78427df5-b273-403a-86e0-7f97496fbcc0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:34.497649 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 181/349] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:34.499012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4fc9-cab9-41f3-bf7a-31ba7b7a85d3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.499437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4fc9-cab9-41f3-bf7a-31ba7b7a85d3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.499875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4fc9-cab9-41f3-bf7a-31ba7b7a85d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.502292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.504118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.504679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.505192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.507316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:34.509069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:34.511188 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 169/350] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:34.512159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:34.518585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-774d4fc9-cab9-41f3-bf7a-31ba7b7a85d3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:34.520038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-774d4fc9-cab9-41f3-bf7a-31ba7b7a85d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:34.587562 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 182/351] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:34.588688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d4fc9-cab9-41f3-bf7a-31ba7b7a85d3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:34.650304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8231f45-f435-4f5c-b0d2-519bfd07023d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.701965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.703171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.703599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.704067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.704341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d4fc9-cab9-41f3-bf7a-31ba7b7a85d3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.717597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:34.727472 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 09 20:38:34.729752 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 170/352] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:34.730992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:34.743404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.744285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.744676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.745482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.746479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:34.747231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:34.749110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:34.756314 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 183/353] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=1b9f4acaec9249c88996af437afcb462 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:34.757265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:34.859828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66fbb-fe2a-4f1a-a73b-6f7a8079b39c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:34.899630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:34.901303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:34.901833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:34.902319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:34.903818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:34.905688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:34.908013 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 171/354] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:34.909107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.003775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff93f9-4d9b-4aae-95d3-82541102238b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.034218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4589-03ae-4f2b-afb4-11a1206fb763 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.041023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.042198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.042674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.043137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.054524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:35.063398 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:35.065053 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 184/355] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:35.070229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.071161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.072180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.072613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.073079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.074261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:35.074703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:35.077297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:35.088545 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 172/356] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:35.090839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.201615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe861b-4a3a-40bb-a22d-37feea99c72b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.237359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.238264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.238708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.239131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.240324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:35.240817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:35.242441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:35.247115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9bf99-932a-4eca-a0d6-6f6e87661c06 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.249317 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 185/357] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:35 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:35.250279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.301428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.302105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.302557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.302983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.303865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:35.304316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:35.305916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:35.321136 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 173/358] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:35.327234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.354588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88736b-1f2c-4353-840a-64123fe38d25 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.390736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073609d-387e-4235-8652-63904fb5c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.392650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073609d-387e-4235-8652-63904fb5c491 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.393370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073609d-387e-4235-8652-63904fb5c491 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.394043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073609d-387e-4235-8652-63904fb5c491 None admin] PATH_INFO: `/v3/users/9b4168032bde47ccb144eef5a60f198d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.395749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073609d-387e-4235-8652-63904fb5c491 None admin] RBAC: Authorizing `identity:get_user(user_id=9b4168032bde47ccb144eef5a60f198d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:35.397385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073609d-387e-4235-8652-63904fb5c491 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:35.399236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 186/359] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:38:35 2022] GET /identity/v3/users/9b4168032bde47ccb144eef5a60f198d => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:35.400710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cd2a-5e70-49a7-9cde-6010364ceb48 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.401171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cd2a-5e70-49a7-9cde-6010364ceb48 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.401580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cd2a-5e70-49a7-9cde-6010364ceb48 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.403081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 187/360] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:35.410155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e724b6-0caa-40e7-8136-23592238007c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.410624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e724b6-0caa-40e7-8136-23592238007c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.411052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e724b6-0caa-40e7-8136-23592238007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.428959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-19e724b6-0caa-40e7-8136-23592238007c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:35.430442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-19e724b6-0caa-40e7-8136-23592238007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:35.470841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767692-7dd9-48ae-93a6-044c71bbb056 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.508263 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 188/361] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:35.509234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e724b6-0caa-40e7-8136-23592238007c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.517825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d44d0-295b-4c5a-b4be-c8e4f62edbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.518509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d44d0-295b-4c5a-b4be-c8e4f62edbb6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.518789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d44d0-295b-4c5a-b4be-c8e4f62edbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.519065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d44d0-295b-4c5a-b4be-c8e4f62edbb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.613545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d44d0-295b-4c5a-b4be-c8e4f62edbb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:35.615471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d44d0-295b-4c5a-b4be-c8e4f62edbb6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:35.626537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e724b6-0caa-40e7-8136-23592238007c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.668057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab995a-7ed7-4f46-ac50-ea9e3a50d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.669189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab995a-7ed7-4f46-ac50-ea9e3a50d76a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.669958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab995a-7ed7-4f46-ac50-ea9e3a50d76a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.670377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab995a-7ed7-4f46-ac50-ea9e3a50d76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.671610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab995a-7ed7-4f46-ac50-ea9e3a50d76a None admin] RBAC: Adding query filter params (role.id=40a27bb8ebd549c497447b0e5806b7a2, user.id=9b4168032bde47ccb144eef5a60f198d, scope.system=all) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:35.672230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab995a-7ed7-4f46-ac50-ea9e3a50d76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:35.674170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab995a-7ed7-4f46-ac50-ea9e3a50d76a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:35.690781 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 189/362] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Apr 9 20:38:35 2022] GET /identity/v3/role_assignments?user.id=9b4168032bde47ccb144eef5a60f198d&scope.system=all&role.id=40a27bb8ebd549c497447b0e5806b7a2 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:35.692903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d504f-770e-4074-b931-56d4da2fa95b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.693353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d504f-770e-4074-b931-56d4da2fa95b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.694012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d504f-770e-4074-b931-56d4da2fa95b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.696844 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 190/363] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:35.697848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d504f-770e-4074-b931-56d4da2fa95b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.747054 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 174/364] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:35.748700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaa025-42cc-487f-9d38-3dd92987b3be None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.749909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaa025-42cc-487f-9d38-3dd92987b3be None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.750517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaa025-42cc-487f-9d38-3dd92987b3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:35.785667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3faaa025-42cc-487f-9d38-3dd92987b3be None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:35.787878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3faaa025-42cc-487f-9d38-3dd92987b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:35.868886 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 175/365] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:35.870016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaa025-42cc-487f-9d38-3dd92987b3be None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:35.886956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d504f-770e-4074-b931-56d4da2fa95b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:35.974770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:35.975572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:35.975848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:35.976117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.002294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:36.006308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaa025-42cc-487f-9d38-3dd92987b3be None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.011720 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:36.017583 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 191/366] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:36.018465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.046308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.047934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.048409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.048870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.050363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.052026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.054026 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 176/367] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:35 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:36.055029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.140542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74557f-1f83-4105-baeb-9675db208106 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.175154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e6ce2-e648-404b-a576-b265617de368 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.182976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.184089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.184577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.185077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.196624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:36.203961 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:36.206458 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 192/368] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:36.207456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.211623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.217193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.217495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.217939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.219130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:36.219448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.221260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.231798 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 177/369] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:36.237528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.316368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379f69-3a23-41de-8017-cddddb6659cc None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.359982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.361296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.361789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.362248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.363139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c082-337f-462a-b4db-ce10b4ff9c27 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.364195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.365944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.368196 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 193/370] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:36.369262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.404379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.405547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.405832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.406110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.407012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:36.407198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.408843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.420204 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 178/371] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:36.421390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.507410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e2e19-4aff-4da3-9c7d-f53de9c8e907 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.548121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.549234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.549715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.550184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.560005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4b832-68de-41f1-a404-9ea286579d81 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.606811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.607393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.607667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.607935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.608793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:36.609093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.610554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.618415 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 179/372] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:36.619411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.634049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.635920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.724785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153108d9-fabb-4ca3-8f66-be5e347b8a6f None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.750617 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 194/373] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:36.757087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.759984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.760545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.760822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.761126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.831486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.832968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.863408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b18baf-2de7-463c-8af6-829010aa14b7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:36.898549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:36.899713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:36.900152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:36.900573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:36.901932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:36.903612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:36.909069 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 195/374] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:36.911865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:36.936617 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 180/375] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:36.942435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:37.037573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c5b42-2d9b-4976-accc-4cf90392215f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:37.080258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:37.081845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:37.082329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:37.082774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:37.084787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:37.086924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:37.093168 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 196/376] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:37.096345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97ac5d-da25-4a17-ae78-cce325a7e361 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:37.098028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:37.132999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:37.133866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:37.134140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:37.134410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] PATH_INFO: `/v3/projects/ac45ac4c5799419597fa1b4dd7090c85` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:37.135661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] RBAC: Authorizing `identity:get_project(project_id=ac45ac4c5799419597fa1b4dd7090c85)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:37.137184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:37.139682 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 181/377] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:36 2022] GET /identity/v3/projects/ac45ac4c5799419597fa1b4dd7090c85 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:37.145428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:37.281277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece269d-6ef3-4839-983e-de96b9964bb5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:37.325684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eab52a-295b-4423-9a68-6412e6b84a23 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:37.347634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:37.348981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:37.349487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:37.349959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:37.351004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:37.351513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:37.353224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:37.360377 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 197/378] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:37 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=1b9f4acaec9249c88996af437afcb462 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:37.407052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d26321-0e26-4e56-a628-282a5c36fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:37.407860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26321-0e26-4e56-a628-282a5c36fa7d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:37.408142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26321-0e26-4e56-a628-282a5c36fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:37.408412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26321-0e26-4e56-a628-282a5c36fa7d None admin] PATH_INFO: `/v3/groups/7c7a7496cbb4420d8d4515c537a83f00` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:37.419847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d26321-0e26-4e56-a628-282a5c36fa7d None admin] RBAC: Authorizing `identity:get_group(group_id=7c7a7496cbb4420d8d4515c537a83f00)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:37.421349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d26321-0e26-4e56-a628-282a5c36fa7d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:37.423491 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 182/379] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:37 2022] GET /identity/v3/groups/7c7a7496cbb4420d8d4515c537a83f00 => generated 229 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:37.429824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:37.568038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757691-f539-4e54-a21b-2f30f04382cc None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:37.602967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb66559-1dd6-453b-a465-93cf48bd0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:37.603649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb66559-1dd6-453b-a465-93cf48bd0462 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:37.603931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb66559-1dd6-453b-a465-93cf48bd0462 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:37.604203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb66559-1dd6-453b-a465-93cf48bd0462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:37.605043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb66559-1dd6-453b-a465-93cf48bd0462 None admin] RBAC: Adding query filter params (group.id=7c7a7496cbb4420d8d4515c537a83f00, role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=ac45ac4c5799419597fa1b4dd7090c85) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:37.605370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb66559-1dd6-453b-a465-93cf48bd0462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:37.606819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb66559-1dd6-453b-a465-93cf48bd0462 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:37.614269 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 198/380] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:37 2022] GET /identity/v3/role_assignments?group.id=7c7a7496cbb4420d8d4515c537a83f00&scope.project.id=ac45ac4c5799419597fa1b4dd7090c85&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:37.932273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59890d30-7711-4a2a-985a-91163fc099a7 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:37.932675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59890d30-7711-4a2a-985a-91163fc099a7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:37.932856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59890d30-7711-4a2a-985a-91163fc099a7 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:37.934258 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 183/381] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:37.939869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbba0b2-1fef-4a58-b0be-2cb0203b5d46 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:37.940156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbba0b2-1fef-4a58-b0be-2cb0203b5d46 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:37.940430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbba0b2-1fef-4a58-b0be-2cb0203b5d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:37.962170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4cbba0b2-1fef-4a58-b0be-2cb0203b5d46 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:37.963359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4cbba0b2-1fef-4a58-b0be-2cb0203b5d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:38.035287 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 199/382] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:38.062776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59890d30-7711-4a2a-985a-91163fc099a7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:38.199233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59890d30-7711-4a2a-985a-91163fc099a7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:38.239469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971e0fe-3b53-4f3c-bd83-bf5913477713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:38.240298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e0fe-3b53-4f3c-bd83-bf5913477713 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.240572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e0fe-3b53-4f3c-bd83-bf5913477713 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.240844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e0fe-3b53-4f3c-bd83-bf5913477713 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.254719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971e0fe-3b53-4f3c-bd83-bf5913477713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:38.262063 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-2971e0fe-3b53-4f3c-bd83-bf5913477713 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:38.263297 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 184/383] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:38.271227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbba0b2-1fef-4a58-b0be-2cb0203b5d46 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:38.309601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2904-bdac-4d7f-9650-304a2bf82903 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.309909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2904-bdac-4d7f-9650-304a2bf82903 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.310421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2904-bdac-4d7f-9650-304a2bf82903 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.312150 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 185/384] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:38.318651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d503d8-ceaa-472e-be55-a8622e74f796 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.318651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d503d8-ceaa-472e-be55-a8622e74f796 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.318651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d503d8-ceaa-472e-be55-a8622e74f796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.348965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d8d503d8-ceaa-472e-be55-a8622e74f796 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:38.350172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d8d503d8-ceaa-472e-be55-a8622e74f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:38.395045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbba0b2-1fef-4a58-b0be-2cb0203b5d46 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:38.432725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:38.434484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.434986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.435483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.436435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:38.436935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:38.441085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:38.449853 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 200/385] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:38.455189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:38.535511 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 186/386] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:38.568406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d503d8-ceaa-472e-be55-a8622e74f796 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:38.586456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956da06-6ed6-42b3-acf0-88a582717fda None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:38.620710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:38.621851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.622263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.622683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.623998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:38.627634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:38.629913 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 201/387] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:38 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:38.635233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:38.698429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d503d8-ceaa-472e-be55-a8622e74f796 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:38.734673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:38.735830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.736303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.736780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.739126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d795b2d-0f05-4004-8528-b57aee38a243 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:38.747692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:38.757532 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:38.759073 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 187/388] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:38.764796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:38.773387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:38.774334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.774616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.774892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.776093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:38.777654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:38.779769 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 202/389] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:38 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:38.785354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:38.896039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5a678-54fc-4b12-b555-9ceaf4cd0510 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:38.957536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711c5a3-3e28-471c-b3d7-8726cdb47ffd None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:38.960608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:38.961534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:38.961975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:38.962382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:38.963265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:38.963724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:38.966345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:38.984512 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 188/390] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:38.991595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:39.032090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:39.033418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:39.033906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:39.034384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/groups/01788d4d9c104bb082c6de3488cec035/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:39.039158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] RBAC: Authorizing `identity:create_grant(project_id=f73da65445eb4c8f8b1dcaa70f191797, group_id=01788d4d9c104bb082c6de3488cec035, role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:39.040932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:39.067760 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 203/391] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Apr 9 20:38:38 2022] PUT /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/groups/01788d4d9c104bb082c6de3488cec035/roles/1b9f4acaec9249c88996af437afcb462 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:38:39.142784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cffb-0e1b-4e41-84e5-ef8184cda4bd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:39.191910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:39.193245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:39.193779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:39.194256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:39.202040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:39.203864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:39.206261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 189/392] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:38 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:39.212298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:39.324595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7eb79-2613-4c61-a445-b12c505058ae None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:39.357795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77c506-70ab-4306-80b2-b49dd762c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:39.359040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77c506-70ab-4306-80b2-b49dd762c812 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:39.359511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77c506-70ab-4306-80b2-b49dd762c812 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:39.359971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77c506-70ab-4306-80b2-b49dd762c812 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:39.361367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77c506-70ab-4306-80b2-b49dd762c812 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:39.363098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77c506-70ab-4306-80b2-b49dd762c812 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:39.365368 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 204/393] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:39 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:39.371370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:39.485354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7685b4-579c-4539-b90c-bf1835029944 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:39.519364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d70e56-c204-46b8-be32-98f18847d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:39.520606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d70e56-c204-46b8-be32-98f18847d4b6 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:39.521111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d70e56-c204-46b8-be32-98f18847d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:39.521577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d70e56-c204-46b8-be32-98f18847d4b6 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/groups/01788d4d9c104bb082c6de3488cec035/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:39.523768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d70e56-c204-46b8-be32-98f18847d4b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f73da65445eb4c8f8b1dcaa70f191797, group_id=01788d4d9c104bb082c6de3488cec035, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:39.525550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d70e56-c204-46b8-be32-98f18847d4b6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:39.543719 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 190/394] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Apr 9 20:38:39 2022] PUT /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797/groups/01788d4d9c104bb082c6de3488cec035/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:40.151444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064045d8-95e2-4aaa-9948-3227e270499f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.152430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064045d8-95e2-4aaa-9948-3227e270499f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.152909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064045d8-95e2-4aaa-9948-3227e270499f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.154940 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 205/395] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:40.160135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81977-0860-4ab6-b33f-e5a7e64fff2b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.160671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81977-0860-4ab6-b33f-e5a7e64fff2b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.161170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81977-0860-4ab6-b33f-e5a7e64fff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.179034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-42c81977-0860-4ab6-b33f-e5a7e64fff2b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:40.180632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-42c81977-0860-4ab6-b33f-e5a7e64fff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:40.256689 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 191/396] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:40.293082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064045d8-95e2-4aaa-9948-3227e270499f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:40.405582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064045d8-95e2-4aaa-9948-3227e270499f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:40.457396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc635-81c4-44d2-ad70-6987187eb5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:40.458226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc635-81c4-44d2-ad70-6987187eb5ac None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.458504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc635-81c4-44d2-ad70-6987187eb5ac None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.458774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc635-81c4-44d2-ad70-6987187eb5ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.473888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dc635-81c4-44d2-ad70-6987187eb5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:40.480840 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-6d2dc635-81c4-44d2-ad70-6987187eb5ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:40.482104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 206/397] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:40.488278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c81977-0860-4ab6-b33f-e5a7e64fff2b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:40.557990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918847a-6567-4ee8-b192-c4c3d7027a47 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.558303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918847a-6567-4ee8-b192-c4c3d7027a47 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.558535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918847a-6567-4ee8-b192-c4c3d7027a47 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.559891 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 207/398] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:40.565162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a892-8161-462a-93de-33d1b33c5f11 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.565664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a892-8161-462a-93de-33d1b33c5f11 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.566120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a892-8161-462a-93de-33d1b33c5f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.599095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8be5a892-8161-462a-93de-33d1b33c5f11 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:40.600429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c81977-0860-4ab6-b33f-e5a7e64fff2b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:40.601160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8be5a892-8161-462a-93de-33d1b33c5f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:40.636428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:40.637378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.637979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.638387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.639267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:40.639708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:40.641246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:40.649837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 192/399] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:40.659411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:40.723001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 208/400] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:40.763280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a892-8161-462a-93de-33d1b33c5f11 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:40.797611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c004-de91-4102-b6f8-7d47cb6cff90 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:40.841537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:40.842987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.843463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.843926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.845391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:40.847266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:40.850042 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 193/401] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:40 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:40.862494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:40.942564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a892-8161-462a-93de-33d1b33c5f11 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:40.984449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1301038-22ea-421c-8fb1-8f318d54e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:40.985595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301038-22ea-421c-8fb1-8f318d54e724 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:40.986009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301038-22ea-421c-8fb1-8f318d54e724 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:40.986412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301038-22ea-421c-8fb1-8f318d54e724 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:40.997503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1301038-22ea-421c-8fb1-8f318d54e724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:41.005613 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f1301038-22ea-421c-8fb1-8f318d54e724 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:41.007298 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 209/402] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:41.008788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4840f-9e6e-411e-bd83-f3e89ac6fd5b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.009228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4840f-9e6e-411e-bd83-f3e89ac6fd5b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.009581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b187a2-2754-4afc-a9dc-b498f1961f41 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.009793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4840f-9e6e-411e-bd83-f3e89ac6fd5b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.011223 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 210/403] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:41.015904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4840f-9e6e-411e-bd83-f3e89ac6fd5b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:41.050127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eb3f7-647d-4b76-9410-287af5ec2113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.051246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb3f7-647d-4b76-9410-287af5ec2113 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.051666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb3f7-647d-4b76-9410-287af5ec2113 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.052112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb3f7-647d-4b76-9410-287af5ec2113 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.053520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eb3f7-647d-4b76-9410-287af5ec2113 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:41.055291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eb3f7-647d-4b76-9410-287af5ec2113 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:41.057765 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 194/404] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:40 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:41.059236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6354a2-0e87-4483-afec-becb565d927e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.059674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6354a2-0e87-4483-afec-becb565d927e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.060071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6354a2-0e87-4483-afec-becb565d927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.077090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bd6354a2-0e87-4483-afec-becb565d927e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:41.078488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bd6354a2-0e87-4483-afec-becb565d927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:41.128228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4840f-9e6e-411e-bd83-f3e89ac6fd5b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.146927 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 195/405] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:41.147967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6354a2-0e87-4483-afec-becb565d927e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:41.161612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.162283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.162716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.163151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.164029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:41.164506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:41.166052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:41.174817 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 211/406] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:41.180511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:41.270464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6354a2-0e87-4483-afec-becb565d927e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.279554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6033-d35d-4459-bcd9-92b7cc8a89ef None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.304119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.305064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.305358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.305629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/groups/01788d4d9c104bb082c6de3488cec035/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.307611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] RBAC: Authorizing `identity:create_grant(project_id=626b2a381ee841dbbe0b0a10a36443ab, group_id=01788d4d9c104bb082c6de3488cec035, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:41.309279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:41.312733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.313702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.313975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.314252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.315568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:41.321093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:41.321093 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 212/407] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:41 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:41.321093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:41.334862 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 196/408] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Apr 9 20:38:41 2022] PUT /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/groups/01788d4d9c104bb082c6de3488cec035/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:41.335718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:41.461635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39a07-ee99-41bd-8d6a-e22b0e20f59b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.509764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.510668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.510941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.511209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.512855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:41.514368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:41.525068 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 197/409] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:41 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:41.526913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:41.552088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe959-ad78-460f-9499-8a1b44adaa1e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.621638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.622499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.622829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.623106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.634024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:41.640964 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:41.647360 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 213/410] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:41.648233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:41.683404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf611bf-adb7-43e7-af0f-cabfaaf26a01 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.731156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.732283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.732692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.733364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/groups/01788d4d9c104bb082c6de3488cec035/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.743396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=626b2a381ee841dbbe0b0a10a36443ab, group_id=01788d4d9c104bb082c6de3488cec035, role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:41.744872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:41.773208 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 198/411] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Apr 9 20:38:41 2022] PUT /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab/groups/01788d4d9c104bb082c6de3488cec035/roles/1b9f4acaec9249c88996af437afcb462 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:38:41.793745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb042-2c80-4d94-b2ab-4c5932de2649 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:41.852268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52423e50-e044-47c8-ba34-2b566ad09c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:41.852965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423e50-e044-47c8-ba34-2b566ad09c30 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:41.853270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423e50-e044-47c8-ba34-2b566ad09c30 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:41.853545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423e50-e044-47c8-ba34-2b566ad09c30 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:41.854307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52423e50-e044-47c8-ba34-2b566ad09c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:41.854613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52423e50-e044-47c8-ba34-2b566ad09c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:41.856079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52423e50-e044-47c8-ba34-2b566ad09c30 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:41.871578 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 214/412] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:41.877860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:42.019160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c04e5-c90c-47db-8725-0e33bde714f5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:42.019356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846000ac-b0e3-40b8-b7d2-d6ec3cb506bb None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.019356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846000ac-b0e3-40b8-b7d2-d6ec3cb506bb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.019356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846000ac-b0e3-40b8-b7d2-d6ec3cb506bb None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.019356 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 215/413] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:42.034711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77e16-0d03-4c35-9184-6143ab6fb8d0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.035344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77e16-0d03-4c35-9184-6143ab6fb8d0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.035720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77e16-0d03-4c35-9184-6143ab6fb8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.053591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:42.053591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.054128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.054631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] PATH_INFO: `/v3/groups/7c7a7496cbb4420d8d4515c537a83f00` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.056605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] RBAC: Authorizing `identity:get_group(group_id=7c7a7496cbb4420d8d4515c537a83f00)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:42.058332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:42.060702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 199/414] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:41 2022] GET /identity/v3/groups/7c7a7496cbb4420d8d4515c537a83f00 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:42.066346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:42.069572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bff77e16-0d03-4c35-9184-6143ab6fb8d0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:42.070832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bff77e16-0d03-4c35-9184-6143ab6fb8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:42.169640 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 216/415] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:42.186240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4d40-cdf3-45ae-b0bc-56b83ab1b28e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:42.205759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77e16-0d03-4c35-9184-6143ab6fb8d0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:42.222467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:42.223607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.224071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.224510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] PATH_INFO: `/v3/projects/ac45ac4c5799419597fa1b4dd7090c85` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.225944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] RBAC: Authorizing `identity:get_project(project_id=ac45ac4c5799419597fa1b4dd7090c85)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:42.227714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:42.230051 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 200/416] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:42 2022] GET /identity/v3/projects/ac45ac4c5799419597fa1b4dd7090c85 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:42.237917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:42.328860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77e16-0d03-4c35-9184-6143ab6fb8d0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:42.355161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f1d1d-e0fa-41b1-8689-fff29cae5efe None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:42.389174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:42.391054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.391732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.392380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] PATH_INFO: `/v3/projects/ac45ac4c5799419597fa1b4dd7090c85/groups/7c7a7496cbb4420d8d4515c537a83f00/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.395755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac45ac4c5799419597fa1b4dd7090c85, group_id=7c7a7496cbb4420d8d4515c537a83f00, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:42.397899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:42.414037 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 201/417] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Apr 9 20:38:42 2022] PUT /identity/v3/projects/ac45ac4c5799419597fa1b4dd7090c85/groups/7c7a7496cbb4420d8d4515c537a83f00/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:38:42.421219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:42.422505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.423033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.423618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.436128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:42.444383 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:42.446176 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 217/418] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:42.456821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:42.571343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89622e8-3777-49e5-9a7f-d2e17f235338 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:42.607868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:42.608461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.608737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.609005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.609784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:42.610084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:42.611487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:42.621312 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 202/419] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:42.626952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:42.732029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c386-0e8d-47ab-9b90-5428c4c54ee1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:42.765126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be7fa-e40a-4a44-98d6-f2c2b3502e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:42.765783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be7fa-e40a-4a44-98d6-f2c2b3502e81 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.766058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be7fa-e40a-4a44-98d6-f2c2b3502e81 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.766400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be7fa-e40a-4a44-98d6-f2c2b3502e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.832785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be7fa-e40a-4a44-98d6-f2c2b3502e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:42.834297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be7fa-e40a-4a44-98d6-f2c2b3502e81 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:42.931417 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 218/420] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:42.936953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:42.953412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892de0-5278-4784-948e-e0b669ba8755 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.953733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892de0-5278-4784-948e-e0b669ba8755 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.953955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892de0-5278-4784-948e-e0b669ba8755 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.955562 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 219/421] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:42.960343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4a7e-2411-441c-b1f0-4f0ec8595f55 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:42.960621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4a7e-2411-441c-b1f0-4f0ec8595f55 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:42.960887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4a7e-2411-441c-b1f0-4f0ec8595f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:42.996694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9e9d4a7e-2411-441c-b1f0-4f0ec8595f55 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:42.997925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9e9d4a7e-2411-441c-b1f0-4f0ec8595f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:43.099652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecf47a-923f-4529-89d0-ce6db6550eef None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:43.136470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:43.137363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:43.137643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:43.137911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:43.139134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:43.140610 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 220/422] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:43.140734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:43.145054 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 203/423] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:42 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:43.147844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d4a7e-2411-441c-b1f0-4f0ec8595f55 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:43.190721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:43.319302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d4a7e-2411-441c-b1f0-4f0ec8595f55 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:43.339744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f777be-7523-45ee-a983-767e164f72d7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:43.375870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:43.377222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:43.377696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:43.378155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:43.390004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:43.397492 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:43.399383 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 204/424] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:43.400291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:43.406114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:43.406114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:43.406114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:43.406114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:43.406114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:43.406487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 221/425] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:43 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:43.407410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:43.417694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:43.590183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d790358-c593-4dd3-bd62-c4267a87711c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:43.594162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cf28-a426-4847-a77b-01416a88617b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:43.643162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:43.643842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:43.644117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:43.644386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:43.645160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:43.645466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:43.646839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:43.661340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 205/426] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:43.666959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:43.667639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:43.667919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:43.668193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:43.669025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:43.669375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:43.670065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:43.670829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:43.677517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 222/427] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:43 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=1b9f4acaec9249c88996af437afcb462 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:43.841411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf36a6-6e34-4a36-b14d-3b86463933de None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:43.882919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:43.883586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:43.883863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:43.884134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:43.972986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:43.974593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:44.071543 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 206/428] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:44.077021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.180486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e89c-e6d7-4df5-af9e-b1b3e8485706 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:44.216687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d368b-71cd-41af-9d4e-881c13311e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:44.217624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d368b-71cd-41af-9d4e-881c13311e89 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.217901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d368b-71cd-41af-9d4e-881c13311e89 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.218170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d368b-71cd-41af-9d4e-881c13311e89 None admin] PATH_INFO: `/v3/projects/f73da65445eb4c8f8b1dcaa70f191797` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.219402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d368b-71cd-41af-9d4e-881c13311e89 None admin] RBAC: Authorizing `identity:get_project(project_id=f73da65445eb4c8f8b1dcaa70f191797)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:44.220884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d368b-71cd-41af-9d4e-881c13311e89 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:44.222968 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 223/429] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/projects/f73da65445eb4c8f8b1dcaa70f191797 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:44.228492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.325668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27b48-dd03-4ddc-afac-05190d5939b9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:44.359338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c822e4c-986b-4b56-b95d-59d0dc4c2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:44.360206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c822e4c-986b-4b56-b95d-59d0dc4c2c1a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.360475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c822e4c-986b-4b56-b95d-59d0dc4c2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.360742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c822e4c-986b-4b56-b95d-59d0dc4c2c1a None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.361940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c822e4c-986b-4b56-b95d-59d0dc4c2c1a None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:44.363483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c822e4c-986b-4b56-b95d-59d0dc4c2c1a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:44.365028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678dd0e-03e5-40c9-abeb-f0be35ddfd5e None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.365549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678dd0e-03e5-40c9-abeb-f0be35ddfd5e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.365657 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 207/430] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:44.365743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678dd0e-03e5-40c9-abeb-f0be35ddfd5e None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.366954 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 224/431] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:44.372026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8ba0-5bc6-4fb2-8a61-614f566535ae None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.372312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8ba0-5bc6-4fb2-8a61-614f566535ae None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.372586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8ba0-5bc6-4fb2-8a61-614f566535ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.372764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678dd0e-03e5-40c9-abeb-f0be35ddfd5e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.389743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-979d8ba0-5bc6-4fb2-8a61-614f566535ae None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:44.390919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-979d8ba0-5bc6-4fb2-8a61-614f566535ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:44.465139 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 208/432] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:44.482186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8ba0-5bc6-4fb2-8a61-614f566535ae None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.488367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678dd0e-03e5-40c9-abeb-f0be35ddfd5e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:44.522059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a6e4c-0bab-4142-b2d6-0eac965958e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:44.522964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a6e4c-0bab-4142-b2d6-0eac965958e9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.523420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a6e4c-0bab-4142-b2d6-0eac965958e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.523856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a6e4c-0bab-4142-b2d6-0eac965958e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.524987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a6e4c-0bab-4142-b2d6-0eac965958e9 None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=f73da65445eb4c8f8b1dcaa70f191797) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:44.525460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a6e4c-0bab-4142-b2d6-0eac965958e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:44.527042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a6e4c-0bab-4142-b2d6-0eac965958e9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:44.533850 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 225/433] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=f73da65445eb4c8f8b1dcaa70f191797&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:44.584950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8ba0-5bc6-4fb2-8a61-614f566535ae None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:44.599715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463cc23-849d-4b0c-a20a-f740cc398b4d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.600153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463cc23-849d-4b0c-a20a-f740cc398b4d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.600529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463cc23-849d-4b0c-a20a-f740cc398b4d None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.605715 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 226/434] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:44.608685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa1bf-af97-4237-8a4b-5eae5d843b01 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.609105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa1bf-af97-4237-8a4b-5eae5d843b01 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.609483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa1bf-af97-4237-8a4b-5eae5d843b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.627602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d96aa1bf-af97-4237-8a4b-5eae5d843b01 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:44.627872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:44.629064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.629220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d96aa1bf-af97-4237-8a4b-5eae5d843b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:44.629625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.630036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.644503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:44.653735 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 09 20:38:44.656028 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 209/435] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:44.665061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.725196 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 227/436] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:44.747168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aa1bf-af97-4237-8a4b-5eae5d843b01 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.768660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6ceff-513c-41c5-98ad-b7ef042e9637 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:44.804387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:44.805319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.805695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.806064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.806897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] RBAC: Adding query filter params (name=member) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:44.807255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:44.808663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:44.820031 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 210/437] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:44.825993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.875146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aa1bf-af97-4237-8a4b-5eae5d843b01 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:44.920641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:44.920641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.920641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.920641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:44.932637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:44.940104 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:44.942347 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 228/438] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:44.947503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:44.950360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6e7b0-16cf-471d-bd88-45c3664bed95 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:44.989715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfa04a-738f-42a4-9abb-8fd1a4c6d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:44.990307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfa04a-738f-42a4-9abb-8fd1a4c6d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:44.990555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfa04a-738f-42a4-9abb-8fd1a4c6d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:44.991241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfa04a-738f-42a4-9abb-8fd1a4c6d4b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.063790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f911-a224-4493-8904-ef0249b5779a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.083574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfa04a-738f-42a4-9abb-8fd1a4c6d4b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.086141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfa04a-738f-42a4-9abb-8fd1a4c6d4b9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.102742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232415b-7dc3-4eba-a33e-d619ce28df08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.103430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232415b-7dc3-4eba-a33e-d619ce28df08 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.103712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232415b-7dc3-4eba-a33e-d619ce28df08 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.103986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232415b-7dc3-4eba-a33e-d619ce28df08 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.104746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232415b-7dc3-4eba-a33e-d619ce28df08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:45.105116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232415b-7dc3-4eba-a33e-d619ce28df08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.106501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232415b-7dc3-4eba-a33e-d619ce28df08 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.115219 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 229/439] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:38:45.116462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ef154-9b2c-47e1-9feb-aca35f749082 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.116843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ef154-9b2c-47e1-9feb-aca35f749082 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.117205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ef154-9b2c-47e1-9feb-aca35f749082 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.118623 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 230/440] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:45.121806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ef154-9b2c-47e1-9feb-aca35f749082 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.195754 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 211/441] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 09 20:38:45.197446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1f08-4b91-40ac-9534-6e54ece1d8f5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.197887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1f08-4b91-40ac-9534-6e54ece1d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.198162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1f08-4b91-40ac-9534-6e54ece1d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.214985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fd2c1f08-4b91-40ac-9534-6e54ece1d8f5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:45.215907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fd2c1f08-4b91-40ac-9534-6e54ece1d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:45.236321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ef154-9b2c-47e1-9feb-aca35f749082 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.267325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.267897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.268171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.268436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.279491 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 212/442] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:45.280408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c1f08-4b91-40ac-9534-6e54ece1d8f5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.332587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.334083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.372026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c1f08-4b91-40ac-9534-6e54ece1d8f5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.403577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.404436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.404707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.404971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.406202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.407610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.409328 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 213/443] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:45.410077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.424746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 231/444] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:45.425616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.505438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddcbfc-ad67-4478-8525-e65c619058c4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.522448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651a1e-f749-4da5-876e-836e59cf4d51 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.536929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.537753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.538029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.538296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.548447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:45.554907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.555550 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:38:45.555762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.556043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.556318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.556761 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 214/445] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:45.557570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.562313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.563761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.570050 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 232/446] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:45.570050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.657322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec99e5-b21d-4e3f-875c-1a54147f1a3e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.658428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07620cc-10af-4df7-9e8d-367cb27a9205 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.689952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.690803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.691082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.691246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.691358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] PATH_INFO: `/v3/projects/626b2a381ee841dbbe0b0a10a36443ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.691922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.692200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.692476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.692616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] RBAC: Authorizing `identity:get_project(project_id=626b2a381ee841dbbe0b0a10a36443ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.693245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:45.693545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.693992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.694916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.695672 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 215/447] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/projects/626b2a381ee841dbbe0b0a10a36443ab => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:45.696422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.703232 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 233/448] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:45.704015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.794463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048339a-cea1-461e-ab87-db2ad4948592 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.794882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d73753-c179-4be7-be6d-784cb0a86a9d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.826859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.827512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.827640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.827767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.828045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.828382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.828657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.828888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=873544593d0a49c4bcb7d1582e9f0759, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:45.829005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] PATH_INFO: `/v3/groups/01788d4d9c104bb082c6de3488cec035` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.829224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.830123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] RBAC: Authorizing `identity:get_group(group_id=01788d4d9c104bb082c6de3488cec035)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.830657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.831635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:45.833487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 234/449] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/groups/01788d4d9c104bb082c6de3488cec035 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:45.834075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.841460 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 216/450] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=873544593d0a49c4bcb7d1582e9f0759 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:45.842245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:45.939309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f95df-fc01-4860-b1fa-11d431998f84 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.953650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada20f96-44f1-4deb-82c5-113cdfa4dffb None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:45.972770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.973515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.973796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.974073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.989012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:45.989880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:45.990447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:45.990447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:45.991250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] RBAC: Adding query filter params (group.id=01788d4d9c104bb082c6de3488cec035, role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=626b2a381ee841dbbe0b0a10a36443ab) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:45.991559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:45.993155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:46.009318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 217/451] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/role_assignments?group.id=01788d4d9c104bb082c6de3488cec035&scope.project.id=626b2a381ee841dbbe0b0a10a36443ab&role.id=1b9f4acaec9249c88996af437afcb462 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:46.047323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:46.048748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:46.168017 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 235/452] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:46.173636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:46.281554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9de33-5aa5-4371-a568-bb053df73c42 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:46.312812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:46.313640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:46.313917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:46.314184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] PATH_INFO: `/v3/projects/ac45ac4c5799419597fa1b4dd7090c85` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:46.315358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] RBAC: Authorizing `identity:get_project(project_id=ac45ac4c5799419597fa1b4dd7090c85)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:46.316799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:46.318510 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 218/453] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:38:46 2022] GET /identity/v3/projects/ac45ac4c5799419597fa1b4dd7090c85 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:46.324138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:46.418061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba581-d1b7-4e68-9fc7-1c0edc359cf7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:46.451273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b0f9-9371-44ce-8d9e-f95048d6846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:46.452342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b0f9-9371-44ce-8d9e-f95048d6846a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:46.452709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b0f9-9371-44ce-8d9e-f95048d6846a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:46.453097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b0f9-9371-44ce-8d9e-f95048d6846a None admin] PATH_INFO: `/v3/groups/7c7a7496cbb4420d8d4515c537a83f00` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:46.455078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b0f9-9371-44ce-8d9e-f95048d6846a None admin] RBAC: Authorizing `identity:get_group(group_id=7c7a7496cbb4420d8d4515c537a83f00)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:46.457525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b0f9-9371-44ce-8d9e-f95048d6846a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:46.460022 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 236/454] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Apr 9 20:38:46 2022] GET /identity/v3/groups/7c7a7496cbb4420d8d4515c537a83f00 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:46.466716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:46.686464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d82160-7234-4256-abd2-94878cfc3a6a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:46.728351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d138b77-301a-4d0e-a210-1808cc9e437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:46.728998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138b77-301a-4d0e-a210-1808cc9e437d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:46.729306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138b77-301a-4d0e-a210-1808cc9e437d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:46.729574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138b77-301a-4d0e-a210-1808cc9e437d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:46.730390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138b77-301a-4d0e-a210-1808cc9e437d None admin] RBAC: Adding query filter params (group.id=7c7a7496cbb4420d8d4515c537a83f00, role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=ac45ac4c5799419597fa1b4dd7090c85) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:46.730696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138b77-301a-4d0e-a210-1808cc9e437d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:46.732130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138b77-301a-4d0e-a210-1808cc9e437d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:46.738011 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 219/455] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Apr 9 20:38:46 2022] GET /identity/v3/role_assignments?group.id=7c7a7496cbb4420d8d4515c537a83f00&scope.project.id=ac45ac4c5799419597fa1b4dd7090c85&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 611 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:49.776133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab579-4712-4364-b23c-6a82236e07e6 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:49.776684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab579-4712-4364-b23c-6a82236e07e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:49.776684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab579-4712-4364-b23c-6a82236e07e6 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:49.778333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 237/456] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:49.783319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce93a5-60f4-41fe-a059-4e32dc212786 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:49.783701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce93a5-60f4-41fe-a059-4e32dc212786 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:49.783875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce93a5-60f4-41fe-a059-4e32dc212786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:49.805487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d87d4-4a37-4506-ab6a-3c794a18a6ba None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:49.805487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d87d4-4a37-4506-ab6a-3c794a18a6ba None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:49.805487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d87d4-4a37-4506-ab6a-3c794a18a6ba None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:49.805840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-71ce93a5-60f4-41fe-a059-4e32dc212786 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:49.806386 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 238/457] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:49.806491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-71ce93a5-60f4-41fe-a059-4e32dc212786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:49.812025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baeb71-9778-468a-9c80-a1f5c32668e0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:49.812550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baeb71-9778-468a-9c80-a1f5c32668e0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:49.813008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baeb71-9778-468a-9c80-a1f5c32668e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:49.832986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-19baeb71-9778-468a-9c80-a1f5c32668e0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:49.834728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-19baeb71-9778-468a-9c80-a1f5c32668e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:49.917010 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 239/458] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:49.921685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53641-4c8d-40d6-9525-4bbfa43c82b9 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:49.921685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53641-4c8d-40d6-9525-4bbfa43c82b9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:49.921685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53641-4c8d-40d6-9525-4bbfa43c82b9 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:49.922845 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 240/459] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:49.931267 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 220/460] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:49.933094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f924-d407-4c15-a336-76bd050e3ae1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:49.933382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f924-d407-4c15-a336-76bd050e3ae1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:49.933654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f924-d407-4c15-a336-76bd050e3ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:49.947438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce93a5-60f4-41fe-a059-4e32dc212786 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:49.958679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bb43f924-d407-4c15-a336-76bd050e3ae1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:49.960042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bb43f924-d407-4c15-a336-76bd050e3ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:50.038914 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 241/461] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:50.040163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f924-d407-4c15-a336-76bd050e3ae1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.083862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce93a5-60f4-41fe-a059-4e32dc212786 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.133915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.135668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.136091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.136496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.151668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.153938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.169139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f924-d407-4c15-a336-76bd050e3ae1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.175175 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:50.177115 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 221/462] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:50.178232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.207768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.208917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.209436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.209900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.222222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.223694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.246210 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:50.249373 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 242/463] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:50.250883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.290720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c01f-0efb-4c18-bba7-0a15667897e1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.333457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.334817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.335399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.335807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.350001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.351995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.366600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fab50-e4dc-4a31-a5d9-0287b6c05f15 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.372219 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:50.378185 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 222/464] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:50.379077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.409005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.409700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.409977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.410253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.410969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:50.411271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.412651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.429086 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 243/465] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:50.429086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.491140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fd664-04bf-4590-abb8-e30ce0d439ea None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.524302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5de18-9367-4f35-b5ad-b9113559eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.525000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5de18-9367-4f35-b5ad-b9113559eabb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.525266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5de18-9367-4f35-b5ad-b9113559eabb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.525569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5de18-9367-4f35-b5ad-b9113559eabb None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.526285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5de18-9367-4f35-b5ad-b9113559eabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:50.526585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5de18-9367-4f35-b5ad-b9113559eabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.527955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5de18-9367-4f35-b5ad-b9113559eabb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.530662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121468f-0f75-4d79-a066-65d81fb72449 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.549225 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 223/466] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:50.549225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9beb82-edae-47c3-a400-903fec4392a2 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.549225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9beb82-edae-47c3-a400-903fec4392a2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.549225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9beb82-edae-47c3-a400-903fec4392a2 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.549225 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 224/467] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:50.549225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9beb82-edae-47c3-a400-903fec4392a2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.574795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.575471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.575736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.576023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.576739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:50.577055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.578470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.595142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 244/468] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:50.595142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.652001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9beb82-edae-47c3-a400-903fec4392a2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.686802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc17fd-c574-4ca7-97cc-0e7fb2bbf1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.687496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc17fd-c574-4ca7-97cc-0e7fb2bbf1cf None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.687773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc17fd-c574-4ca7-97cc-0e7fb2bbf1cf None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.688042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc17fd-c574-4ca7-97cc-0e7fb2bbf1cf None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.688195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e910265-fd88-40b0-a39c-4bfed8f40a19 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.688763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc17fd-c574-4ca7-97cc-0e7fb2bbf1cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.690331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc17fd-c574-4ca7-97cc-0e7fb2bbf1cf None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.711785 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 225/469] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:50 2022] POST /identity/v3/users => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:50.717310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e886cc-3b0d-4c5f-bb87-3eef46b02a60 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.717310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e886cc-3b0d-4c5f-bb87-3eef46b02a60 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.717310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e886cc-3b0d-4c5f-bb87-3eef46b02a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.729645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.730363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.730641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.730977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.731699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.733302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:50.741172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c9e886cc-3b0d-4c5f-bb87-3eef46b02a60 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:50.744123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c9e886cc-3b0d-4c5f-bb87-3eef46b02a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:50.765071 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 245/470] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:50 2022] POST /identity/v3/users => generated 248 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:50.765071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.874376 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 226/471] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:50.904835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e886cc-3b0d-4c5f-bb87-3eef46b02a60 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:50.944617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23115f85-441f-42a1-9bbd-d343e6f78b3f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:50.985781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:50.986857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:50.987334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:50.987799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:50.988756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:50.990552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:51.015529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 246/472] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:50 2022] POST /identity/v3/users => generated 248 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:51.031278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e886cc-3b0d-4c5f-bb87-3eef46b02a60 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:51.072548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444dfd2-b545-4dc0-b7c2-f49a6e0747af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:51.073407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444dfd2-b545-4dc0-b7c2-f49a6e0747af None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.073685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444dfd2-b545-4dc0-b7c2-f49a6e0747af None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.073961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444dfd2-b545-4dc0-b7c2-f49a6e0747af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.087181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444dfd2-b545-4dc0-b7c2-f49a6e0747af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:51.089104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444dfd2-b545-4dc0-b7c2-f49a6e0747af None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:51.108562 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-a444dfd2-b545-4dc0-b7c2-f49a6e0747af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:51.110212 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 227/473] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:51.116138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:51.124493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a14f3-e98a-4f1f-92a6-d2aa61f216d3 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.124677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a14f3-e98a-4f1f-92a6-d2aa61f216d3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.124939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a14f3-e98a-4f1f-92a6-d2aa61f216d3 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.126682 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 228/474] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:51.134528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be3cff-6266-4b1f-9831-2559c5ce52ac None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.134849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be3cff-6266-4b1f-9831-2559c5ce52ac None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.135068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be3cff-6266-4b1f-9831-2559c5ce52ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.158239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-64be3cff-6266-4b1f-9831-2559c5ce52ac None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:51.159902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-64be3cff-6266-4b1f-9831-2559c5ce52ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:51.237707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851457-7f3f-4060-9899-f4b92972dc52 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:51.251270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 229/475] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:51.278140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be3cff-6266-4b1f-9831-2559c5ce52ac None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:51.283631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:51.284575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.285169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.285665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.286638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:51.287144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:51.288827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:51.302608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 247/476] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:51.307945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:51.375753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be3cff-6266-4b1f-9831-2559c5ce52ac None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:51.406776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5efabe-a565-43b6-bd37-82a6229416d4 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:51.411857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:51.412535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.412808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.413173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.413879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:51.415253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:51.423846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.sql.core [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 09 20:38:51.423846 ncdv-master-1 devstack@keystone.service[102531]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 09 20:38:51.423846 ncdv-master-1 devstack@keystone.service[102531]: [parameters: {'id': '24ad551871c8435a9405eb12e63922e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 09 20:38:51.423846 ncdv-master-1 devstack@keystone.service[102531]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102531) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 09 20:38:51.442309 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 09 20:38:51.444824 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 230/477] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Apr 9 20:38:51 2022] POST /identity/v3/roles => generated 144 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:51.452230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:51.453194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:51.454172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.454640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.455099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.456254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:51.458185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:51.489490 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 248/478] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:51 2022] POST /identity/v3/users => generated 249 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:51.570624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac44126-f51e-4f4f-ae41-424f030f382a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:51.612338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19836d-ad9f-4da8-b69e-15e86b961bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:51.613209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19836d-ad9f-4da8-b69e-15e86b961bd7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.613532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19836d-ad9f-4da8-b69e-15e86b961bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.613803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19836d-ad9f-4da8-b69e-15e86b961bd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.628115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19836d-ad9f-4da8-b69e-15e86b961bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:51.635608 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-cd19836d-ad9f-4da8-b69e-15e86b961bd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 09 20:38:51.637180 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 231/479] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:51.644893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:51.781748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b006099-ede9-4d0f-aa84-523c2583389b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:51.815214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc577928-7b20-4cc5-8233-ba6aa1a343f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:51.815891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577928-7b20-4cc5-8233-ba6aa1a343f0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:51.816168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577928-7b20-4cc5-8233-ba6aa1a343f0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:51.816438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577928-7b20-4cc5-8233-ba6aa1a343f0 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:51.817217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc577928-7b20-4cc5-8233-ba6aa1a343f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:51.817527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc577928-7b20-4cc5-8233-ba6aa1a343f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:51.818920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc577928-7b20-4cc5-8233-ba6aa1a343f0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:51.827185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 249/480] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:53.516038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955869a0-b81e-4f02-b022-122d3be6f8a4 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:53.516549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955869a0-b81e-4f02-b022-122d3be6f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:53.516619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955869a0-b81e-4f02-b022-122d3be6f8a4 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:53.518230 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 232/481] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:53.523509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b65a6-c2a4-459b-b69d-b375fc3e0951 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:53.523916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b65a6-c2a4-459b-b69d-b375fc3e0951 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:53.524084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b65a6-c2a4-459b-b69d-b375fc3e0951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:53.546652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ac1b65a6-c2a4-459b-b69d-b375fc3e0951 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:53.547842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ac1b65a6-c2a4-459b-b69d-b375fc3e0951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:53.634278 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 250/482] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:53.674737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955869a0-b81e-4f02-b022-122d3be6f8a4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:53.813716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955869a0-b81e-4f02-b022-122d3be6f8a4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:53.860459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:53.861655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:53.862161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:53.862620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:53.873462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:53.880671 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:38:53.882636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 233/483] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:53.889638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b65a6-c2a4-459b-b69d-b375fc3e0951 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.002474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b65a6-c2a4-459b-b69d-b375fc3e0951 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.040477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879bf1b-2424-4a9e-92a3-189311349a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.041185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879bf1b-2424-4a9e-92a3-189311349a9f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.041463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879bf1b-2424-4a9e-92a3-189311349a9f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.041736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879bf1b-2424-4a9e-92a3-189311349a9f None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.042479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879bf1b-2424-4a9e-92a3-189311349a9f None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:54.042782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879bf1b-2424-4a9e-92a3-189311349a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.044183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879bf1b-2424-4a9e-92a3-189311349a9f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.052768 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 251/484] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:38:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:54.061204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.093342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1cda5-eccf-464c-a0fb-5b255563c733 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.093621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1cda5-eccf-464c-a0fb-5b255563c733 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.093815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1cda5-eccf-464c-a0fb-5b255563c733 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.095184 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 252/485] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:54.101187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d408b-a065-417a-9d18-fe9f1c9c4a5d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.101523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d408b-a065-417a-9d18-fe9f1c9c4a5d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.101703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d408b-a065-417a-9d18-fe9f1c9c4a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.125579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-474d408b-a065-417a-9d18-fe9f1c9c4a5d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:54.127140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-474d408b-a065-417a-9d18-fe9f1c9c4a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:54.183439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db1970-8f74-45a5-a9fa-69c985afa8dd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.206937 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 253/486] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:54.208332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc209c-66fd-40b5-8b5b-ee45c0cbbd1f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.208616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc209c-66fd-40b5-8b5b-ee45c0cbbd1f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.208882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc209c-66fd-40b5-8b5b-ee45c0cbbd1f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.210718 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 254/487] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:54.216187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a3427-f041-4d89-815b-c984572939a2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.216467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a3427-f041-4d89-815b-c984572939a2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.216742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a3427-f041-4d89-815b-c984572939a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.225590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.226715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.227251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.227817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.233514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-265a3427-f041-4d89-815b-c984572939a2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:54.234689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-265a3427-f041-4d89-815b-c984572939a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:54.239617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.241554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.259467 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:54.261088 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 234/488] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:54.262228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.301135 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 255/489] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:54.302028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a3427-f041-4d89-815b-c984572939a2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.365830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d22ac-7c21-4dce-a5c5-a4b9c29eac75 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.400250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.401504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.401980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.402471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.420147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:54.427332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a3427-f041-4d89-815b-c984572939a2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.428529 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:38:54.430419 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 235/490] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:54.431548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.461527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.462298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.462779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.463029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.463767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:54.464056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.465553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.477242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 256/491] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:54.478071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.535493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8e3d9-485b-4ed2-a189-16d1ed5b18b3 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.569714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.570884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.571353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.571838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.572871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea666-9616-4ad9-81fe-3be079ed5ef1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.589747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:54.597122 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:38:54.598988 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 236/492] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:54.600053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.610577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.611243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.611522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.611788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.612529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:54.612826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.614245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.622719 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 257/493] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:54.623300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.707994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5aaa2-d8e3-460f-aaaf-d936375d4d33 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.724561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06319-61f9-4156-851c-9ef42dfe3105 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.740378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.741266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.741543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.741812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] PATH_INFO: `/v3/users/nova` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.749795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.751301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.756940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb7fb3-1962-4b0d-8048-6729bf07512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.757651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb7fb3-1962-4b0d-8048-6729bf07512a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.757933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb7fb3-1962-4b0d-8048-6729bf07512a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.758207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb7fb3-1962-4b0d-8048-6729bf07512a None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.758962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb7fb3-1962-4b0d-8048-6729bf07512a None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:54.759268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb7fb3-1962-4b0d-8048-6729bf07512a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.760655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb7fb3-1962-4b0d-8048-6729bf07512a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.764593 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:38:54.770260 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 237/494] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:54.770260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.770465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 258/495] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:54.770465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6386-4278-438c-a25f-0307b1026ce8 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.770465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6386-4278-438c-a25f-0307b1026ce8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.770669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6386-4278-438c-a25f-0307b1026ce8 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.772075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 259/496] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:54.776521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca6386-4278-438c-a25f-0307b1026ce8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.865149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940b68-6bbe-425f-87ad-e108c401e59a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.870819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca6386-4278-438c-a25f-0307b1026ce8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:54.896314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.897344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.897678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.897892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.904202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d8e4c-3be5-425d-8ab3-da62b476a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:54.905563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8e4c-3be5-425d-8ab3-da62b476a5bc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.905835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8e4c-3be5-425d-8ab3-da62b476a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.906104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8e4c-3be5-425d-8ab3-da62b476a5bc None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.906920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d8e4c-3be5-425d-8ab3-da62b476a5bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:54.907230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d8e4c-3be5-425d-8ab3-da62b476a5bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.908679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d8e4c-3be5-425d-8ab3-da62b476a5bc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.909022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:54.910528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:54.926345 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:54.927543 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 238/497] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:54.928298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:54.944745 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 260/498] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:54.946044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351ef97-c996-49d5-a04e-70a237b37fcc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:54.946332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351ef97-c996-49d5-a04e-70a237b37fcc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:54.946773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351ef97-c996-49d5-a04e-70a237b37fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:54.962924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7351ef97-c996-49d5-a04e-70a237b37fcc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:54.964111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7351ef97-c996-49d5-a04e-70a237b37fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:55.023020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f30eee-f2fc-4c66-84ff-493c709e39f6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.028528 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 261/499] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:55.029923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f69d2-3f9b-4921-ac42-9150fbfc4032 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.030205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f69d2-3f9b-4921-ac42-9150fbfc4032 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.030474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f69d2-3f9b-4921-ac42-9150fbfc4032 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.031721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 262/500] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:38:55.032396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f69d2-3f9b-4921-ac42-9150fbfc4032 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.056434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.057265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.057543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.057815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.067815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.069333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.085022 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:55.086223 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 239/501] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:55.086987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.136686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f69d2-3f9b-4921-ac42-9150fbfc4032 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.169675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e3d3-7bf8-490c-89ee-dbcf21eb965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.170263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e3d3-7bf8-490c-89ee-dbcf21eb965b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.170541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e3d3-7bf8-490c-89ee-dbcf21eb965b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.170811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e3d3-7bf8-490c-89ee-dbcf21eb965b None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.171533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e3d3-7bf8-490c-89ee-dbcf21eb965b None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:55.171830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e3d3-7bf8-490c-89ee-dbcf21eb965b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.173259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e3d3-7bf8-490c-89ee-dbcf21eb965b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.179691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bc8e0-b1c6-4e6f-b483-2452027842cf None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.184108 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 263/502] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:55.185347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644d2b-802a-489c-97fc-1d0c660ca321 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.185633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644d2b-802a-489c-97fc-1d0c660ca321 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.185904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644d2b-802a-489c-97fc-1d0c660ca321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.201608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2f644d2b-802a-489c-97fc-1d0c660ca321 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:55.202764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2f644d2b-802a-489c-97fc-1d0c660ca321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:55.211333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.211982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.212577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.212853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.267896 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 264/503] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:38:55.268818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f644d2b-802a-489c-97fc-1d0c660ca321 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.275342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.276810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.361784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f644d2b-802a-489c-97fc-1d0c660ca321 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.374696 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 240/504] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:55.375518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.395479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.396286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.396567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.396839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.406586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.408065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.424653 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:55.425815 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 265/505] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:55.426573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.470049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd87bc-a4c9-4669-aa1f-e81d7eb8ace8 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.503640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.504297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.504573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.504837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.505647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:55.505944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.507342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.519082 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 241/506] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:55.519870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.524097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42463-f7b5-4b26-9e92-259734c42d99 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.555641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.556438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.556712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.556980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.564290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.565802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.579560 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 09 20:38:55.580786 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 266/507] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:55.581571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.616266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb38bed-97ed-412e-8632-62a008017695 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.646361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.647201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.647476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.647743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.657892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:55.664781 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:38:55.666023 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 242/508] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:55.666774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.674497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254daa8-710e-4ffe-bbf0-8a39345c6df7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.708922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.709758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.710035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.710311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.720709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.722224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.738008 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:55.739219 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 267/509] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:55.739968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.760798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38a617-0dd7-4fcb-a1a7-533704f64f15 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.791969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.792617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.792894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.793196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.793902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:55.794201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.795563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.806821 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 243/510] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:55.807619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.834933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd795f-78ca-4e9d-b5b2-eaf6d67a4f27 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.867176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.867983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.868263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.868538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.875437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.876915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.891224 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 09 20:38:55.892380 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 268/511] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:55.893159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.899963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba8320-20ef-4db4-a3f5-671245fb68b5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:55.936428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:55.937255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:55.937532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:55.937801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:55.938641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:55.938946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:55.940390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:55.976836 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 244/512] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:55.977606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:55.992893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7b9eb-7e48-4f3a-b7b0-7b9d84f921e7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.025946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.026611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.026903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.027301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.028047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:56.028344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.029773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.037357 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 269/513] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:56.038195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.073138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0afb-cff8-4f5a-9b9d-ba90b92384e9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.105575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.106231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.106512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.106784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.107505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:56.107807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.109219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.120343 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 245/514] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:56.121155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.130802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca526f20-3ce8-4038-91cf-aeaeca0f8e34 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.161913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.162588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.162865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.163135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.163825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.165297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.184890 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 270/515] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:38:56 2022] POST /identity/v3/users => generated 247 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:38:56.186069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.231165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6da5-d8fd-43c8-b405-e5e97b0b75d2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.265897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.266584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.266862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.267132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.267969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:56.268272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.269797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.292712 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 246/516] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:56.292712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.300417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560be06-796a-4c31-834a-d6f803087dae None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.334921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.335590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.335864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.336138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.392064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f813-d9ed-499c-a2e1-d7dab38d5a2e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.414515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.416012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.426600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.427538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.427926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.428301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.440341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.440341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.457203 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:56.458566 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 247/517] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:56.459213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.525412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 271/518] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:56.526445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.555446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe836ce-3046-4e8a-b0fe-70e9e4c8ab53 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.587991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.588796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.589100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.589379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.596059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.597572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.610834 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:38:56.617005 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 248/519] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:56.617005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.620149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23bf8a-d9c5-4cba-b53c-7cf91d155fad None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.652722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.653441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.653723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.653997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.716380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3413a-490f-4675-bda1-af72db0908a6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.717945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.719769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.749924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.750583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.750853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.751124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.751834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:56.752133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.753528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.769102 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 249/520] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:56.769790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.812277 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 272/521] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:56.813021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.870216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a518c62-a93d-4dac-9251-1fc95d6fd139 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.901683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.902471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.902745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.903011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.905391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac564ad2-6d85-4717-9d83-dd43e57d781a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:56.917613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.919383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.935953 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:56.941706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 250/522] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:56.941706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:56.945257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:56.946415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:56.946696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:56.946965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:56.947737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:56.948037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:56.949552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:56.967677 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 273/523] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:56.968327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.043259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac790fc-89f9-40b9-b738-74351404edf4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.063274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc900a-8399-4b96-be12-3a8d463784c0 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.076705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.077672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.077951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.078222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.085915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.087700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.095745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.096549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.096822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.097205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.100990 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 09 20:38:57.106781 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 251/524] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:57.106781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.107559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.109061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.125598 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:57.126806 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 274/525] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:57.127565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.207662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968cdcf-3bb4-45ec-858d-53521362f386 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.219126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3d69a-bf89-4a6f-8dd8-69a5c4f85707 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.240255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.240955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.241274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.241551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.242272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:57.242575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.243959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.255418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.260456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.260587 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 252/526] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:57.260710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.260710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.260860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.260939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d3a4c68c9de346219732fa8f9f6df17f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:57.260939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.260939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.265582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 275/527] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/role_assignments?user.id=d3a4c68c9de346219732fa8f9f6df17f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:57.273071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.368328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7c72-bddc-47ba-a56b-0557181ad643 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.394252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66466ce-886e-4752-baac-a818e05314d5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.406843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.407693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.408062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.408433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.409428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:57.409876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.411513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.430190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.430872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.431148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.431417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.432315 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 253/528] 10.222.0.30 () {56 vars in 1139 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:57.433392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.436682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:57.437067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.438528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.459102 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 276/529] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:57.460025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.561282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197d7d3-16d7-4209-8b65-854ce094f3b9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.574275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0331-1bc0-42a5-b190-dd59f1a0f165 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.595425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.596442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.596854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.597321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.604320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.606048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.609084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.609853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.610264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.610636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.620780 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:38:57.622556 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 254/530] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:57.623535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.678679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.680319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.721511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f1742-950a-441d-9ce0-51e87c687b7e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.753863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.754859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.755270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.755774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.762807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.764510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.777838 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:38:57.778675 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 277/531] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:38:57.779525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.779840 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 255/532] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:57.786555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.877724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8965c3-c797-4eb2-9a20-a745bb237b03 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.883981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e944c-f6ab-4333-8ecd-49e6c3bad902 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:57.911636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.912315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.912653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.913466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.914476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:57.914764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.916043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.924702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:57.925842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:57.926344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:57.926816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:57.928578 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 278/533] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:57.929501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:57.938430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:57.940299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:57.957762 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:57.959590 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 256/534] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:57.960594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:58.029159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee9eb-2092-4f1d-bf90-df56e9f45510 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:58.058916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863cc1-9888-478c-bd33-cb61dde70f6d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:58.062865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:58.063604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.063885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.064196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.064990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:58.065333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:58.066862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:58.084282 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 279/535] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:58.084282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:58.109256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:58.110304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.110778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.111287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.112344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=3efd3561844146239d5a9aa46ff7f401) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:58.112855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:58.114571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:58.120920 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 257/536] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:57 2022] GET /identity/v3/role_assignments?user.id=3efd3561844146239d5a9aa46ff7f401&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:58.122174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:58.215006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a3fec-76df-43e7-a036-07954c9aeb19 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:58.304714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:58.305817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.306548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.307010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.307930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:58.308447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:58.310229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:58.331027 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 280/537] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:58.336881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:58.348069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536749f-d2aa-43c1-9fd7-eaa9b5f50a94 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:58.408388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:58.409100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.409381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.409650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.410489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=6504d578b1b64feb93ba69d947a971e9) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:58.410795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:58.412292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:58.426660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 258/538] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:58 2022] GET /identity/v3/role_assignments?user.id=6504d578b1b64feb93ba69d947a971e9&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:58.477594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a3cda-0951-4b35-9a81-474651980c48 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:58.516746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929a8d4-9c8e-4fca-9517-0ea0bf5c89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:58.517639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929a8d4-9c8e-4fca-9517-0ea0bf5c89da None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.517913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929a8d4-9c8e-4fca-9517-0ea0bf5c89da None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.518206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929a8d4-9c8e-4fca-9517-0ea0bf5c89da None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.528645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929a8d4-9c8e-4fca-9517-0ea0bf5c89da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:58.530272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929a8d4-9c8e-4fca-9517-0ea0bf5c89da None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:58.548316 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d929a8d4-9c8e-4fca-9517-0ea0bf5c89da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:38:58.557514 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 281/539] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:38:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:58.563324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:58.591910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b6a2-d70f-4da0-ad0e-77c62d651b91 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.592641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b6a2-d70f-4da0-ad0e-77c62d651b91 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.592641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b6a2-d70f-4da0-ad0e-77c62d651b91 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.594183 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 282/540] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:58.599825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd7440-14a5-4329-810d-6bc52da45002 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.600139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd7440-14a5-4329-810d-6bc52da45002 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.600381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd7440-14a5-4329-810d-6bc52da45002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.642266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-98cd7440-14a5-4329-810d-6bc52da45002 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:38:58.643478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98cd7440-14a5-4329-810d-6bc52da45002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:38:58.680772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255fde-34b7-4720-b86b-a508233b68e1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:58.716328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:58.717486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.717958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.718476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.719452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:58.719944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:58.721751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:58.741206 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 259/541] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:58.749809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:58.790533 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 283/542] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:38:58.815279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd7440-14a5-4329-810d-6bc52da45002 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:58.885994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7409bd8-ceda-4f43-84af-f7a76a716b4b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:58.939396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:58.940309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:58.940723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:58.941152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:58.942139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=504db2ec734c46999530ed037dc0330c) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:58.942581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:58.944184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:58.958436 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 260/543] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:38:58 2022] GET /identity/v3/role_assignments?user.id=504db2ec734c46999530ed037dc0330c&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:58.998872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd7440-14a5-4329-810d-6bc52da45002 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:59.047036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:59.047869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:59.048142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:59.048412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:59.067394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:38:59.075757 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:38:59.077091 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 284/544] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:38:59.083384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:59.228543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa902b-11fa-41d1-b7ef-69f8c0157e42 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:59.274789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:59.275380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:59.275658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:59.275928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:59.276674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:59.276976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:59.278391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:59.292628 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 261/545] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:38:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:59.297873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:59.449884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13230af-241f-479d-baa7-4eaf9409c985 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:59.498288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:59.499103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:59.499382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:59.499653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:59.514981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:59.516504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:59.538610 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:38:59.540146 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 285/546] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:38:59.545946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:59.700861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4caae-2d7f-40d4-b1cc-0f483e8c79c9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:59.740471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d375b-b75d-41f6-97fb-666160a45b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:59.741166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d375b-b75d-41f6-97fb-666160a45b80 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:59.741447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d375b-b75d-41f6-97fb-666160a45b80 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:59.741719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d375b-b75d-41f6-97fb-666160a45b80 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:59.742443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d375b-b75d-41f6-97fb-666160a45b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:38:59.742743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d375b-b75d-41f6-97fb-666160a45b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:59.744127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d375b-b75d-41f6-97fb-666160a45b80 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:38:59.756286 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 262/547] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:38:59.762086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:38:59.928484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96061d-81cd-4640-b0a9-1a944fcd3db2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:38:59.958333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc633b-be36-4a61-981d-65546f5c8a3e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:59.958663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc633b-be36-4a61-981d-65546f5c8a3e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:59.958884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc633b-be36-4a61-981d-65546f5c8a3e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:59.960571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 263/548] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:38:59.965815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db8eca-b5a1-4043-b531-2b9119f77665 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:59.967209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db8eca-b5a1-4043-b531-2b9119f77665 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:59.968132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db8eca-b5a1-4043-b531-2b9119f77665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:59.972431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:38:59.973899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:38:59.975564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:38:59.976050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:38:59.993006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:38:59.994798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:00.002042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-50db8eca-b5a1-4043-b531-2b9119f77665 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:00.003249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-50db8eca-b5a1-4043-b531-2b9119f77665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:00.010889 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 09 20:39:00.016922 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 286/549] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:38:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:00.018646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:00.126495 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 264/550] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:39:00.158269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db8eca-b5a1-4043-b531-2b9119f77665 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:00.171491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bac3b9-15f0-484e-949d-3eac8e357598 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:00.289968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:00.291059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:00.291551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:00.292019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:00.293082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:00.293592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:00.295232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:00.309767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db8eca-b5a1-4043-b531-2b9119f77665 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:00.345280 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 287/551] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Apr 9 20:39:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:00.354092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:00.360265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:00.361948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:00.362438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:00.362899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:00.375172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:00.382750 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:00.388035 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 265/552] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:00.390623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:00.500752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1d277-8bb8-4879-b604-112db4fb189c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:00.534285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:00.535468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:00.535951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:00.536404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:00.537405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:00.537894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:00.539463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:00.552977 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 266/553] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:00.554481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:00.567372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57800874-5d1f-4819-bf48-8d2e1954c019 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:00.633763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:00.634443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:00.634721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:00.634994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:00.662153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49f75-ce5d-4a9b-93c2-a7a2d6546912 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:00.737864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:00.738706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:00.738986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:00.739260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:00.747729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:00.749636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:00.763455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:00.764953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:00.796435 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:00.797930 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 267/554] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:00.803799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:00.934384 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 288/555] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:00.938236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:00.983058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48265be6-0ad6-40e7-87e9-6b07e2cf65d5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.049670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.050347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.050626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.050894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.051615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:01.051914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.053339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.084686 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 268/556] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:01.089622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.115378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ae92-93f5-4767-88d9-106641bdc2b3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.162657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae8b7-554b-4c66-a543-633af0c407cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.163479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae8b7-554b-4c66-a543-633af0c407cd None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.163762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae8b7-554b-4c66-a543-633af0c407cd None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.164037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae8b7-554b-4c66-a543-633af0c407cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.177441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae8b7-554b-4c66-a543-633af0c407cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.179231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae8b7-554b-4c66-a543-633af0c407cd None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.200908 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f38ae8b7-554b-4c66-a543-633af0c407cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:01.206986 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 289/557] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:01.206986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefe559-cf87-45b5-b072-8893f3328870 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.206986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefe559-cf87-45b5-b072-8893f3328870 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.206986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefe559-cf87-45b5-b072-8893f3328870 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.207565 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 290/558] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:01.208030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2736-547e-4584-adc8-90f028a12c2a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.209337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11934-2061-4929-9f92-bdef21f10cde None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.209829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11934-2061-4929-9f92-bdef21f10cde None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.210183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11934-2061-4929-9f92-bdef21f10cde None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.211637 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 291/559] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:01.212755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd11934-2061-4929-9f92-bdef21f10cde None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.244420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d2bf8-1798-4ace-b7e9-f72e68a7c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.245394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d2bf8-1798-4ace-b7e9-f72e68a7c40f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.245762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d2bf8-1798-4ace-b7e9-f72e68a7c40f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.246131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d2bf8-1798-4ace-b7e9-f72e68a7c40f None admin] PATH_INFO: `/v3/users/nova` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.253353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d2bf8-1798-4ace-b7e9-f72e68a7c40f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.254789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d2bf8-1798-4ace-b7e9-f72e68a7c40f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.268299 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ee2d2bf8-1798-4ace-b7e9-f72e68a7c40f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:39:01.274252 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 269/560] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:01.274252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09961-5608-4f39-a0ff-e600e8e54a03 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.274252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09961-5608-4f39-a0ff-e600e8e54a03 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.274252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09961-5608-4f39-a0ff-e600e8e54a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.288657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5fb09961-5608-4f39-a0ff-e600e8e54a03 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:01.289880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5fb09961-5608-4f39-a0ff-e600e8e54a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:01.317335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd11934-2061-4929-9f92-bdef21f10cde None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.351757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.352707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.352981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.353412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.354292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:01.354410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.355751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.358632 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 270/561] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:01.366659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479890ec-e987-4113-8231-1a0febc694cf None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.367042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479890ec-e987-4113-8231-1a0febc694cf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.367331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479890ec-e987-4113-8231-1a0febc694cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.372922 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 292/562] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:01.372922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.392917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-479890ec-e987-4113-8231-1a0febc694cf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:01.394122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-479890ec-e987-4113-8231-1a0febc694cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:01.477056 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 271/563] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:01.477056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479890ec-e987-4113-8231-1a0febc694cf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.490906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bbc77-a561-4c33-bbbf-4c849c7e0d08 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.523720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.524403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.524687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.524958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.525829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:01.526139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.527595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.548386 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 293/564] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:01.548386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.567445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479890ec-e987-4113-8231-1a0febc694cf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.600364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.601542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.602069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.602549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.609344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.610851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.623984 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:01.630026 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 272/565] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:01.630026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.645580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cdac6-44f9-412f-8d4d-74e65daab454 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.677689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.678502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.678780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.679051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.689904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:01.696831 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:01.698395 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 294/566] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:01.699242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.733063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395f08-1110-4a34-9d72-f0f05b048507 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.764543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526418-2da6-411c-9610-992252e03488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.765375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526418-2da6-411c-9610-992252e03488 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.765658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526418-2da6-411c-9610-992252e03488 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.765932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526418-2da6-411c-9610-992252e03488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.775726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3526418-2da6-411c-9610-992252e03488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:01.782675 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e3526418-2da6-411c-9610-992252e03488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:01.783883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 273/567] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:01.784638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526418-2da6-411c-9610-992252e03488 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.800853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6e515-f2df-4ecb-b028-4e50401d8246 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.832785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.833622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.833928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.834196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.845259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.846747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.863371 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:01.864508 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 295/568] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:01.865467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.880142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526418-2da6-411c-9610-992252e03488 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.912051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c843c76-799f-4bc3-b397-818ac568f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.912737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843c76-799f-4bc3-b397-818ac568f531 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.913004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843c76-799f-4bc3-b397-818ac568f531 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.913399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843c76-799f-4bc3-b397-818ac568f531 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.914173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843c76-799f-4bc3-b397-818ac568f531 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:01.914475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843c76-799f-4bc3-b397-818ac568f531 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:01.915903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843c76-799f-4bc3-b397-818ac568f531 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:01.927824 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 274/569] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:01.929015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5476-8902-42ed-b054-005f4f6e725b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.929299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5476-8902-42ed-b054-005f4f6e725b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.929589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5476-8902-42ed-b054-005f4f6e725b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.930989 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 275/570] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:01.932794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e5476-8902-42ed-b054-005f4f6e725b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:01.960439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23eb4c-aa3e-4d57-8a9b-9a1658acefb1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:01.996998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:01.997696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:01.997968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:01.998239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:01.998972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:01.999272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.000654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.008454 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 296/571] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.009248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.031698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e5476-8902-42ed-b054-005f4f6e725b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.063700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.064394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.064665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.064934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.065702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:02.065999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.067370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.075587 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 276/572] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.076336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.105178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1234c-36c6-43b3-8341-3c1f604f1b13 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.136009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8196944-0f16-4192-a94b-5da1c7ba90b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.136615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196944-0f16-4192-a94b-5da1c7ba90b1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.136925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196944-0f16-4192-a94b-5da1c7ba90b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.137229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196944-0f16-4192-a94b-5da1c7ba90b1 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.137946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196944-0f16-4192-a94b-5da1c7ba90b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:02.138247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196944-0f16-4192-a94b-5da1c7ba90b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.139627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196944-0f16-4192-a94b-5da1c7ba90b1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.150764 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 297/573] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.151964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72df2-d8d6-4ed1-93c6-2d423f3306e1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.152243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72df2-d8d6-4ed1-93c6-2d423f3306e1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.152513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72df2-d8d6-4ed1-93c6-2d423f3306e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.169611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-69f72df2-d8d6-4ed1-93c6-2d423f3306e1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:02.170838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-69f72df2-d8d6-4ed1-93c6-2d423f3306e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:02.175523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da86fa-e7e7-47fd-9b3c-8a3a9bd53440 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.206854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.207503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.207779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.208052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.208919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=c6ff773b27b94f59b97edddcab55716f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:02.209255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.210688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.216414 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 277/574] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/role_assignments?user.id=c6ff773b27b94f59b97edddcab55716f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.217198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.238215 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 298/575] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:02.239476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f72df2-d8d6-4ed1-93c6-2d423f3306e1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.331385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088608-886d-454f-99d8-273a4dc52fe2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.351140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f72df2-d8d6-4ed1-93c6-2d423f3306e1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.367253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.368071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.368348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.368606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.379867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.381598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.385633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.386501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.386718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.386984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.397481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.399377 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:02.399491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.404400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 278/576] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:02.404400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.420758 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:02.422239 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 299/577] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:02.426861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.510803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d317b6a-fa6c-4ba7-b7c2-f7d015a86235 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.529569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cc94-7922-432a-8134-190e6f1e89ef None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.547317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.548104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.548375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.548626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.555647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.557134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.562516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.563487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.563901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.564334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] PATH_INFO: `/v3/roles/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.570300 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:02.571497 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 279/578] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:02.572247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.579537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:02.587361 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:02.589054 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 300/579] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:02.589997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.667732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773595e8-a8c8-43ef-9da1-9d9f809f39e4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.687828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ea4c-5d56-41b0-9276-4df5a5a8c99d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.700419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.701118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.701399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.701671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.702394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:02.702699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.704090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.715929 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 280/580] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.716948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.726082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.726934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.727263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.727674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.728827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:02.729021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.734381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.747243 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 301/581] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.747971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.811844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab4186-9bf8-4bda-b1c4-01c75d3d25d2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.842386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053ac6-c8fa-41a2-a77b-b5f506b22212 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.843812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.844477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.844761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.845061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.845852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:02.846158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.847597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.864195 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 281/582] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.864195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.875963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.876715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.877086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.877365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.878105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:02.878403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.879788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:02.887833 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 302/583] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:02.888842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:02.953558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad2af5-ba4e-47c2-8a41-6e7920e7ae43 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.982557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa6f64-a0e0-4726-b106-d0bbe8630c9f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:02.986091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:02.986893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:02.987166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:02.987432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] PATH_INFO: `/v3/users/glance` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:02.994297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:02.995830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.009402 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 09 20:39:03.013616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.014477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.014759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.015026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.015436 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 282/584] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:03.016180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.023144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.024596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.037838 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 09 20:39:03.043448 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 303/585] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:03.043448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.116433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9f7a7-ec19-43a3-8956-ed89c8740446 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.136876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7ce0c-c080-4b18-a006-0d6bf239b96b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.148286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.149208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.149485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.149754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d3a4c68c9de346219732fa8f9f6df17f/roles/463fc59d1d56462181691eaa570e646f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.164694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=d3a4c68c9de346219732fa8f9f6df17f, role_id=463fc59d1d56462181691eaa570e646f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.166181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.171770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.172690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.172921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.173249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.189437 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 283/586] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:03 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d3a4c68c9de346219732fa8f9f6df17f/roles/463fc59d1d56462181691eaa570e646f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:03.189437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.189727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.189727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.207697 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:03.208881 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 304/587] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:03.209696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.304242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369526b7-cc60-4ca8-b7d2-8d84290dd0cd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.313410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da748c3-f453-4ec8-b4f8-0b7235f566da None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.341579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.342319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.342607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.342863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.343711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:03.344012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.345692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.348078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.348770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.349063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.349430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.350276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:03.350581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.352054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.365476 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 284/588] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:03.366346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.376034 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 305/589] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:03.377019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.479072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e5541-4e2f-4a3d-8d41-3f986b2edff6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.500421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee05557-175b-4189-bee1-4ceb0d081ae8 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.513464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.514206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.514543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.514881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.515661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:03.516027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.517656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.530261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 285/590] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:03.531372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.541868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.542962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.543759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.544212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.557810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.560225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.580294 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:03.586379 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 306/591] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:03.587607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.648533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f1f31-3be7-46a1-bc3a-a5d6034de114 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.681517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a3e12-c38b-4f21-9ec5-e3d943ec7291 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.687256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.688284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.688734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.689227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.701565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.703243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.716299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.717236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.717579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.717910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.721535 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:03.727460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.727460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.727833 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 286/592] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:03.728891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.741879 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 09 20:39:03.743389 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 307/593] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:03.744256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.828087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9005bc-39a4-42c7-a5a1-a28ef92be104 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.841642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f4f3-d442-4575-b191-147dde35ab73 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:03.862792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.863761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.864275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.864767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.865794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:03.866292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.867848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.875083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:03.875968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:03.876102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:03.876335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:03.877076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:03.877387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:03.878781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:03.882255 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 287/594] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:03.883281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.900611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 308/595] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:03.905630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:03.984258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa07bf-1ee5-4a42-8dc3-abe59e89727a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.004397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81ba2-499e-4f49-bce8-c07007ccba08 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.020484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.021590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.022077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.022537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.023578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:04.024074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.025745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.038254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.039061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.039337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.039609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.046091 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 288/596] 10.222.0.30 () {56 vars in 1139 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:04.046878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.047379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.048416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.064125 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:04.070406 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 309/597] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:04.071335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.150838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7f7f-39b4-46fa-82f5-3a0a2d0a49fe None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.182196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d4c4b-23a7-40b6-ba74-e50b3ae22c78 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.184088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.184996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.185391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.185774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.195974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.197513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.211842 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:04.213455 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 289/598] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:04.218416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.225534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.226633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.227108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.227572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.241409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.243600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.265584 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:04.267579 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 310/599] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:04.268838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.321168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33bc6-ed36-47a7-85ca-c67f27c5a76a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.358881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.359691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.360057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.360421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.361417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:04.361794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.363637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.376258 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 290/600] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:04.377314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.387000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e5ca-541b-4af0-bb92-483e396d2781 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.433688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.434314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.434587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.434855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.435652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:04.436007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.437577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.455096 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 311/601] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:04.456133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.504834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b592ae-0181-4c14-8d43-18f3e4daedcf None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.537670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.538253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.538575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.538848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.539563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:04.539852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.541237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.553389 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 291/602] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:04.554326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.577450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6104fe8-5e99-4b43-9e1e-f9f637b6e659 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.609316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.610210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.610482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.610756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/3efd3561844146239d5a9aa46ff7f401/roles/463fc59d1d56462181691eaa570e646f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.625415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=3efd3561844146239d5a9aa46ff7f401, role_id=463fc59d1d56462181691eaa570e646f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.626884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.640335 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 312/603] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:04 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/3efd3561844146239d5a9aa46ff7f401/roles/463fc59d1d56462181691eaa570e646f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:04.641269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.682029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437edff3-8462-436f-b5bc-4ebe25a167a2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.733691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216da0f-b1fa-4081-92fc-fcb52a002313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.735564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216da0f-b1fa-4081-92fc-fcb52a002313 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.736058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216da0f-b1fa-4081-92fc-fcb52a002313 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.736511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216da0f-b1fa-4081-92fc-fcb52a002313 None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/6504d578b1b64feb93ba69d947a971e9/roles/463fc59d1d56462181691eaa570e646f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.753441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7300a-dd83-411f-959e-6787bc3e7dd2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:04.758447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216da0f-b1fa-4081-92fc-fcb52a002313 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=6504d578b1b64feb93ba69d947a971e9, role_id=463fc59d1d56462181691eaa570e646f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.760217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216da0f-b1fa-4081-92fc-fcb52a002313 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.780580 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 292/604] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:04 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/6504d578b1b64feb93ba69d947a971e9/roles/463fc59d1d56462181691eaa570e646f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:04.782383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4709-30e9-4dac-8eee-73218cc3fccc None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.782877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4709-30e9-4dac-8eee-73218cc3fccc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.783351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4709-30e9-4dac-8eee-73218cc3fccc None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.785409 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 293/605] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:04.795726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16aa7-cd7b-4f17-80fa-c54f17c22aae None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.795726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16aa7-cd7b-4f17-80fa-c54f17c22aae None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.795726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16aa7-cd7b-4f17-80fa-c54f17c22aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.815073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-78e16aa7-cd7b-4f17-80fa-c54f17c22aae None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:04.816549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78e16aa7-cd7b-4f17-80fa-c54f17c22aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:04.822846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:04.823681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:04.823955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:04.824222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:04.842914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:04.844429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:04.862263 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:04.864476 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 313/606] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:04.870476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:04.904800 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 294/607] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:04.932046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16aa7-cd7b-4f17-80fa-c54f17c22aae None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:05.007926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d6e88-80b6-41e7-9545-2cabb9d7137c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:05.063555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:05.064262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.064903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.065218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.066322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:05.066633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:05.068612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:05.085543 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 314/608] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:05.087436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16aa7-cd7b-4f17-80fa-c54f17c22aae None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:05.091535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:05.138634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:05.139449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.139721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.139986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.166415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:05.182316 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:05.183931 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 295/609] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:05.204678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:05.207162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604ce9-b667-4d48-97b0-f731bdf38085 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:05.247288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:05.251354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.251642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.251919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/504db2ec734c46999530ed037dc0330c/roles/463fc59d1d56462181691eaa570e646f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.268826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=504db2ec734c46999530ed037dc0330c, role_id=463fc59d1d56462181691eaa570e646f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:05.270343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:05.290270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 315/610] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:05 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/504db2ec734c46999530ed037dc0330c/roles/463fc59d1d56462181691eaa570e646f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:05.396433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1ccc6-6db4-4ad6-90d6-d367ce7d7b92 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:05.439461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:05.440165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.440443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.440713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.441752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:05.442139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:05.443571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:05.459059 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 296/611] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:05.465259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:05.602771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcc90f-6edd-4947-bf9b-fc46fb28593d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:05.637549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:05.638359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.638636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.638906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.649376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:05.650796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:05.668857 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:05.670394 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 316/612] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:05.676163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:05.795396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fc084-e69a-43c0-a11c-25da641abaa0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:05.827889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0467-b2d7-4749-9309-1570d47c1926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:05.828556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0467-b2d7-4749-9309-1570d47c1926 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.828833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0467-b2d7-4749-9309-1570d47c1926 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.829131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0467-b2d7-4749-9309-1570d47c1926 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.829861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0467-b2d7-4749-9309-1570d47c1926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:05.830161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0467-b2d7-4749-9309-1570d47c1926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:05.831528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0467-b2d7-4749-9309-1570d47c1926 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:05.848346 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 297/613] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:05.854238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:05.878469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842d17-1262-4d2a-83c1-bc8a456d631d None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.878788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842d17-1262-4d2a-83c1-bc8a456d631d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.879007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842d17-1262-4d2a-83c1-bc8a456d631d None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.880670 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 298/614] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:05.885750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b67053-083a-4b3c-b06a-de05cbd10ab2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:05.886031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b67053-083a-4b3c-b06a-de05cbd10ab2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:05.886306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b67053-083a-4b3c-b06a-de05cbd10ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:05.904263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-24b67053-083a-4b3c-b06a-de05cbd10ab2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:05.905415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24b67053-083a-4b3c-b06a-de05cbd10ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:05.977283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 299/615] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:39:06.005381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b67053-083a-4b3c-b06a-de05cbd10ab2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.031159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800fc19-28b3-4954-9036-588448006d78 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.105865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.106678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.106951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.107218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.121534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b67053-083a-4b3c-b06a-de05cbd10ab2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.122894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:06.124376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:06.148643 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 09 20:39:06.154697 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 317/616] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:06.155814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.171213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.172028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.172307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.172577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.183563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:06.190501 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:06.192137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 300/617] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:06.206003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.284791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2225a-d31b-4a33-80ca-f1062b9f7c24 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.318129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.318812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.319625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.319906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.320745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:06.321063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:06.322521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:06.345698 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 318/618] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:06.351870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.409158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9921a3-792c-48c6-86da-264aeb1f275c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.462983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024caaa-fc9f-4a0e-ae68-09b827d7a56d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.466337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.467036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.467316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.467592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.468355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:06.468656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:06.470094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:06.488494 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 301/619] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:06.499053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.501332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.502251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.502529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.502803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.514849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:06.516342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:06.533195 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:06.534801 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 319/620] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:06.540917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.667990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809da3-20d9-4416-a0b0-9b961dca69f5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.678895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd6f98-bb2f-4ae2-ab5c-3cea81a61db0 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.713205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.713874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.714154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.714426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.715141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:06.715440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:06.716825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:06.735759 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 320/621] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:06.737140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.754532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c97c03-3444-4914-a722-def86531e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.755482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c97c03-3444-4914-a722-def86531e36f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.755761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c97c03-3444-4914-a722-def86531e36f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.756032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c97c03-3444-4914-a722-def86531e36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.783657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c97c03-3444-4914-a722-def86531e36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:06.785225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c97c03-3444-4914-a722-def86531e36f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:06.813619 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-21c97c03-3444-4914-a722-def86531e36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:06.821503 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 302/622] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:06.826670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c97c03-3444-4914-a722-def86531e36f None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.838483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cd266-22b9-46d2-a0e4-0e1efed83eca None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:06.876204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:06.877015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:06.877315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:06.877584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:06.884378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:06.885882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:06.899696 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:06.913071 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 321/623] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:06.913071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:06.976165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c97c03-3444-4914-a722-def86531e36f None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:07.009953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:07.010959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.011426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.011910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.012811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:07.013342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:07.013914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c309db-fb02-4915-a282-f494b17be510 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:07.015120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:07.027394 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 303/624] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:07.038101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:07.057061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:07.057061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.057061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.057061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.057765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:07.057765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:07.057765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:07.074600 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 322/625] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:07.075851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:07.173275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b1c0-d5d9-4fac-8c5d-9546e9e860ea None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:07.205871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:07.206773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.207045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.207309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/c6ff773b27b94f59b97edddcab55716f/roles/463fc59d1d56462181691eaa570e646f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.223334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=c6ff773b27b94f59b97edddcab55716f, role_id=463fc59d1d56462181691eaa570e646f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:07.224899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:07.254095 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 323/626] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:07 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/c6ff773b27b94f59b97edddcab55716f/roles/463fc59d1d56462181691eaa570e646f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:39:07.259737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148b3d2-b2cc-4e48-b71a-dbdfeaa8a0d0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:07.306481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:07.307356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.307740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.308078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.320204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:07.321701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:07.339441 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:39:07.345272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 304/627] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:39:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:07.346577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:07.462663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8b403-804a-41fe-a3b8-ced44f20f199 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:07.497574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03456-62a5-41f6-9e86-79b6eadd71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:07.498258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03456-62a5-41f6-9e86-79b6eadd71bc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.498535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03456-62a5-41f6-9e86-79b6eadd71bc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.498807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03456-62a5-41f6-9e86-79b6eadd71bc None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.499641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03456-62a5-41f6-9e86-79b6eadd71bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:07.499942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03456-62a5-41f6-9e86-79b6eadd71bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:07.501462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03456-62a5-41f6-9e86-79b6eadd71bc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:07.521000 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 324/628] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:39:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:07.526225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:07.650258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bc23b-f521-48c5-8ba2-bf08117017d2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:07.685316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:07.685971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.686245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.686507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.694095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9321-de93-47d8-9626-2702cd43086f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.694379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9321-de93-47d8-9626-2702cd43086f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.694657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9321-de93-47d8-9626-2702cd43086f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.696030 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 325/629] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:07.701240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72d5ad-0233-40ae-b4b6-5ac9a54ae3e0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.701527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72d5ad-0233-40ae-b4b6-5ac9a54ae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.701804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72d5ad-0233-40ae-b4b6-5ac9a54ae3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.730466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aa72d5ad-0233-40ae-b4b6-5ac9a54ae3e0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:07.731665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aa72d5ad-0233-40ae-b4b6-5ac9a54ae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:07.766544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:07.768080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:07.802840 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 326/630] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:07.804161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a14ec-ee1f-4c8b-90bb-8cb4da1019e7 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.804445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a14ec-ee1f-4c8b-90bb-8cb4da1019e7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.804720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a14ec-ee1f-4c8b-90bb-8cb4da1019e7 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.813597 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 327/631] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:07.819295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221df5ca-12b3-4e2b-a8db-492ef1fc70ed None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:07.819588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221df5ca-12b3-4e2b-a8db-492ef1fc70ed None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:07.819859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221df5ca-12b3-4e2b-a8db-492ef1fc70ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:07.844487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-221df5ca-12b3-4e2b-a8db-492ef1fc70ed None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:07.845837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-221df5ca-12b3-4e2b-a8db-492ef1fc70ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:07.871690 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 305/632] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:07.872774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:07.916626 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 328/633] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:07.917514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221df5ca-12b3-4e2b-a8db-492ef1fc70ed None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:07.976078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa2671-5f60-4fe6-a4b8-3c430bb31869 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.009982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.011485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.011902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.012308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.021804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221df5ca-12b3-4e2b-a8db-492ef1fc70ed None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.023160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:08.030372 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:08.036674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 306/634] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:08.037701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.055434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.056227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.056530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.056887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.067419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.068888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.086281 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:08.087880 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 329/635] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:08.088863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.140869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf8c99-d8ab-4e82-8142-2539b81731d7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.174607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.175747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.176186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.176594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.185771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea159a-cfa4-46d8-9fe6-c5e87875eb38 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.187542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:08.194807 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:08.196548 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 307/636] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:08.197673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.220010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.220449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.220726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.220998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.221770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:08.222072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.223459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.233112 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 330/637] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:08.233112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.302180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498ece-7039-4716-88ed-efb8dc717ec9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.328982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f591-e03f-4d63-a7d2-ba3f4cb8806d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.334965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.335659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.335936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.336520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.337261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:08.337564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.339060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.359616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 308/638] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:08.359616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.366042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825c52f-6149-4cfd-8dc5-3dafbcbc0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.366756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c52f-6149-4cfd-8dc5-3dafbcbc0c87 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.367034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c52f-6149-4cfd-8dc5-3dafbcbc0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.367307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c52f-6149-4cfd-8dc5-3dafbcbc0c87 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.368051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825c52f-6149-4cfd-8dc5-3dafbcbc0c87 None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:08.368352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825c52f-6149-4cfd-8dc5-3dafbcbc0c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.369788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825c52f-6149-4cfd-8dc5-3dafbcbc0c87 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.383509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 331/639] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:08.384894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63019d-5689-43f6-86c6-b66e73fb41ca None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.385205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63019d-5689-43f6-86c6-b66e73fb41ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.385478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63019d-5689-43f6-86c6-b66e73fb41ca None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.386811 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 332/640] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:08.387533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63019d-5689-43f6-86c6-b66e73fb41ca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.468345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9d52-2f33-43f4-8c42-c894035b2eca None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.489673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63019d-5689-43f6-86c6-b66e73fb41ca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.501398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.502197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.502479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.502747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.513421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.514866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.522240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f74e-8b23-4a52-8507-38aaf5e08d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.523354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f74e-8b23-4a52-8507-38aaf5e08d83 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.523817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f74e-8b23-4a52-8507-38aaf5e08d83 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.524213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f74e-8b23-4a52-8507-38aaf5e08d83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.531384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774f74e-8b23-4a52-8507-38aaf5e08d83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.531693 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:08.537666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774f74e-8b23-4a52-8507-38aaf5e08d83 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.537785 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 309/641] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:08.537785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.550694 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-1774f74e-8b23-4a52-8507-38aaf5e08d83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:08.556322 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 333/642] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:08.556322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb7f9-982a-4140-90c4-b0a4e7842910 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.556322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb7f9-982a-4140-90c4-b0a4e7842910 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.556322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb7f9-982a-4140-90c4-b0a4e7842910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.572752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ec8cb7f9-982a-4140-90c4-b0a4e7842910 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:08.573988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec8cb7f9-982a-4140-90c4-b0a4e7842910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:08.636832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930dd02-da1b-4c55-b880-ee378559eb96 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.649346 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 334/643] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:08.649346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cb7f9-982a-4140-90c4-b0a4e7842910 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.681548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.682346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.682620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.682884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.692723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.694217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.710626 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:08.716842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 310/644] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:08.717837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.747348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cb7f9-982a-4140-90c4-b0a4e7842910 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.780328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.781005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.781318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.781599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.782319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:08.782626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.784023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.799222 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 335/645] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:08.799222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.817544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e46d5-a8cc-4be0-9e2c-6ced496594c0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.854197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.854861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.855138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.855409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.856192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:08.856495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:08.857963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:08.874238 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 311/646] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:08.874238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.896110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13c4ae-249c-4015-ae9b-d224768842da None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:08.929227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:08.930209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:08.930652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:08.930901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] PATH_INFO: `/v3/roles/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:08.940942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:08.947937 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:08.953090 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 336/647] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:08.953090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:08.978822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b30326-e8df-4145-a2bc-449e6db2607d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.013364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.014044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.014325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.014596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.015316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:09.015623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.016998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.028762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 312/648] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:09.029606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.050085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f1dc-58e7-40c8-9e06-7ffc5709b3df None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.083259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.084075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.084335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.084627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.092475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.094040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.107139 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 09 20:39:09.112941 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 337/649] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:09.113572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.126249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b945a-49d5-48de-8480-a2455002a420 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.159687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.160271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.160548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.161018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.161743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d3a4c68c9de346219732fa8f9f6df17f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:09.162052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.163541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.177295 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 313/650] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/role_assignments?user.id=d3a4c68c9de346219732fa8f9f6df17f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:09.177295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.221796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f2ab1-b44d-4421-b9bc-a6f310af825b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.260222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.261025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.261422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.261767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.262664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:09.263042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.264627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.278855 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 338/651] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:09.279920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.298321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4b575-a288-4221-a716-26cfa65bb2d3 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.333856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.334725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.335010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.335282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.344181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.345730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.360290 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 09 20:39:09.361936 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 314/652] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:09.362744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.399274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d6c3-7a14-4a89-9341-60c39ebf70f8 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.445336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.446294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.446576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.446851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.448816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:09.449697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.450724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.474853 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 339/653] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:09.476111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.497985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d42cc-6372-4ebc-b3ae-e05e406f28b1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.539838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.540919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.541233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.541501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.555690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.558133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.577497 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:09.579448 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 315/654] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:09.580824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.589350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db8627-d124-428a-84a8-e94dc0347a5e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.631787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.632874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.633192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.633724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.634567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:09.635020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.636785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.657399 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 340/655] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:09.658246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.701970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e7f89-c21d-422d-bdcc-d4aec42dc6d1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.735435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.736351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.736780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.737217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.759985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cde00e-ea78-4ad9-a5d7-ecf3b4c33f24 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.792828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.793751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.794264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.794671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:09.795596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:09.796033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.797640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.809358 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 341/656] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:09.810516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.816203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:09.818004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:09.914167 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 316/657] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:09.915331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:09.928336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361847-6aac-4eec-8a0c-6d161d8fa6d8 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:09.967211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:09.967798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:09.968077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:09.968348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.010929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13524a46-1131-4ae5-baea-921f94f76b49 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.032382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.033984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.044220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5716-1a29-44f9-98a0-5e566d2b3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.045028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5716-1a29-44f9-98a0-5e566d2b3534 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.045332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5716-1a29-44f9-98a0-5e566d2b3534 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.045605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5716-1a29-44f9-98a0-5e566d2b3534 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.052832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a5716-1a29-44f9-98a0-5e566d2b3534 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.054322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a5716-1a29-44f9-98a0-5e566d2b3534 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.068254 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ae7a5716-1a29-44f9-98a0-5e566d2b3534 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 09 20:39:10.073326 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 317/658] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:10.074595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141dd76-43f0-425f-a56e-38a079488b62 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.074874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141dd76-43f0-425f-a56e-38a079488b62 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.075331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141dd76-43f0-425f-a56e-38a079488b62 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.076532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 318/659] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:10.077106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141dd76-43f0-425f-a56e-38a079488b62 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.134167 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 342/660] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:10.135021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.179992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141dd76-43f0-425f-a56e-38a079488b62 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.212369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d0e40-3f79-4a0c-a0b2-7827e49295df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.213196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0e40-3f79-4a0c-a0b2-7827e49295df None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.213470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0e40-3f79-4a0c-a0b2-7827e49295df None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.213737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0e40-3f79-4a0c-a0b2-7827e49295df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.223758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d0e40-3f79-4a0c-a0b2-7827e49295df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.225172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d0e40-3f79-4a0c-a0b2-7827e49295df None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.236028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7e80-ce1c-4e4f-bddb-721117fbac34 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.242224 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-145d0e40-3f79-4a0c-a0b2-7827e49295df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:10.243549 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 319/661] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:10.244732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9bb9c-1cf5-4646-bd0e-ee80d4f9baf2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.244920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9bb9c-1cf5-4646-bd0e-ee80d4f9baf2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.245219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9bb9c-1cf5-4646-bd0e-ee80d4f9baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.262149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7aa9bb9c-1cf5-4646-bd0e-ee80d4f9baf2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:10.263359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7aa9bb9c-1cf5-4646-bd0e-ee80d4f9baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:10.272681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.273752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.274032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.274296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.275239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:10.275573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.277067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.294564 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 343/662] 10.222.0.30 () {56 vars in 1139 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:10.295184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.333810 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 320/663] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:10.334642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9bb9c-1cf5-4646-bd0e-ee80d4f9baf2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.416159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8892cb-ed6c-4d1b-b8b4-6c1165bd6945 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.427961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9bb9c-1cf5-4646-bd0e-ee80d4f9baf2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.450711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.451521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.451795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.452061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.462310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.463794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.469436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.470283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.470562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.470833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.471554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:10.471859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.473235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.480496 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:10.486117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 344/664] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:10.486117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.493159 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 321/665] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:10.493159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.577922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032af51-bb73-4fcd-acfa-e93334724b8b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.588756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fd33-9cd0-4b6c-b9a0-272d28770e7b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.612167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.612925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.613263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.613534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.622933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.623716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.623995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.624262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.635419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:10.644745 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:10.651009 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 322/666] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:10.651009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.679292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.680743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.748004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d98da-b529-41aa-9e2c-e5ed2e0686e3 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.773548 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 345/667] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:10.774561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.781477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.782152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.782449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.782705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.783419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:10.783721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.785116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.796935 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 323/668] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:10.797908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.874482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482ef43-0fc0-49b3-a26c-b5fb7f874b57 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.896240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1383-b94d-4272-9a82-ee04ad2fff48 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:10.906440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.907252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.907530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.907800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.914558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.916028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.928896 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:10.929256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:10.929927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:10.934868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:10.934986 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 346/669] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:10.935087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:10.935160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:10.935227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:10.935227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:10.935227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:10.941224 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 324/670] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:10.945853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.029800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe4b9d-a745-46a9-b8d8-4d20727c3abe None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.040493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184aafb5-0a8c-49bc-8b3d-88f5d5e7ea63 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.062819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.063628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.063907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.064176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.072228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.073135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.073416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.073688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.074228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.075734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.080307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.081753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.093255 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:11.098987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 347/671] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:11.099127 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:11.099206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.099283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 325/672] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:11.102111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.196056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3b09b-689f-4fb9-b26c-40066c67a6f7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.197655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc03a1-fef8-4e6e-8c5b-6dfa2c115060 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.230167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.230392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.230908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.231005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.231183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.231277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.231450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.231541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.232220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:11.232525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.234022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.241652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.243290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.250290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 348/673] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:11.250290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.260951 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:11.262273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 326/674] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:11.262954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.348944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1de68c-0110-443f-b483-ebbe5e1c0dbf None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.360915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fc15a-3587-4a93-bcad-315aa79fc22c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.381659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.382332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.382609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.382879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.383590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:11.383883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.385316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.394412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.395105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.395380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.395649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.396426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:11.396727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.398204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.401559 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 349/675] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:11.402221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.414546 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 327/676] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:11.414546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.497574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd6fd9-506f-4742-873b-61b9b84de415 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.517853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36143c6-850f-4940-b3d6-7050e218b836 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.529587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.530245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.530528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.530784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.531622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=6504d578b1b64feb93ba69d947a971e9) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:11.531920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.533428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.549078 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 350/677] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/role_assignments?user.id=6504d578b1b64feb93ba69d947a971e9&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:11.549078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.563815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.564791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.565095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.565372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.566676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:11.567050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.568931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.585163 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 328/678] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:11.586492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.652206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b450-28bd-44bf-ac7e-0297317ba2ba None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.690335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.691487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.691770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.692223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.700948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.702462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.715031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3629be8-7c53-4957-a74d-52555cd8a949 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.718204 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:11.720580 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 351/679] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:11.720703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.750944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d90e-3e1c-4b22-bca0-80b64d31dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.751600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d90e-3e1c-4b22-bca0-80b64d31dc1d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.751870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d90e-3e1c-4b22-bca0-80b64d31dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.753396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d90e-3e1c-4b22-bca0-80b64d31dc1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.753396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210d90e-3e1c-4b22-bca0-80b64d31dc1d None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=3efd3561844146239d5a9aa46ff7f401) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:11.753396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210d90e-3e1c-4b22-bca0-80b64d31dc1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.754737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210d90e-3e1c-4b22-bca0-80b64d31dc1d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.760759 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 329/680] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/role_assignments?user.id=3efd3561844146239d5a9aa46ff7f401&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:11.761860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df458af-ac17-4ccb-a8d0-215da611fe8e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.762140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df458af-ac17-4ccb-a8d0-215da611fe8e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.762412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df458af-ac17-4ccb-a8d0-215da611fe8e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.763627 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 330/681] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:11.764304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df458af-ac17-4ccb-a8d0-215da611fe8e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.838732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87867-2c25-45ec-9c41-25037b197013 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.881104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df458af-ac17-4ccb-a8d0-215da611fe8e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:11.882985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77471b1f-bc7c-44f9-8388-1e2dd2bbddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.883826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77471b1f-bc7c-44f9-8388-1e2dd2bbddf2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.884102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77471b1f-bc7c-44f9-8388-1e2dd2bbddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.884367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77471b1f-bc7c-44f9-8388-1e2dd2bbddf2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.892358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77471b1f-bc7c-44f9-8388-1e2dd2bbddf2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.895222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77471b1f-bc7c-44f9-8388-1e2dd2bbddf2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.909865 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-77471b1f-bc7c-44f9-8388-1e2dd2bbddf2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 09 20:39:11.911472 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 352/682] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:11.912776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6807c8-7d42-4bb4-a8d1-d945bd1f0a30 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.917126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6807c8-7d42-4bb4-a8d1-d945bd1f0a30 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.917533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6807c8-7d42-4bb4-a8d1-d945bd1f0a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.925757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:11.926568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:11.926846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:11.927118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:11.927912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:11.928213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:11.929727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:11.942014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1f6807c8-7d42-4bb4-a8d1-d945bd1f0a30 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:11.942478 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 331/683] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:11.943331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:11.944217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f6807c8-7d42-4bb4-a8d1-d945bd1f0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:12.018440 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 353/684] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:12.019633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6807c8-7d42-4bb4-a8d1-d945bd1f0a30 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.042355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251ec0-8002-4cee-98ad-bfdd84071326 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.076368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.077094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.077349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.077605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.078436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:12.078740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.080178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.098415 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 332/685] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Apr 9 20:39:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:12.099087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.134767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6807c8-7d42-4bb4-a8d1-d945bd1f0a30 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.175944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.176564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.176846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.177152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.177999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=504db2ec734c46999530ed037dc0330c) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:12.178643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.180425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.187988 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 354/686] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/role_assignments?user.id=504db2ec734c46999530ed037dc0330c&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:12.188789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.207289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa791-45fc-44d5-9f7c-836bce2e2562 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.251672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.252497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.252790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.253399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.268034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:12.275375 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:39:12.276821 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 333/687] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:12.282577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.330906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf680-5535-4e85-8e2f-0f3e542e5aef None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.394648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.395430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.395704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.395972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.465243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234693a-bf24-44b8-a1f7-cea80a4f54f8 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.508958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.510049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.510524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.510988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.511089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.512083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:12.512468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.512791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.514353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.524675 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 334/688] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:12.530383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.629067 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 355/689] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:12.632888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73b130-311d-489a-894d-4bb3218876d6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.635269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.669300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.670025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.670298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.670565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.681418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.682925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.699695 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:12.701286 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 335/690] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:12.708119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.757842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2419544-8b92-4b7a-b999-01d68da2447c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.797772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.798580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.798855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.799122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.809965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.811452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.813102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7522197-7a84-4216-92e7-5ee4c1f459f5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.828899 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:12.830490 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 356/691] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:12.838973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.860629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.861613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.862037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.862449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.863566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:12.864041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.865612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.887135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 336/692] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:12.892758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:12.944109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56745dd-4acf-41d3-ae0b-49fafad277b5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:12.978892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:12.980088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:12.980478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:12.980844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:12.981970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:12.982369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:12.984738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:12.991796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914129-1acb-4752-a8a3-d7f68b394725 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:13.001494 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 357/693] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:13.008077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:13.033999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:13.035073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:13.035539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:13.035949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:13.043580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:13.045287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:13.062604 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:39:13.064423 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 337/694] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:39:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:13.070170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:13.117648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caba1c-4d23-4f95-83e2-2e1cb2c130f0 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:13.150364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:13.151426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:13.151768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:13.152450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:13.168701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:13.171457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:13.190687 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:13.192588 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 358/695] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:13.198299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:13.199497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83874-7b5d-4bda-afc3-ae0394a19455 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:13.258927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:13.259523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:13.259802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:13.260077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:13.265672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:13.265987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:13.267449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:13.286757 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 338/696] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:39:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:13.292212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:13.370597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1395f0-62f4-40a1-b397-9b72c39cd45c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:13.430726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:13.431665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:13.432085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:13.432497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:13.433449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:13.433891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:13.440823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:13.460377 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 359/697] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:13.467630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7550f-fd00-4db1-9a58-a4c6b6a6b2c2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:13.469874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:13.525965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:13.526537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:13.526814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:13.527084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:13.629478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743144-e23a-438c-a461-02bf368c67a4 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:13.631702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:13.633217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:13.694219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f36e3-57da-455a-8112-557111331c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:13.694889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f36e3-57da-455a-8112-557111331c1f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:13.695167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f36e3-57da-455a-8112-557111331c1f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:13.695439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f36e3-57da-455a-8112-557111331c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:13.696271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f36e3-57da-455a-8112-557111331c1f None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=c6ff773b27b94f59b97edddcab55716f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:13.696574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f36e3-57da-455a-8112-557111331c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:13.698066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f36e3-57da-455a-8112-557111331c1f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:13.711423 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 360/698] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:13 2022] GET /identity/v3/role_assignments?user.id=c6ff773b27b94f59b97edddcab55716f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:13.803408 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 339/699] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:13.809141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f36e3-57da-455a-8112-557111331c1f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:13.943885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f36e3-57da-455a-8112-557111331c1f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:13.978674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:13.979484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:13.979762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:13.980031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:13.990955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:13.992432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:14.009689 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:14.011220 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 361/700] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:14.016730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:14.118357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5efc9e-a65a-4ae0-8704-c45b5a9d7ca8 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:14.152718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2110d76-1bbd-49ed-9f58-374dcaa7140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:14.153447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2110d76-1bbd-49ed-9f58-374dcaa7140c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.153730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2110d76-1bbd-49ed-9f58-374dcaa7140c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.154001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2110d76-1bbd-49ed-9f58-374dcaa7140c None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.154740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2110d76-1bbd-49ed-9f58-374dcaa7140c None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:14.155039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2110d76-1bbd-49ed-9f58-374dcaa7140c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:14.156428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2110d76-1bbd-49ed-9f58-374dcaa7140c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:14.168140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 340/701] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:14.173589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:14.277855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb6020-2ff7-475b-94ae-5e9bdf57b962 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:14.313022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:14.313905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.314186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.314457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.322152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:14.323523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a4451-4917-4ab9-a36f-4e4e6a909235 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.323969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:14.324055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a4451-4917-4ab9-a36f-4e4e6a909235 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.324055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a4451-4917-4ab9-a36f-4e4e6a909235 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.325462 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 341/702] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:14.330436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495ddf-6bc3-433c-9fd8-e2ac27a938f0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.330723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495ddf-6bc3-433c-9fd8-e2ac27a938f0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.331001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495ddf-6bc3-433c-9fd8-e2ac27a938f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.338342 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:14.339830 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 362/703] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:14.345272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:14.358597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4d495ddf-6bc3-433c-9fd8-e2ac27a938f0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:14.359796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4d495ddf-6bc3-433c-9fd8-e2ac27a938f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:14.489062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d9908-297a-428a-8e81-ccdfc624394a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:14.494644 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 342/704] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:39:14.532149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:14.532831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.533149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.533422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.534209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:14.534512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:14.536118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:14.547201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495ddf-6bc3-433c-9fd8-e2ac27a938f0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:14.548260 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 363/705] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:14.554708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:14.711487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495ddf-6bc3-433c-9fd8-e2ac27a938f0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:14.729162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88bf4-11dc-4cfd-84d5-e4c9298c46ce None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:14.764887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2039b2-6def-454e-807c-44fadf435219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:14.765903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2039b2-6def-454e-807c-44fadf435219 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.766011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2039b2-6def-454e-807c-44fadf435219 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.766249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2039b2-6def-454e-807c-44fadf435219 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.766892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2039b2-6def-454e-807c-44fadf435219 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:14.768244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2039b2-6def-454e-807c-44fadf435219 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:14.775360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e57b58-cab8-4c93-a9d3-52a9b234c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:14.776462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e57b58-cab8-4c93-a9d3-52a9b234c43d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.777132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e57b58-cab8-4c93-a9d3-52a9b234c43d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.777640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e57b58-cab8-4c93-a9d3-52a9b234c43d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.778654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e57b58-cab8-4c93-a9d3-52a9b234c43d None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d3a4c68c9de346219732fa8f9f6df17f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:14.779151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e57b58-cab8-4c93-a9d3-52a9b234c43d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:14.780793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e57b58-cab8-4c93-a9d3-52a9b234c43d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:14.781616 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-dd2039b2-6def-454e-807c-44fadf435219 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 09 20:39:14.783587 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 343/706] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:14.784839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba783-f023-4212-8ce9-4da5076b16fb None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.785153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba783-f023-4212-8ce9-4da5076b16fb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.785457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba783-f023-4212-8ce9-4da5076b16fb None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.790753 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 344/707] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:14.790753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ba783-f023-4212-8ce9-4da5076b16fb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:14.792873 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 364/708] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/role_assignments?user.id=d3a4c68c9de346219732fa8f9f6df17f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:14.794607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99dd34-76e1-403b-94dc-c40cdeced643 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.795093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99dd34-76e1-403b-94dc-c40cdeced643 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.795573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99dd34-76e1-403b-94dc-c40cdeced643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.814119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ff99dd34-76e1-403b-94dc-c40cdeced643 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:14.815698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ff99dd34-76e1-403b-94dc-c40cdeced643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:14.897684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ba783-f023-4212-8ce9-4da5076b16fb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:14.898079 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 365/709] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:39:14.935739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:14.936552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:14.936836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:14.937143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:14.937898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:14.938201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:14.939801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:14.945835 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 345/710] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:14.947448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99dd34-76e1-403b-94dc-c40cdeced643 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:14.951203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:15.079683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65e9ff-b248-4e8b-b074-5ebcc5d48f44 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:15.091825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99dd34-76e1-403b-94dc-c40cdeced643 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:15.114981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:15.115654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.120038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.120038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.120038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:15.120038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:15.120038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:15.124561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 346/711] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:15.137851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:15.139095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.139569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.140031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.159450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:15.161447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:15.179728 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:15.185166 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 366/712] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:15.188147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:15.312319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4322cef-145c-48b8-8c3e-99817b3934d2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:15.347235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b79a-8b55-4d9f-915a-2be4dadc1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:15.347908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b79a-8b55-4d9f-915a-2be4dadc1db6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.348156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b79a-8b55-4d9f-915a-2be4dadc1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.348419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b79a-8b55-4d9f-915a-2be4dadc1db6 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.349183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b79a-8b55-4d9f-915a-2be4dadc1db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:15.349488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b79a-8b55-4d9f-915a-2be4dadc1db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:15.350866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b79a-8b55-4d9f-915a-2be4dadc1db6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:15.363679 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 347/713] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:15.369384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:15.394715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead142bb-0227-42fb-8549-23e83255e039 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.395035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead142bb-0227-42fb-8549-23e83255e039 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.395285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead142bb-0227-42fb-8549-23e83255e039 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.400956 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 348/714] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:15.402447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987795-719a-474b-afe0-82d669d7995b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.402728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987795-719a-474b-afe0-82d669d7995b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.402998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987795-719a-474b-afe0-82d669d7995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.424302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-56987795-719a-474b-afe0-82d669d7995b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:15.425535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-56987795-719a-474b-afe0-82d669d7995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:15.504244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 349/715] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:39:15.519422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f63d-1f2f-4fd3-a89f-07361dca3b40 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:15.527374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987795-719a-474b-afe0-82d669d7995b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:15.571370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:15.572109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.572391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.572691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.573431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:15.574904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:15.603466 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 367/716] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:39:15 2022] POST /identity/v3/users => generated 254 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:15.680590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987795-719a-474b-afe0-82d669d7995b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:15.733919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:15.734752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.735031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.735301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] PATH_INFO: `/v3/services/network` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.735962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:15.737380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:15.749202 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 09 20:39:15.750866 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 350/717] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:15 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:15.756623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:15.896625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e209a-b32d-40a3-86ff-1e8f384e0ffc None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:15.942665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb1d21-8c52-400c-9c72-ada2e3d08da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:15.943347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb1d21-8c52-400c-9c72-ada2e3d08da1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:15.943623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb1d21-8c52-400c-9c72-ada2e3d08da1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:15.943887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb1d21-8c52-400c-9c72-ada2e3d08da1 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:15.944593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb1d21-8c52-400c-9c72-ada2e3d08da1 None admin] RBAC: Adding query filter params (name=network) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:15.944891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb1d21-8c52-400c-9c72-ada2e3d08da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:15.946317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb1d21-8c52-400c-9c72-ada2e3d08da1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:15.951257 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 368/718] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:15.956370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:16.060992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5ce8-c8ca-48d1-9317-715c67207637 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:16.097582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157805ad-3387-4342-86ba-3c137dacc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:16.098628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157805ad-3387-4342-86ba-3c137dacc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:16.099088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157805ad-3387-4342-86ba-3c137dacc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:16.099524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157805ad-3387-4342-86ba-3c137dacc0d0 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:16.100392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157805ad-3387-4342-86ba-3c137dacc0d0 None admin] RBAC: Adding query filter params (type=network) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:16.100875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157805ad-3387-4342-86ba-3c137dacc0d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:16.102421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157805ad-3387-4342-86ba-3c137dacc0d0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:16.107624 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 351/719] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:17.129479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445ca62-e52f-458d-ac14-2bd7cb89fd60 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:17.130489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445ca62-e52f-458d-ac14-2bd7cb89fd60 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:17.130995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445ca62-e52f-458d-ac14-2bd7cb89fd60 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:17.132823 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 369/720] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:17.137635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7089-0337-4aa9-95ab-892576f519bc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:17.138418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7089-0337-4aa9-95ab-892576f519bc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:17.138911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7089-0337-4aa9-95ab-892576f519bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:17.161998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f3ba7089-0337-4aa9-95ab-892576f519bc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:17.163504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f3ba7089-0337-4aa9-95ab-892576f519bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:17.234586 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 352/721] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:17.279210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445ca62-e52f-458d-ac14-2bd7cb89fd60 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:17.405917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445ca62-e52f-458d-ac14-2bd7cb89fd60 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:17.454343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:17.455172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:17.455537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:17.455807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:17.469749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:17.476654 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:39:17.478266 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 370/722] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:17.483756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7089-0337-4aa9-95ab-892576f519bc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:17.613893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7089-0337-4aa9-95ab-892576f519bc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:17.652349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641dfd-a066-4607-a65c-08bb5c9b68b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:17.653421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641dfd-a066-4607-a65c-08bb5c9b68b5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:17.653908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641dfd-a066-4607-a65c-08bb5c9b68b5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:17.654386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641dfd-a066-4607-a65c-08bb5c9b68b5 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:17.655311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641dfd-a066-4607-a65c-08bb5c9b68b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:17.655811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641dfd-a066-4607-a65c-08bb5c9b68b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:17.657427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641dfd-a066-4607-a65c-08bb5c9b68b5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:17.670472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 353/723] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:17.675689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:17.750649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0f40-4679-4188-b380-1e0690a0d102 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:17.751005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0f40-4679-4188-b380-1e0690a0d102 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:17.751201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0f40-4679-4188-b380-1e0690a0d102 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:17.753160 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 354/724] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:17.759431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415acae2-aaf8-455b-a87d-8835675e76fe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:17.759724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415acae2-aaf8-455b-a87d-8835675e76fe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:17.759979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415acae2-aaf8-455b-a87d-8835675e76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:17.778202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-415acae2-aaf8-455b-a87d-8835675e76fe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:17.779763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-415acae2-aaf8-455b-a87d-8835675e76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:17.856313 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 355/725] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 20:39:17.882545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415acae2-aaf8-455b-a87d-8835675e76fe None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:17.900650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd602c-66e6-441c-b6cf-8716a3f503d8 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:17.973162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75540774-9d42-4561-a1c5-43b066f7ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:17.974240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75540774-9d42-4561-a1c5-43b066f7ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:17.974688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75540774-9d42-4561-a1c5-43b066f7ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:17.975096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75540774-9d42-4561-a1c5-43b066f7ffd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:17.991397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75540774-9d42-4561-a1c5-43b066f7ffd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:17.993896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75540774-9d42-4561-a1c5-43b066f7ffd0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.009319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415acae2-aaf8-455b-a87d-8835675e76fe None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.015060 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-75540774-9d42-4561-a1c5-43b066f7ffd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:18.016412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 371/726] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:18.025641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b8cdf-5bc0-4c80-8ecc-ba30e98a6717 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.025929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b8cdf-5bc0-4c80-8ecc-ba30e98a6717 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.026205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b8cdf-5bc0-4c80-8ecc-ba30e98a6717 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.027712 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 372/727] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:18.028260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b8cdf-5bc0-4c80-8ecc-ba30e98a6717 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.044312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf294ef-3683-4add-a722-efaa4cef2bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.045156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf294ef-3683-4add-a722-efaa4cef2bd0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.045436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf294ef-3683-4add-a722-efaa4cef2bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.045708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf294ef-3683-4add-a722-efaa4cef2bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.058484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf294ef-3683-4add-a722-efaa4cef2bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:18.067911 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-3bf294ef-3683-4add-a722-efaa4cef2bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:39:18.069591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 356/728] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:18.073893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c3ac-baca-4b4a-aa16-88fec75f471a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.074376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c3ac-baca-4b4a-aa16-88fec75f471a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.074935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c3ac-baca-4b4a-aa16-88fec75f471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.098180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8e53c3ac-baca-4b4a-aa16-88fec75f471a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:18.099679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8e53c3ac-baca-4b4a-aa16-88fec75f471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:18.147613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b8cdf-5bc0-4c80-8ecc-ba30e98a6717 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.180799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.181514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.181842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.182114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.189052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:18.189052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:18.189052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.189304 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 357/729] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:18.190000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c3ac-baca-4b4a-aa16-88fec75f471a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.209842 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 373/730] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:18.216610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.324692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c3ac-baca-4b4a-aa16-88fec75f471a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.327094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78e5b1-effe-465b-b817-9786799b07d3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.360052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.360897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.361206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.361478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.367425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.368621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.369132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.369235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:18.369684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.370635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:18.370800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.371446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:18.373648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.383004 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 358/731] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:18.384078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.384182 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 09 20:39:18.394623 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 374/732] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:18.394623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.508442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd560-5f02-4bf5-b064-41a2e116c0f5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.513131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d668e-6956-41a5-8a43-97c55bd191c5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.540979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.541996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.542105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.542378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.554498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:18.555981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.560469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.561170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.561448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.561872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.562601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:18.563967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.579638 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:18.581646 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 375/733] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:18.582788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.593060 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 359/734] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:18 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:18.593060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.713949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10214c8-dc91-4b9f-8627-803e8317997c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.762405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e0376-0495-48f0-9bb2-9b334393a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.763560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0376-0495-48f0-9bb2-9b334393a211 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.765243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0376-0495-48f0-9bb2-9b334393a211 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.765900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0376-0495-48f0-9bb2-9b334393a211 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.768420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e0376-0495-48f0-9bb2-9b334393a211 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:18.769813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e0376-0495-48f0-9bb2-9b334393a211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:18.774350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e0376-0495-48f0-9bb2-9b334393a211 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.806693 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 376/735] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:18.808548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed4582-8ffa-4f3a-8fa7-3e95aaa3a063 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.809066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed4582-8ffa-4f3a-8fa7-3e95aaa3a063 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.809363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed4582-8ffa-4f3a-8fa7-3e95aaa3a063 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.815240 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 377/736] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:18.815240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed4582-8ffa-4f3a-8fa7-3e95aaa3a063 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:18.825069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c726cdc-eb37-446d-9425-202d9fd90922 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.862741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1dcf-c187-4b1e-9ea6-870fb5c6491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.863775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1dcf-c187-4b1e-9ea6-870fb5c6491e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.864286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1dcf-c187-4b1e-9ea6-870fb5c6491e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.864627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1dcf-c187-4b1e-9ea6-870fb5c6491e None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.866358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1dcf-c187-4b1e-9ea6-870fb5c6491e None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:18.866358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1dcf-c187-4b1e-9ea6-870fb5c6491e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:18.867057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1dcf-c187-4b1e-9ea6-870fb5c6491e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:18.881818 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 360/737] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:18.883111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8075fb-9004-4724-a2d0-9a960930f702 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.883393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8075fb-9004-4724-a2d0-9a960930f702 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.883669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8075fb-9004-4724-a2d0-9a960930f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.900657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ac8075fb-9004-4724-a2d0-9a960930f702 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:18.901891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ac8075fb-9004-4724-a2d0-9a960930f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:18.935827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed4582-8ffa-4f3a-8fa7-3e95aaa3a063 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:18.972067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:18.973246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:18.973544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:18.973946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:18.976864 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 361/738] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:18.978058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8075fb-9004-4724-a2d0-9a960930f702 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.046400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.047865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.087168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8075fb-9004-4724-a2d0-9a960930f702 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.123432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668bdb3-81bb-422f-bffc-98dbb05fadff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.124156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bdb3-81bb-422f-bffc-98dbb05fadff None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.124428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bdb3-81bb-422f-bffc-98dbb05fadff None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.124696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bdb3-81bb-422f-bffc-98dbb05fadff None admin] PATH_INFO: `/v3/users/nova` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.131976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bdb3-81bb-422f-bffc-98dbb05fadff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.133451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bdb3-81bb-422f-bffc-98dbb05fadff None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.150011 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 378/739] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 20:39:19.150011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.150577 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5668bdb3-81bb-422f-bffc-98dbb05fadff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:39:19.152967 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 362/740] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:19.154272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42918-896b-4343-bc95-c9a8ca1b0f0d None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.154556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42918-896b-4343-bc95-c9a8ca1b0f0d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.154827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42918-896b-4343-bc95-c9a8ca1b0f0d None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.156112 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 363/741] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:19.156793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42918-896b-4343-bc95-c9a8ca1b0f0d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.247490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a0b9e-b5fb-44be-9446-398d65f0be10 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.254058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42918-896b-4343-bc95-c9a8ca1b0f0d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.282028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.283075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.283511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.283914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.286995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f821-8fa2-4804-ab1e-b2abb38d954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.287788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f821-8fa2-4804-ab1e-b2abb38d954a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.288060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f821-8fa2-4804-ab1e-b2abb38d954a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.288327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f821-8fa2-4804-ab1e-b2abb38d954a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.295306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:19.297937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f821-8fa2-4804-ab1e-b2abb38d954a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.299378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f821-8fa2-4804-ab1e-b2abb38d954a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.303075 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:19.304736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 379/742] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:19.305654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.324488 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-38d3f821-8fa2-4804-ab1e-b2abb38d954a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:19.325881 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 364/743] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:19.327039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d50a09-cf5f-45e1-9740-c26821eeff0f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.327317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d50a09-cf5f-45e1-9740-c26821eeff0f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.327582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d50a09-cf5f-45e1-9740-c26821eeff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.344588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-85d50a09-cf5f-45e1-9740-c26821eeff0f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:19.345795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-85d50a09-cf5f-45e1-9740-c26821eeff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:19.417133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 365/744] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 20:39:19.417133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d50a09-cf5f-45e1-9740-c26821eeff0f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.422329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2221513-aa72-4e2f-934b-743890cfc7fa None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.459805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.460804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.461112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.461392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.462228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:19.462537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.464046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.481012 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 380/745] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:19.481849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.514791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d50a09-cf5f-45e1-9740-c26821eeff0f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.547428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.548093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.548370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.548641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.549421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:19.549722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.551153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.563435 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 366/746] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:19.563435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.587887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8894a7-0a24-4809-b4ee-f579a38fdad3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.621306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.622063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.622404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.622766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.623714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:19.623990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.625497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.636594 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 381/747] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:19.641575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.659082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7f2d1-547e-46a8-bfc2-ecc540d40cfb None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.690849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.691493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.691768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.692038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.692748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.694148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.717423 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 367/748] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:19 2022] POST /identity/v3/services => generated 240 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:19.717423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.739341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec19a2-08a3-472a-a593-864e95171d6f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.780073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.780893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.781211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.781532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.793748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.795348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.812977 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:19.818915 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 382/749] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:19.818915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.848867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee81d3-6e0a-41b7-9a16-e4fe061f8a7d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.886728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.887562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.887814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.888085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.900780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.902460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:19.920836 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:19.922134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 368/750] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:19.922909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:19.941287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806690e2-27ea-4271-8105-0918e6ff1c6b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:19.983744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:19.985135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:19.985719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:19.986155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:19.996877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:19.998974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.013331 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:20.014890 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 383/751] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:20.015601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.043798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a06da1-c7c9-49dd-b765-1429e4ce1c01 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.079950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.080915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.081418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.081939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.082832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:20.083304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.085196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.097613 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 369/752] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:20.098685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.121692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4fc35-5f8e-49f0-a3c4-69649db3f284 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.154740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.155496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.155673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.155939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.156663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:20.156943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.158354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.170170 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 384/753] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:20.171056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.199398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692f75-c7ad-4571-916d-f9a64e8e3f9d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.233490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.234487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.234986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.235451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.236539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:20.237063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.238723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.250762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 370/754] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:20.251852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.272235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d43b5-aa36-45ae-87dd-aadea50704ac None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.304652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.305544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.305819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.306137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.312906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.314490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.329023 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:20.335397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 385/755] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:20.336257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.351984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231dc4-d403-4e70-9062-e4ff00adfdbf None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.386319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.387212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.387483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.387750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.395438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.396878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.410662 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 09 20:39:20.412177 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 371/756] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:20.413060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.447258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc98e-e660-4af3-bda3-d1386dc92c58 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.488553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.489780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.490260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.490740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.491833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=c6ff773b27b94f59b97edddcab55716f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:20.492780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.494847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.502462 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 386/757] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/role_assignments?user.id=c6ff773b27b94f59b97edddcab55716f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:20.503569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.551386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918865c-c2c3-4007-b5e3-ec8227cbd257 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.620743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15049f62-699b-4807-83ae-29dfbac9c2ad None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.638372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.639057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.639334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.639598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.640395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:20.640698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.642157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.668250 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 372/758] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:20.669733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.670541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.670820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.671088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.671928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:20.672230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.674101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.675399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.712979 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 387/759] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:20.714375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:20.814987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0eaed-d06b-49ca-a93d-0cb64b1aa9dc None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.820748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0da3e-b62f-48a1-adbb-a749036511af None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:20.859585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.860502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.860782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.861060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d3a4c68c9de346219732fa8f9f6df17f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.867436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=d3a4c68c9de346219732fa8f9f6df17f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.868891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:20.882294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f691c2-9013-4d4d-8e88-1ca8396f8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:20.882966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f691c2-9013-4d4d-8e88-1ca8396f8863 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:20.883243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f691c2-9013-4d4d-8e88-1ca8396f8863 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:20.883563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f691c2-9013-4d4d-8e88-1ca8396f8863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:20.895974 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 373/760] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:20 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d3a4c68c9de346219732fa8f9f6df17f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:20.992739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f691c2-9013-4d4d-8e88-1ca8396f8863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:20.994273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f691c2-9013-4d4d-8e88-1ca8396f8863 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:21.117511 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 388/761] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:39:21.122876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:21.223237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d303cf-3c2a-43bf-a909-645e289e6f4c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:21.244933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b02f-6c94-4d58-bc45-a732d5ab62cb None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:21.246006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b02f-6c94-4d58-bc45-a732d5ab62cb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:21.246479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b02f-6c94-4d58-bc45-a732d5ab62cb None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:21.253063 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 389/762] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:21.264788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffb2a-1036-49d1-b0f6-da546715e333 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:21.265122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffb2a-1036-49d1-b0f6-da546715e333 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:21.265396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffb2a-1036-49d1-b0f6-da546715e333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:21.269851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:21.270664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:21.270937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:21.271206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:21.282664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7adffb2a-1036-49d1-b0f6-da546715e333 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:21.284594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7adffb2a-1036-49d1-b0f6-da546715e333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:21.288699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:21.290649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:21.316140 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:21.326422 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 374/763] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:21.332825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:21.393976 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 390/764] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:21.417416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adffb2a-1036-49d1-b0f6-da546715e333 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:21.513742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adffb2a-1036-49d1-b0f6-da546715e333 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:21.529146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00fad5-7a1f-48ff-9955-3a3c9b7f45f4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:21.547119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:21.547947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:21.548230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:21.548505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:21.549196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:21.550716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:21.563734 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 09 20:39:21.565254 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 391/765] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Apr 9 20:39:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:21.573983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:21.581267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:21.582107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:21.582389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:21.582661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:21.583381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:21.583681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:21.585391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:21.601404 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 375/766] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:21.602865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:21.694250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146224-86ba-4e29-a883-c9f84596fd92 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:21.711092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a2ec6-4ae6-4ae8-b783-bf4cbd8bb618 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:21.754889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:21.755708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:21.755983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:21.756230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:21.756348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:21.757106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:21.757396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:21.757677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:21.758393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:21.758701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:21.760106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:21.763413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:21.764837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:21.765114 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 392/767] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Apr 9 20:39:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:21.770914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:21.795141 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:21.796584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 376/768] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:21.805428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:21.949515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25698-b5b1-4884-95c8-843739fbc680 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:22.006940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa5f8-1f12-4e30-a545-671aa3a426f1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:22.034896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:22.035591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.035872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.036135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.036945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:22.037252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:22.038729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:22.055833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:22.056853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.057368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.057900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.058822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:22.059330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:22.061016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:22.070167 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 377/769] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:22.073922 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 393/770] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Apr 9 20:39:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:22.081056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:22.081994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:22.218613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30af7-556b-45c6-a7d1-ba439a8daacd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:22.284405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f458c-638e-489a-9d76-bd35906bf4d3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:22.293665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59022909-ab66-4313-be36-202e89a6142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:22.294620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59022909-ab66-4313-be36-202e89a6142f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.295095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59022909-ab66-4313-be36-202e89a6142f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.295562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59022909-ab66-4313-be36-202e89a6142f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.296581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59022909-ab66-4313-be36-202e89a6142f None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=65106688ce7b496880f3b7753f766f7d) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:22.297121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59022909-ab66-4313-be36-202e89a6142f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:22.298803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59022909-ab66-4313-be36-202e89a6142f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:22.307166 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 378/771] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:22 2022] GET /identity/v3/role_assignments?user.id=65106688ce7b496880f3b7753f766f7d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:22.345609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501792cc-660d-40b8-8012-15f938fd7a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:22.346699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501792cc-660d-40b8-8012-15f938fd7a34 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.347238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501792cc-660d-40b8-8012-15f938fd7a34 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.347715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501792cc-660d-40b8-8012-15f938fd7a34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.348811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501792cc-660d-40b8-8012-15f938fd7a34 None admin] RBAC: Adding query filter params (interface=public, service_id=5610f62e69274ef88a92a5b43adadf5d, region_id=RegionOne) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:22.349380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501792cc-660d-40b8-8012-15f938fd7a34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:22.351182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501792cc-660d-40b8-8012-15f938fd7a34 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:22.364103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 394/772] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:39:22 2022] GET /identity/v3/endpoints?service_id=5610f62e69274ef88a92a5b43adadf5d&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:22.370802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59022909-ab66-4313-be36-202e89a6142f None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:22.521165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59022909-ab66-4313-be36-202e89a6142f None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:22.556578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2d62c-645a-4ee4-b3c9-b7ec3fb267c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:22.557249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2d62c-645a-4ee4-b3c9-b7ec3fb267c1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.557532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2d62c-645a-4ee4-b3c9-b7ec3fb267c1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.557864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2d62c-645a-4ee4-b3c9-b7ec3fb267c1 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.558548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2d62c-645a-4ee4-b3c9-b7ec3fb267c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:22.560019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2d62c-645a-4ee4-b3c9-b7ec3fb267c1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:22.569231 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 379/773] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:22 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:22.599071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb54f-f874-42c1-ab83-4385e8636def None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.599693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb54f-f874-42c1-ab83-4385e8636def None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.600327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb54f-f874-42c1-ab83-4385e8636def None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.603568 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 395/774] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:22.618780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4332d7-0f4b-456c-9862-abddec63190c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.619088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4332d7-0f4b-456c-9862-abddec63190c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.619324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4332d7-0f4b-456c-9862-abddec63190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.646249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3d4332d7-0f4b-456c-9862-abddec63190c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:22.648283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3d4332d7-0f4b-456c-9862-abddec63190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:22.717463 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 380/775] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:22.765172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddb54f-f874-42c1-ab83-4385e8636def None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:22.896486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddb54f-f874-42c1-ab83-4385e8636def None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:22.930114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:22.930925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:22.931205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:22.931476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:22.932133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:22.933597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:22.945580 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 09 20:39:22.947116 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 396/776] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:22 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:22.952655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4332d7-0f4b-456c-9862-abddec63190c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:23.059981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4332d7-0f4b-456c-9862-abddec63190c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:23.105668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:23.106693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.107188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.107659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.108544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] RBAC: Adding query filter params (name=network) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:23.113054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:23.114933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:23.119796 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 381/777] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:23.125375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:23.242169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892835-254d-48f0-83fa-a30f754996d2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:23.285669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:23.286426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.286663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.286982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.287695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:23.287996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:23.289430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:23.297417 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 397/778] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:23.303177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:23.420578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dae7a-baeb-4160-920b-17507132a105 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:23.460860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f12901-b2ac-4042-a716-84e827a90849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:23.461571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12901-b2ac-4042-a716-84e827a90849 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.461852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12901-b2ac-4042-a716-84e827a90849 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.462126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12901-b2ac-4042-a716-84e827a90849 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.462928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12901-b2ac-4042-a716-84e827a90849 None admin] RBAC: Adding query filter params (interface=public, service_id=0544f195d0e0491785bdcea5ae917272, region_id=RegionOne) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:23.463240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12901-b2ac-4042-a716-84e827a90849 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:23.464620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12901-b2ac-4042-a716-84e827a90849 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:23.473904 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 382/779] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:39:23 2022] GET /identity/v3/endpoints?service_id=0544f195d0e0491785bdcea5ae917272&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:23.482134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:23.623294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dabca-781a-45db-bc55-e1a7ae8665c7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:23.656067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb5ec-edc5-49e2-9826-0bd409bdafb1 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.656634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb5ec-edc5-49e2-9826-0bd409bdafb1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.656634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb5ec-edc5-49e2-9826-0bd409bdafb1 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.658279 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 383/780] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:23.664197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e2b71-2b10-41a1-962d-2ed0ccffab98 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.664587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e2b71-2b10-41a1-962d-2ed0ccffab98 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.664950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e2b71-2b10-41a1-962d-2ed0ccffab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.674637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:23.676383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.677116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.681399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.682302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:23.683864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:23.694424 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 398/781] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:23 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:23.695573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-786e2b71-2b10-41a1-962d-2ed0ccffab98 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:23.696945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-786e2b71-2b10-41a1-962d-2ed0ccffab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:23.785512 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 384/782] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:23.821753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:23.915428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245463-d3d7-4188-a94f-19474924f72b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.915610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245463-d3d7-4188-a94f-19474924f72b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.915879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245463-d3d7-4188-a94f-19474924f72b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.917544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 385/783] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:23.922591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6aeda-3f49-4340-8ab5-705c7ecf5626 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:23.922880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6aeda-3f49-4340-8ab5-705c7ecf5626 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:23.923161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6aeda-3f49-4340-8ab5-705c7ecf5626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:23.941670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fd17-209d-42d7-9256-1c86c45d0140 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:23.957864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1cd6aeda-3f49-4340-8ab5-705c7ecf5626 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:23.960978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1cd6aeda-3f49-4340-8ab5-705c7ecf5626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:24.010721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.012701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.014721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.015173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.032449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:24.040428 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:39:24.042563 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 399/784] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:24.048726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.069274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 386/785] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:24.097649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6aeda-3f49-4340-8ab5-705c7ecf5626 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.162163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fd810-d3cb-477c-91e3-11721100abf2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:24.196324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89caade-196b-4158-a070-075f6e797689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.196992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89caade-196b-4158-a070-075f6e797689 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.197250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89caade-196b-4158-a070-075f6e797689 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.197529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89caade-196b-4158-a070-075f6e797689 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.198278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89caade-196b-4158-a070-075f6e797689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:24.198612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89caade-196b-4158-a070-075f6e797689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:24.199986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89caade-196b-4158-a070-075f6e797689 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:24.210548 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 400/786] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:24.216337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89caade-196b-4158-a070-075f6e797689 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.219331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6aeda-3f49-4340-8ab5-705c7ecf5626 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:24.263482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.265787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.267201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.267681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.290707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:24.297973 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:39:24.309399 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 387/787] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:24.315345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.373684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89caade-196b-4158-a070-075f6e797689 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:24.414085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571c1b-f6c1-4cd7-ac2b-1d895fb387e5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:24.418695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.419518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.419859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.420058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.447432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:24.450603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:24.457260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.457260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.457260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.457260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.457604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:24.457604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:24.457604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:24.482392 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:24.483636 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 401/789] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:24.484399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.484790 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 388/789] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:24.489778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.650634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6abf-0b10-46ce-bc0c-06132ead2ff3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:24.686426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.687384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.687662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.687929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.699655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:24.701167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:24.720585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ed8a-4347-4bb6-9361-217f9a6c07dd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:24.721117 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:24.722369 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 402/790] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:24.728376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.795548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.796223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.796500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.796774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.797521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:24.797823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:24.799196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:24.824271 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 389/791] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:24.830114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.831640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834ddf-aa66-4539-86ca-5e378cb33b71 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:24.874518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:24.875201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:24.875478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:24.875746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:24.876470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:24.876778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:24.878269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:24.905107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 403/792] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:24.933060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:24.995377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570838-7004-43d1-a1f8-a33a5d26f5ca None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.038357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9255dab-7acf-44b6-9a16-3c47dc942838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.039686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255dab-7acf-44b6-9a16-3c47dc942838 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.039984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255dab-7acf-44b6-9a16-3c47dc942838 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.040399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255dab-7acf-44b6-9a16-3c47dc942838 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.049614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9255dab-7acf-44b6-9a16-3c47dc942838 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.051886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9255dab-7acf-44b6-9a16-3c47dc942838 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.070860 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-b9255dab-7acf-44b6-9a16-3c47dc942838 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 09 20:39:25.072871 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 390/793] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:25.074547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6d7b-e663-4090-9661-370e3f3d0479 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.074970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6d7b-e663-4090-9661-370e3f3d0479 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.075245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6d7b-e663-4090-9661-370e3f3d0479 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.081126 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 391/794] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:25.082582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e6d7b-e663-4090-9661-370e3f3d0479 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.089296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61c121-e0e8-40dd-b397-70c4b88ba107 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.131473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0ab3f-b6fe-4bbb-ba65-09bcd3cc63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.132307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0ab3f-b6fe-4bbb-ba65-09bcd3cc63d5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.132586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0ab3f-b6fe-4bbb-ba65-09bcd3cc63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.132860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0ab3f-b6fe-4bbb-ba65-09bcd3cc63d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.143184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0ab3f-b6fe-4bbb-ba65-09bcd3cc63d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.145204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0ab3f-b6fe-4bbb-ba65-09bcd3cc63d5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.163002 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d9f0ab3f-b6fe-4bbb-ba65-09bcd3cc63d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:39:25.165117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 404/795] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:39:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:25.166507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bef65-b986-4f41-a67e-3ab3de9b1a8a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.166784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bef65-b986-4f41-a67e-3ab3de9b1a8a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.167054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bef65-b986-4f41-a67e-3ab3de9b1a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.190414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-421bef65-b986-4f41-a67e-3ab3de9b1a8a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:25.191771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-421bef65-b986-4f41-a67e-3ab3de9b1a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:25.202366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e6d7b-e663-4090-9661-370e3f3d0479 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.248476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.249243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.249808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.250083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.250918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:25.251217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.253161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.272776 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 392/797] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:25.273841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.276891 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 405/797] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:25.277907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bef65-b986-4f41-a67e-3ab3de9b1a8a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.388310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65db2f-00a7-4364-b85e-30319dec7b98 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.390256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bef65-b986-4f41-a67e-3ab3de9b1a8a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.422034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.422708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.423043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.423319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.423463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.424124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.424362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:25.424501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.424684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.424826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.426035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.434863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.438502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.448825 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 393/798] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:25.452400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.461071 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:25.461071 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 406/799] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:25.461071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.552500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b049642-5b12-444e-bfac-25d985fd4e88 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.557444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bbf6c-8748-4232-a0a1-a3210e2fcffd None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.583960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.585112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.585394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.585665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.589370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77781-a44d-479e-8d7a-15caf89e37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.590251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77781-a44d-479e-8d7a-15caf89e37c6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.590532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77781-a44d-479e-8d7a-15caf89e37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.590801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77781-a44d-479e-8d7a-15caf89e37c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.595404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:25.602392 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:25.608287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 394/800] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:25.608287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.661271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77781-a44d-479e-8d7a-15caf89e37c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.663036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77781-a44d-479e-8d7a-15caf89e37c6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.711528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163c334-3fe9-4d6e-adbb-caf629526723 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.752858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.753808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.753919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.754164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.754881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:25.755182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.756699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.759969 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 407/801] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:39:25.765868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602173-b4d5-4718-906f-197c451ed71d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.766154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602173-b4d5-4718-906f-197c451ed71d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.766429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602173-b4d5-4718-906f-197c451ed71d None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.769112 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 408/802] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:25.769112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602173-b4d5-4718-906f-197c451ed71d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.769307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 395/803] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:25.769761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.871069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8453-63f2-49e4-b36a-f033967cf659 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.875153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602173-b4d5-4718-906f-197c451ed71d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:25.905603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1c3b-0316-4357-8a27-8fe647289b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.906391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1c3b-0316-4357-8a27-8fe647289b3a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.906673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1c3b-0316-4357-8a27-8fe647289b3a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.906940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1c3b-0316-4357-8a27-8fe647289b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.909380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:25.910222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.910634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.911040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.911927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:25.912363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.913902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.916987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df1c3b-0316-4357-8a27-8fe647289b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:25.918494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df1c3b-0316-4357-8a27-8fe647289b3a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:25.922367 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 409/804] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:25.923301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:25.936984 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c2df1c3b-0316-4357-8a27-8fe647289b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:25.938426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 396/805] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:25.943973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ed25-91ad-4d77-8ad6-e946233b4e25 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:25.944255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ed25-91ad-4d77-8ad6-e946233b4e25 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:25.944530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ed25-91ad-4d77-8ad6-e946233b4e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:25.961759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2f57ed25-91ad-4d77-8ad6-e946233b4e25 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:25.962971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2f57ed25-91ad-4d77-8ad6-e946233b4e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:26.037062 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 397/806] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:26.037260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa970-c266-4331-b4ef-24067a7c4fa8 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.037383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ed25-91ad-4d77-8ad6-e946233b4e25 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.060977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.061848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.062133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.062406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.069150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.070643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.083972 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:26.090337 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 410/807] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:26.091254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.139739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ed25-91ad-4d77-8ad6-e946233b4e25 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.174858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.175664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.175937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.176207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.185909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.187355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.190376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb6e64-7cc6-4aef-82d7-e9cea8cd3924 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.204003 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:26.210054 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 398/808] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:26.210054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.230176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.230995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.231280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.231551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.232274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:26.232579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.234013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.246080 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 411/809] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:26.246661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.312339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2dd3-2929-4c44-a51f-3bbec1b54a6a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.342377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41e7b2-b0eb-480e-9ace-4496d4b17ef6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.344571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.345424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.345701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.345970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.346682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.348057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.359138 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 09 20:39:26.365358 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 399/810] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:26.365358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.376468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.377171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.377435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.377786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.378553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:26.378856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.380301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.392290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 412/811] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:26.393055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.473418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb2c0-2f22-41e8-a852-fc2a40db3a27 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.487936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff26c9-8282-4ab8-be61-1a62d8abff5d None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.505510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.506234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.506510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.506812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.507574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:26.507876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.509300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.521296 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 400/812] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:26.522161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.527901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.528729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.529008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.529416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.537068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.538559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.552122 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:26.553320 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 413/813] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:26.554059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.617885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d92359-97e7-48c2-b956-4a8994ee9e26 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.653705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308b070-a939-4626-a37b-d0564b747e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.654303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b070-a939-4626-a37b-d0564b747e84 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.654574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebba1a-d4d9-416a-b5da-ba4eeb456164 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.654669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b070-a939-4626-a37b-d0564b747e84 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.654849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b070-a939-4626-a37b-d0564b747e84 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.655556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308b070-a939-4626-a37b-d0564b747e84 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:26.655863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308b070-a939-4626-a37b-d0564b747e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.657267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308b070-a939-4626-a37b-d0564b747e84 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.661688 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 401/814] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:26.662920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b0eda-0c32-444e-b51e-a6b4c838052b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.663197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b0eda-0c32-444e-b51e-a6b4c838052b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.663465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b0eda-0c32-444e-b51e-a6b4c838052b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.664662 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 402/815] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:26.665372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b0eda-0c32-444e-b51e-a6b4c838052b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.688170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.689122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.689399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.689671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/c6ff773b27b94f59b97edddcab55716f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.691741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=c6ff773b27b94f59b97edddcab55716f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.693210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.706977 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 414/816] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:26 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/c6ff773b27b94f59b97edddcab55716f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:26.707745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.772543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b0eda-0c32-444e-b51e-a6b4c838052b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.807935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.808769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.809079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.809340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.815600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cbfd4-9c52-44ac-8db2-9cc3503363aa None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.817108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.818596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.833523 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 09 20:39:26.840328 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 403/817] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:26.840328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.850232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a5f04-acef-41d6-b99e-cca153f0a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.850918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5f04-acef-41d6-b99e-cca153f0a740 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.851189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5f04-acef-41d6-b99e-cca153f0a740 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.851459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5f04-acef-41d6-b99e-cca153f0a740 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.852248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a5f04-acef-41d6-b99e-cca153f0a740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:26.852550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a5f04-acef-41d6-b99e-cca153f0a740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:26.854054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a5f04-acef-41d6-b99e-cca153f0a740 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:26.870257 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 415/818] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:26.870257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113862-b1d9-4e1d-ab86-1a41f2afba68 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.870257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113862-b1d9-4e1d-ab86-1a41f2afba68 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.870257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113862-b1d9-4e1d-ab86-1a41f2afba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.886064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f0113862-b1d9-4e1d-ab86-1a41f2afba68 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:26.887264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0113862-b1d9-4e1d-ab86-1a41f2afba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:26.956939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c9b40-1ae6-4486-bafb-37a8b7e30a45 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:26.962309 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 416/819] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:26.963038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0113862-b1d9-4e1d-ab86-1a41f2afba68 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:26.997685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:26.998350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:26.998627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:26.998897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:26.999599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:26.999896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.001299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.010532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 404/820] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:27.010532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.071436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0113862-b1d9-4e1d-ab86-1a41f2afba68 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.107732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.108718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.109205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.109682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.110680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:27.111174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.112835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.118576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82247c7-7a37-49ad-a319-93493f6a86d2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.135326 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 417/821] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Apr 9 20:39:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:27.136507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.153168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.153830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.154108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.154431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.155303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d3a4c68c9de346219732fa8f9f6df17f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:27.155616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.157085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.173571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 405/822] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/role_assignments?user.id=d3a4c68c9de346219732fa8f9f6df17f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:27.174669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.253140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0031-4d86-4478-b50e-594d82cef970 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.312344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.313597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.314105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.314575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] PATH_INFO: `/v3/services/network` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.315527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.317199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.329245 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 09 20:39:27.336644 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 418/823] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:27.337991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.390857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c40182-19d1-494a-8613-646aec9eb1ae None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.434020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.435460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.435966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.436438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.437420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.441504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.479615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad64c1d-0958-4678-a46a-03c8ad9d9cab None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.485067 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 406/824] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:27.486712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.543069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.544133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.544570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.544978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.560074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.562701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.585419 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:27.587960 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 419/825] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:27.594177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.617613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d0e3-84fc-457b-b640-e2b4d42716bd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.660732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.661515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.661796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.662122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.662847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] RBAC: Adding query filter params (name=network) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:27.663154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.664571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.687508 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 407/826] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:27.696297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.757336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bedaf6-cce1-4c75-a72e-a82c69b9b79e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.801070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.801820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.802171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.802515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.803398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:27.803688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.805328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.807506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5911e-4510-4843-9987-fa429edc6076 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.818901 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 420/827] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:27.824254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.845375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.846567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.847073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.847555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.848458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] RBAC: Adding query filter params (type=network) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:27.848952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.850558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.856192 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 408/828] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:27.862577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:27.925819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d35dec-504b-446e-93e8-40ee7af9dff3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.961711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:27.962518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:27.962798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:27.963070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:27.967755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bae1-3738-4968-afaf-b55e683a8d82 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:27.971270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:27.972299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:27.986209 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:27.987708 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 421/829] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:27.993498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:28.017738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:28.018778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:28.019269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:28.019733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:28.020660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:28.022278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:28.060352 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 409/830] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:28.096526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186dc9-0c8b-498d-b326-2326f23c2e69 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:28.138530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c58b9-8d0d-49a7-8186-8d926a911574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:28.139270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c58b9-8d0d-49a7-8186-8d926a911574 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:28.139551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c58b9-8d0d-49a7-8186-8d926a911574 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:28.139822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c58b9-8d0d-49a7-8186-8d926a911574 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:28.140706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c58b9-8d0d-49a7-8186-8d926a911574 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:28.141016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c58b9-8d0d-49a7-8186-8d926a911574 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:28.142527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c58b9-8d0d-49a7-8186-8d926a911574 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:28.156436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 422/831] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:28.162488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:28.266499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e4ad-e2ac-4c77-9b19-8e9e65e7e374 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:28.311206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aff70-e926-4b1d-acf9-75ab9692ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:28.312088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aff70-e926-4b1d-acf9-75ab9692ff3f None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:28.312368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aff70-e926-4b1d-acf9-75ab9692ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:28.312642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aff70-e926-4b1d-acf9-75ab9692ff3f None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/65106688ce7b496880f3b7753f766f7d/roles/463fc59d1d56462181691eaa570e646f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:28.335066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aff70-e926-4b1d-acf9-75ab9692ff3f None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=65106688ce7b496880f3b7753f766f7d, role_id=463fc59d1d56462181691eaa570e646f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:28.336521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aff70-e926-4b1d-acf9-75ab9692ff3f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:28.357719 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 410/832] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:28 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/65106688ce7b496880f3b7753f766f7d/roles/463fc59d1d56462181691eaa570e646f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:29.287284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c433-5d78-445e-b2f3-f72195be2e5a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:29.287910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c433-5d78-445e-b2f3-f72195be2e5a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:29.287910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c433-5d78-445e-b2f3-f72195be2e5a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:29.289483 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 423/833] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:29.294954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969447e-0b76-49e9-bbb2-829ca741b434 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:29.295354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969447e-0b76-49e9-bbb2-829ca741b434 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:29.295543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969447e-0b76-49e9-bbb2-829ca741b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:29.312382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7969447e-0b76-49e9-bbb2-829ca741b434 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:29.313658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7969447e-0b76-49e9-bbb2-829ca741b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:29.385226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 411/834] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:29.405412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c433-5d78-445e-b2f3-f72195be2e5a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:29.514643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c433-5d78-445e-b2f3-f72195be2e5a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:29.550252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:29.551401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:29.551968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:29.552459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:29.563290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:29.570537 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:39:29.572336 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 424/835] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:29.578210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969447e-0b76-49e9-bbb2-829ca741b434 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:29.681196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969447e-0b76-49e9-bbb2-829ca741b434 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:29.716126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e59b2-5541-4a95-87ac-c8b9e8814e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:29.717201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e59b2-5541-4a95-87ac-c8b9e8814e3a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:29.717683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e59b2-5541-4a95-87ac-c8b9e8814e3a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:29.718150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e59b2-5541-4a95-87ac-c8b9e8814e3a None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:29.719111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e59b2-5541-4a95-87ac-c8b9e8814e3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:29.719617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e59b2-5541-4a95-87ac-c8b9e8814e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:29.721256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e59b2-5541-4a95-87ac-c8b9e8814e3a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:29.730217 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 412/836] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:29.738343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:29.847300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25823fb1-77bd-4e0c-a452-835736a8bd92 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:29.881777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:29.883009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:29.883490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:29.883967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:29.895103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:29.896912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:29.911535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273daa4-6827-4d17-a93a-dcddd9a3c2db None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:29.911824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273daa4-6827-4d17-a93a-dcddd9a3c2db None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:29.912097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273daa4-6827-4d17-a93a-dcddd9a3c2db None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:29.913743 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 413/837] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:29.918067 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:29.920617 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 425/838] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:29.922204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e989-1289-4d9c-ba1e-161728520d02 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:29.922589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e989-1289-4d9c-ba1e-161728520d02 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:29.922964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e989-1289-4d9c-ba1e-161728520d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:29.926084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:29.943559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-47b7e989-1289-4d9c-ba1e-161728520d02 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:29.945068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-47b7e989-1289-4d9c-ba1e-161728520d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:30.018002 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 414/839] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:30.045919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e989-1289-4d9c-ba1e-161728520d02 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.052854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf80ef-23ab-4cc9-9ac3-bbb7c04b1606 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.095697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.096593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.096879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.097189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.098271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:30.098528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.099955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.117070 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 426/840] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:30.123389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.157332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e989-1289-4d9c-ba1e-161728520d02 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.199962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399308b1-b667-4cd4-938b-1f11f162068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.201059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399308b1-b667-4cd4-938b-1f11f162068b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.201488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399308b1-b667-4cd4-938b-1f11f162068b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.201925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399308b1-b667-4cd4-938b-1f11f162068b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.202715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399308b1-b667-4cd4-938b-1f11f162068b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.204782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399308b1-b667-4cd4-938b-1f11f162068b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.216516 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-399308b1-b667-4cd4-938b-1f11f162068b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 09 20:39:30.217888 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 415/841] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:30.218949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504305a7-00e0-43e5-8905-d56c115528c9 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.219210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504305a7-00e0-43e5-8905-d56c115528c9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.219489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504305a7-00e0-43e5-8905-d56c115528c9 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.220724 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 416/842] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:30.223743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504305a7-00e0-43e5-8905-d56c115528c9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.233755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def97ba-5fef-407b-afc9-7b6e225866d0 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.266096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc0004-84e9-424f-a7f1-0c95ba10d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.266900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0004-84e9-424f-a7f1-0c95ba10d94f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.267174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0004-84e9-424f-a7f1-0c95ba10d94f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.267438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0004-84e9-424f-a7f1-0c95ba10d94f None admin] PATH_INFO: `/v3/users/swift` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.274938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc0004-84e9-424f-a7f1-0c95ba10d94f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.276390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc0004-84e9-424f-a7f1-0c95ba10d94f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.289966 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c9dc0004-84e9-424f-a7f1-0c95ba10d94f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 09 20:39:30.295828 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 427/843] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:30.295828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982ed8-3b8b-4f86-bfad-3c1f4cb45817 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.295828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982ed8-3b8b-4f86-bfad-3c1f4cb45817 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.295828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982ed8-3b8b-4f86-bfad-3c1f4cb45817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.310305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d1982ed8-3b8b-4f86-bfad-3c1f4cb45817 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:30.311496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d1982ed8-3b8b-4f86-bfad-3c1f4cb45817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:30.321846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504305a7-00e0-43e5-8905-d56c115528c9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.353976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.354569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.354879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.355122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.355819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:30.356154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.357564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.366742 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 417/844] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:30.366742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.386625 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 428/845] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:30.386625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982ed8-3b8b-4f86-bfad-3c1f4cb45817 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.472201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3df288-ad8f-4115-a65e-04348fa5ccb4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.497329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982ed8-3b8b-4f86-bfad-3c1f4cb45817 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.509013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.509860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.510142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.510417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.511941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:30.512248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.514150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.529123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.529792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.530065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.530721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.531333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:30.531637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.533045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.538889 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 418/846] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:30.538889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.553444 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 429/847] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:30.554235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.660978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193d00-c945-4e89-a9a8-ee5c416c8fe7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.668012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3cb1-8b3f-43fa-a254-085f803d797c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.698646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.699500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.699780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.700055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.700862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.702188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.714722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525feeeb-f4d4-4015-861e-a19eee4e9c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.715764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525feeeb-f4d4-4015-861e-a19eee4e9c06 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.715950 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 09 20:39:30.716455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525feeeb-f4d4-4015-861e-a19eee4e9c06 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.716916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525feeeb-f4d4-4015-861e-a19eee4e9c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.722098 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 419/848] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:30.723844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.800081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525feeeb-f4d4-4015-861e-a19eee4e9c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.801610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525feeeb-f4d4-4015-861e-a19eee4e9c06 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.830880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e4db-8c6e-4567-85df-6749d84b6a18 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.862734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609143f0-a92c-4fd5-8a26-01c2a5db0a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:30.863408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609143f0-a92c-4fd5-8a26-01c2a5db0a67 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.863685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609143f0-a92c-4fd5-8a26-01c2a5db0a67 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.863955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609143f0-a92c-4fd5-8a26-01c2a5db0a67 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.864653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609143f0-a92c-4fd5-8a26-01c2a5db0a67 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:30.864962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609143f0-a92c-4fd5-8a26-01c2a5db0a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:30.866361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609143f0-a92c-4fd5-8a26-01c2a5db0a67 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:30.870706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 420/849] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:30.871912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82afd8-9bb6-4cdd-b5c8-dc14c327457b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.872189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82afd8-9bb6-4cdd-b5c8-dc14c327457b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.872453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82afd8-9bb6-4cdd-b5c8-dc14c327457b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.877127 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 421/850] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:30.877127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82afd8-9bb6-4cdd-b5c8-dc14c327457b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:30.901185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 430/851] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:39:30.902572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae5a9-a3a2-4e0b-b1e7-4858c5deb42a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:30.902859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae5a9-a3a2-4e0b-b1e7-4858c5deb42a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:30.903130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae5a9-a3a2-4e0b-b1e7-4858c5deb42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:30.919216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f9cae5a9-a3a2-4e0b-b1e7-4858c5deb42a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:30.920397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f9cae5a9-a3a2-4e0b-b1e7-4858c5deb42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:30.980968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82afd8-9bb6-4cdd-b5c8-dc14c327457b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:30.984385 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 431/852] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:30.985228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cae5a9-a3a2-4e0b-b1e7-4858c5deb42a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.031109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.031776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.032052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.032319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.033019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:31.033435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.034820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.039022 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 422/853] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:31.049461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.100680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cae5a9-a3a2-4e0b-b1e7-4858c5deb42a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.135007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.136047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.136386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.136724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.147585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.149209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.167730 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:31.169519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 432/854] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:31.174711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152f40-59e5-4b09-bfda-a6c8a7d0ecc6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.175152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.213375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.214201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.214476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.214743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.230763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:31.240503 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:39:31.247837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 423/855] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:31.249525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.288217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dcc27-2607-4076-a3e0-398a19ec1bd5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.322503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.323192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.323470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.323712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.324428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:31.324736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.326154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.338225 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 433/856] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:31.343626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.368408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbfdd2-fc34-42f0-96d7-86442662e400 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.406610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.407468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.407840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.408259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.409148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:31.409545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.411025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.424420 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 424/857] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:31.425749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.467320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2f7d-0d06-41ec-88a2-7138410ab729 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.508685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.509897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.510708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.511182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.520010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.522476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.532115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be44eb-acc6-432a-b517-cea23e5e28e1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.539907 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:31.542079 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 434/858] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:31.547356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.568578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.569760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.570249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.570745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.581439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.583168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.599963 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:31.601877 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 425/859] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:31.617058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.658371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaf8b-6139-4eb6-ab1d-d9547ee3e804 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.699207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.700110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.700387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.700910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.701727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:31.702035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.704237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.719079 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 435/860] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:31.724677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.728414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13602374-7385-40a8-ab02-c32556a759f5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.776259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.777133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.777476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.777816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.778601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:31.778970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.780676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.798859 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 426/861] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:31.800612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:31.846663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855e2e-77c8-4250-8dd1-4ab2795b31f6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.888119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.889184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.889469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.889742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.890858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=c6ff773b27b94f59b97edddcab55716f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:31.891166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.893225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.905226 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 436/862] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/role_assignments?user.id=c6ff773b27b94f59b97edddcab55716f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:31.914460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7c3f4-2f7a-4fae-bc39-81ee459f0be1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:31.950623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:31.951463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:31.951742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:31.952009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:31.961064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:31.962575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:31.978424 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 09 20:39:31.984738 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 427/863] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:31.986267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:32.095840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e064-24f9-4ef5-a013-27f81292feef None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:32.130688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:32.131733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:32.132217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:32.132691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:32.133784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:32.134287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:32.135932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:32.153330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 437/864] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Apr 9 20:39:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:32.158831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:32.258142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66f65c-4bda-4883-9d31-a981eb032837 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:32.290948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:32.291599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:32.291873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:32.292145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:32.363852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:32.365794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:32.464666 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 428/865] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:39:32.477078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:32.566940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc870199-5ed9-4f5a-8370-fd274784d842 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:32.604242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:32.605234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:32.605510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:32.605806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:32.616086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:32.617622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:32.634058 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:32.639808 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 438/866] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:32.642122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:32.740761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff119-2fdd-404b-8434-113637dbe6db None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:32.774820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:32.775510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:32.775781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:32.776054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:32.776786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:32.777113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:32.778500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:32.790914 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 429/867] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:32.796775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:32.893880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a067eb-f1ca-4b3a-be75-df933f7ca514 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:32.926973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618017-d0f6-44c3-aa79-28123c6014f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:32.927778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618017-d0f6-44c3-aa79-28123c6014f4 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:32.928050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618017-d0f6-44c3-aa79-28123c6014f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:32.928314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618017-d0f6-44c3-aa79-28123c6014f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:32.935089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618017-d0f6-44c3-aa79-28123c6014f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:32.936547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618017-d0f6-44c3-aa79-28123c6014f4 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:32.949654 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-de618017-d0f6-44c3-aa79-28123c6014f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:32.955658 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 439/868] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:32.957021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:32.969088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf807-f670-4372-aeb6-8d46cf8c83e1 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:32.969365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf807-f670-4372-aeb6-8d46cf8c83e1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:32.969623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf807-f670-4372-aeb6-8d46cf8c83e1 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:32.971333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 440/869] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:32.977215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6afe1-ee4e-430b-9fa1-0ea4696ea3eb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:32.977494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6afe1-ee4e-430b-9fa1-0ea4696ea3eb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:32.977762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6afe1-ee4e-430b-9fa1-0ea4696ea3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:32.994605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7ed6afe1-ee4e-430b-9fa1-0ea4696ea3eb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:32.995820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7ed6afe1-ee4e-430b-9fa1-0ea4696ea3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:33.058472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa0248-aa29-486b-8c7a-0d0e64fab627 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:33.069126 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 441/870] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:33.087223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6afe1-ee4e-430b-9fa1-0ea4696ea3eb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:33.092765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:33.093466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:33.093740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:33.094013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:33.094796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:33.095097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:33.096593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:33.109721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 430/871] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:33.116470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:33.192299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6afe1-ee4e-430b-9fa1-0ea4696ea3eb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:33.228750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378cd0-a4da-48cb-a34c-c9460f87f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:33.229627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378cd0-a4da-48cb-a34c-c9460f87f8de None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:33.229995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378cd0-a4da-48cb-a34c-c9460f87f8de None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:33.230362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378cd0-a4da-48cb-a34c-c9460f87f8de None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:33.231183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378cd0-a4da-48cb-a34c-c9460f87f8de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:33.232651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378cd0-a4da-48cb-a34c-c9460f87f8de None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:33.240294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7725e2-263c-4b37-a981-8851cb045973 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:33.249212 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 442/872] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:33 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:33.297844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034df18-8193-471f-834a-51c71cc6a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:33.298916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034df18-8193-471f-834a-51c71cc6a19d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:33.299401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034df18-8193-471f-834a-51c71cc6a19d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:33.299895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034df18-8193-471f-834a-51c71cc6a19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:33.300928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034df18-8193-471f-834a-51c71cc6a19d None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=65106688ce7b496880f3b7753f766f7d) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:33.301540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034df18-8193-471f-834a-51c71cc6a19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:33.303188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034df18-8193-471f-834a-51c71cc6a19d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:33.317275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 431/873] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:33 2022] GET /identity/v3/role_assignments?user.id=65106688ce7b496880f3b7753f766f7d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:33.544819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7ac20-9a28-4edc-b0e5-b0cf881cf9d4 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:33.545377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7ac20-9a28-4edc-b0e5-b0cf881cf9d4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:33.545460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7ac20-9a28-4edc-b0e5-b0cf881cf9d4 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:33.547037 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 443/874] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:33.552414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1a54-3dff-4123-82ff-424bf6933925 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:33.552845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1a54-3dff-4123-82ff-424bf6933925 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:33.553028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1a54-3dff-4123-82ff-424bf6933925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:33.569700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-45cb1a54-3dff-4123-82ff-424bf6933925 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:33.570904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-45cb1a54-3dff-4123-82ff-424bf6933925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:33.638034 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 432/875] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:33 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:33.661964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7ac20-9a28-4edc-b0e5-b0cf881cf9d4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:33.764648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7ac20-9a28-4edc-b0e5-b0cf881cf9d4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:33.797209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb937a-25a8-4279-8709-fff6c910e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:33.797807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb937a-25a8-4279-8709-fff6c910e6d9 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:33.798130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb937a-25a8-4279-8709-fff6c910e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:33.798400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb937a-25a8-4279-8709-fff6c910e6d9 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:33.799160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb937a-25a8-4279-8709-fff6c910e6d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:33.800606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb937a-25a8-4279-8709-fff6c910e6d9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:33.817413 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 444/876] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:33 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:34.431867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbd6e-4736-4991-8b1d-244995ccaaf8 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:34.432509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbd6e-4736-4991-8b1d-244995ccaaf8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:34.432989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbd6e-4736-4991-8b1d-244995ccaaf8 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:34.434866 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 433/877] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:34.441230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd0e2-a4db-4eb5-8249-8a1b0759be1f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:34.441720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd0e2-a4db-4eb5-8249-8a1b0759be1f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:34.442179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd0e2-a4db-4eb5-8249-8a1b0759be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:34.467127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f2bcd0e2-a4db-4eb5-8249-8a1b0759be1f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:34.468327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f2bcd0e2-a4db-4eb5-8249-8a1b0759be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:34.541489 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 445/878] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:34.564904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecbd6e-4736-4991-8b1d-244995ccaaf8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:34.666325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecbd6e-4736-4991-8b1d-244995ccaaf8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:34.700309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:34.701496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:34.701969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:34.702427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:34.703279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:34.704952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:34.717118 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 09 20:39:34.724035 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 434/879] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:34.725811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd0e2-a4db-4eb5-8249-8a1b0759be1f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:34.824487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd0e2-a4db-4eb5-8249-8a1b0759be1f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:34.857549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dad39-1753-4506-872b-b8af2ca8d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:34.858223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dad39-1753-4506-872b-b8af2ca8d264 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:34.858500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dad39-1753-4506-872b-b8af2ca8d264 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:34.858771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dad39-1753-4506-872b-b8af2ca8d264 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:34.859481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dad39-1753-4506-872b-b8af2ca8d264 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:34.859784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dad39-1753-4506-872b-b8af2ca8d264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:34.861352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dad39-1753-4506-872b-b8af2ca8d264 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:34.866316 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 446/880] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:34.871979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:34.977464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cfc76-1408-41bc-8eed-dc3816467e2a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:35.010639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba367-fac1-4f28-9384-65864aaff8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:35.011662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba367-fac1-4f28-9384-65864aaff8c9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:35.012150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba367-fac1-4f28-9384-65864aaff8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:35.012609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba367-fac1-4f28-9384-65864aaff8c9 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:35.013607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ba367-fac1-4f28-9384-65864aaff8c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:35.014142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ba367-fac1-4f28-9384-65864aaff8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:35.015696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ba367-fac1-4f28-9384-65864aaff8c9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:35.025273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 435/881] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:35.659234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ca40-d9dc-48f4-8d9a-0e4b37e72194 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:35.659788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ca40-d9dc-48f4-8d9a-0e4b37e72194 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:35.660293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ca40-d9dc-48f4-8d9a-0e4b37e72194 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:35.662260 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 447/882] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:35.670364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6af5b-438e-458b-a91e-313ab0353b05 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:35.670821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6af5b-438e-458b-a91e-313ab0353b05 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:35.670914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6af5b-438e-458b-a91e-313ab0353b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:35.687820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-39f6af5b-438e-458b-a91e-313ab0353b05 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:35.689432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-39f6af5b-438e-458b-a91e-313ab0353b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:35.755179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 436/883] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:35.778955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ca40-d9dc-48f4-8d9a-0e4b37e72194 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:35.885954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ca40-d9dc-48f4-8d9a-0e4b37e72194 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:35.922136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:35.923376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:35.923848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:35.924276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:35.925389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:35.926962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:35.932595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac04a-77e0-41cc-ba1e-62d0a9a832bb None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:35.932879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac04a-77e0-41cc-ba1e-62d0a9a832bb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:35.933191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac04a-77e0-41cc-ba1e-62d0a9a832bb None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:35.934956 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 437/884] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:35.942218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a3270-3887-4379-9b24-73c3ed744a10 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:35.942650 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 09 20:39:35.942943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a3270-3887-4379-9b24-73c3ed744a10 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:35.943411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a3270-3887-4379-9b24-73c3ed744a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:35.944130 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 448/885] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Apr 9 20:39:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:35.949971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:35.962358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-363a3270-3887-4379-9b24-73c3ed744a10 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:35.963855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-363a3270-3887-4379-9b24-73c3ed744a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:36.037226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 438/886] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:36.057626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a3270-3887-4379-9b24-73c3ed744a10 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.061107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701a575-7bd3-409e-8885-c24614e6686f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.102865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.103544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.103822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.104090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.104951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:36.105293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.107213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.113227 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 449/887] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:36.118739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.163250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a3270-3887-4379-9b24-73c3ed744a10 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.197120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.198281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.198747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.199223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.210319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:36.215200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8e131-7132-42f2-9d04-61c4decf82f5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.218312 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 09 20:39:36.224799 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 439/888] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:36.226485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.251162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c3e5f-c3cd-4a88-b84d-6541d3fc5c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.252001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c3e5f-c3cd-4a88-b84d-6541d3fc5c82 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.252345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c3e5f-c3cd-4a88-b84d-6541d3fc5c82 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.252681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c3e5f-c3cd-4a88-b84d-6541d3fc5c82 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.253488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c3e5f-c3cd-4a88-b84d-6541d3fc5c82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:36.254095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c3e5f-c3cd-4a88-b84d-6541d3fc5c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.255243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c3e5f-c3cd-4a88-b84d-6541d3fc5c82 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.265184 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 450/889] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:36.265184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6300-e693-471d-ad29-bb39c3048f5f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.265184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6300-e693-471d-ad29-bb39c3048f5f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.265184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6300-e693-471d-ad29-bb39c3048f5f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.265184 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 451/890] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:36.266000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6300-e693-471d-ad29-bb39c3048f5f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.335231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7afcf6-b430-46fc-a1ca-fed6c2655b4d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.363373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6300-e693-471d-ad29-bb39c3048f5f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.366888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1c5b2-1c33-4c25-916d-30106c69017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.367552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1c5b2-1c33-4c25-916d-30106c69017d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.367831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1c5b2-1c33-4c25-916d-30106c69017d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.368097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1c5b2-1c33-4c25-916d-30106c69017d None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.368824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1c5b2-1c33-4c25-916d-30106c69017d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:36.369153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1c5b2-1c33-4c25-916d-30106c69017d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.370518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1c5b2-1c33-4c25-916d-30106c69017d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.382981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 440/891] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:36.382981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2c17-5937-48fc-941e-3c65c3bebdce None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.382981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2c17-5937-48fc-941e-3c65c3bebdce None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.382981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2c17-5937-48fc-941e-3c65c3bebdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.396703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a88c2c17-5937-48fc-941e-3c65c3bebdce None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:36.397895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a88c2c17-5937-48fc-941e-3c65c3bebdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:36.400452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.401225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.401507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.401777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.402564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] RBAC: Adding query filter params (interface=public, service_id=8f491d761c864444bb233a64a5a44bed, region_id=RegionOne) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:36.402874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.404266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.409467 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 452/892] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/endpoints?service_id=8f491d761c864444bb233a64a5a44bed&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:36.410285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.485066 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 441/893] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:36.485066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c2c17-5937-48fc-941e-3c65c3bebdce None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.520373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573885-c3c9-4a46-a5b6-eb6ea23fd5d6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.551833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.552636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.552917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.553221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.563522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.565063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.572547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c2c17-5937-48fc-941e-3c65c3bebdce None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.582448 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:36.583991 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 453/894] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:36.590174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.615724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.616612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.617228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.617509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.618343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.619720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.625181 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 442/895] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:39:36.625947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.701261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423b1d-77e7-4550-a8ea-1866bed500c2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.746378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.747439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.747733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.747986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.748988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.750447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.765246 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 09 20:39:36.765458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfa0d-b94d-4348-9d14-5f67b501a278 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.772071 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 454/896] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:36.776102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.813189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.814313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.814810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.815231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.816124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:36.816621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.819282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.835360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 443/897] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:36.841712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.889265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01947e-16eb-4906-be8b-6448f0d8c93e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:36.925270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:36.926242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:36.926709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:36.927187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:36.928101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:36.928600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:36.930209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:36.936249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 455/898] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:36.945486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:36.969673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90ea59-4130-4d03-83dc-9ef61c20bf1d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.003348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.004443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.004884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.005316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.013276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.014897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.028962 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 09 20:39:37.030735 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 444/899] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:37.037492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:37.061538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b280aa1-8e6a-43a8-a45f-96ca65e3d831 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.103325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.104639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.105103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.105786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.106715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:37.107306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.109449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.120772 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 456/900] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:37.122372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:37.157793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746ab2b-0bfb-406f-8c15-ce095f57941c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.190799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.191738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.192202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.192612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.193660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:37.194108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.195676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.213822 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 445/901] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Apr 9 20:39:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:37.219474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:37.240781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64960-e61c-472f-9378-aa2e39a0e9f1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.280283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.280999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.281417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.281690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.282832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] RBAC: Adding query filter params (interface=public, service_id=6357fb485eb249dcaf3ac6abe72a3b2d, region_id=RegionOne) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:37.283139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.284930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.293073 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 457/902] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:39:37 2022] GET /identity/v3/endpoints?service_id=6357fb485eb249dcaf3ac6abe72a3b2d&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:37.297901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:37.330553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856a6c-6e9d-4644-851b-590ad856ad74 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.364209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.364784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.365162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.365442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.425822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2baa-192a-4ccd-8831-712a644a3211 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.431859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.433369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.462979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279485-ab69-46a5-b3a4-d1a2e86e78bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.463652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279485-ab69-46a5-b3a4-d1a2e86e78bb None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.463935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279485-ab69-46a5-b3a4-d1a2e86e78bb None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.464208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279485-ab69-46a5-b3a4-d1a2e86e78bb None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.464893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279485-ab69-46a5-b3a4-d1a2e86e78bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.466314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279485-ab69-46a5-b3a4-d1a2e86e78bb None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.479013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 458/903] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:37 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:39:37.479013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4e091-0e5b-4266-abde-a47d895ff5e6 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.479013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4e091-0e5b-4266-abde-a47d895ff5e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.479013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4e091-0e5b-4266-abde-a47d895ff5e6 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.479013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 459/904] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:37.481267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b00d-31b0-4f50-80d2-b406e9726b63 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.481557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b00d-31b0-4f50-80d2-b406e9726b63 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.481836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b00d-31b0-4f50-80d2-b406e9726b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.499211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8936b00d-31b0-4f50-80d2-b406e9726b63 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:37.500444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8936b00d-31b0-4f50-80d2-b406e9726b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:37.558921 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 446/905] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 09 20:39:37.560440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:37.581753 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 460/906] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:37.600211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936b00d-31b0-4f50-80d2-b406e9726b63 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:37.690786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a73dc-dad8-4977-8813-4fcb2eb5ed9d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.727872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.728692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.728973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.729329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.737099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936b00d-31b0-4f50-80d2-b406e9726b63 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.739738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.741286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.760582 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:37.762202 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 447/907] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:37.769063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:37.789588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.790734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.791011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.791280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.792264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.794200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.813142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 461/908] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:37 2022] POST /identity/v3/services => generated 241 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:37.885677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e4194-743e-41a5-b3f6-7e3d89593846 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:37.933118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:37.933801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:37.934079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:37.934351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:37.935071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:37.935371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:37.936764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:37.954530 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 448/909] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:37.957618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:38.059316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925e48-ebc0-477b-972a-59e67385d4fe None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:38.092709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:38.093547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:38.093821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:38.094086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:38.100626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:38.102109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:38.115312 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:38.121185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 462/910] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:38.122689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:38.219605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82445-3731-44a6-bde7-3de8d0f9132c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:38.252573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044357da-73cd-4aba-a52d-c8aeefe138ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:38.253348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044357da-73cd-4aba-a52d-c8aeefe138ed None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:38.253631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044357da-73cd-4aba-a52d-c8aeefe138ed None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:38.253901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044357da-73cd-4aba-a52d-c8aeefe138ed None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:38.254681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044357da-73cd-4aba-a52d-c8aeefe138ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:38.254980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044357da-73cd-4aba-a52d-c8aeefe138ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:38.256423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044357da-73cd-4aba-a52d-c8aeefe138ed None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:38.273147 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 449/911] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:38.274905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:38.372659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43d992-78e5-4fce-95c9-a0f401f1d14c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:38.405532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee85c7-8b5b-46ff-9e4e-0ce0abe81e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:38.406188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee85c7-8b5b-46ff-9e4e-0ce0abe81e81 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:38.406466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee85c7-8b5b-46ff-9e4e-0ce0abe81e81 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:38.406786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee85c7-8b5b-46ff-9e4e-0ce0abe81e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:38.407658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee85c7-8b5b-46ff-9e4e-0ce0abe81e81 None admin] RBAC: Adding query filter params (role.id=0c4198c4d36d49d59ed44bc16c2573de, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=65106688ce7b496880f3b7753f766f7d) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:38.408006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee85c7-8b5b-46ff-9e4e-0ce0abe81e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:38.409479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee85c7-8b5b-46ff-9e4e-0ce0abe81e81 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:38.418525 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 463/912] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:38 2022] GET /identity/v3/role_assignments?user.id=65106688ce7b496880f3b7753f766f7d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=0c4198c4d36d49d59ed44bc16c2573de => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:39.089582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a245d-46a8-437b-a368-e611f434d00e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.090139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a245d-46a8-437b-a368-e611f434d00e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.090139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a245d-46a8-437b-a368-e611f434d00e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.091710 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 450/913] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:39.097130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11f5f-2375-4e22-82e4-0d272c8d6eee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.097519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11f5f-2375-4e22-82e4-0d272c8d6eee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.097677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11f5f-2375-4e22-82e4-0d272c8d6eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.114702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d4c11f5f-2375-4e22-82e4-0d272c8d6eee None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:39.115878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d4c11f5f-2375-4e22-82e4-0d272c8d6eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:39.179613 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 464/914] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:39.203878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a245d-46a8-437b-a368-e611f434d00e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:39.304623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a245d-46a8-437b-a368-e611f434d00e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:39.338231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:39.339055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.339331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.339653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.340248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:39.341654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:39.353089 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 09 20:39:39.354594 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 451/915] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Apr 9 20:39:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:39.360548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11f5f-2375-4e22-82e4-0d272c8d6eee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:39.467817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11f5f-2375-4e22-82e4-0d272c8d6eee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:39.500706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:39.501442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.501718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.501992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.502698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:39.503001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:39.504397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:39.509436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 465/916] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:39.515151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:39.621251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee31c0-c5bb-4021-861e-3854e0118244 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:39.655824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8479374-79e5-4794-b72f-8f79bc59bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:39.656553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8479374-79e5-4794-b72f-8f79bc59bc21 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.656833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8479374-79e5-4794-b72f-8f79bc59bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.657131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8479374-79e5-4794-b72f-8f79bc59bc21 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.657872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8479374-79e5-4794-b72f-8f79bc59bc21 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:39.658174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8479374-79e5-4794-b72f-8f79bc59bc21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:39.659542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8479374-79e5-4794-b72f-8f79bc59bc21 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:39.664667 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 452/917] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:39.670258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:39.769783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18440a29-3568-478f-84d2-ca8d1ce4d6dc None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:39.803869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30182-e9bb-4abf-b034-9896cbe87af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:39.804920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30182-e9bb-4abf-b034-9896cbe87af9 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.805427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30182-e9bb-4abf-b034-9896cbe87af9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.805897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30182-e9bb-4abf-b034-9896cbe87af9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.806864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30182-e9bb-4abf-b034-9896cbe87af9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:39.808475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30182-e9bb-4abf-b034-9896cbe87af9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:39.832716 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 466/918] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:39.936309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856daa62-a745-4f82-afc7-9d0b79762c8e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.936493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856daa62-a745-4f82-afc7-9d0b79762c8e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.936766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856daa62-a745-4f82-afc7-9d0b79762c8e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.938589 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 453/919] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:39.947024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e404-485b-4e24-9b5f-5ea5fd4e97a8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:39.947333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e404-485b-4e24-9b5f-5ea5fd4e97a8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:39.947587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e404-485b-4e24-9b5f-5ea5fd4e97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:39.968156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b459e404-485b-4e24-9b5f-5ea5fd4e97a8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:39.969891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b459e404-485b-4e24-9b5f-5ea5fd4e97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:40.050991 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 467/920] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:40.076479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856daa62-a745-4f82-afc7-9d0b79762c8e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.180832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856daa62-a745-4f82-afc7-9d0b79762c8e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:40.214349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83dfba-4ac1-4141-aee9-aaddca66d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:40.215160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83dfba-4ac1-4141-aee9-aaddca66d6ee None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.215478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83dfba-4ac1-4141-aee9-aaddca66d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.215754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83dfba-4ac1-4141-aee9-aaddca66d6ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.216401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83dfba-4ac1-4141-aee9-aaddca66d6ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:40.217821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83dfba-4ac1-4141-aee9-aaddca66d6ee None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:40.228996 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-cb83dfba-4ac1-4141-aee9-aaddca66d6ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 09 20:39:40.230528 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 454/921] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:40.236434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e404-485b-4e24-9b5f-5ea5fd4e97a8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.336595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e404-485b-4e24-9b5f-5ea5fd4e97a8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:40.338154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1cbd-8932-49ee-85e3-15fae4deaaaa None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.338446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1cbd-8932-49ee-85e3-15fae4deaaaa None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.338726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1cbd-8932-49ee-85e3-15fae4deaaaa None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.340351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 455/922] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:40.345468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad355bd-5a55-4308-a4d2-8493fcf51964 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.345741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad355bd-5a55-4308-a4d2-8493fcf51964 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.346021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad355bd-5a55-4308-a4d2-8493fcf51964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.366531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-aad355bd-5a55-4308-a4d2-8493fcf51964 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:40.368194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-aad355bd-5a55-4308-a4d2-8493fcf51964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:40.372728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:40.373681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.374174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.374640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.375580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:40.376086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:40.377813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:40.383576 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 468/923] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:40.389074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.449500 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 456/924] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:40.479519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad355bd-5a55-4308-a4d2-8493fcf51964 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.516067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8a11-1e71-440d-a011-aa87679386fa None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:40.563531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:40.564219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.564657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.564942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.565978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:40.566288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:40.567683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:40.574790 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 469/925] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Apr 9 20:39:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:40.582140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.585176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad355bd-5a55-4308-a4d2-8493fcf51964 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:40.618444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:40.624716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.625001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.625304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.626049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:40.627550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:40.639100 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 09 20:39:40.640627 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 457/926] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:40.646359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.698246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93569a9c-ffe3-45a5-bc6e-b2af45385d1f None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:40.732206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aebf3b-ed00-4e07-bc7a-41feb4cab2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:40.732802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebf3b-ed00-4e07-bc7a-41feb4cab2ef None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.733115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebf3b-ed00-4e07-bc7a-41feb4cab2ef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.733380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebf3b-ed00-4e07-bc7a-41feb4cab2ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.734119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aebf3b-ed00-4e07-bc7a-41feb4cab2ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:40.735544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aebf3b-ed00-4e07-bc7a-41feb4cab2ef None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:40.765061 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 470/927] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:39:40.771667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecceb61-7aae-4bc4-bf8a-f57bdf9b5bca None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:40.816971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:40.817691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.817968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.818237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.818950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:40.819251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:40.820664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:40.824810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce67261-e919-4b03-9f72-953b8dbe7816 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.825125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce67261-e919-4b03-9f72-953b8dbe7816 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.825402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce67261-e919-4b03-9f72-953b8dbe7816 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.827557 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 471/928] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:40.829393 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 458/929] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:40.835275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1077f6-c7a3-44eb-97f3-2771d1c30341 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:40.835561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1077f6-c7a3-44eb-97f3-2771d1c30341 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:40.835841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1077f6-c7a3-44eb-97f3-2771d1c30341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:40.836496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.853084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1b1077f6-c7a3-44eb-97f3-2771d1c30341 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:40.854339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b1077f6-c7a3-44eb-97f3-2771d1c30341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:40.933195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 472/930] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:40.958881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1077f6-c7a3-44eb-97f3-2771d1c30341 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:40.965230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8105f9d-d18f-46c2-8f38-1fcd7e9f5932 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.004445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.005233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.006044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.006044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.006764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:41.007149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.008528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.014767 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 459/931] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:41.020755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:41.093238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1077f6-c7a3-44eb-97f3-2771d1c30341 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.126746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ee21-6dc9-4ad0-a8dc-aa99cbd37ccb None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.127238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.128070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.128351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.128621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.139099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:41.146819 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 09 20:39:41.153266 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 473/932] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Apr 9 20:39:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:41.154290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:41.160897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.161608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.161887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.162161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.162961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] RBAC: Adding query filter params (interface=public, service_id=1a7239a13e604ef2a81bad9b5fee862f, region_id=RegionOne) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:41.163270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.164723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.170761 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 460/933] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/endpoints?service_id=1a7239a13e604ef2a81bad9b5fee862f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:41.176568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:41.255154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2898-6283-468d-a9a6-a8c4b728a519 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.277230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dab78-bb01-4530-9381-42a728a8ab46 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.287934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.288615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.288896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.289219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.289968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:41.290285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.291671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.304549 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 474/934] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:41.305603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:41.310640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.311308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.311587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.311856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.312539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.314032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.325152 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 461/935] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:39:41.411355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4288b-5ecc-49d8-95b0-b7c2c74db5e3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.449773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.449773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.449773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.449773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.461920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.463422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.481011 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:41.482636 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 475/936] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:41.488417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:41.593192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10549-0779-4eb7-b6d1-b1441b3b1a63 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.626111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.626785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.627070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.627344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.628068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:41.628374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.629778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.642221 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 462/937] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:41.647889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:41.748296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59065e88-d467-4550-b8c0-e970cdcf5fb8 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.783271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.784105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.784388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.784663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.792930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.794431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.808810 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 09 20:39:41.810397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 476/938] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:41.816179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:41.915286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0807-fba7-4101-8d2e-efeebf140197 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:41.950689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:41.951369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:41.951648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:41.951919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:41.952757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:41.953081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:41.954594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:41.974092 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 463/939] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:41.979569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.081533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b497-be38-4f03-831a-dcf72fa2e325 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.115992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.116808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.117114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.117390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.128184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.129699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.146099 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:42.147709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 477/940] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:42.153303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.255128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569852-c8a4-484f-b679-74a86055a932 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.287718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900b9c6-272a-446a-b3ce-b7b3e2a613a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.288476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900b9c6-272a-446a-b3ce-b7b3e2a613a7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.288630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900b9c6-272a-446a-b3ce-b7b3e2a613a7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.288906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900b9c6-272a-446a-b3ce-b7b3e2a613a7 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.289669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900b9c6-272a-446a-b3ce-b7b3e2a613a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:42.289973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900b9c6-272a-446a-b3ce-b7b3e2a613a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.291345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900b9c6-272a-446a-b3ce-b7b3e2a613a7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.303039 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 464/941] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:42.308215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.360635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e348-a3e1-4dc3-85c5-70153ebfaf09 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.361014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e348-a3e1-4dc3-85c5-70153ebfaf09 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.361355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e348-a3e1-4dc3-85c5-70153ebfaf09 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.362929 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 465/942] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:42.370210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fa72f-221b-4b67-8109-0cab9ad76a97 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.370498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fa72f-221b-4b67-8109-0cab9ad76a97 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.370777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fa72f-221b-4b67-8109-0cab9ad76a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.392100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c71fa72f-221b-4b67-8109-0cab9ad76a97 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:42.394086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c71fa72f-221b-4b67-8109-0cab9ad76a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:42.408001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a8c9f-9fa3-4123-8171-6bee2720b6ce None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.442812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.443633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.443909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.444185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.452419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.453096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.468102 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:42.469704 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 478/943] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:42.475177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.485283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 466/944] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:42.503409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fa72f-221b-4b67-8109-0cab9ad76a97 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.575503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a2c5d-d57b-4d26-852a-a734b27436d7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.602126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fa72f-221b-4b67-8109-0cab9ad76a97 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.612638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.613221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.613566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.613842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.614904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:42.615010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.616426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.633140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 479/945] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:42.635251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.642838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.644197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.644671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.645148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] PATH_INFO: `/v3/services/compute` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.645986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.647719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.663591 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 09 20:39:42.670133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 467/946] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:42.671512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.735674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6561789-ab1e-4882-8916-821d0de1ab77 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.769235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.770037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4935-9fac-489c-856a-f27cb6e02a9d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.770148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.770464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.770739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/65106688ce7b496880f3b7753f766f7d/roles/0c4198c4d36d49d59ed44bc16c2573de` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.773775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=65106688ce7b496880f3b7753f766f7d, role_id=0c4198c4d36d49d59ed44bc16c2573de)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.774575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.793470 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 480/947] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:39:42 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/65106688ce7b496880f3b7753f766f7d/roles/0c4198c4d36d49d59ed44bc16c2573de => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:39:42.814749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40b95f-2859-49ef-8b7d-e91d683b4128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.816055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40b95f-2859-49ef-8b7d-e91d683b4128 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.816619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40b95f-2859-49ef-8b7d-e91d683b4128 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.817182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40b95f-2859-49ef-8b7d-e91d683b4128 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.818277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40b95f-2859-49ef-8b7d-e91d683b4128 None admin] RBAC: Adding query filter params (name=compute) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:42.818949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40b95f-2859-49ef-8b7d-e91d683b4128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.820901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40b95f-2859-49ef-8b7d-e91d683b4128 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.831932 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 468/948] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:42.834015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:42.943137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495842ee-7f9e-42ac-8d05-4346cbfaca48 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:42.984385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcace03-303f-4294-a686-e17e75e30c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:42.985186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcace03-303f-4294-a686-e17e75e30c8d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:42.985470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcace03-303f-4294-a686-e17e75e30c8d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:42.985747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcace03-303f-4294-a686-e17e75e30c8d None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:42.986468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcace03-303f-4294-a686-e17e75e30c8d None admin] RBAC: Adding query filter params (type=compute) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:42.986777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcace03-303f-4294-a686-e17e75e30c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:42.988201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcace03-303f-4294-a686-e17e75e30c8d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:42.993949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 481/949] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:43.293068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4338a5-d73d-4c7e-a592-6132546c0d7b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:43.293607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4338a5-d73d-4c7e-a592-6132546c0d7b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:43.293607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4338a5-d73d-4c7e-a592-6132546c0d7b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:43.295284 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 469/950] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:43.302410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4d181-0fec-471a-beba-5f6108394b75 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:43.302917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4d181-0fec-471a-beba-5f6108394b75 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:43.303391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4d181-0fec-471a-beba-5f6108394b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:43.320218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-74b4d181-0fec-471a-beba-5f6108394b75 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:43.322147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-74b4d181-0fec-471a-beba-5f6108394b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:43.388390 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 482/951] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:43.413009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4338a5-d73d-4c7e-a592-6132546c0d7b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:43.517356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4338a5-d73d-4c7e-a592-6132546c0d7b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:43.549471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:43.550460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:43.550929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:43.551428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:43.552309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:43.553999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:43.555669 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.common [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 09 20:39:43.574588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.sql.core [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 09 20:39:43.574588 ncdv-master-1 devstack@keystone.service[102531]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 09 20:39:43.574588 ncdv-master-1 devstack@keystone.service[102531]: [parameters: {'id': '1ac4898611c94ee2bb41d642a8741cc8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 09 20:39:43.574588 ncdv-master-1 devstack@keystone.service[102531]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102531) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 09 20:39:43.581862 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ac4898611c94ee2bb41d642a8741cc8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ac4898611c94ee2bb41d642a8741cc8. Apr 09 20:39:43.584235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 470/952] 10.222.0.30 () {60 vars in 1140 bytes} [Sat Apr 9 20:39:43 2022] POST /identity/v3/projects => generated 262 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:43.589702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4d181-0fec-471a-beba-5f6108394b75 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:43.687713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4d181-0fec-471a-beba-5f6108394b75 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:43.721803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38829d4-8b79-4cca-a919-f39846540490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:43.722617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38829d4-8b79-4cca-a919-f39846540490 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:43.722899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38829d4-8b79-4cca-a919-f39846540490 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:43.723169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38829d4-8b79-4cca-a919-f39846540490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:43.730100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38829d4-8b79-4cca-a919-f39846540490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:43.731583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38829d4-8b79-4cca-a919-f39846540490 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:43.744527 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d38829d4-8b79-4cca-a919-f39846540490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:43.746096 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 483/953] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:43.751973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:43.766530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2295-817c-42ec-9483-37a5b4f7772d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:43.766799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2295-817c-42ec-9483-37a5b4f7772d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:43.767065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2295-817c-42ec-9483-37a5b4f7772d None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:43.768686 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 484/954] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:43.774073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e380e-d260-4ec9-9e67-4eb3b8eaccaf None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:43.774356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e380e-d260-4ec9-9e67-4eb3b8eaccaf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:43.774627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e380e-d260-4ec9-9e67-4eb3b8eaccaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:43.794844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a83e380e-d260-4ec9-9e67-4eb3b8eaccaf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:43.796391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a83e380e-d260-4ec9-9e67-4eb3b8eaccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:43.854173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbce81-5a9c-43fd-b361-fb5d93d211e2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:43.885398 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 485/955] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:43.886924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:43.887660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:43.888011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:43.888354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:43.889214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:43.889585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:43.891400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:43.901319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e380e-d260-4ec9-9e67-4eb3b8eaccaf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:43.913949 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 471/956] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:44.011004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e380e-d260-4ec9-9e67-4eb3b8eaccaf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:44.051222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:44.052444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:44.052925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:44.053613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:44.054470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:44.056088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:44.069729 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 09 20:39:44.071752 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 486/957] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:44.077597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:44.185384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76033e72-2d7f-4900-8218-8221aff05b78 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:44.222841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:44.223918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:44.224398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:44.224860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:44.225778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:44.226380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:44.227963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:44.233658 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 472/958] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:44.239040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:44.344878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d3bd-17c5-41cf-82fc-6f6b779753b4 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:44.378514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a753b0c-5f8d-4686-9d5a-b2f18fe7f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:44.379529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753b0c-5f8d-4686-9d5a-b2f18fe7f13d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:44.379997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753b0c-5f8d-4686-9d5a-b2f18fe7f13d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:44.380471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753b0c-5f8d-4686-9d5a-b2f18fe7f13d None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:44.381401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a753b0c-5f8d-4686-9d5a-b2f18fe7f13d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:44.381901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a753b0c-5f8d-4686-9d5a-b2f18fe7f13d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:44.383494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a753b0c-5f8d-4686-9d5a-b2f18fe7f13d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:44.389289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 487/959] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:44.395246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:44.492886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b9d59-31d9-4fc5-a414-dfaeb78f7181 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:44.525517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46583-89f5-4c0b-a29e-c29b915f52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:44.526426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46583-89f5-4c0b-a29e-c29b915f52aa None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:44.526841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46583-89f5-4c0b-a29e-c29b915f52aa None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:44.527247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46583-89f5-4c0b-a29e-c29b915f52aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:44.528109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d46583-89f5-4c0b-a29e-c29b915f52aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:44.529680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d46583-89f5-4c0b-a29e-c29b915f52aa None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:44.551502 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 473/960] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:45.287669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b126b-45cc-4b29-ae53-7f7d5b9d811d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.288361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b126b-45cc-4b29-ae53-7f7d5b9d811d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.288845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b126b-45cc-4b29-ae53-7f7d5b9d811d None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.290769 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 488/961] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:45.296347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77fd37-b8ad-4479-9406-f099c2e8af83 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.296904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77fd37-b8ad-4479-9406-f099c2e8af83 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.297443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77fd37-b8ad-4479-9406-f099c2e8af83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.315982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1f77fd37-b8ad-4479-9406-f099c2e8af83 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:45.317876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1f77fd37-b8ad-4479-9406-f099c2e8af83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:45.393975 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 474/962] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:45.418523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b126b-45cc-4b29-ae53-7f7d5b9d811d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:45.470475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae9ac-13c5-4a33-bdb1-e2ff06c00ad1 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.471412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae9ac-13c5-4a33-bdb1-e2ff06c00ad1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.471904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae9ac-13c5-4a33-bdb1-e2ff06c00ad1 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.473759 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 475/963] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:45.479291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732a3e0-abcf-413f-8f42-9d6ef9ac73c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.479945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732a3e0-abcf-413f-8f42-9d6ef9ac73c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.480723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732a3e0-abcf-413f-8f42-9d6ef9ac73c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.499861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7732a3e0-abcf-413f-8f42-9d6ef9ac73c0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:45.501933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7732a3e0-abcf-413f-8f42-9d6ef9ac73c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:45.525979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b126b-45cc-4b29-ae53-7f7d5b9d811d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:45.560612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:45.561988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.562439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.562909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.576050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:45.584154 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 09 20:39:45.584570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 476/964] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:45.586028 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 489/965] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Apr 9 20:39:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:45.592004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732a3e0-abcf-413f-8f42-9d6ef9ac73c0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:45.604144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:45.690297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732a3e0-abcf-413f-8f42-9d6ef9ac73c0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:45.701637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b540-884f-41c9-9f7b-817945bbbcf2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:45.725150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:45.726075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.726496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.726934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.727821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:45.728283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:45.729858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:45.735887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:45.736813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.737304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.737772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.738660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:45.740218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:45.743845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 477/966] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Apr 9 20:39:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:45.745054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:45.769301 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 490/967] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:45 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:39:45.868261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8d3d3-c7de-445e-8ae3-f4a779a49481 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:45.912166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:45.913255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:45.913677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:45.914114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:45.925958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:45.927723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:45.949713 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:45.951397 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 478/968] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:45.957181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.060141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b29a89-b5b0-45d7-99a2-e64624bcbe04 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:46.095275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:46.095959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.096236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.096507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.097249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:46.097555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:46.098962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:46.111242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 491/969] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:46.117302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.219448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5082-1cb5-4e9f-8b26-f9723e4e0e5a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:46.252491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdfbb6-622d-4ad7-9cc7-fe6906ff01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:46.253359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfbb6-622d-4ad7-9cc7-fe6906ff01fa None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.253635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfbb6-622d-4ad7-9cc7-fe6906ff01fa None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.253904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfbb6-622d-4ad7-9cc7-fe6906ff01fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.261785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdfbb6-622d-4ad7-9cc7-fe6906ff01fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:46.263256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdfbb6-622d-4ad7-9cc7-fe6906ff01fa None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:46.277403 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-35fdfbb6-622d-4ad7-9cc7-fe6906ff01fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 09 20:39:46.278942 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 479/970] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:39:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:46.286125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.385146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc01db-9c6a-49f6-88c0-95214d3cae1a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:46.419088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:46.420555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.421054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.421552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.422640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:46.423160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:46.424820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:46.433748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2eea6-f7f9-4914-b9f2-d45bbee2f27a None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.440210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2eea6-f7f9-4914-b9f2-d45bbee2f27a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.440708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2eea6-f7f9-4914-b9f2-d45bbee2f27a None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.443361 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 492/971] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Apr 9 20:39:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:46.450187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.452468 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 480/972] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:46.454122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592d964-99b4-4709-b02e-78892e34cac5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.454619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592d964-99b4-4709-b02e-78892e34cac5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.455078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592d964-99b4-4709-b02e-78892e34cac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.473467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3592d964-99b4-4709-b02e-78892e34cac5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:46.475441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3592d964-99b4-4709-b02e-78892e34cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:46.551765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a88c-5eca-411c-992e-ab86609654ae None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:46.552680 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 481/973] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:46.578649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592d964-99b4-4709-b02e-78892e34cac5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.589324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:46.590576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.591907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.593021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.681100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:46.682707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:46.684441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592d964-99b4-4709-b02e-78892e34cac5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:46.727567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:46.728541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.728985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.729454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.730335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:46.731976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:46.752153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.sql.core [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 09 20:39:46.752153 ncdv-master-1 devstack@keystone.service[102531]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 09 20:39:46.752153 ncdv-master-1 devstack@keystone.service[102531]: [parameters: {'user_id': '1550234b3e834e3288ea5b9d1de1c504', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 09 20:39:46.752153 ncdv-master-1 devstack@keystone.service[102531]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102531) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 09 20:39:46.758383 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 09 20:39:46.765184 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 482/974] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Apr 9 20:39:46 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:46.767156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.805108 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 493/975] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:39:46.807930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.880284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fcb40-26a5-47b2-93d4-bbc962bdc460 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:46.923323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999595-611a-4839-b933-621c95b0b116 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:46.923577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:46.925284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.926678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.927166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.937109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:46.939480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:46.955853 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 09 20:39:46.958557 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 483/976] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:46.964279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:46.971287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c137d4-2ba6-41d0-acdb-15d5c9c9ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:46.972359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c137d4-2ba6-41d0-acdb-15d5c9c9ab5a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:46.972811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c137d4-2ba6-41d0-acdb-15d5c9c9ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:46.973304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c137d4-2ba6-41d0-acdb-15d5c9c9ab5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:46.983666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c137d4-2ba6-41d0-acdb-15d5c9c9ab5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:46.985450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c137d4-2ba6-41d0-acdb-15d5c9c9ab5a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.004807 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a1c137d4-2ba6-41d0-acdb-15d5c9c9ab5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:47.006257 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 494/977] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:47.007741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d14df-acbd-4b60-86a9-979dc124d9ee None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.008250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d14df-acbd-4b60-86a9-979dc124d9ee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.008675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d14df-acbd-4b60-86a9-979dc124d9ee None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.010584 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 495/978] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:47.011619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d14df-acbd-4b60-86a9-979dc124d9ee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.074488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71931825-9eee-4e72-b371-5a5be0b69af6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.108199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fb15c-582c-484f-9cad-396ea006ed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.109185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fb15c-582c-484f-9cad-396ea006ed90 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.109503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fb15c-582c-484f-9cad-396ea006ed90 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.109806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fb15c-582c-484f-9cad-396ea006ed90 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.110583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fb15c-582c-484f-9cad-396ea006ed90 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:47.110881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fb15c-582c-484f-9cad-396ea006ed90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.110977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d14df-acbd-4b60-86a9-979dc124d9ee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.112311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fb15c-582c-484f-9cad-396ea006ed90 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.143441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.144117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.144398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.144671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.145423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:47.145739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.147133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.157255 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 484/979] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Apr 9 20:39:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:47.157255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037860f-df97-4d5b-b1b5-d375405a8f5b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.157255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037860f-df97-4d5b-b1b5-d375405a8f5b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.157255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037860f-df97-4d5b-b1b5-d375405a8f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.168872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2037860f-df97-4d5b-b1b5-d375405a8f5b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:47.170715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2037860f-df97-4d5b-b1b5-d375405a8f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:47.174274 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 496/980] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:47.176249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.244674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 485/981] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:47.268496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037860f-df97-4d5b-b1b5-d375405a8f5b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.300485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013940a-1793-4205-b513-2cb2c5d3f0c1 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.343725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.345260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.345541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.345812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.355994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.357547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.372403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037860f-df97-4d5b-b1b5-d375405a8f5b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.374271 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:47.377076 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 497/982] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:47.381383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.423746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.424885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.425192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.425463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.426112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.427512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.444209 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 09 20:39:47.445850 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 486/983] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:47.452430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.506650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c877ccc-675d-4515-9d73-a3ea2aa9fba6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.539475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.540373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.540818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.541337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.542273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:47.542732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.544319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.557001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 498/984] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:47.562901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.564004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809b97-6410-4df1-898b-3ba97e97abfa None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.600543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.601242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.601522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.601792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.602494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:47.602793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.604158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.610273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 487/985] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:47.615642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.660633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c0478-4544-4bde-880c-b2ed2a27350a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.693797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.694460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.694740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.695011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.695831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] RBAC: Adding query filter params (role.id=0c4198c4d36d49d59ed44bc16c2573de, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=65106688ce7b496880f3b7753f766f7d) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:47.696142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.697631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.703716 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 499/986] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/role_assignments?user.id=65106688ce7b496880f3b7753f766f7d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=0c4198c4d36d49d59ed44bc16c2573de => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:47.723762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4d123-947b-4e6c-8b79-d9d351d7085e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.759613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.760619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.761120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.761573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.762473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:47.762961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.764564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.770809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 488/987] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:47.776579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:47.887217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f5f88-b605-4e9a-8f8a-3cf9bc7ff415 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:47.921960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bef855-696d-4c16-bd8f-d04fb7346553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:47.922630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef855-696d-4c16-bd8f-d04fb7346553 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:47.922903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef855-696d-4c16-bd8f-d04fb7346553 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:47.923175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef855-696d-4c16-bd8f-d04fb7346553 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:47.923983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bef855-696d-4c16-bd8f-d04fb7346553 None admin] RBAC: Adding query filter params (interface=admin, service_id=1a7239a13e604ef2a81bad9b5fee862f, region_id=RegionOne) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:47.924273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bef855-696d-4c16-bd8f-d04fb7346553 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:47.925713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bef855-696d-4c16-bd8f-d04fb7346553 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:47.930969 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 500/988] 10.222.0.30 () {56 vars in 1249 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/endpoints?service_id=1a7239a13e604ef2a81bad9b5fee862f&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:47.936457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:48.037101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f872b-ca60-4ce4-a480-5d37e821f9db None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:48.070181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89fdf1-285a-4e0f-abea-e06b62228090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:48.070848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89fdf1-285a-4e0f-abea-e06b62228090 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:48.071125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89fdf1-285a-4e0f-abea-e06b62228090 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:48.071397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89fdf1-285a-4e0f-abea-e06b62228090 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:48.072076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89fdf1-285a-4e0f-abea-e06b62228090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:48.073479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89fdf1-285a-4e0f-abea-e06b62228090 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:48.079714 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 489/989] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:47 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:39:48.246310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a09c2-1150-4bcb-9592-8f35778433bc None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:48.246691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a09c2-1150-4bcb-9592-8f35778433bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:48.246859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a09c2-1150-4bcb-9592-8f35778433bc None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:48.248422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 501/990] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:48.254301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112125-5668-4749-912f-77380b462dd6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:48.254301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112125-5668-4749-912f-77380b462dd6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:48.254611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112125-5668-4749-912f-77380b462dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:48.271820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f112125-5668-4749-912f-77380b462dd6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:48.273094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f112125-5668-4749-912f-77380b462dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:48.338671 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 490/991] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:48.362159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a09c2-1150-4bcb-9592-8f35778433bc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:48.462329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a09c2-1150-4bcb-9592-8f35778433bc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:48.496179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:48.496996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:48.497316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:48.497561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:48.498222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:48.499607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:48.510675 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 09 20:39:48.512094 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 502/992] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:48.517979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112125-5668-4749-912f-77380b462dd6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:48.616500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112125-5668-4749-912f-77380b462dd6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:48.650031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:48.650696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:48.650972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:48.651241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:48.651960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] RBAC: Adding query filter params (name=compute) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:48.652258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:48.653666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:48.658492 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 491/993] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:48.664053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:48.758984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5f765-1c39-4ca0-9899-bf51b46084f6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:48.790768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:48.791437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:48.791710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:48.791975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:48.792674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] RBAC: Adding query filter params (type=compute) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:48.792998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:48.794381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:48.799355 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 503/994] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:48.805108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:48.902919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650d98-9e47-465d-844d-a055058baabb None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:48.937504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda855-c41a-4820-95ea-36f0fcb72029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:48.938164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda855-c41a-4820-95ea-36f0fcb72029 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:48.938451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda855-c41a-4820-95ea-36f0fcb72029 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:48.938721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda855-c41a-4820-95ea-36f0fcb72029 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:48.939522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda855-c41a-4820-95ea-36f0fcb72029 None admin] RBAC: Adding query filter params (interface=public, service_id=7555773fa3764b9490b404a75fcd623c, region_id=RegionOne) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:48.939825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda855-c41a-4820-95ea-36f0fcb72029 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:48.941237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda855-c41a-4820-95ea-36f0fcb72029 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:48.946506 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 492/995] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:39:48 2022] GET /identity/v3/endpoints?service_id=7555773fa3764b9490b404a75fcd623c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:48.952014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:49.055267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809572-6ec7-4436-a310-d5c236963f1b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:49.087892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb0744-bed3-4315-8bbb-8e2a5f575f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:49.088564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb0744-bed3-4315-8bbb-8e2a5f575f2b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:49.088842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb0744-bed3-4315-8bbb-8e2a5f575f2b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:49.089158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb0744-bed3-4315-8bbb-8e2a5f575f2b None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:49.089884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb0744-bed3-4315-8bbb-8e2a5f575f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:49.091308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb0744-bed3-4315-8bbb-8e2a5f575f2b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:49.097580 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 504/996] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:48 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:39:50.102823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c729b9-5ce5-48e7-88bb-ead80b9e8d71 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.103399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c729b9-5ce5-48e7-88bb-ead80b9e8d71 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.103399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c729b9-5ce5-48e7-88bb-ead80b9e8d71 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.104791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 493/997] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:50.110296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c67f7-ec68-4ae4-a8f4-f150df63f3e5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.110751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c67f7-ec68-4ae4-a8f4-f150df63f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.110830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c67f7-ec68-4ae4-a8f4-f150df63f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.128022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-009c67f7-ec68-4ae4-a8f4-f150df63f3e5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:50.129286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-009c67f7-ec68-4ae4-a8f4-f150df63f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:50.198346 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 505/998] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:50.221662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c729b9-5ce5-48e7-88bb-ead80b9e8d71 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:50.324571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c729b9-5ce5-48e7-88bb-ead80b9e8d71 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:50.358271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2ecc8-cc4d-470f-8b99-727776722d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:50.358989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2ecc8-cc4d-470f-8b99-727776722d3f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.359289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2ecc8-cc4d-470f-8b99-727776722d3f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.359557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2ecc8-cc4d-470f-8b99-727776722d3f None admin] PATH_INFO: `/v3/services/image` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.360201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2ecc8-cc4d-470f-8b99-727776722d3f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:50.361613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2ecc8-cc4d-470f-8b99-727776722d3f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:50.372377 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-9bb2ecc8-cc4d-470f-8b99-727776722d3f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 09 20:39:50.381266 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 494/999] 10.222.0.30 () {56 vars in 1105 bytes} [Sat Apr 9 20:39:50 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:50.381431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c67f7-ec68-4ae4-a8f4-f150df63f3e5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:50.455693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338a5d6-ffef-47bb-809d-ae16c644ca05 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.455971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338a5d6-ffef-47bb-809d-ae16c644ca05 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.456592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338a5d6-ffef-47bb-809d-ae16c644ca05 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.458168 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 495/1000] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:39:50.462748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058ab77-60c7-49c4-b7ec-998eb07b3594 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.463028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058ab77-60c7-49c4-b7ec-998eb07b3594 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.463299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058ab77-60c7-49c4-b7ec-998eb07b3594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.479427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3058ab77-60c7-49c4-b7ec-998eb07b3594 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:50.480609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3058ab77-60c7-49c4-b7ec-998eb07b3594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:50.481899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c67f7-ec68-4ae4-a8f4-f150df63f3e5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:50.513856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:50.514501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.514778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.515046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.515782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] RBAC: Adding query filter params (name=image) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:50.516090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:50.517535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:50.526703 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 506/1001] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:50.528155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:50.547641 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 496/1002] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:50.571635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058ab77-60c7-49c4-b7ec-998eb07b3594 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:50.625880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254adf0-a864-4b57-8776-a31ed5262805 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:50.658103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:50.658835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.659117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.659394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.660095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] RBAC: Adding query filter params (type=image) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:50.660398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:50.661816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:50.665841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058ab77-60c7-49c4-b7ec-998eb07b3594 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:50.666397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 507/1003] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:50.702669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:50.703667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.703899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.704194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.704881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:50.706381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:50.718794 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 09 20:39:50.720335 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 497/1004] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Apr 9 20:39:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:50.726384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:50.832508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5fc07-81fc-45b6-ad4b-25c660a040eb None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:50.868760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:50.869458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:50.869734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:50.869999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:50.870723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:50.871018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:50.872383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:50.877621 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 508/1005] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:50.883368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:50.980285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd7f7-d5b9-40ad-bdb6-6710a2e94f3b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:51.014675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae262-0541-44af-9a80-2007848f4239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:51.015376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae262-0541-44af-9a80-2007848f4239 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:51.015654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae262-0541-44af-9a80-2007848f4239 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:51.015926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae262-0541-44af-9a80-2007848f4239 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:51.016649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae262-0541-44af-9a80-2007848f4239 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:51.016947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae262-0541-44af-9a80-2007848f4239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:51.018339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae262-0541-44af-9a80-2007848f4239 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:51.023466 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 498/1006] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Apr 9 20:39:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:51.028974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:51.126452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23afe8e-bb2d-4986-a44b-890b0ed9ac57 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:51.158734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32c20-6329-4478-ba7f-34243b50e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:51.159312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32c20-6329-4478-ba7f-34243b50e8a2 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:51.159589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32c20-6329-4478-ba7f-34243b50e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:51.159854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32c20-6329-4478-ba7f-34243b50e8a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:51.160587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32c20-6329-4478-ba7f-34243b50e8a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:51.162006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32c20-6329-4478-ba7f-34243b50e8a2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:51.181963 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 509/1007] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:39:51.455085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188bbef-93bf-4ecc-b482-a91643628d51 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:51.455906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188bbef-93bf-4ecc-b482-a91643628d51 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:51.456183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188bbef-93bf-4ecc-b482-a91643628d51 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:51.457979 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 499/1008] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:51.463306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1be0-806a-4fe9-a39c-55c1ef226075 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:51.463664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1be0-806a-4fe9-a39c-55c1ef226075 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:51.464003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1be0-806a-4fe9-a39c-55c1ef226075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:51.480793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a8ee1be0-806a-4fe9-a39c-55c1ef226075 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:51.482009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a8ee1be0-806a-4fe9-a39c-55c1ef226075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:51.552929 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 510/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:51.576941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188bbef-93bf-4ecc-b482-a91643628d51 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:51.677057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188bbef-93bf-4ecc-b482-a91643628d51 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:51.710546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:51.711359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:51.711635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:51.711900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] PATH_INFO: `/v3/services/compute` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:51.712548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:51.713966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:51.724859 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 09 20:39:51.726231 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 500/1010] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:51.732100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee1be0-806a-4fe9-a39c-55c1ef226075 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:51.828228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee1be0-806a-4fe9-a39c-55c1ef226075 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:51.863815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:51.864489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:51.864737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:51.865057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:51.865777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:51.866076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:51.867476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:51.872684 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 511/1011] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:51.878406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:51.974402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17edfd2-a51c-4734-9ef8-d047eb90cbeb None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:52.007420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c2321-9fd7-45da-8950-b7d306026a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:52.008085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2321-9fd7-45da-8950-b7d306026a60 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:52.008358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2321-9fd7-45da-8950-b7d306026a60 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:52.008624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2321-9fd7-45da-8950-b7d306026a60 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:52.009357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c2321-9fd7-45da-8950-b7d306026a60 None admin] RBAC: Adding query filter params (type=compute) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:52.009658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c2321-9fd7-45da-8950-b7d306026a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:52.011027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c2321-9fd7-45da-8950-b7d306026a60 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:52.015940 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 501/1012] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Apr 9 20:39:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:52.021554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:52.116892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67307d7-d4c2-4585-b539-4ba3c7d448bb None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:52.148571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d5f80-5169-486e-8c1e-d357b403864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:52.149247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d5f80-5169-486e-8c1e-d357b403864b None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:52.149531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d5f80-5169-486e-8c1e-d357b403864b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:52.149794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d5f80-5169-486e-8c1e-d357b403864b None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:52.150518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d5f80-5169-486e-8c1e-d357b403864b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:52.151903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d5f80-5169-486e-8c1e-d357b403864b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:52.172548 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 512/1013] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:53.030649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60db8-65ee-499a-b071-fd41914d92d0 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:53.031192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60db8-65ee-499a-b071-fd41914d92d0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:53.031192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60db8-65ee-499a-b071-fd41914d92d0 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:53.032747 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 502/1014] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:53.038080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabac00-898c-44d0-9bd7-f71c2f3a6ef4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:53.038327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabac00-898c-44d0-9bd7-f71c2f3a6ef4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:53.038628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabac00-898c-44d0-9bd7-f71c2f3a6ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:53.056690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8eabac00-898c-44d0-9bd7-f71c2f3a6ef4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:53.057914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8eabac00-898c-44d0-9bd7-f71c2f3a6ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:53.131608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 513/1015] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:53 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:53.155361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60db8-65ee-499a-b071-fd41914d92d0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:53.260817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60db8-65ee-499a-b071-fd41914d92d0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:53.293801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dcdf9-f4be-43cc-a998-ea76c8ecadf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:53.294382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dcdf9-f4be-43cc-a998-ea76c8ecadf9 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:53.294658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dcdf9-f4be-43cc-a998-ea76c8ecadf9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:53.294926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dcdf9-f4be-43cc-a998-ea76c8ecadf9 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:53.295652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dcdf9-f4be-43cc-a998-ea76c8ecadf9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:53.297060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dcdf9-f4be-43cc-a998-ea76c8ecadf9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:53.321075 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 503/1016] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:53 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:39:53.580194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd2cb-a37b-40a1-bb1e-b0a475e9210c None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:53.580690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd2cb-a37b-40a1-bb1e-b0a475e9210c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:53.580690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd2cb-a37b-40a1-bb1e-b0a475e9210c None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:53.582614 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 514/1017] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:53.587744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1290bd-646f-48e1-9e2a-5ff69fbbc63b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:53.588038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1290bd-646f-48e1-9e2a-5ff69fbbc63b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:53.588315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1290bd-646f-48e1-9e2a-5ff69fbbc63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:53.605295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2a1290bd-646f-48e1-9e2a-5ff69fbbc63b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:53.606595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2a1290bd-646f-48e1-9e2a-5ff69fbbc63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:53.678766 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 504/1018] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:53.703632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdd2cb-a37b-40a1-bb1e-b0a475e9210c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:53.804230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdd2cb-a37b-40a1-bb1e-b0a475e9210c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:53.839040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378577f3-cebf-4247-8601-76ae1e80a37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:53.839769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378577f3-cebf-4247-8601-76ae1e80a37e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:53.840048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378577f3-cebf-4247-8601-76ae1e80a37e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:53.840325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378577f3-cebf-4247-8601-76ae1e80a37e None admin] PATH_INFO: `/v3/domains/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:53.841542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378577f3-cebf-4247-8601-76ae1e80a37e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:53.843017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378577f3-cebf-4247-8601-76ae1e80a37e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:53.845074 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 515/1019] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:53.850841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1290bd-646f-48e1-9e2a-5ff69fbbc63b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:53.946452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1290bd-646f-48e1-9e2a-5ff69fbbc63b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:53.979463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709326c9-d5cc-4881-857b-14592a706f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:53.980182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709326c9-d5cc-4881-857b-14592a706f5e None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:53.980464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709326c9-d5cc-4881-857b-14592a706f5e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:53.980754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709326c9-d5cc-4881-857b-14592a706f5e None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:53.981487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709326c9-d5cc-4881-857b-14592a706f5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:53.982925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709326c9-d5cc-4881-857b-14592a706f5e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:54.017071 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 505/1020] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:39:53 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:54.607098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fff8f8-f055-42fe-90d7-7ee3172ea4ea None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:54.607981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fff8f8-f055-42fe-90d7-7ee3172ea4ea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:54.607981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fff8f8-f055-42fe-90d7-7ee3172ea4ea None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:54.609283 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 516/1021] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:54.614337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8769d-a335-45e2-815c-3654d4e0cbbe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:54.614761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8769d-a335-45e2-815c-3654d4e0cbbe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:54.614840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8769d-a335-45e2-815c-3654d4e0cbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:54.631567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-22f8769d-a335-45e2-815c-3654d4e0cbbe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:54.632744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-22f8769d-a335-45e2-815c-3654d4e0cbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:54.695850 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 506/1022] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:54.720294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fff8f8-f055-42fe-90d7-7ee3172ea4ea None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:54.820058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fff8f8-f055-42fe-90d7-7ee3172ea4ea None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:54.854809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:54.855690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:54.855966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:54.856284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:54.866304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:54.873731 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 09 20:39:54.875225 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 517/1023] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Apr 9 20:39:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:54.881111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8769d-a335-45e2-815c-3654d4e0cbbe None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:54.977779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8769d-a335-45e2-815c-3654d4e0cbbe None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:55.012605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:55.013288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.013563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.013828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.014560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:55.014907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:55.016272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:55.024283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 507/1024] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Apr 9 20:39:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:55.029739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:55.127126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b54be8-f3b8-4dd3-a7cb-c3431b8421d4 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:55.162029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:55.162841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.163118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.163387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.174651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:55.176126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:55.192901 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:55.194326 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 518/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:55.199928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:55.303101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db344-8742-423c-8e88-7cdaa07658db None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:55.339540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:55.340204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.340477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.340748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.341494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:55.341794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:55.343195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:55.355083 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 508/1026] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:55.360644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:55.465483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e8fb-894b-46b5-bea2-12d39926534b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:55.498241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091d71-cd6f-4715-b1bc-7fe726bebf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:55.499067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091d71-cd6f-4715-b1bc-7fe726bebf95 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.499365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091d71-cd6f-4715-b1bc-7fe726bebf95 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.499637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091d71-cd6f-4715-b1bc-7fe726bebf95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.507170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41091d71-cd6f-4715-b1bc-7fe726bebf95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:55.508628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41091d71-cd6f-4715-b1bc-7fe726bebf95 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:55.521537 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-41091d71-cd6f-4715-b1bc-7fe726bebf95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:39:55.522887 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 519/1027] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:55.528513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:55.626961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a46942-511f-4739-9928-26fe27d8c136 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:55.660438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:55.661137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.661415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.661686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.662511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:55.662810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:55.664248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:55.681715 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 509/1028] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:55.684279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123387-7ad8-46c7-8161-0129aa407a2a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.684727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123387-7ad8-46c7-8161-0129aa407a2a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.684801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123387-7ad8-46c7-8161-0129aa407a2a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.687640 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 520/1029] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:55.687777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:55.691590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d58227-81f7-4111-82fc-903c83e452c9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.691884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d58227-81f7-4111-82fc-903c83e452c9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.692158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d58227-81f7-4111-82fc-903c83e452c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.709024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a4d58227-81f7-4111-82fc-903c83e452c9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:55.710294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a4d58227-81f7-4111-82fc-903c83e452c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:55.774454 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 521/1030] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:39:55.782308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54a337-e851-46a0-a779-a799c64abad1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:55.798789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d58227-81f7-4111-82fc-903c83e452c9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:55.816332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:55.817009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.817334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.817598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.884465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:55.885878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:55.901261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d58227-81f7-4111-82fc-903c83e452c9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:55.941049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:55.941870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:55.942146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:55.942413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] PATH_INFO: `/v3/services/image` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:55.943108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:55.944437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:55.955105 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 09 20:39:55.956641 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 522/1031] 10.222.0.30 () {56 vars in 1105 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:55.962679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:55.989166 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 510/1032] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:39:55.996865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.067462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32f390-f3b1-4ecb-b864-4eec84fea8ef None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.095909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880793-54a5-40fc-8a04-4d8680d382e2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.099924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.100597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.100871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.101169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.101867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] RBAC: Adding query filter params (name=image) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:56.102167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.103626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.113084 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 523/1033] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:56.114128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.129450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.130254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.130535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.130814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.140931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.142445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.159113 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:56.160471 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 511/1034] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:56.166035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.215880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948221-0319-4be0-a073-b556257e3cc7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.248111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.248782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.249139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.249414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.250127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] RBAC: Adding query filter params (type=image) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:56.250432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.251831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.256745 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 524/1035] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:56.262537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.269839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fcdd-5b67-4c09-9faa-894f46776786 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.303889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.304838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.305159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.305487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.306213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:56.306517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.307924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.319163 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 512/1036] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:56.324878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.359926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d540d63-1bb0-4f20-80e9-76c715290e6a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.392473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.393079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.393352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.393649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.394442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] RBAC: Adding query filter params (interface=public, service_id=9ffe9ced14b7469a991dc5f44a9d5e0d, region_id=RegionOne) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:56.394749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.396150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.401275 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 525/1037] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/endpoints?service_id=9ffe9ced14b7469a991dc5f44a9d5e0d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:56.407008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.420945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118c1c0-0f79-4e9b-ab6d-89a5e15f87d0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.454122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543b56a-8805-47f4-9ec0-4931f0068856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.454928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b56a-8805-47f4-9ec0-4931f0068856 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.455200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b56a-8805-47f4-9ec0-4931f0068856 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.455467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b56a-8805-47f4-9ec0-4931f0068856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.462440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543b56a-8805-47f4-9ec0-4931f0068856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.463878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543b56a-8805-47f4-9ec0-4931f0068856 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.476937 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5543b56a-8805-47f4-9ec0-4931f0068856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:39:56.478151 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 513/1038] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:56.479398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861adc-813c-4939-b487-365075e3ccab None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.479699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861adc-813c-4939-b487-365075e3ccab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.480036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861adc-813c-4939-b487-365075e3ccab None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.481527 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 514/1039] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:56.484307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861adc-813c-4939-b487-365075e3ccab None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.503949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba3d76-6367-4d0e-94ed-7cdfdd5846b0 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.537680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37980f58-76df-4ce4-9d97-3cb12ebec67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.538354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980f58-76df-4ce4-9d97-3cb12ebec67b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.538632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980f58-76df-4ce4-9d97-3cb12ebec67b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.538901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980f58-76df-4ce4-9d97-3cb12ebec67b None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.539580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37980f58-76df-4ce4-9d97-3cb12ebec67b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.540977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37980f58-76df-4ce4-9d97-3cb12ebec67b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.547538 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 526/1040] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:39:56.548504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995c0c-c6a5-4912-851c-8afde82107b6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.548786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995c0c-c6a5-4912-851c-8afde82107b6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.549076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995c0c-c6a5-4912-851c-8afde82107b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.566369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ea995c0c-c6a5-4912-851c-8afde82107b6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:56.567603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea995c0c-c6a5-4912-851c-8afde82107b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:56.590367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861adc-813c-4939-b487-365075e3ccab None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.626663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.627345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.627921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.627921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.628669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:56.628974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.630511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.640105 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 527/1041] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:56.643675 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 515/1042] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:56.649864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea995c0c-c6a5-4912-851c-8afde82107b6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.666169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.751897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea995c0c-c6a5-4912-851c-8afde82107b6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.770462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0181c-ffc6-4788-a969-08bdc31e3593 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.789124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.793306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.793592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.793867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.794734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] RBAC: Adding query filter params (role.id=0c4198c4d36d49d59ed44bc16c2573de, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d3a4c68c9de346219732fa8f9f6df17f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:56.795041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.796604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.805073 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 528/1043] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/role_assignments?user.id=d3a4c68c9de346219732fa8f9f6df17f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=0c4198c4d36d49d59ed44bc16c2573de => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:56.808458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4fcc-454a-4352-b1d1-9cb5054df1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.809828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4fcc-454a-4352-b1d1-9cb5054df1d1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.810268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4fcc-454a-4352-b1d1-9cb5054df1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.810679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4fcc-454a-4352-b1d1-9cb5054df1d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.812184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4fcc-454a-4352-b1d1-9cb5054df1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.814221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4fcc-454a-4352-b1d1-9cb5054df1d1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:56.816502 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 516/1044] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:56.822272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:56.935473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a77ce-cbfb-434f-bd1e-40b0cd96f8fc None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:56.972287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd98b7-451e-433d-964e-cdc658185363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:56.973359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd98b7-451e-433d-964e-cdc658185363 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:56.973815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd98b7-451e-433d-964e-cdc658185363 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:56.974259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd98b7-451e-433d-964e-cdc658185363 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:56.975193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd98b7-451e-433d-964e-cdc658185363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:56.976987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd98b7-451e-433d-964e-cdc658185363 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:57.002289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 529/1045] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:39:56 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:39:58.901734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63714-5c50-4e8b-8c87-d46ef5ab3196 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:58.902301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63714-5c50-4e8b-8c87-d46ef5ab3196 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:58.902301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63714-5c50-4e8b-8c87-d46ef5ab3196 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:58.903762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 517/1046] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:58.909260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ed4c-3167-4c1c-bf36-4a85e3f0126f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:58.909697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ed4c-3167-4c1c-bf36-4a85e3f0126f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:58.909809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ed4c-3167-4c1c-bf36-4a85e3f0126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:58.926699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cdc3ed4c-3167-4c1c-bf36-4a85e3f0126f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:58.927877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cdc3ed4c-3167-4c1c-bf36-4a85e3f0126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:58.997024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 530/1047] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:59.021350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63714-5c50-4e8b-8c87-d46ef5ab3196 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.127208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63714-5c50-4e8b-8c87-d46ef5ab3196 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.153780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ada12-da75-4bab-97c1-2f14f992dbe4 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.154017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ada12-da75-4bab-97c1-2f14f992dbe4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.154406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ada12-da75-4bab-97c1-2f14f992dbe4 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.155993 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 531/1048] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:59.160714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.161138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b11c9-0e6f-46cd-9af4-cb5de72b1188 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.161428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b11c9-0e6f-46cd-9af4-cb5de72b1188 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.161528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.161705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b11c9-0e6f-46cd-9af4-cb5de72b1188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.161816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.162056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.162699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:59.164061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:59.174673 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 09 20:39:59.176013 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 518/1049] 10.222.0.30 () {56 vars in 1105 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:59.178274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-561b11c9-0e6f-46cd-9af4-cb5de72b1188 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:59.179467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-561b11c9-0e6f-46cd-9af4-cb5de72b1188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:59.181628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.242993 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 532/1050] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:59.267014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b11c9-0e6f-46cd-9af4-cb5de72b1188 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.279603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f378ac-9a05-4f58-9164-d880be3567e8 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.312338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.313001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.313309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.313578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.314276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] RBAC: Adding query filter params (name=image) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:59.314579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:59.315955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:59.325402 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 519/1051] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:59.326405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.362535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b11c9-0e6f-46cd-9af4-cb5de72b1188 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.394665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07144d2c-8d7d-4bee-a2dd-bcd3bccd377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.395212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144d2c-8d7d-4bee-a2dd-bcd3bccd377b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.395485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144d2c-8d7d-4bee-a2dd-bcd3bccd377b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.395752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144d2c-8d7d-4bee-a2dd-bcd3bccd377b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.405818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07144d2c-8d7d-4bee-a2dd-bcd3bccd377b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:59.413023 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-07144d2c-8d7d-4bee-a2dd-bcd3bccd377b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 09 20:39:59.414207 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 533/1052] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:39:59.416577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4b5c9-5554-4de6-931e-0e29fdb58591 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.416861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4b5c9-5554-4de6-931e-0e29fdb58591 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.417182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4b5c9-5554-4de6-931e-0e29fdb58591 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.418486 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 534/1053] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:39:59.420597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4b5c9-5554-4de6-931e-0e29fdb58591 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.421261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceae974-401f-41bc-b73f-337996ba93b9 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.454960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ede51-cccb-460f-b38c-5182a7af1a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.455668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ede51-cccb-460f-b38c-5182a7af1a60 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.456292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ede51-cccb-460f-b38c-5182a7af1a60 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.456552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ede51-cccb-460f-b38c-5182a7af1a60 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.457281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ede51-cccb-460f-b38c-5182a7af1a60 None admin] RBAC: Adding query filter params (type=image) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:59.457586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ede51-cccb-460f-b38c-5182a7af1a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:59.458991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ede51-cccb-460f-b38c-5182a7af1a60 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:59.463808 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 520/1054] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:59.464977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7066ad-5dee-4156-afd4-19b37beda230 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.465285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7066ad-5dee-4156-afd4-19b37beda230 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.465577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7066ad-5dee-4156-afd4-19b37beda230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.481421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0b7066ad-5dee-4156-afd4-19b37beda230 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:39:59.482638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0b7066ad-5dee-4156-afd4-19b37beda230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:39:59.520412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4b5c9-5554-4de6-931e-0e29fdb58591 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.544237 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 521/1055] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:39:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:39:59.545002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7066ad-5dee-4156-afd4-19b37beda230 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.553332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.553985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.554258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.554520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.555248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:59.555550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:59.556932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:59.569180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 535/1056] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:39:59.569180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.647482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7066ad-5dee-4156-afd4-19b37beda230 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.661805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c24330-cd6c-4c15-9676-ea146f4abd3c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.679632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.680281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.680554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.680813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.681578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:59.682948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:59.695563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.696372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.697294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.697294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.703866 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 522/1057] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:39:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:39:59.703866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.719214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:39:59.726655 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:39:59.728288 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 536/1058] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:59.734595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.818576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f197-a0c3-42ae-a10a-c2681bedef58 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.843014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9b29-71ca-4fe4-b688-49644afdc859 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:39:59.855210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.856122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.856466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.856802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.869317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:59.870935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:59.878576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:39:59.879603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:39:59.880169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:39:59.880517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:39:59.881380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:39:59.881753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:39:59.883242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:39:59.889572 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:39:59.891224 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 523/1059] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:39:59.896605 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 537/1060] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:39:59.897532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.898654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:39:59.998500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e761520-774f-47d5-b7a5-1356382014f7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.000668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b66c5-f8f4-45c1-b3a0-721922b0a3cb None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.034532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.034742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.035254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.035434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.035553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.035708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.035800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.035985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] PATH_INFO: `/v3/users/18d9e5c9fc25409987803d8d0bb3bba1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.036510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:00.036813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.038235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.049354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] RBAC: Authorizing `identity:get_user(user_id=18d9e5c9fc25409987803d8d0bb3bba1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.050600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 524/1061] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:40:00.051027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.057595 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 538/1062] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:39:59 2022] GET /identity/v3/users/18d9e5c9fc25409987803d8d0bb3bba1 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:00.057728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.058918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.152254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44197481-ad91-4f03-b034-77b79e1de0e3 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.156770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dab026-fb5c-4b8a-9b8f-7409f178d432 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.185005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.185831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.186163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.186435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.189298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.189837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.190207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.190565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.193663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.195800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.214442 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:40:00.220519 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 525/1063] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:00.221517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.261018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.262429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.316846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514495d-e066-4e3b-92a3-b1f6e3ed7bd0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.349797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.350471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.350748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.351017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.351846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:00.352178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.353635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.356443 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 539/1064] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 09 20:40:00.362932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.379768 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 526/1065] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:40:00.380905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.457456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7b8c3-3bae-40bf-8bad-45eb5ed4f890 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.477672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff007f9-0826-4e37-83c9-127430f1c597 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.490543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.491727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.492152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.492568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.493922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] RBAC: Authorizing `identity:get_project(project_id=eed8782ea4a548f793a8554a75632be2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.495564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.497469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 540/1066] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/projects/eed8782ea4a548f793a8554a75632be2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:00.503536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.511094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.511835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.512114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.512384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.522841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.524383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.541823 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:40:00.543296 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 527/1067] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:00.548715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.605192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc775648-8075-4b0a-a7d5-bc48f9a3d618 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.639276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.639949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.640216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.640483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.641327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=eed8782ea4a548f793a8554a75632be2, user.id=18d9e5c9fc25409987803d8d0bb3bba1) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:00.641620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.643074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.647574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf5e6-9ffc-4453-b573-43e5b070ed86 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.653415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 541/1068] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/role_assignments?user.id=18d9e5c9fc25409987803d8d0bb3bba1&scope.project.id=eed8782ea4a548f793a8554a75632be2&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:00.684564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.685274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.685557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.685830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.686604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:00.686909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.688346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.701581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 528/1069] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:40:00.707995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.814355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dba9fe-e92d-46d4-ac0e-36cd80c2b685 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:00.850905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:00.851726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:00.852007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:00.852280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:00.859182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:00.860701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:00.874369 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:40:00.875761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 542/1070] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:00.881751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:00.987600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65182a69-7c29-4af5-9025-fb64318edc82 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:01.021223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159202d0-a618-4e60-aeae-f5eae930e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:01.021860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159202d0-a618-4e60-aeae-f5eae930e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:01.022227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159202d0-a618-4e60-aeae-f5eae930e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:01.022559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159202d0-a618-4e60-aeae-f5eae930e0b7 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:01.023346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159202d0-a618-4e60-aeae-f5eae930e0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:01.023653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159202d0-a618-4e60-aeae-f5eae930e0b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:01.025216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159202d0-a618-4e60-aeae-f5eae930e0b7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:01.037506 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 529/1071] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:01.043541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:01.141396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644ebf7-d884-485f-8523-45c98849ab22 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:01.174080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa5b29-daba-42bc-a79a-2fdc138ca75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:01.174980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5b29-daba-42bc-a79a-2fdc138ca75b None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:01.175259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5b29-daba-42bc-a79a-2fdc138ca75b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:01.175534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5b29-daba-42bc-a79a-2fdc138ca75b None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d3a4c68c9de346219732fa8f9f6df17f/roles/0c4198c4d36d49d59ed44bc16c2573de` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:01.177768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa5b29-daba-42bc-a79a-2fdc138ca75b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=d3a4c68c9de346219732fa8f9f6df17f, role_id=0c4198c4d36d49d59ed44bc16c2573de)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:01.179228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa5b29-daba-42bc-a79a-2fdc138ca75b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:01.192483 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 543/1072] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:40:01 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d3a4c68c9de346219732fa8f9f6df17f/roles/0c4198c4d36d49d59ed44bc16c2573de => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:40:02.106767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7279eb-6301-4d8b-922c-a68b702f1202 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:02.107410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7279eb-6301-4d8b-922c-a68b702f1202 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:02.107410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7279eb-6301-4d8b-922c-a68b702f1202 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:02.108796 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 530/1073] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:02.114137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87505f75-24de-4b2e-9595-c9f3333e9bc5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:02.114600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87505f75-24de-4b2e-9595-c9f3333e9bc5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:02.114683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87505f75-24de-4b2e-9595-c9f3333e9bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:02.131557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-87505f75-24de-4b2e-9595-c9f3333e9bc5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:02.132735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-87505f75-24de-4b2e-9595-c9f3333e9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:02.199560 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 544/1074] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:02.222972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7279eb-6301-4d8b-922c-a68b702f1202 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:02.324833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7279eb-6301-4d8b-922c-a68b702f1202 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:02.359526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:02.360117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:02.360391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:02.360661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:02.426713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:02.428175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:02.523286 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 531/1075] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:02.529001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87505f75-24de-4b2e-9595-c9f3333e9bc5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:02.625095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87505f75-24de-4b2e-9595-c9f3333e9bc5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:02.659017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06cb21-bb29-49ed-ac3c-dccf7e933d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:02.659817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cb21-bb29-49ed-ac3c-dccf7e933d2e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:02.660055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cb21-bb29-49ed-ac3c-dccf7e933d2e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:02.660354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cb21-bb29-49ed-ac3c-dccf7e933d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:02.670770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06cb21-bb29-49ed-ac3c-dccf7e933d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:02.672248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06cb21-bb29-49ed-ac3c-dccf7e933d2e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:02.689061 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-8a06cb21-bb29-49ed-ac3c-dccf7e933d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:40:02.690446 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 545/1076] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:40:02.696600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:02.795875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c42657-c53a-41fb-baa1-fd4a4858481d None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:02.833774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035862c-2ad9-4c07-b5b9-78d938d12cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:02.834451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035862c-2ad9-4c07-b5b9-78d938d12cfa None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:02.834724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035862c-2ad9-4c07-b5b9-78d938d12cfa None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:02.834992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035862c-2ad9-4c07-b5b9-78d938d12cfa None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:02.835715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035862c-2ad9-4c07-b5b9-78d938d12cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:02.836014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035862c-2ad9-4c07-b5b9-78d938d12cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:02.837618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035862c-2ad9-4c07-b5b9-78d938d12cfa None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:02.849272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 532/1077] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:02.970657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d890f-73fe-4270-b39f-aafd53382947 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:02.970907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d890f-73fe-4270-b39f-aafd53382947 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:02.971150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d890f-73fe-4270-b39f-aafd53382947 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:02.972716 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 546/1078] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:02.978327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689edc-e4a2-4d42-b8ed-d77bfe28aeb3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:02.978645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689edc-e4a2-4d42-b8ed-d77bfe28aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:02.978855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689edc-e4a2-4d42-b8ed-d77bfe28aeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:02.996910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-79689edc-e4a2-4d42-b8ed-d77bfe28aeb3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:02.998183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-79689edc-e4a2-4d42-b8ed-d77bfe28aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:03.066866 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 533/1079] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:03.090354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d890f-73fe-4270-b39f-aafd53382947 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:03.194834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d890f-73fe-4270-b39f-aafd53382947 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:03.228143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:03.228892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.229194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.229467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.239099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:03.245979 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:03.247374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 547/1080] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:03.253633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689edc-e4a2-4d42-b8ed-d77bfe28aeb3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:03.351302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689edc-e4a2-4d42-b8ed-d77bfe28aeb3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:03.384676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:03.385384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.385654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.385923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.386658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:03.386962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:03.388332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:03.396334 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 534/1081] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:03.402259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:03.501252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1c87-365c-4f7d-ba7c-990953e3366a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:03.534170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cabf9-954f-4f3f-9ec2-d3356da8ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:03.535055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cabf9-954f-4f3f-9ec2-d3356da8ad99 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.535332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cabf9-954f-4f3f-9ec2-d3356da8ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.535601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cabf9-954f-4f3f-9ec2-d3356da8ad99 None admin] PATH_INFO: `/v3/users/18d9e5c9fc25409987803d8d0bb3bba1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.536787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cabf9-954f-4f3f-9ec2-d3356da8ad99 None admin] RBAC: Authorizing `identity:get_user(user_id=18d9e5c9fc25409987803d8d0bb3bba1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:03.538276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cabf9-954f-4f3f-9ec2-d3356da8ad99 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:03.540057 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 548/1082] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:03 2022] GET /identity/v3/users/18d9e5c9fc25409987803d8d0bb3bba1 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:03.545982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:03.550839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968315-a0a8-47d3-95f0-62b545a4d951 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.551132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968315-a0a8-47d3-95f0-62b545a4d951 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.551423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968315-a0a8-47d3-95f0-62b545a4d951 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.552739 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 549/1083] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:03.557539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a6ea-25df-4323-a12a-7456767bded5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.557821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a6ea-25df-4323-a12a-7456767bded5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.558094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a6ea-25df-4323-a12a-7456767bded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.574516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5b06a6ea-25df-4323-a12a-7456767bded5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:03.575695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5b06a6ea-25df-4323-a12a-7456767bded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:03.638058 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 550/1084] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:03.645730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c258-4998-4808-97e3-c694a8fce629 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:03.662104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06a6ea-25df-4323-a12a-7456767bded5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:03.678791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:03.679667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.679943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.680211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.681450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] RBAC: Authorizing `identity:get_project(project_id=eed8782ea4a548f793a8554a75632be2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:03.682885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:03.689631 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 535/1085] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:03 2022] GET /identity/v3/projects/eed8782ea4a548f793a8554a75632be2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:03.690658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:03.754740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06a6ea-25df-4323-a12a-7456767bded5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:03.784848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562699-78a8-4d5f-92aa-1725ea9714fa None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:03.788647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:03.789499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.789793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.790060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.800118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:03.807389 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 09 20:40:03.808620 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 551/1086] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Apr 9 20:40:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:40:03.814630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:03.816676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:03.817613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.817875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.818146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2/users/18d9e5c9fc25409987803d8d0bb3bba1/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.820198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] RBAC: Authorizing `identity:create_grant(project_id=eed8782ea4a548f793a8554a75632be2, user_id=18d9e5c9fc25409987803d8d0bb3bba1, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:03.821671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:03.836215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 536/1087] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:40:03 2022] PUT /identity/v3/projects/eed8782ea4a548f793a8554a75632be2/users/18d9e5c9fc25409987803d8d0bb3bba1/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:40:03.922387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217e876-7046-4af7-9c31-6ca014352981 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:03.958450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:03.959141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:03.959448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:03.959710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:03.960470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:03.960768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:03.962219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:03.971469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 552/1088] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Apr 9 20:40:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:40:03.977522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:04.081202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf0ff-6ddf-4528-8ef1-28d4fdc5e36e None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:04.116153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:04.116951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:04.117254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:04.117525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:04.127876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:04.129373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:04.145313 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:40:04.146526 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 537/1089] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:04.152340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:04.254188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a96bd-b23b-42d0-9799-dca2df43a6c2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:04.288620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:04.289330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:04.289584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:04.289872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:04.290581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:04.290878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:04.292257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:04.303850 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 553/1090] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:04.309734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:04.411128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634c4a-c89c-4d88-a019-b7e7607e13df None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:04.445275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:04.446078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:04.446372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:04.446620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:04.454359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:04.456156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:04.469185 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 09 20:40:04.470365 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 538/1091] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Apr 9 20:40:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:40:04.476178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:04.574419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6153-fe60-4b3d-a072-b1b90c0dea90 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:04.608065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:04.608741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:04.609010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:04.609303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:04.610127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:04.610423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:04.611856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:04.628487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 554/1092] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Apr 9 20:40:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:04.634354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:04.735904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3d861-da7c-40ba-9e3e-147d674171bf None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:04.769118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:04.769766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:04.770043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:04.770314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:04.836097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:04.837595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:04.942056 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 539/1093] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:04.947994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:05.047337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447cd03-78fc-446a-8a7b-129f66517855 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:05.086753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:05.087555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:05.087863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:05.088127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:05.098214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:05.099973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:05.116494 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:40:05.117885 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 555/1094] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:05.123706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:05.220301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98047c-90c1-4ff2-9faa-10bbf9454fd5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:05.253493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:05.254138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:05.254413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:05.254679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:05.255389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:05.255686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:05.257075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:05.268063 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 540/1095] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:05.273948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:05.369449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de7b0f-2543-48b0-a491-7ee3a944ff4b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:05.403489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:05.404355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:05.404640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:05.404909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:05.411726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:05.413217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:05.426114 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:40:05.427293 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 556/1096] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:05.433307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:05.533066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e9471-61ef-40d4-bc9e-573c52fb0bb2 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:05.566692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cf134-ad18-451e-822e-3ae3987226bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:05.567346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cf134-ad18-451e-822e-3ae3987226bc None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:05.567619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cf134-ad18-451e-822e-3ae3987226bc None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:05.567890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cf134-ad18-451e-822e-3ae3987226bc None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:05.568669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cf134-ad18-451e-822e-3ae3987226bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:05.568973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cf134-ad18-451e-822e-3ae3987226bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:05.570445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cf134-ad18-451e-822e-3ae3987226bc None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:05.583401 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 541/1097] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:05.589493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:05.688833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a599425-a787-428b-a67b-aa1a9f08c337 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:05.721654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950d79-7c4f-4189-9f53-2a1b1caeb99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:05.722297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950d79-7c4f-4189-9f53-2a1b1caeb99d None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:05.722570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950d79-7c4f-4189-9f53-2a1b1caeb99d None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:05.722833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950d79-7c4f-4189-9f53-2a1b1caeb99d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:05.723650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e950d79-7c4f-4189-9f53-2a1b1caeb99d None admin] RBAC: Adding query filter params (role.id=0c4198c4d36d49d59ed44bc16c2573de, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d3a4c68c9de346219732fa8f9f6df17f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:05.723952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e950d79-7c4f-4189-9f53-2a1b1caeb99d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:05.725428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e950d79-7c4f-4189-9f53-2a1b1caeb99d None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:05.731097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 557/1098] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:05 2022] GET /identity/v3/role_assignments?user.id=d3a4c68c9de346219732fa8f9f6df17f&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=0c4198c4d36d49d59ed44bc16c2573de => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:06.164934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b680e1-0f68-46f7-8d72-a2c8f7a84034 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:06.165281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b680e1-0f68-46f7-8d72-a2c8f7a84034 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:06.165475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b680e1-0f68-46f7-8d72-a2c8f7a84034 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:06.166867 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 542/1099] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:06.172711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369f42-4745-4227-86eb-85810177fa37 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:06.172994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369f42-4745-4227-86eb-85810177fa37 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:06.173374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369f42-4745-4227-86eb-85810177fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:06.192300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6d369f42-4745-4227-86eb-85810177fa37 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:06.193493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6d369f42-4745-4227-86eb-85810177fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:06.261610 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 558/1100] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:06.286655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b680e1-0f68-46f7-8d72-a2c8f7a84034 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:06.387089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b680e1-0f68-46f7-8d72-a2c8f7a84034 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:06.422277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:06.423066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:06.423351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:06.423621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:06.433577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:06.440480 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:06.441753 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 543/1101] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:06.447832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d369f42-4745-4227-86eb-85810177fa37 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:06.545859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d369f42-4745-4227-86eb-85810177fa37 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:06.581498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:06.582182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:06.582463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:06.582736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:06.583490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:06.583792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:06.585254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:06.593563 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 559/1102] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:06.599473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:06.696274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d4a96-b541-430c-84bf-cb9b57e7e80c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:06.730017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:06.730890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:06.731160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:06.731424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] PATH_INFO: `/v3/users/18d9e5c9fc25409987803d8d0bb3bba1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:06.732736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] RBAC: Authorizing `identity:get_user(user_id=18d9e5c9fc25409987803d8d0bb3bba1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:06.734226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:06.735842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 544/1103] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:06 2022] GET /identity/v3/users/18d9e5c9fc25409987803d8d0bb3bba1 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:06.744605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:06.845157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614b3ed-44ce-4d13-8e01-bfe76d728937 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:06.884843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:06.885509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:06.885784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:06.886044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:06.957460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:06.958918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:07.052452 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 560/1104] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 09 20:40:07.058814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:07.174540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2b6ca-49ce-4c30-bead-b6fce3cf1700 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:07.208696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d32a4-4f6c-4876-8734-400fbd114546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:07.209518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d32a4-4f6c-4876-8734-400fbd114546 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:07.209796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d32a4-4f6c-4876-8734-400fbd114546 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:07.210068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d32a4-4f6c-4876-8734-400fbd114546 None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:07.211375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d32a4-4f6c-4876-8734-400fbd114546 None admin] RBAC: Authorizing `identity:get_project(project_id=eed8782ea4a548f793a8554a75632be2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:07.212812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d32a4-4f6c-4876-8734-400fbd114546 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:07.214560 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 545/1105] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:07 2022] GET /identity/v3/projects/eed8782ea4a548f793a8554a75632be2 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:07.224341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:07.327180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2f77c-e8e5-4a8b-a076-38f836820c25 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:07.360428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb7792-a184-4238-a335-0322601b6d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:07.361073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7792-a184-4238-a335-0322601b6d37 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:07.361367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7792-a184-4238-a335-0322601b6d37 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:07.361632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7792-a184-4238-a335-0322601b6d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:07.362442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7792-a184-4238-a335-0322601b6d37 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=eed8782ea4a548f793a8554a75632be2, user.id=18d9e5c9fc25409987803d8d0bb3bba1) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:07.362746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7792-a184-4238-a335-0322601b6d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:07.364183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7792-a184-4238-a335-0322601b6d37 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:07.369949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 561/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:07 2022] GET /identity/v3/role_assignments?user.id=18d9e5c9fc25409987803d8d0bb3bba1&scope.project.id=eed8782ea4a548f793a8554a75632be2&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:09.735196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6111b-f86d-49a9-b458-f84745031a3a None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:09.736060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6111b-f86d-49a9-b458-f84745031a3a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:09.736060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6111b-f86d-49a9-b458-f84745031a3a None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:09.738333 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 546/1107] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:09.747050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e304a7-ea00-4542-8284-35df326bb3f0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:09.747633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e304a7-ea00-4542-8284-35df326bb3f0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:09.747727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e304a7-ea00-4542-8284-35df326bb3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:09.766731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e1e304a7-ea00-4542-8284-35df326bb3f0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:09.767932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1e304a7-ea00-4542-8284-35df326bb3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:09.842309 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 562/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:09.880470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6111b-f86d-49a9-b458-f84745031a3a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:10.002571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6111b-f86d-49a9-b458-f84745031a3a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:10.035853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae553f-16c3-4768-996a-72f63312bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:10.036701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae553f-16c3-4768-996a-72f63312bd7d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:10.036952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae553f-16c3-4768-996a-72f63312bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:10.037255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae553f-16c3-4768-996a-72f63312bd7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:10.038614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae553f-16c3-4768-996a-72f63312bd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:10.040056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae553f-16c3-4768-996a-72f63312bd7d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:10.041719 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 547/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:40:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:10.048210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e304a7-ea00-4542-8284-35df326bb3f0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:10.170881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e304a7-ea00-4542-8284-35df326bb3f0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:10.208914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebac319-4010-4512-8430-f3807ca731d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:10.209626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebac319-4010-4512-8430-f3807ca731d4 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:10.209900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebac319-4010-4512-8430-f3807ca731d4 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:10.210170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebac319-4010-4512-8430-f3807ca731d4 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:10.210866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebac319-4010-4512-8430-f3807ca731d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:10.212322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebac319-4010-4512-8430-f3807ca731d4 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:10.234976 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 563/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:40:10 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:40:12.605423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747ba4-1aa7-47cc-ac1f-13a62fed24e6 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:12.606353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747ba4-1aa7-47cc-ac1f-13a62fed24e6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:12.606353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747ba4-1aa7-47cc-ac1f-13a62fed24e6 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:12.607793 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 548/1111] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:12.613252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10251-20b1-4ab9-bebd-ee08d2ed7c04 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:12.613683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10251-20b1-4ab9-bebd-ee08d2ed7c04 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:12.613771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10251-20b1-4ab9-bebd-ee08d2ed7c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:12.631592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-def10251-20b1-4ab9-bebd-ee08d2ed7c04 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:12.632759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-def10251-20b1-4ab9-bebd-ee08d2ed7c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:12.698424 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 564/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:12.723718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2747ba4-1aa7-47cc-ac1f-13a62fed24e6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:12.845478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2747ba4-1aa7-47cc-ac1f-13a62fed24e6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:12.879553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:12.880418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:12.880695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:12.881007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] PATH_INFO: `/v3/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:12.885459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] RBAC: Authorizing `identity:get_role(role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:12.885459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:12.885459 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 549/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:12 2022] GET /identity/v3/roles/1b9f4acaec9249c88996af437afcb462 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:12.893626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10251-20b1-4ab9-bebd-ee08d2ed7c04 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:13.001373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10251-20b1-4ab9-bebd-ee08d2ed7c04 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:13.036506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:13.037419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:13.037695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:13.037960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] PATH_INFO: `/v3/users/ad1647f79b5847adab268dc121c102b0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:13.050797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] RBAC: Authorizing `identity:get_user(user_id=ad1647f79b5847adab268dc121c102b0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:13.052267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:13.053919 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 565/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:12 2022] GET /identity/v3/users/ad1647f79b5847adab268dc121c102b0 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:13.060119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:13.163502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e497-7319-4eda-b6d9-116f2a891bd6 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:13.199130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:13.199771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:13.200112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:13.200382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:13.265957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:13.267355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:13.365600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 550/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:13.371800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:13.474290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fab49-160b-4bb9-ae78-b6194839479a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:13.510632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2244-b16c-4e4b-97ad-0c6c2f7c9d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:13.511489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2244-b16c-4e4b-97ad-0c6c2f7c9d05 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:13.511768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2244-b16c-4e4b-97ad-0c6c2f7c9d05 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:13.512041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2244-b16c-4e4b-97ad-0c6c2f7c9d05 None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:13.513349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2244-b16c-4e4b-97ad-0c6c2f7c9d05 None admin] RBAC: Authorizing `identity:get_project(project_id=eed8782ea4a548f793a8554a75632be2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:13.514802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2244-b16c-4e4b-97ad-0c6c2f7c9d05 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:13.516552 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 566/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:13 2022] GET /identity/v3/projects/eed8782ea4a548f793a8554a75632be2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:13.522895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:13.627000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678deda0-5fe9-46e5-9e6d-bbbe9a8f7ee7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:13.660162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932773a-4711-4af3-a3e6-1c7f9dc4e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:13.660804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932773a-4711-4af3-a3e6-1c7f9dc4e7eb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:13.661108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932773a-4711-4af3-a3e6-1c7f9dc4e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:13.661382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932773a-4711-4af3-a3e6-1c7f9dc4e7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:13.662202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932773a-4711-4af3-a3e6-1c7f9dc4e7eb None admin] RBAC: Adding query filter params (role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=eed8782ea4a548f793a8554a75632be2, user.id=ad1647f79b5847adab268dc121c102b0) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:13.662507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932773a-4711-4af3-a3e6-1c7f9dc4e7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:13.663940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932773a-4711-4af3-a3e6-1c7f9dc4e7eb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:13.669260 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 551/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:13 2022] GET /identity/v3/role_assignments?user.id=ad1647f79b5847adab268dc121c102b0&scope.project.id=eed8782ea4a548f793a8554a75632be2&role.id=1b9f4acaec9249c88996af437afcb462 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:15.973546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c612-ae6e-4550-a885-c02998cf16a9 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:15.974132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c612-ae6e-4550-a885-c02998cf16a9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:15.974132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c612-ae6e-4550-a885-c02998cf16a9 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:15.975431 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 567/1118] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:15.981880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c195-80ec-478e-b623-17879d39a710 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:15.982659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c195-80ec-478e-b623-17879d39a710 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:15.982816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c195-80ec-478e-b623-17879d39a710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:16.005079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e403c195-80ec-478e-b623-17879d39a710 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:16.006284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e403c195-80ec-478e-b623-17879d39a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:16.072545 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 552/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:16.104094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952c612-ae6e-4550-a885-c02998cf16a9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:16.208019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952c612-ae6e-4550-a885-c02998cf16a9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:16.241661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:16.242446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:16.242728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:16.242998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] PATH_INFO: `/v3/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:16.244581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] RBAC: Authorizing `identity:get_role(role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:16.246002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:16.247415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 568/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:16 2022] GET /identity/v3/roles/1b9f4acaec9249c88996af437afcb462 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:16.254119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c195-80ec-478e-b623-17879d39a710 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:16.364450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c195-80ec-478e-b623-17879d39a710 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:16.401778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:16.402650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:16.402955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:16.403225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] PATH_INFO: `/v3/users/ad1647f79b5847adab268dc121c102b0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:16.404533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] RBAC: Authorizing `identity:get_user(user_id=ad1647f79b5847adab268dc121c102b0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:16.406008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:16.407629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 553/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:16 2022] GET /identity/v3/users/ad1647f79b5847adab268dc121c102b0 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:16.413354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:16.514017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe1be-786b-42ea-b3c8-066f9b0886b7 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:16.549649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81b732-2fb0-4fcb-9cc0-fd822d881cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:16.551003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81b732-2fb0-4fcb-9cc0-fd822d881cfd None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:16.551421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81b732-2fb0-4fcb-9cc0-fd822d881cfd None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:16.551837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81b732-2fb0-4fcb-9cc0-fd822d881cfd None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:16.554062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81b732-2fb0-4fcb-9cc0-fd822d881cfd None admin] RBAC: Authorizing `identity:get_project(project_id=eed8782ea4a548f793a8554a75632be2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:16.556389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81b732-2fb0-4fcb-9cc0-fd822d881cfd None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:16.559238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 569/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:16 2022] GET /identity/v3/projects/eed8782ea4a548f793a8554a75632be2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:16.565450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:16.690396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079b100-ea48-481d-8e1f-7381cc67a1ac None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:16.735317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c43b-bc50-4ebd-8803-fe937d3d5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:16.736189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c43b-bc50-4ebd-8803-fe937d3d5c00 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:16.736465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c43b-bc50-4ebd-8803-fe937d3d5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:16.736733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c43b-bc50-4ebd-8803-fe937d3d5c00 None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2/users/ad1647f79b5847adab268dc121c102b0/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:16.739113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c43b-bc50-4ebd-8803-fe937d3d5c00 None admin] RBAC: Authorizing `identity:create_grant(project_id=eed8782ea4a548f793a8554a75632be2, user_id=ad1647f79b5847adab268dc121c102b0, role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:16.740569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c43b-bc50-4ebd-8803-fe937d3d5c00 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:16.756941 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 554/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:40:16 2022] PUT /identity/v3/projects/eed8782ea4a548f793a8554a75632be2/users/ad1647f79b5847adab268dc121c102b0/roles/1b9f4acaec9249c88996af437afcb462 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:40:19.065304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d4ed-9c7a-45c5-a5af-3224aa53993c None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:19.065892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d4ed-9c7a-45c5-a5af-3224aa53993c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:19.065892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d4ed-9c7a-45c5-a5af-3224aa53993c None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:19.067196 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 570/1124] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:19.073712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988cbd-8848-413c-b9dd-1c324f850126 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:19.074448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988cbd-8848-413c-b9dd-1c324f850126 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:19.074629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988cbd-8848-413c-b9dd-1c324f850126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:19.099153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3d988cbd-8848-413c-b9dd-1c324f850126 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:19.100356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3d988cbd-8848-413c-b9dd-1c324f850126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:19.169616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 555/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:19.194872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d4ed-9c7a-45c5-a5af-3224aa53993c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:19.301679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d4ed-9c7a-45c5-a5af-3224aa53993c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:19.341718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:19.342506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:19.342769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:19.343030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] PATH_INFO: `/v3/roles/1b9f4acaec9249c88996af437afcb462` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:19.344525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] RBAC: Authorizing `identity:get_role(role_id=1b9f4acaec9249c88996af437afcb462)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:19.345954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:19.347308 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 571/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:19 2022] GET /identity/v3/roles/1b9f4acaec9249c88996af437afcb462 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:19.353319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d988cbd-8848-413c-b9dd-1c324f850126 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:19.455286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d988cbd-8848-413c-b9dd-1c324f850126 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:19.489727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:19.490604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:19.490879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:19.491148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] PATH_INFO: `/v3/users/ad1647f79b5847adab268dc121c102b0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:19.492381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] RBAC: Authorizing `identity:get_user(user_id=ad1647f79b5847adab268dc121c102b0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:19.493851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:19.495503 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 556/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:19 2022] GET /identity/v3/users/ad1647f79b5847adab268dc121c102b0 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:19.501691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:19.602738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8ee2f-551f-42e7-9921-beb456029418 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:19.636542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:19.637250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:19.637530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:19.637804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:19.705473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:19.706959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:19.806498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 572/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:19.813474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:19.923447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86659e5-ab3d-4ddf-96e8-700056295279 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:19.959487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4cc28-25d0-4550-bc8e-5e4f8a45d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:19.959487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4cc28-25d0-4550-bc8e-5e4f8a45d61d None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:19.959487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4cc28-25d0-4550-bc8e-5e4f8a45d61d None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:19.959487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4cc28-25d0-4550-bc8e-5e4f8a45d61d None admin] PATH_INFO: `/v3/projects/eed8782ea4a548f793a8554a75632be2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:19.960064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4cc28-25d0-4550-bc8e-5e4f8a45d61d None admin] RBAC: Authorizing `identity:get_project(project_id=eed8782ea4a548f793a8554a75632be2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:19.961550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4cc28-25d0-4550-bc8e-5e4f8a45d61d None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:19.963271 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 557/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:19 2022] GET /identity/v3/projects/eed8782ea4a548f793a8554a75632be2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:19.971489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:20.078366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75495-9f9b-42c9-a696-ce479dcb3054 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:20.113733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43225e-35c5-4037-b4da-79d1cb32f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:20.114388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43225e-35c5-4037-b4da-79d1cb32f1cf None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:20.114689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43225e-35c5-4037-b4da-79d1cb32f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:20.114954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43225e-35c5-4037-b4da-79d1cb32f1cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:20.115769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43225e-35c5-4037-b4da-79d1cb32f1cf None admin] RBAC: Adding query filter params (role.id=1b9f4acaec9249c88996af437afcb462, scope.project.id=eed8782ea4a548f793a8554a75632be2, user.id=ad1647f79b5847adab268dc121c102b0) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:20.116050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43225e-35c5-4037-b4da-79d1cb32f1cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:20.117576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43225e-35c5-4037-b4da-79d1cb32f1cf None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:20.123398 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 573/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:19 2022] GET /identity/v3/role_assignments?user.id=ad1647f79b5847adab268dc121c102b0&scope.project.id=eed8782ea4a548f793a8554a75632be2&role.id=1b9f4acaec9249c88996af437afcb462 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:22.503711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a82620-11b1-4c2a-9323-4755cc0e896e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:22.504289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a82620-11b1-4c2a-9323-4755cc0e896e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:22.504289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a82620-11b1-4c2a-9323-4755cc0e896e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:22.506410 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 558/1131] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:22.511891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b09b-bef1-44dc-a455-cacba5392798 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:22.512315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b09b-bef1-44dc-a455-cacba5392798 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:22.512422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b09b-bef1-44dc-a455-cacba5392798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:22.530177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a976b09b-bef1-44dc-a455-cacba5392798 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:22.531383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a976b09b-bef1-44dc-a455-cacba5392798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:22.602461 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 574/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:22.627524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a82620-11b1-4c2a-9323-4755cc0e896e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:22.743127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a82620-11b1-4c2a-9323-4755cc0e896e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:22.779795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76334c-e186-4fe4-86c8-5c3e9218a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:22.780593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76334c-e186-4fe4-86c8-5c3e9218a65f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:22.780870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76334c-e186-4fe4-86c8-5c3e9218a65f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:22.781180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76334c-e186-4fe4-86c8-5c3e9218a65f None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:22.782585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76334c-e186-4fe4-86c8-5c3e9218a65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:22.784037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76334c-e186-4fe4-86c8-5c3e9218a65f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:22.785727 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 559/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:22.792335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976b09b-bef1-44dc-a455-cacba5392798 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:22.896806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976b09b-bef1-44dc-a455-cacba5392798 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:22.930583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8de63-1245-4b73-8713-747cca22d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:22.931271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8de63-1245-4b73-8713-747cca22d8ce None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:22.931503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8de63-1245-4b73-8713-747cca22d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:22.931773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8de63-1245-4b73-8713-747cca22d8ce None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:22.932467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8de63-1245-4b73-8713-747cca22d8ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:22.933987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8de63-1245-4b73-8713-747cca22d8ce None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:22.961529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 575/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:40:22 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:40:25.302626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7840fe-67da-45ee-959b-461de74ff630 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:25.303533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7840fe-67da-45ee-959b-461de74ff630 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:25.303533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7840fe-67da-45ee-959b-461de74ff630 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:25.305816 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 560/1135] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:25.311259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e9a0-77f1-47b0-9efe-655266e5d1fe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:25.311674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e9a0-77f1-47b0-9efe-655266e5d1fe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:25.311762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e9a0-77f1-47b0-9efe-655266e5d1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:25.329686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-afd8e9a0-77f1-47b0-9efe-655266e5d1fe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:25.330853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-afd8e9a0-77f1-47b0-9efe-655266e5d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:25.395404 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 576/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:25.421564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7840fe-67da-45ee-959b-461de74ff630 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:25.535296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7840fe-67da-45ee-959b-461de74ff630 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:25.569385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c5dea-d7eb-4e42-8c30-2e4c245a23de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:25.570116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c5dea-d7eb-4e42-8c30-2e4c245a23de None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:25.570390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c5dea-d7eb-4e42-8c30-2e4c245a23de None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:25.570657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c5dea-d7eb-4e42-8c30-2e4c245a23de None admin] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:25.571944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c5dea-d7eb-4e42-8c30-2e4c245a23de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:25.573442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c5dea-d7eb-4e42-8c30-2e4c245a23de None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:25.575061 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 561/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:40:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:25.584687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8e9a0-77f1-47b0-9efe-655266e5d1fe None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:25.687191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8e9a0-77f1-47b0-9efe-655266e5d1fe None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:25.720772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab77b7-e539-425f-97f8-ac9dd7ff01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:25.721458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab77b7-e539-425f-97f8-ac9dd7ff01ed None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:25.721728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab77b7-e539-425f-97f8-ac9dd7ff01ed None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:25.721995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab77b7-e539-425f-97f8-ac9dd7ff01ed None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:25.722684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab77b7-e539-425f-97f8-ac9dd7ff01ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:25.724125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab77b7-e539-425f-97f8-ac9dd7ff01ed None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:25.746390 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 577/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:40:25 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:40:28.121744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e066-7caa-4a8b-88e6-ac04bc09df9f None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:28.122305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e066-7caa-4a8b-88e6-ac04bc09df9f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:28.122305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e066-7caa-4a8b-88e6-ac04bc09df9f None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:28.123657 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 562/1139] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:40:28.130014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b1d8-6fbe-42f2-9ca7-17e4ffc2cce4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:28.130679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b1d8-6fbe-42f2-9ca7-17e4ffc2cce4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:28.130831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b1d8-6fbe-42f2-9ca7-17e4ffc2cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:28.151485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7e78b1d8-6fbe-42f2-9ca7-17e4ffc2cce4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:28.152685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7e78b1d8-6fbe-42f2-9ca7-17e4ffc2cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:28.220120 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 578/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:28.251009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e066-7caa-4a8b-88e6-ac04bc09df9f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:28.362082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e066-7caa-4a8b-88e6-ac04bc09df9f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:28.395663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:28.396380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:28.396662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:28.396927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:28.407263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:28.414070 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:28.415246 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 563/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:28.422145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b1d8-6fbe-42f2-9ca7-17e4ffc2cce4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:28.526076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b1d8-6fbe-42f2-9ca7-17e4ffc2cce4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:28.559591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:28.560252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:28.560524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:28.560797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:28.561572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:28.561874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:28.563264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:28.571863 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 579/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:28.577798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:28.680840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da1a7-e1e0-40c0-bc85-e9c057188fb3 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:28.714271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:28.715124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:28.715397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:28.715665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] PATH_INFO: `/v3/users/73aa80a312ef46c7a25bebdc42f7243f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:28.728791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] RBAC: Authorizing `identity:get_user(user_id=73aa80a312ef46c7a25bebdc42f7243f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:28.730304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:28.731937 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 564/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:28 2022] GET /identity/v3/users/73aa80a312ef46c7a25bebdc42f7243f => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:28.738446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:28.839519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0d70-24de-4fa3-bf00-865c9b96c946 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:28.872406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:28.873049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:28.873336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:28.873605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:28.942330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:28.943518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:29.048231 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 580/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:29.057529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:29.161951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a7c4-967b-4e7a-aa63-de80a47d77ec None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:29.196362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8704c-4eed-4e20-b7aa-eeb288b71980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:29.197183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8704c-4eed-4e20-b7aa-eeb288b71980 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:29.197462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8704c-4eed-4e20-b7aa-eeb288b71980 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:29.197731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8704c-4eed-4e20-b7aa-eeb288b71980 None admin] PATH_INFO: `/v3/projects/2c729098ac0846efae70263085dbacf5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:29.199083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8704c-4eed-4e20-b7aa-eeb288b71980 None admin] RBAC: Authorizing `identity:get_project(project_id=2c729098ac0846efae70263085dbacf5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:29.200540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8704c-4eed-4e20-b7aa-eeb288b71980 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:29.202257 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 565/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:29 2022] GET /identity/v3/projects/2c729098ac0846efae70263085dbacf5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:29.212488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:29.311411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073a8bc-bd62-4d4b-af3f-abf3828ad256 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:29.345500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f465c61-0ff1-4869-aed6-cc31a0c6cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:29.346147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465c61-0ff1-4869-aed6-cc31a0c6cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:29.346427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465c61-0ff1-4869-aed6-cc31a0c6cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:29.346700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465c61-0ff1-4869-aed6-cc31a0c6cbf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:29.347526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f465c61-0ff1-4869-aed6-cc31a0c6cbf9 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=2c729098ac0846efae70263085dbacf5, user.id=73aa80a312ef46c7a25bebdc42f7243f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:29.347833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f465c61-0ff1-4869-aed6-cc31a0c6cbf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:29.349320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f465c61-0ff1-4869-aed6-cc31a0c6cbf9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:29.354812 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 581/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:29 2022] GET /identity/v3/role_assignments?user.id=73aa80a312ef46c7a25bebdc42f7243f&scope.project.id=2c729098ac0846efae70263085dbacf5&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:31.683044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17de9d7-ea6b-4cbb-89a6-420adf11ad85 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:31.683590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17de9d7-ea6b-4cbb-89a6-420adf11ad85 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:31.683590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17de9d7-ea6b-4cbb-89a6-420adf11ad85 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:31.684993 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 566/1147] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:31.691617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059166-a69f-4670-b056-234533c7c1a2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:31.692289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059166-a69f-4670-b056-234533c7c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:31.692427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059166-a69f-4670-b056-234533c7c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:31.717059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c8059166-a69f-4670-b056-234533c7c1a2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:31.718265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c8059166-a69f-4670-b056-234533c7c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:31.784596 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 582/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:31.809065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17de9d7-ea6b-4cbb-89a6-420adf11ad85 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:31.912007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17de9d7-ea6b-4cbb-89a6-420adf11ad85 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:31.946129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:31.946852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:31.947123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:31.947391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:31.958373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:31.965206 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:31.966411 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 567/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:31.973814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8059166-a69f-4670-b056-234533c7c1a2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:32.073894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8059166-a69f-4670-b056-234533c7c1a2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:32.108517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:32.109213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:32.109515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:32.109785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:32.110519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:32.110815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:32.112218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:32.120257 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 583/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:32.126939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:32.227247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae5d25-f39f-4f14-9bbe-ecf02d6c64e3 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:32.260482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:32.261347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:32.261617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:32.261883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] PATH_INFO: `/v3/users/73aa80a312ef46c7a25bebdc42f7243f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:32.263172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] RBAC: Authorizing `identity:get_user(user_id=73aa80a312ef46c7a25bebdc42f7243f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:32.264599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:32.266248 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 568/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:32 2022] GET /identity/v3/users/73aa80a312ef46c7a25bebdc42f7243f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:32.272179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:32.378138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5460f-ba5f-43bd-8482-5ebe4acf94f3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:32.411899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e25d-edc2-44a5-b869-f4405a2b3a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:32.412758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e25d-edc2-44a5-b869-f4405a2b3a3e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:32.413064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e25d-edc2-44a5-b869-f4405a2b3a3e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:32.413340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e25d-edc2-44a5-b869-f4405a2b3a3e None admin] PATH_INFO: `/v3/projects/2c729098ac0846efae70263085dbacf5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:32.414637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e25d-edc2-44a5-b869-f4405a2b3a3e None admin] RBAC: Authorizing `identity:get_project(project_id=2c729098ac0846efae70263085dbacf5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:32.416087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e25d-edc2-44a5-b869-f4405a2b3a3e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:32.417839 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 584/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:32 2022] GET /identity/v3/projects/2c729098ac0846efae70263085dbacf5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:32.424411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:32.524989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916432-789b-49b6-bb57-57489f8f0299 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:32.558352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3f4cf-eeec-409d-9535-c1f800037839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:32.559223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3f4cf-eeec-409d-9535-c1f800037839 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:32.559493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3f4cf-eeec-409d-9535-c1f800037839 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:32.559755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3f4cf-eeec-409d-9535-c1f800037839 None admin] PATH_INFO: `/v3/projects/2c729098ac0846efae70263085dbacf5/users/73aa80a312ef46c7a25bebdc42f7243f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:32.561915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3f4cf-eeec-409d-9535-c1f800037839 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c729098ac0846efae70263085dbacf5, user_id=73aa80a312ef46c7a25bebdc42f7243f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:32.563344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3f4cf-eeec-409d-9535-c1f800037839 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:32.579539 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 569/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:40:32 2022] PUT /identity/v3/projects/2c729098ac0846efae70263085dbacf5/users/73aa80a312ef46c7a25bebdc42f7243f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:40:34.894696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa3f0-0000-498a-bc02-96de518d26cc None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:34.895574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa3f0-0000-498a-bc02-96de518d26cc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:34.895574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa3f0-0000-498a-bc02-96de518d26cc None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:34.897703 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 585/1154] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:34.903108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad92f-58ff-4505-8825-1134f482d5c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:34.903561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad92f-58ff-4505-8825-1134f482d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:34.903664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad92f-58ff-4505-8825-1134f482d5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:34.922055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ee5ad92f-58ff-4505-8825-1134f482d5c6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:34.923232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ee5ad92f-58ff-4505-8825-1134f482d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:34.991981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 570/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:35.017750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfa3f0-0000-498a-bc02-96de518d26cc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:35.128646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfa3f0-0000-498a-bc02-96de518d26cc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:35.162087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:35.162803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:35.163077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:35.163344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:35.174669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:35.181415 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:35.182635 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 586/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:35.188937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ad92f-58ff-4505-8825-1134f482d5c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:35.291646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ad92f-58ff-4505-8825-1134f482d5c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:35.333620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:35.334311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:35.334596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:35.334870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:35.335652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:35.336057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:35.337466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:35.345758 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 571/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:35.351762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:35.456855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bf035-afb7-44c5-a6c4-f417321e47d3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:35.490543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:35.491411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:35.491685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:35.491954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] PATH_INFO: `/v3/users/73aa80a312ef46c7a25bebdc42f7243f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:35.493172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] RBAC: Authorizing `identity:get_user(user_id=73aa80a312ef46c7a25bebdc42f7243f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:35.494682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:35.496289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 587/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:35 2022] GET /identity/v3/users/73aa80a312ef46c7a25bebdc42f7243f => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:35.502431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:35.598750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2c8b-ab13-4e42-af6b-c5125a1f65e0 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:35.632621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:35.633279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:35.633558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:35.633822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:35.699062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:35.700439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:35.805298 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 572/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:35.811513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:35.941728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9aa8f-3c8d-4aa3-aeee-08cd845f4d2a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:35.978663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29409672-4ec3-4701-aba7-8b1c12daf0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:35.979520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29409672-4ec3-4701-aba7-8b1c12daf0e9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:35.979795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29409672-4ec3-4701-aba7-8b1c12daf0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:35.980059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29409672-4ec3-4701-aba7-8b1c12daf0e9 None admin] PATH_INFO: `/v3/projects/2c729098ac0846efae70263085dbacf5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:35.981363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29409672-4ec3-4701-aba7-8b1c12daf0e9 None admin] RBAC: Authorizing `identity:get_project(project_id=2c729098ac0846efae70263085dbacf5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:35.982818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29409672-4ec3-4701-aba7-8b1c12daf0e9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:35.984588 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 588/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:35 2022] GET /identity/v3/projects/2c729098ac0846efae70263085dbacf5 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:35.991131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:36.091611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0326-f293-432a-a9a9-efe31145662b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:36.125533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15896f-d150-4a5d-adb9-887234d19e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:36.126171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15896f-d150-4a5d-adb9-887234d19e6a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:36.126441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15896f-d150-4a5d-adb9-887234d19e6a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:36.126707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15896f-d150-4a5d-adb9-887234d19e6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:36.127519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15896f-d150-4a5d-adb9-887234d19e6a None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=2c729098ac0846efae70263085dbacf5, user.id=73aa80a312ef46c7a25bebdc42f7243f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:36.127824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15896f-d150-4a5d-adb9-887234d19e6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:36.129270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15896f-d150-4a5d-adb9-887234d19e6a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:36.135084 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 573/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:35 2022] GET /identity/v3/role_assignments?user.id=73aa80a312ef46c7a25bebdc42f7243f&scope.project.id=2c729098ac0846efae70263085dbacf5&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:38.500956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea0e2-8ee0-4b8d-853e-80c9c91be881 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:38.501516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea0e2-8ee0-4b8d-853e-80c9c91be881 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:38.501516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea0e2-8ee0-4b8d-853e-80c9c91be881 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:38.502874 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 589/1162] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:38.509185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2298e-20ab-48cc-a359-fa70dd9dba10 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:38.509915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2298e-20ab-48cc-a359-fa70dd9dba10 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:38.510058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2298e-20ab-48cc-a359-fa70dd9dba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:38.533349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f4e2298e-20ab-48cc-a359-fa70dd9dba10 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:38.534583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f4e2298e-20ab-48cc-a359-fa70dd9dba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:38.609839 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 574/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:38.643864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dea0e2-8ee0-4b8d-853e-80c9c91be881 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:38.751632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dea0e2-8ee0-4b8d-853e-80c9c91be881 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:38.785600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:38.786266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:38.786537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:38.786802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:38.985948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:38.987410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:39.107686 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 590/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:39.116797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2298e-20ab-48cc-a359-fa70dd9dba10 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:39.213987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2298e-20ab-48cc-a359-fa70dd9dba10 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:39.252863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190b5ca-3579-45fb-954e-7312ba5e0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:39.254192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190b5ca-3579-45fb-954e-7312ba5e0cbc None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:39.254520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190b5ca-3579-45fb-954e-7312ba5e0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:39.254902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190b5ca-3579-45fb-954e-7312ba5e0cbc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:39.266514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190b5ca-3579-45fb-954e-7312ba5e0cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:39.268282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190b5ca-3579-45fb-954e-7312ba5e0cbc None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:39.284661 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-8190b5ca-3579-45fb-954e-7312ba5e0cbc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 09 20:40:39.285984 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 575/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:40:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:39.292423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:39.392700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f13a1-cd42-4e4e-bea4-d6c7183d7a7b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:39.435804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdb4d5-793b-467b-9af5-9a21a60ea9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:39.436469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb4d5-793b-467b-9af5-9a21a60ea9ac None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:39.436743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb4d5-793b-467b-9af5-9a21a60ea9ac None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:39.437006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb4d5-793b-467b-9af5-9a21a60ea9ac None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:39.437725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdb4d5-793b-467b-9af5-9a21a60ea9ac None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:39.438020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdb4d5-793b-467b-9af5-9a21a60ea9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:39.439850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdb4d5-793b-467b-9af5-9a21a60ea9ac None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:39.446766 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 591/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Apr 9 20:40:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:41.759692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093dea7-b7a1-4bb1-bd16-8ff98a7143be None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:41.760523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093dea7-b7a1-4bb1-bd16-8ff98a7143be None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:41.760523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093dea7-b7a1-4bb1-bd16-8ff98a7143be None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:41.762889 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 576/1167] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:41.769089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010e0a-a157-48a1-9c79-50be226d4041 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:41.769771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010e0a-a157-48a1-9c79-50be226d4041 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:41.770013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010e0a-a157-48a1-9c79-50be226d4041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:41.794910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-89010e0a-a157-48a1-9c79-50be226d4041 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:41.796105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-89010e0a-a157-48a1-9c79-50be226d4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:41.867113 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 592/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:41.892162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093dea7-b7a1-4bb1-bd16-8ff98a7143be None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:42.006488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093dea7-b7a1-4bb1-bd16-8ff98a7143be None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:42.039559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592f85c-96f9-4959-919e-121307af4bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:42.040179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f85c-96f9-4959-919e-121307af4bde None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:42.040460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f85c-96f9-4959-919e-121307af4bde None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:42.040734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f85c-96f9-4959-919e-121307af4bde None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:42.041478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f85c-96f9-4959-919e-121307af4bde None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:42.042860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f85c-96f9-4959-919e-121307af4bde None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:42.060982 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 577/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Sat Apr 9 20:40:41 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:40:44.434358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a2ab0-a839-4f76-b019-1e675fa450cc None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:44.435119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a2ab0-a839-4f76-b019-1e675fa450cc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:44.435202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a2ab0-a839-4f76-b019-1e675fa450cc None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:44.437514 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 593/1170] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:44.444046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4eb5-d844-489a-8bd6-ef4d43324393 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:44.444469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4eb5-d844-489a-8bd6-ef4d43324393 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:44.444661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4eb5-d844-489a-8bd6-ef4d43324393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:44.468747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ff4b4eb5-d844-489a-8bd6-ef4d43324393 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:44.470006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ff4b4eb5-d844-489a-8bd6-ef4d43324393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:44.538500 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 578/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:44.571577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a2ab0-a839-4f76-b019-1e675fa450cc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:44.682447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a2ab0-a839-4f76-b019-1e675fa450cc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:44.717697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9da9b-438e-4f04-a4f1-343e2ce01351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:44.718548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9da9b-438e-4f04-a4f1-343e2ce01351 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:44.718822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9da9b-438e-4f04-a4f1-343e2ce01351 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:44.719091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9da9b-438e-4f04-a4f1-343e2ce01351 None admin] PATH_INFO: `/v3/domains/e7cc6e69ca8543c0b31e1736a14521e1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:44.729813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9da9b-438e-4f04-a4f1-343e2ce01351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e7cc6e69ca8543c0b31e1736a14521e1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:44.731287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9da9b-438e-4f04-a4f1-343e2ce01351 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:44.732889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 594/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Sat Apr 9 20:40:44 2022] GET /identity/v3/domains/e7cc6e69ca8543c0b31e1736a14521e1 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:44.742120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b4eb5-d844-489a-8bd6-ef4d43324393 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:44.849266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b4eb5-d844-489a-8bd6-ef4d43324393 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:44.887445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89322-b6d8-4c8f-ba36-34971187b00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:44.888119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89322-b6d8-4c8f-ba36-34971187b00c None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:44.888396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89322-b6d8-4c8f-ba36-34971187b00c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:44.888665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89322-b6d8-4c8f-ba36-34971187b00c None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:44.889402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89322-b6d8-4c8f-ba36-34971187b00c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:44.890935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89322-b6d8-4c8f-ba36-34971187b00c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:44.919885 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 579/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:40:44 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:40:47.285302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea03b34-82d8-4682-af49-132bbdf08d39 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:47.285866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea03b34-82d8-4682-af49-132bbdf08d39 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:47.285866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea03b34-82d8-4682-af49-132bbdf08d39 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:47.287222 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 595/1174] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:47.295988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70994-e50c-4992-8434-f3ac0aa48de8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:47.296691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70994-e50c-4992-8434-f3ac0aa48de8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:47.296843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70994-e50c-4992-8434-f3ac0aa48de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:47.318416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-76a70994-e50c-4992-8434-f3ac0aa48de8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:47.319613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76a70994-e50c-4992-8434-f3ac0aa48de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:47.387840 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 580/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:47.414048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea03b34-82d8-4682-af49-132bbdf08d39 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:47.518080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea03b34-82d8-4682-af49-132bbdf08d39 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:47.551892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82177253-2f8b-4e05-96d4-1607a3fdc390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:47.552693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177253-2f8b-4e05-96d4-1607a3fdc390 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:47.552967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177253-2f8b-4e05-96d4-1607a3fdc390 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:47.553268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177253-2f8b-4e05-96d4-1607a3fdc390 None admin] PATH_INFO: `/v3/domains/e7cc6e69ca8543c0b31e1736a14521e1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:47.554488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82177253-2f8b-4e05-96d4-1607a3fdc390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e7cc6e69ca8543c0b31e1736a14521e1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:47.555951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82177253-2f8b-4e05-96d4-1607a3fdc390 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:47.557665 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 596/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Sat Apr 9 20:40:47 2022] GET /identity/v3/domains/e7cc6e69ca8543c0b31e1736a14521e1 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:47.563903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a70994-e50c-4992-8434-f3ac0aa48de8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:47.668540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a70994-e50c-4992-8434-f3ac0aa48de8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:47.702481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d5c9-8b72-4d11-90df-39b48e4c9048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:47.703455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d5c9-8b72-4d11-90df-39b48e4c9048 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:47.703760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d5c9-8b72-4d11-90df-39b48e4c9048 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:47.704030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d5c9-8b72-4d11-90df-39b48e4c9048 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:47.704727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498d5c9-8b72-4d11-90df-39b48e4c9048 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:47.706227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498d5c9-8b72-4d11-90df-39b48e4c9048 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:47.728895 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 581/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:40:47 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:40:50.125687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed701-45f9-4b5a-893b-9a0bb0b29586 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:50.126644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed701-45f9-4b5a-893b-9a0bb0b29586 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:50.126644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed701-45f9-4b5a-893b-9a0bb0b29586 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:50.128749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 597/1178] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:50.134316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a68a0-c262-41c6-beb5-ec96999eb525 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:50.134749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a68a0-c262-41c6-beb5-ec96999eb525 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:50.134849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a68a0-c262-41c6-beb5-ec96999eb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:50.152715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-191a68a0-c262-41c6-beb5-ec96999eb525 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:50.153922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-191a68a0-c262-41c6-beb5-ec96999eb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:50.221733 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 582/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:50.247731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbed701-45f9-4b5a-893b-9a0bb0b29586 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:50.357880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbed701-45f9-4b5a-893b-9a0bb0b29586 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:50.391424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:50.392137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:50.392413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:50.392679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:50.403857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:50.410725 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:50.411871 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 598/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:50.418225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a68a0-c262-41c6-beb5-ec96999eb525 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:50.527899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a68a0-c262-41c6-beb5-ec96999eb525 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:50.566687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:50.567352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:50.567623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:50.567888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:50.568623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:50.568923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:50.570325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:50.578352 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 583/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:50.584972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:50.682143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb89fd4-bf95-4d36-b034-2f2cdee6b926 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:50.714900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:50.715757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:50.716032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:50.716300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] PATH_INFO: `/v3/users/00292ffc2683463787eb1c864450ba5f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:50.728887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] RBAC: Authorizing `identity:get_user(user_id=00292ffc2683463787eb1c864450ba5f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:50.730412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:50.732059 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 599/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:50 2022] GET /identity/v3/users/00292ffc2683463787eb1c864450ba5f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:40:50.740950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:50.863241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bed1b-cd86-4af2-beaa-b3a118082970 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:50.900075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:50.900714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:50.900991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:50.901291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:50.966740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:50.968207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:51.074192 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 584/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:51.080905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:51.184754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dd320-0e9e-43f9-88e8-2b05c68bffca None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:51.218449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647f931-63a7-4f3f-bf63-2e65c32efa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:51.219240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f931-63a7-4f3f-bf63-2e65c32efa31 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:51.219513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f931-63a7-4f3f-bf63-2e65c32efa31 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:51.219787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f931-63a7-4f3f-bf63-2e65c32efa31 None admin] PATH_INFO: `/v3/projects/f86ccf45771f42a8894a93d7a9a3479e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:51.221080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647f931-63a7-4f3f-bf63-2e65c32efa31 None admin] RBAC: Authorizing `identity:get_project(project_id=f86ccf45771f42a8894a93d7a9a3479e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:51.222540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647f931-63a7-4f3f-bf63-2e65c32efa31 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:51.224206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 600/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:51 2022] GET /identity/v3/projects/f86ccf45771f42a8894a93d7a9a3479e => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:51.230741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:51.327556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92d1cf-4a83-44a1-9c2d-33ee150a288f None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:51.362049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e3ec3-c53e-468b-a7c0-06ce4fe71572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:51.362697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3ec3-c53e-468b-a7c0-06ce4fe71572 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:51.362983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3ec3-c53e-468b-a7c0-06ce4fe71572 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:51.363255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3ec3-c53e-468b-a7c0-06ce4fe71572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:51.364078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e3ec3-c53e-468b-a7c0-06ce4fe71572 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=f86ccf45771f42a8894a93d7a9a3479e, user.id=00292ffc2683463787eb1c864450ba5f) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:51.364392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e3ec3-c53e-468b-a7c0-06ce4fe71572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:51.365888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e3ec3-c53e-468b-a7c0-06ce4fe71572 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:51.371426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 585/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:51 2022] GET /identity/v3/role_assignments?user.id=00292ffc2683463787eb1c864450ba5f&scope.project.id=f86ccf45771f42a8894a93d7a9a3479e&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:53.686358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0aa89-2be5-4172-a331-fa06e12fe43c None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:53.687298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0aa89-2be5-4172-a331-fa06e12fe43c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:53.687298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0aa89-2be5-4172-a331-fa06e12fe43c None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:53.689544 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 601/1186] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:53.698287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3623-6c7b-48ca-953d-d2f9295e569c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:53.698714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3623-6c7b-48ca-953d-d2f9295e569c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:53.698895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3623-6c7b-48ca-953d-d2f9295e569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:53.718107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c38c3623-6c7b-48ca-953d-d2f9295e569c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:53.719305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c38c3623-6c7b-48ca-953d-d2f9295e569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:53.790673 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 586/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:53.815215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0aa89-2be5-4172-a331-fa06e12fe43c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:53.933588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0aa89-2be5-4172-a331-fa06e12fe43c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:53.967518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:53.968325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:53.968598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:53.968867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:53.978759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:53.985591 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:53.986775 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 602/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:53.993383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3623-6c7b-48ca-953d-d2f9295e569c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:54.094936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3623-6c7b-48ca-953d-d2f9295e569c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:54.131767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:54.132427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:54.132704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:54.132967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:54.133748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:54.134048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:54.135440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:54.143334 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 587/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:54.149309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:54.257606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e13df6-b760-42ba-b616-35082cbaacef None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:54.290750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:54.291609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:54.291883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:54.292156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] PATH_INFO: `/v3/users/00292ffc2683463787eb1c864450ba5f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:54.293482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] RBAC: Authorizing `identity:get_user(user_id=00292ffc2683463787eb1c864450ba5f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:54.294921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:54.296534 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 603/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:54 2022] GET /identity/v3/users/00292ffc2683463787eb1c864450ba5f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:54.305898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:54.418643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756d33-7f8d-473e-a53a-f1aad366f3cd None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:54.451492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9497c4-fa76-4d32-b953-00d7440339ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:54.452362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9497c4-fa76-4d32-b953-00d7440339ac None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:54.452632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9497c4-fa76-4d32-b953-00d7440339ac None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:54.452897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9497c4-fa76-4d32-b953-00d7440339ac None admin] PATH_INFO: `/v3/projects/f86ccf45771f42a8894a93d7a9a3479e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:54.454224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9497c4-fa76-4d32-b953-00d7440339ac None admin] RBAC: Authorizing `identity:get_project(project_id=f86ccf45771f42a8894a93d7a9a3479e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:54.455999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9497c4-fa76-4d32-b953-00d7440339ac None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:54.457774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 588/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:54 2022] GET /identity/v3/projects/f86ccf45771f42a8894a93d7a9a3479e => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:54.467084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:54.569872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3114b-fd3c-47b5-acf8-a6ea64638473 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:54.611489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59146a4b-cc0e-4328-a5a1-adcdccb502b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:54.612394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59146a4b-cc0e-4328-a5a1-adcdccb502b1 None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:54.612669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59146a4b-cc0e-4328-a5a1-adcdccb502b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:54.612945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59146a4b-cc0e-4328-a5a1-adcdccb502b1 None admin] PATH_INFO: `/v3/projects/f86ccf45771f42a8894a93d7a9a3479e/users/00292ffc2683463787eb1c864450ba5f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:54.615057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59146a4b-cc0e-4328-a5a1-adcdccb502b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f86ccf45771f42a8894a93d7a9a3479e, user_id=00292ffc2683463787eb1c864450ba5f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:54.616528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59146a4b-cc0e-4328-a5a1-adcdccb502b1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:54.632825 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 604/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:40:54 2022] PUT /identity/v3/projects/f86ccf45771f42a8894a93d7a9a3479e/users/00292ffc2683463787eb1c864450ba5f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:40:56.932755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85df2-5089-4f4e-bca6-fb219299386f None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:56.933356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85df2-5089-4f4e-bca6-fb219299386f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:56.933356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85df2-5089-4f4e-bca6-fb219299386f None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:56.934715 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 589/1193] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:40:56.941013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be17e3-4397-44b3-a704-d1b43b7e2927 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:56.941714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be17e3-4397-44b3-a704-d1b43b7e2927 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:56.941927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be17e3-4397-44b3-a704-d1b43b7e2927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:56.969264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-48be17e3-4397-44b3-a704-d1b43b7e2927 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:40:56.970967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-48be17e3-4397-44b3-a704-d1b43b7e2927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:40:57.050925 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 605/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:40:57.076070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85df2-5089-4f4e-bca6-fb219299386f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:57.193112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85df2-5089-4f4e-bca6-fb219299386f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:57.228659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:57.229490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:57.229765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:57.230032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:57.240920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:40:57.247630 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:40:57.248814 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 590/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:40:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:40:57.255369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be17e3-4397-44b3-a704-d1b43b7e2927 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:57.351423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be17e3-4397-44b3-a704-d1b43b7e2927 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:57.384984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:57.385681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:57.385964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:57.386236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:57.387009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:57.387319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:57.388708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:57.396701 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 606/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:40:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:57.402730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:57.508575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9cd0-f7bb-4fa4-8069-01a3b985d3d7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:57.542811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:57.543681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:57.543957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:57.544238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] PATH_INFO: `/v3/users/00292ffc2683463787eb1c864450ba5f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:57.545571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] RBAC: Authorizing `identity:get_user(user_id=00292ffc2683463787eb1c864450ba5f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:57.547022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:57.548742 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 591/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Apr 9 20:40:57 2022] GET /identity/v3/users/00292ffc2683463787eb1c864450ba5f => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:57.555160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:57.659926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7547d68-6689-4b24-8443-dfd1e8a72784 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:57.696841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:57.697513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:57.697790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:57.698057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:57.763656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:57.765075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:57.862593 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 607/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:40:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:40:57.868851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:57.980326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196267-9915-40f3-9f2d-e2d8f0d85c23 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:58.014216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf6577-6825-453f-99b7-7a0bd4364c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:58.015009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf6577-6825-453f-99b7-7a0bd4364c6f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:58.015285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf6577-6825-453f-99b7-7a0bd4364c6f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:58.015553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf6577-6825-453f-99b7-7a0bd4364c6f None admin] PATH_INFO: `/v3/projects/f86ccf45771f42a8894a93d7a9a3479e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:58.016763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf6577-6825-453f-99b7-7a0bd4364c6f None admin] RBAC: Authorizing `identity:get_project(project_id=f86ccf45771f42a8894a93d7a9a3479e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:58.018279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf6577-6825-453f-99b7-7a0bd4364c6f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:58.019967 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 592/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Apr 9 20:40:57 2022] GET /identity/v3/projects/f86ccf45771f42a8894a93d7a9a3479e => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:40:58.026380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:40:58.137407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d64a-aa78-419d-82bf-5b61ce482e30 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:40:58.170877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c913-48f2-4a73-8b05-7351ff14ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:40:58.171519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c913-48f2-4a73-8b05-7351ff14ec91 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:40:58.171790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c913-48f2-4a73-8b05-7351ff14ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:40:58.172052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c913-48f2-4a73-8b05-7351ff14ec91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:40:58.172872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c913-48f2-4a73-8b05-7351ff14ec91 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=f86ccf45771f42a8894a93d7a9a3479e, user.id=00292ffc2683463787eb1c864450ba5f) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:40:58.173207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c913-48f2-4a73-8b05-7351ff14ec91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:40:58.174691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c913-48f2-4a73-8b05-7351ff14ec91 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:40:58.180430 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 608/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:40:58 2022] GET /identity/v3/role_assignments?user.id=00292ffc2683463787eb1c864450ba5f&scope.project.id=f86ccf45771f42a8894a93d7a9a3479e&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:01.633557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6cc68-3783-4969-bc01-a635dac3e74e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:01.633557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6cc68-3783-4969-bc01-a635dac3e74e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:01.633557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6cc68-3783-4969-bc01-a635dac3e74e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:01.633557 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 593/1201] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:01.638150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeeb55-e4a1-4866-968b-9d88122bdef9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:01.638675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeeb55-e4a1-4866-968b-9d88122bdef9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:01.638788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeeb55-e4a1-4866-968b-9d88122bdef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:01.665309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a2eeeb55-e4a1-4866-968b-9d88122bdef9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:01.665309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a2eeeb55-e4a1-4866-968b-9d88122bdef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:01.749753 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 609/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:01.778380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6cc68-3783-4969-bc01-a635dac3e74e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:01.896210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6cc68-3783-4969-bc01-a635dac3e74e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:01.931763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:01.932573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:01.932835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:01.933123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:01.944030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:01.945752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:01.967604 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:01.969179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 594/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:01.975559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeeb55-e4a1-4866-968b-9d88122bdef9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:02.093650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeeb55-e4a1-4866-968b-9d88122bdef9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:02.132849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee968d84-fc30-456c-80ad-d0d812fe24d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:02.133593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968d84-fc30-456c-80ad-d0d812fe24d1 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:02.133877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968d84-fc30-456c-80ad-d0d812fe24d1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:02.134179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968d84-fc30-456c-80ad-d0d812fe24d1 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:02.134902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968d84-fc30-456c-80ad-d0d812fe24d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:02.135274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968d84-fc30-456c-80ad-d0d812fe24d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:02.136840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968d84-fc30-456c-80ad-d0d812fe24d1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:02.149623 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 610/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:02.158089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:02.276754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b9af-c159-4c26-9b54-7a8f6ce72a91 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:02.315684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa33d27-3694-4941-88ad-6a1cef025330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:02.316446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa33d27-3694-4941-88ad-6a1cef025330 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:02.316773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa33d27-3694-4941-88ad-6a1cef025330 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:02.317075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa33d27-3694-4941-88ad-6a1cef025330 None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:02.317915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa33d27-3694-4941-88ad-6a1cef025330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:02.319590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa33d27-3694-4941-88ad-6a1cef025330 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:02.345521 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 595/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Apr 9 20:42:02 2022] POST /identity/v3/users => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:42:04.897133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e4cb3-e99b-4a51-a315-7e52c5b5dbca None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:04.897734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e4cb3-e99b-4a51-a315-7e52c5b5dbca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:04.897734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e4cb3-e99b-4a51-a315-7e52c5b5dbca None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:04.899107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 611/1206] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:04.904835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19abc-b991-459c-80f1-1a917678f104 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:04.905275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19abc-b991-459c-80f1-1a917678f104 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:04.905440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19abc-b991-459c-80f1-1a917678f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:04.923342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f5f19abc-b991-459c-80f1-1a917678f104 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:04.924698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f5f19abc-b991-459c-80f1-1a917678f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:05.003403 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 596/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:05.038642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e4cb3-e99b-4a51-a315-7e52c5b5dbca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:05.178276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e4cb3-e99b-4a51-a315-7e52c5b5dbca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:05.217765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:05.218819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:05.219276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:05.219737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] PATH_INFO: `/v3/roles/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:05.235824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:42:05.245076 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:42:05.246687 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 612/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:05.254237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19abc-b991-459c-80f1-1a917678f104 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:05.384522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19abc-b991-459c-80f1-1a917678f104 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:05.428642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:05.429481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:05.429949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:05.430324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:05.431219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:05.431644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:05.433710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:05.444807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 597/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:05.452073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:05.563016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202c4f9-435e-4d6b-82a7-47864773a64e None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:05.603358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:05.604344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:05.604737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:05.605153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:05.617931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:05.619538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:05.637331 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:05.638778 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 613/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:05.645209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:05.747766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6621-bbd2-460a-8c2b-8dc9b0df25cb None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:05.784885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:05.785756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:05.786037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:05.786317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:05.787142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:05.787463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:05.788955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:05.802438 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 598/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:05.808496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:05.913898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b3b9-f66a-4e99-b7f5-69d7d34db7fa None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:05.952840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:05.953820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:05.954101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:05.954363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:05.963731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:05.968062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:05.982567 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 09 20:42:05.983811 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 614/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:05.989901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:06.095659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6058a4d-33be-4659-9997-9a76f95a023b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:06.131514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:06.132194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:06.132496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:06.132770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:06.133644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:06.133942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:06.135441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:06.153308 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 599/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Apr 9 20:42:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:06.159035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:06.260353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131d6b5-ac86-4bcd-aa40-83c823a9b0a2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:06.295861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:06.296799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:06.297096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:06.297444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:06.364107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:06.365720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:06.464180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 615/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:42:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:42:06.470238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:06.577177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f76e35-4bb3-4042-b583-8c33f415762b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:06.612942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:06.613821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:06.614190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:06.614423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:06.625466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:06.626945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:06.646188 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:06.647700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 600/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:42:06.653464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:06.753641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c2e5-c2c3-4c6b-b672-9054a9d49478 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:06.788255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:06.788933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:06.789241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:06.789575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:06.790225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:06.790526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:06.791921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:06.803534 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 616/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:06.809616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:06.917269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730af145-afdd-4816-94f7-aae87b80d511 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:06.956811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:06.957704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:06.957988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:06.958265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:06.965574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:06.967065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:06.981149 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:42:06.983507 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 601/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:06.988248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:07.094900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21894a-b07b-41e6-a925-9700b8e21bc9 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:07.134441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563711e-1330-484a-869c-920f0360b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:07.137212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563711e-1330-484a-869c-920f0360b99e None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:07.137212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563711e-1330-484a-869c-920f0360b99e None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:07.137212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563711e-1330-484a-869c-920f0360b99e None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:07.137212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563711e-1330-484a-869c-920f0360b99e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:07.137212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563711e-1330-484a-869c-920f0360b99e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:07.139066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563711e-1330-484a-869c-920f0360b99e None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:07.158786 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 617/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:07.165167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:07.270947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e48885-2932-416b-a125-4902a3a887f1 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:07.307147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce8a35-876c-4f5e-b1a3-1bed601d8637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:07.308069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce8a35-876c-4f5e-b1a3-1bed601d8637 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:07.308439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce8a35-876c-4f5e-b1a3-1bed601d8637 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:07.308821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce8a35-876c-4f5e-b1a3-1bed601d8637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:07.309846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce8a35-876c-4f5e-b1a3-1bed601d8637 None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d46de1b79f16410fbd8dc2d1c1ecc29d) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:07.310256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce8a35-876c-4f5e-b1a3-1bed601d8637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:07.311818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce8a35-876c-4f5e-b1a3-1bed601d8637 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:07.321100 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 602/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:42:07 2022] GET /identity/v3/role_assignments?user.id=d46de1b79f16410fbd8dc2d1c1ecc29d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:09.749539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f9abc-3de5-4fdb-912c-9ee53f844c4b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:09.750108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f9abc-3de5-4fdb-912c-9ee53f844c4b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:09.750108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f9abc-3de5-4fdb-912c-9ee53f844c4b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:09.751495 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 618/1220] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:09.757247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a5c11-59a3-4694-97da-055f313d95ba None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:09.757732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a5c11-59a3-4694-97da-055f313d95ba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:09.757836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a5c11-59a3-4694-97da-055f313d95ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:09.775870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6f8a5c11-59a3-4694-97da-055f313d95ba None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:09.777110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6f8a5c11-59a3-4694-97da-055f313d95ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:09.860784 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 603/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:09.886242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f9abc-3de5-4fdb-912c-9ee53f844c4b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:10.003647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f9abc-3de5-4fdb-912c-9ee53f844c4b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:10.036858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:10.037689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:10.037962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:10.038229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:10.048295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:42:10.056037 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:42:10.057422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 619/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:10.064603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a5c11-59a3-4694-97da-055f313d95ba None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:10.172891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a5c11-59a3-4694-97da-055f313d95ba None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:10.207560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:10.208263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:10.208542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:10.208814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:10.209607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] RBAC: Adding query filter params (name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:10.209934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:10.211320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:10.219678 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 604/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:10.226092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:10.329801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8243a80-b270-4552-b682-a211f6f1fbb3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:10.365945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:10.366856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:10.367210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:10.367487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:10.378764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:10.380276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:10.397629 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:10.403472 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 620/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:42:10.404696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:10.516899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6875-57e5-4ffb-852b-6e072ff7d825 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:10.552963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:10.553929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:10.554252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:10.554621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:10.555503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:10.555835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:10.557350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:10.570148 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 605/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:10.575939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:10.678635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96fef0-0022-4afa-8fb2-32328a3bf417 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:10.712922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:10.713809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:10.714090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:10.714425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] PATH_INFO: `/v3/users/placement` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:10.721925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:10.723392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:10.742413 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 09 20:42:10.743724 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 621/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:10.749620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:10.850868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e962-0a89-411b-a4a3-9dffb671c356 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:10.886700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:10.887472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:10.887764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:10.888057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:10.888952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:10.889320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:10.890917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:10.909641 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 606/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Apr 9 20:42:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:10.915369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:11.017714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89a9d8-9403-4659-8a06-1e4c9de21a50 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:11.052661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:11.053555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:11.053820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:11.054086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:11.066297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:11.067836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:11.084451 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:11.085762 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 622/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:11.091985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:11.194836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70722f-92fb-40f3-ad1a-8b900a1a36dc None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:11.229472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:11.230227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:11.230510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:11.230850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:11.231643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:11.231963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:11.233388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:11.245817 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 607/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:11.251716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:11.359023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551a63b-b95b-4fc7-af88-a41ddbeed830 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:11.392032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:11.392991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:11.393386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:11.393664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:11.400557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:11.402111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:11.415680 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:42:11.416903 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 623/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:11.422973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:11.530259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6675f-7ea9-4efb-9eaa-30d0ff660428 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:11.563571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c02250-7648-4f62-bad2-ed1c59d37266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:11.564277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c02250-7648-4f62-bad2-ed1c59d37266 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:11.564558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c02250-7648-4f62-bad2-ed1c59d37266 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:11.564824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c02250-7648-4f62-bad2-ed1c59d37266 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:11.565650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c02250-7648-4f62-bad2-ed1c59d37266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:11.565956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c02250-7648-4f62-bad2-ed1c59d37266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:11.567450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c02250-7648-4f62-bad2-ed1c59d37266 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:11.580684 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 608/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:11.586945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:11.689087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951cf8-7307-400a-8255-c894a5371bc3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:11.724012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7821b-7b91-4f0e-af1f-0358186e66e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:11.725524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7821b-7b91-4f0e-af1f-0358186e66e1 None admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:11.725991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7821b-7b91-4f0e-af1f-0358186e66e1 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:11.726623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7821b-7b91-4f0e-af1f-0358186e66e1 None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d46de1b79f16410fbd8dc2d1c1ecc29d/roles/463fc59d1d56462181691eaa570e646f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:11.745251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7821b-7b91-4f0e-af1f-0358186e66e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=d46de1b79f16410fbd8dc2d1c1ecc29d, role_id=463fc59d1d56462181691eaa570e646f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:11.747701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7821b-7b91-4f0e-af1f-0358186e66e1 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:11.763157 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 624/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:42:11 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d46de1b79f16410fbd8dc2d1c1ecc29d/roles/463fc59d1d56462181691eaa570e646f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:42:14.120223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c1bff-5d84-4b0d-9181-780e9a7e9022 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:14.120793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c1bff-5d84-4b0d-9181-780e9a7e9022 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:14.120793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c1bff-5d84-4b0d-9181-780e9a7e9022 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:14.122172 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 609/1233] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:42:14.127572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f99a-423f-4c31-befd-f51c4b98be7e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:14.127976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f99a-423f-4c31-befd-f51c4b98be7e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:14.128136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f99a-423f-4c31-befd-f51c4b98be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:14.145127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3b22f99a-423f-4c31-befd-f51c4b98be7e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:14.146377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3b22f99a-423f-4c31-befd-f51c4b98be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:14.213503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 625/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:14.238635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c1bff-5d84-4b0d-9181-780e9a7e9022 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:14.343710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c1bff-5d84-4b0d-9181-780e9a7e9022 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:14.381662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:14.382388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:14.382660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:14.382926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:14.393094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:42:14.400025 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 09 20:42:14.401203 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 610/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Apr 9 20:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:14.407599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22f99a-423f-4c31-befd-f51c4b98be7e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:14.509515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22f99a-423f-4c31-befd-f51c4b98be7e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:14.545063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:14.545720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:14.545987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:14.546226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:14.546964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] RBAC: Adding query filter params (name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:14.547259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:14.548672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:14.556559 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 626/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Apr 9 20:42:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:14.562663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:14.667837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4090-447e-4696-ac1f-ab0d27f2d5f3 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:14.701086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:14.701905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:14.702177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:14.702439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:14.714037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:14.715885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:14.735995 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:14.737529 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 611/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:42:14.743551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:14.846890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6926eb0-20d2-428e-a2ae-1a296d3f1699 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:14.882564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:14.883332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:14.883588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:14.883861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:14.884592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:14.884950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:14.886536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:14.898902 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 627/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:14.904755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:15.004356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3a3f6-0078-4ab7-a85c-2e685b36682a None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:15.038079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:15.039095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:15.039439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:15.039712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] PATH_INFO: `/v3/users/placement` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:15.048948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:15.050852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:15.066923 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 09 20:42:15.068210 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 612/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:15.074093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:15.185705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f773-5941-4d04-b232-f8a1ba9ae16b None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:15.220494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:15.221286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:15.221570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:15.221842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:15.222675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:15.222985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:15.224536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:15.243421 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 628/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Apr 9 20:42:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:15.249889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:15.358895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58293-1817-4783-a020-d3ff3530d023 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:15.394647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:15.395324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:15.395606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:15.395882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:15.471356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:15.472874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:15.701543 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 613/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:42:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:42:15.707511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:15.810143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34051813-ff22-4572-9a5e-07275f34f7ec None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:15.844659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:15.845498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:15.845772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:15.846042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:15.857285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:15.858755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:15.875344 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:15.876575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 629/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:15.882971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:15.994399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c8f08-1379-4fd2-b6c0-865907c58adc None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:16.031185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:16.031879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:16.032130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:16.032421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:16.033161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:16.033480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:16.034862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:16.047182 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 614/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:16.053130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:16.161426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f26acd-5938-40d7-b579-0fb7d78f51ab None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:16.195782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:16.196678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:16.197720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:16.197720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:16.205611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:16.207084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:16.222098 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:42:16.223561 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 630/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:16.230221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:16.334854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5291-4ea8-4228-a2c0-a5870b151039 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:16.371258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773eeee-6b20-49d1-94ce-91089b61c300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:16.371990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773eeee-6b20-49d1-94ce-91089b61c300 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:16.372263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773eeee-6b20-49d1-94ce-91089b61c300 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:16.372569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773eeee-6b20-49d1-94ce-91089b61c300 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:16.373486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773eeee-6b20-49d1-94ce-91089b61c300 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:16.373791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773eeee-6b20-49d1-94ce-91089b61c300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:16.375224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773eeee-6b20-49d1-94ce-91089b61c300 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:16.387180 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 615/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:16.393969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:16.502188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e332ef-bb3d-407c-a51c-04d0e9e31e11 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:16.535433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e1335-6edb-4246-b411-71cb9d11f83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:16.536099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e1335-6edb-4246-b411-71cb9d11f83f None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:16.536367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e1335-6edb-4246-b411-71cb9d11f83f None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:16.536630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e1335-6edb-4246-b411-71cb9d11f83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:16.537522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e1335-6edb-4246-b411-71cb9d11f83f None admin] RBAC: Adding query filter params (role.id=463fc59d1d56462181691eaa570e646f, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d46de1b79f16410fbd8dc2d1c1ecc29d) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:16.537820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e1335-6edb-4246-b411-71cb9d11f83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:16.539265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e1335-6edb-4246-b411-71cb9d11f83f None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:16.545053 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 631/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:42:16 2022] GET /identity/v3/role_assignments?user.id=d46de1b79f16410fbd8dc2d1c1ecc29d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=463fc59d1d56462181691eaa570e646f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:19.026504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594decb-b7dc-4fb6-b605-b1b87975895c None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:19.027107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594decb-b7dc-4fb6-b605-b1b87975895c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:19.027107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594decb-b7dc-4fb6-b605-b1b87975895c None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:19.028538 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 616/1247] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:19.034422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f75ab-1f02-4187-8cab-d393163f3571 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:19.034929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f75ab-1f02-4187-8cab-d393163f3571 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:19.035112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f75ab-1f02-4187-8cab-d393163f3571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:19.054711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-887f75ab-1f02-4187-8cab-d393163f3571 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:19.056039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-887f75ab-1f02-4187-8cab-d393163f3571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:19.137155 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 632/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:19.163591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594decb-b7dc-4fb6-b605-b1b87975895c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:19.269862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594decb-b7dc-4fb6-b605-b1b87975895c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:19.305133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:19.306044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:19.306332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:19.306646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:19.318399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:42:19.326808 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:42:19.328399 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 617/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:19.336122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f75ab-1f02-4187-8cab-d393163f3571 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:19.443974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f75ab-1f02-4187-8cab-d393163f3571 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:19.484056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:19.485287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:19.485569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:19.485867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:19.486738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:19.487070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:19.488615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:19.496981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 633/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:19.503011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:19.608577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93fb2-f59a-4d80-a4d7-b92ea0f315df None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:19.644455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:19.645416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:19.645689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:19.645999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:19.658016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:19.659483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:19.678065 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:19.679499 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 618/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:42:19.685497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:19.790465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f544-22bc-4726-adc1-a4b330855630 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:19.825884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:19.826669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:19.826948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:19.827224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:19.828020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:19.828379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:19.829818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:19.842161 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 634/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:19.848611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:19.958998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f715d5d-feb9-4ea6-911f-1f46b9e9a337 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:19.995161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:19.995966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:19.996270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:19.996521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] PATH_INFO: `/v3/users/placement` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:20.004147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:20.005661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:20.020197 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 09 20:42:20.021719 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 619/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:20.027876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:20.136369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ab54-4ab1-4c54-91e4-1b71c1d84887 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:20.172321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:20.173004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:20.173317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:20.173588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:20.174423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:20.174728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:20.176176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:20.194293 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 635/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Apr 9 20:42:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:20.201100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:20.303494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972979-99e5-4251-a1f7-0c7ee9bf160b None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:20.339563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:20.340201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:20.340474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:20.340739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:20.407725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:20.409209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:20.513020 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 620/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:42:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:42:20.519203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:20.618829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a783fa-7e57-49eb-9c95-26bc5c3ac364 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:20.651618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:20.652416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:20.652691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:20.652964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:20.664017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:20.665759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:20.683100 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:20.684454 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 636/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:42:20.692066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:20.796819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f519089-f547-4f51-bb82-1f86a1478bb4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:20.834486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:20.835225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:20.835497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:20.835765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:20.836493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:20.836796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:20.838223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:20.850639 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 621/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:20.856719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:20.963402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8811e9-7eff-4f54-aa79-8eb1954e1918 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:21.000834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:21.001691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:21.001968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:21.002242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:21.009738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:21.011234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:21.025073 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:42:21.026349 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 637/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:21.032904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:21.140941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007fb91-ccaa-44ec-bf46-4ce98eab3520 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:21.175233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62737da-aea4-43dd-b3fd-5fd2bbc2e886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:21.175896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62737da-aea4-43dd-b3fd-5fd2bbc2e886 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:21.176172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62737da-aea4-43dd-b3fd-5fd2bbc2e886 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:21.176438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62737da-aea4-43dd-b3fd-5fd2bbc2e886 None admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:21.177245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62737da-aea4-43dd-b3fd-5fd2bbc2e886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:21.177545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62737da-aea4-43dd-b3fd-5fd2bbc2e886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:21.179075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62737da-aea4-43dd-b3fd-5fd2bbc2e886 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:21.191702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 622/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:21.197796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:21.297968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052445e3-b336-4951-9a57-294f9b032529 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:21.329421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af326a89-1720-4a66-900c-8eb9da1dc753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:21.330075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326a89-1720-4a66-900c-8eb9da1dc753 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:21.330351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326a89-1720-4a66-900c-8eb9da1dc753 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:21.330621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326a89-1720-4a66-900c-8eb9da1dc753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:21.331442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af326a89-1720-4a66-900c-8eb9da1dc753 None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d46de1b79f16410fbd8dc2d1c1ecc29d) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:21.331742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af326a89-1720-4a66-900c-8eb9da1dc753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:21.333207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af326a89-1720-4a66-900c-8eb9da1dc753 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:21.338643 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 638/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:42:21 2022] GET /identity/v3/role_assignments?user.id=d46de1b79f16410fbd8dc2d1c1ecc29d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:23.712765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f7fe-ad0d-4a88-928e-6d57240af05c None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:23.713333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f7fe-ad0d-4a88-928e-6d57240af05c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:23.713442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f7fe-ad0d-4a88-928e-6d57240af05c None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:23.715482 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 623/1261] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:23.723627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0070e-7028-4771-afae-b1d1d6fc08b1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:23.724072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0070e-7028-4771-afae-b1d1d6fc08b1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:23.724160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0070e-7028-4771-afae-b1d1d6fc08b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:23.741803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4ae0070e-7028-4771-afae-b1d1d6fc08b1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:23.742961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ae0070e-7028-4771-afae-b1d1d6fc08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:23.814277 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 639/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 09 20:42:23.840347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9f7fe-ad0d-4a88-928e-6d57240af05c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:23.949252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9f7fe-ad0d-4a88-928e-6d57240af05c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:23.997895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:23.998616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:23.998890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:23.999159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:24.010523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:42:24.017371 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:42:24.018576 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 624/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:24.025247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0070e-7028-4771-afae-b1d1d6fc08b1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:24.131575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0070e-7028-4771-afae-b1d1d6fc08b1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:24.166443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:24.167177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:24.167454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:24.167823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:24.168543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:24.168848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:24.170290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:24.178457 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 640/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:24.185898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:24.292579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a7bff-b075-42ac-ad6f-83b6179f9463 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:24.333077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:24.333875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:24.334151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:24.334422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:24.345284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:24.346723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:24.365342 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:24.366588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 625/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:24.372713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:24.489883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda0556-f64d-41bc-a594-929011937505 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:24.531711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:24.532370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:24.532643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:24.532909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:24.533652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:24.534067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:24.535490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:24.547271 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 641/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:24.558128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:24.688818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd453db-67cd-44b2-ae40-b792560b34b4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:24.723606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:24.724395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:24.724666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:24.724927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:24.732827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:24.734289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:24.747835 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 09 20:42:24.749006 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 626/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:24.755184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:24.859388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19672fe2-8665-4ce5-b11f-cc4a8addc216 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:24.897003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:24.897754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:24.898029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:24.898294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:24.899107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:24.899409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:24.900869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:24.918730 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 642/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Apr 9 20:42:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:42:24.927958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:25.045551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319b170-6556-46cb-a92e-797383fe6bd7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:25.078485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:25.079246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:25.079530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:25.079794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:25.091562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:25.093277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:25.113314 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:25.114845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 627/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:25.120891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:25.225678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bd037-fc30-46cf-87a6-c7bf66f25e83 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:25.260058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:25.260711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:25.260989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:25.261296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:25.262009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:25.262307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:25.263706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:25.274889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 643/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:25.281070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:25.388371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c0e4-1b19-4c25-9f3c-edf9520d3fd7 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:25.426988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:25.427806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:25.428078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:25.428346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:25.435249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:25.436693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:25.450166 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:42:25.451528 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 628/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:25.458148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:25.570839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f41e6-ed2c-431e-a5ed-d5e571fa06b5 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:25.606804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf0e6f-2f43-4c7d-ac73-64b3e5cdfdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:25.607465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0e6f-2f43-4c7d-ac73-64b3e5cdfdef None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:25.607751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0e6f-2f43-4c7d-ac73-64b3e5cdfdef None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:25.608020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0e6f-2f43-4c7d-ac73-64b3e5cdfdef None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:25.608800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf0e6f-2f43-4c7d-ac73-64b3e5cdfdef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:25.609144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf0e6f-2f43-4c7d-ac73-64b3e5cdfdef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:25.610603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf0e6f-2f43-4c7d-ac73-64b3e5cdfdef None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:25.622913 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 644/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:25.629396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:25.741200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249400a8-ac91-4316-86df-26690f34b3b4 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:25.774796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950f79-45f6-43a1-b337-82be0b0d3281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:25.775675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950f79-45f6-43a1-b337-82be0b0d3281 None admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:25.775949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950f79-45f6-43a1-b337-82be0b0d3281 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:25.776214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950f79-45f6-43a1-b337-82be0b0d3281 None admin] PATH_INFO: `/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d46de1b79f16410fbd8dc2d1c1ecc29d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:25.778404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950f79-45f6-43a1-b337-82be0b0d3281 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf2e406d07415cac661e73b93ccb02, user_id=d46de1b79f16410fbd8dc2d1c1ecc29d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:25.779839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950f79-45f6-43a1-b337-82be0b0d3281 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:25.795472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 629/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Apr 9 20:42:25 2022] PUT /identity/v3/projects/a6cf2e406d07415cac661e73b93ccb02/users/d46de1b79f16410fbd8dc2d1c1ecc29d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:42:28.096641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee954a-e236-465b-a365-18cc3d5e4b47 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:28.097253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee954a-e236-465b-a365-18cc3d5e4b47 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:28.097253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee954a-e236-465b-a365-18cc3d5e4b47 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:28.099158 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 645/1274] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:28.104980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ad46-203a-4d91-8b86-27f96150b2f6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:28.105517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ad46-203a-4d91-8b86-27f96150b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:28.105517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ad46-203a-4d91-8b86-27f96150b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:28.123873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6b51ad46-203a-4d91-8b86-27f96150b2f6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:28.125352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6b51ad46-203a-4d91-8b86-27f96150b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:28.201878 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 630/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:28.226559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee954a-e236-465b-a365-18cc3d5e4b47 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:28.327685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee954a-e236-465b-a365-18cc3d5e4b47 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:28.361848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:28.362592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:28.362845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:28.363139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:28.373808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 20:42:28.380733 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 09 20:42:28.381960 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 646/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Apr 9 20:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:28.388556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51ad46-203a-4d91-8b86-27f96150b2f6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:28.489162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51ad46-203a-4d91-8b86-27f96150b2f6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:28.522877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:28.523599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:28.523877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:28.524150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:28.524900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:28.525235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:28.526619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:28.534678 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 631/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Apr 9 20:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:28.541249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:28.644912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5d1e-a653-4c0c-b09c-6ce86df60ed2 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:28.681809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:28.682603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:28.682880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:28.683146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:28.693609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:28.695106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:28.711661 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:28.712817 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 647/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:28.722204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:28.827449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8db70-1520-43ba-b7c5-4da9cb5618ab None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:28.860988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:28.861676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:28.861953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:28.862224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:28.862935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:28.863241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:28.864642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:28.876193 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 632/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:28.882649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:28.978583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d920cf-f4eb-4eaf-ba2e-970038b0603a None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:29.012143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:29.012952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:29.013260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:29.013529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] PATH_INFO: `/v3/users/placement` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:29.021120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:29.022574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:29.036005 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 09 20:42:29.037176 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 648/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:29.043634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:29.151389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e028eb4-f033-47a1-920d-23e9706b90cf None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:29.185154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:29.185926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:29.186207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:29.186507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:29.187339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:29.187644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:29.189078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:29.205711 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 633/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Apr 9 20:42:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:29.211699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:29.313370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9608d-d264-48a7-803d-6331767b130c None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:29.352844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:29.353541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:29.353816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:29.354084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:29.419301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:29.420761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:29.530908 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 649/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Apr 9 20:42:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 09 20:42:29.537539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:29.641499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367504-b301-4753-8b24-6a1abe6e3a0c None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:29.674579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:29.675372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:29.675627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:29.675898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:29.685605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:29.687055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:29.703242 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 09 20:42:29.704394 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 634/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:29.712930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:29.812550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec3d8-d9d3-4c27-942d-a90d0b7c0e48 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:29.847253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:29.847914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:29.848187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:29.848457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:29.849199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:29.849503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:29.850887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:29.862377 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 650/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Apr 9 20:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:29.870624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:29.967437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c29d3-b22e-4984-90a4-f670477f3513 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:30.003479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:30.004285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:30.004561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:30.004826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:30.011452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:30.012899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:30.025622 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 09 20:42:30.026784 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 635/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Apr 9 20:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 20:42:30.036160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:30.163600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586b43-5b96-4d84-b0f8-0e291458c4f9 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:30.202100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f310a1-6707-4696-9963-0d2426a496ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:30.203124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f310a1-6707-4696-9963-0d2426a496ce None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:30.203561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f310a1-6707-4696-9963-0d2426a496ce None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:30.203990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f310a1-6707-4696-9963-0d2426a496ce None admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:30.205298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f310a1-6707-4696-9963-0d2426a496ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:30.205784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f310a1-6707-4696-9963-0d2426a496ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:30.208220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f310a1-6707-4696-9963-0d2426a496ce None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:30.228460 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 651/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Apr 9 20:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:30.234837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:30.353728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa0d4-6574-42f1-a582-cb5e7f3b3c5f None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:30.388213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580688b-83d3-4eaf-971b-5d654ecd490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:30.388854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580688b-83d3-4eaf-971b-5d654ecd490a None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:30.389172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580688b-83d3-4eaf-971b-5d654ecd490a None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:30.389439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580688b-83d3-4eaf-971b-5d654ecd490a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:30.390271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580688b-83d3-4eaf-971b-5d654ecd490a None admin] RBAC: Adding query filter params (role.id=342abca02a8e4f5b9ce622af865ffa78, scope.project.id=a6cf2e406d07415cac661e73b93ccb02, user.id=d46de1b79f16410fbd8dc2d1c1ecc29d) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:30.390582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580688b-83d3-4eaf-971b-5d654ecd490a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:30.392030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580688b-83d3-4eaf-971b-5d654ecd490a None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:30.398016 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 636/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Apr 9 20:42:30 2022] GET /identity/v3/role_assignments?user.id=d46de1b79f16410fbd8dc2d1c1ecc29d&scope.project.id=a6cf2e406d07415cac661e73b93ccb02&role.id=342abca02a8e4f5b9ce622af865ffa78 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:32.741255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a386c9-c8dd-4016-835e-5b5ecd6e4a47 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:32.741799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a386c9-c8dd-4016-835e-5b5ecd6e4a47 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:32.741799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a386c9-c8dd-4016-835e-5b5ecd6e4a47 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:32.743169 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 652/1288] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:32.749518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924006-be1f-4dd0-992d-26c73d8feaa3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:32.750246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924006-be1f-4dd0-992d-26c73d8feaa3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:32.750371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924006-be1f-4dd0-992d-26c73d8feaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:32.772847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-32924006-be1f-4dd0-992d-26c73d8feaa3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:32.774069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-32924006-be1f-4dd0-992d-26c73d8feaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:32.847589 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 637/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:32.880163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a386c9-c8dd-4016-835e-5b5ecd6e4a47 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:32.982805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a386c9-c8dd-4016-835e-5b5ecd6e4a47 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:33.016640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:33.017405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:33.017682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:33.017943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:33.018593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:33.019988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:33.031129 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 09 20:42:33.032276 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 653/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:42:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:33.038920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924006-be1f-4dd0-992d-26c73d8feaa3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:33.155980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924006-be1f-4dd0-992d-26c73d8feaa3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:33.190745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec31a9-3f4f-4bf8-b4cc-179d80c84599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:33.191413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec31a9-3f4f-4bf8-b4cc-179d80c84599 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:33.191691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec31a9-3f4f-4bf8-b4cc-179d80c84599 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:33.191965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec31a9-3f4f-4bf8-b4cc-179d80c84599 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:33.192673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec31a9-3f4f-4bf8-b4cc-179d80c84599 None admin] RBAC: Adding query filter params (name=placement) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:33.192975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec31a9-3f4f-4bf8-b4cc-179d80c84599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:33.194398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec31a9-3f4f-4bf8-b4cc-179d80c84599 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:33.199715 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 638/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Apr 9 20:42:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:33.205694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:33.321182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026871c-2e92-40fd-84e8-00d2763101d3 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:33.366642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c161f-00ff-4ded-b717-5cd1f17d84eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:33.367319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c161f-00ff-4ded-b717-5cd1f17d84eb None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:33.367603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c161f-00ff-4ded-b717-5cd1f17d84eb None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:33.367880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c161f-00ff-4ded-b717-5cd1f17d84eb None admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:33.368612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c161f-00ff-4ded-b717-5cd1f17d84eb None admin] RBAC: Adding query filter params (type=placement) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:33.368913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c161f-00ff-4ded-b717-5cd1f17d84eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:33.370381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c161f-00ff-4ded-b717-5cd1f17d84eb None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:33.374945 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 654/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Apr 9 20:42:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:35.669975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c72c12-bec1-48f0-a751-52e5f210c1ba None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:35.670732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c72c12-bec1-48f0-a751-52e5f210c1ba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:35.670732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c72c12-bec1-48f0-a751-52e5f210c1ba None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:35.673762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 639/1293] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:35.680030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a181a96-8ecb-444a-9a58-e5bbfba6526f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:35.680479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a181a96-8ecb-444a-9a58-e5bbfba6526f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:35.680601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a181a96-8ecb-444a-9a58-e5bbfba6526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:35.704699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7a181a96-8ecb-444a-9a58-e5bbfba6526f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:35.705949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7a181a96-8ecb-444a-9a58-e5bbfba6526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:35.775466 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 655/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:35.799618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c72c12-bec1-48f0-a751-52e5f210c1ba None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:35.902512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c72c12-bec1-48f0-a751-52e5f210c1ba None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:35.939094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba8fc8-bada-4883-b932-451bb68eaab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:35.939753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8fc8-bada-4883-b932-451bb68eaab9 None admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:35.940031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8fc8-bada-4883-b932-451bb68eaab9 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:35.940304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8fc8-bada-4883-b932-451bb68eaab9 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:35.941057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba8fc8-bada-4883-b932-451bb68eaab9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:35.942580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba8fc8-bada-4883-b932-451bb68eaab9 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:35.959852 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 640/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Apr 9 20:42:35 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:42:38.310845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d078b-a2fa-438b-8ff2-4eeb18317cb7 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:38.311746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d078b-a2fa-438b-8ff2-4eeb18317cb7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:38.311746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d078b-a2fa-438b-8ff2-4eeb18317cb7 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:38.313940 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 656/1296] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:38.319394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5b13-47a9-44b6-8c2a-d2632328555a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:38.319819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5b13-47a9-44b6-8c2a-d2632328555a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:38.319919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5b13-47a9-44b6-8c2a-d2632328555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:38.338204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e54d5b13-47a9-44b6-8c2a-d2632328555a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:38.339423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e54d5b13-47a9-44b6-8c2a-d2632328555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:38.411179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 641/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:38.435696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d078b-a2fa-438b-8ff2-4eeb18317cb7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:38.539824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d078b-a2fa-438b-8ff2-4eeb18317cb7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:38.581822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:38.582558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:38.582831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:38.583120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] PATH_INFO: `/v3/services/placement` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:38.583770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:38.585233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:38.596194 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 09 20:42:38.597405 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 657/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:42:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:38.604114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d5b13-47a9-44b6-8c2a-d2632328555a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:38.702465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d5b13-47a9-44b6-8c2a-d2632328555a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:38.746904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:38.747561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:38.747846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:38.748141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:38.749015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:38.749352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:38.750731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:38.755954 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 642/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Apr 9 20:42:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:38.762007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:38.863186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48929-d22e-406e-be3c-b0d3419c7660 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:38.898212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506961b9-6a3d-4fbe-9453-c86c20bf2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:38.898868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506961b9-6a3d-4fbe-9453-c86c20bf2f91 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:38.899145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506961b9-6a3d-4fbe-9453-c86c20bf2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:38.899419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506961b9-6a3d-4fbe-9453-c86c20bf2f91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:38.900204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506961b9-6a3d-4fbe-9453-c86c20bf2f91 None admin] RBAC: Adding query filter params (interface=public, service_id=b566900933eb41768b95d5c0be9e17bf, region_id=RegionOne) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:38.900511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506961b9-6a3d-4fbe-9453-c86c20bf2f91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:38.901935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506961b9-6a3d-4fbe-9453-c86c20bf2f91 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:38.907398 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 658/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Apr 9 20:42:38 2022] GET /identity/v3/endpoints?service_id=b566900933eb41768b95d5c0be9e17bf&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:38.916619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:39.041201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42cdd-6ee2-4be9-8e3c-b9a69f30f7d5 None admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:39.074732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56e4dd-5fb7-48c6-8054-d4e5b4d7fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:39.075376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56e4dd-5fb7-48c6-8054-d4e5b4d7fd4c None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:39.075650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56e4dd-5fb7-48c6-8054-d4e5b4d7fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:39.075915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56e4dd-5fb7-48c6-8054-d4e5b4d7fd4c None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:39.076588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56e4dd-5fb7-48c6-8054-d4e5b4d7fd4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:39.077981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56e4dd-5fb7-48c6-8054-d4e5b4d7fd4c None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:39.084945 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 643/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Apr 9 20:42:38 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:42:41.412905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ec00-e44f-481a-bb5a-e82ce28f1ad0 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:41.413868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ec00-e44f-481a-bb5a-e82ce28f1ad0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:41.413868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ec00-e44f-481a-bb5a-e82ce28f1ad0 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:41.416062 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 659/1302] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:42:41.421428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751308-61d1-42b9-820e-962a42ac9e8e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:41.421861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751308-61d1-42b9-820e-962a42ac9e8e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:41.421965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751308-61d1-42b9-820e-962a42ac9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:41.439215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6e751308-61d1-42b9-820e-962a42ac9e8e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:42:41.440396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e751308-61d1-42b9-820e-962a42ac9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:42:41.508857 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 644/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:42:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 20:42:41.533080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7ec00-e44f-481a-bb5a-e82ce28f1ad0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:41.653762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7ec00-e44f-481a-bb5a-e82ce28f1ad0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:41.688461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:41.689226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:41.689498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:41.689764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:41.690409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:41.691796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:41.702771 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 09 20:42:41.703910 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 660/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Apr 9 20:42:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 20:42:41.712764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751308-61d1-42b9-820e-962a42ac9e8e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:41.817076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751308-61d1-42b9-820e-962a42ac9e8e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:41.859628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07e22e-7cf3-443d-a61f-87c8c0eb8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:41.860294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07e22e-7cf3-443d-a61f-87c8c0eb8627 None admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:41.860576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07e22e-7cf3-443d-a61f-87c8c0eb8627 None admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:41.860845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07e22e-7cf3-443d-a61f-87c8c0eb8627 None admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:41.861591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07e22e-7cf3-443d-a61f-87c8c0eb8627 None admin] RBAC: Adding query filter params (name=placement) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:42:41.861893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07e22e-7cf3-443d-a61f-87c8c0eb8627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:41.863268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07e22e-7cf3-443d-a61f-87c8c0eb8627 None admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:41.868756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 645/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Apr 9 20:42:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:42:41.877448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:42:41.980065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8156-0a44-410e-b7e3-bed4d8ba4fc6 None admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:42:42.014154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946673e-b6d4-4a81-aead-5330a7d8c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:42:42.014807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946673e-b6d4-4a81-aead-5330a7d8c3d8 None admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:42:42.015086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946673e-b6d4-4a81-aead-5330a7d8c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:42:42.015357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946673e-b6d4-4a81-aead-5330a7d8c3d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:42:42.016096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946673e-b6d4-4a81-aead-5330a7d8c3d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:42:42.017530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946673e-b6d4-4a81-aead-5330a7d8c3d8 None admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:42:42.040004 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 661/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Apr 9 20:42:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:43:53.355884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d19be-bc3a-4b00-8539-4c66524ea04e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:53.356802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d19be-bc3a-4b00-8539-4c66524ea04e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:53.357268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d19be-bc3a-4b00-8539-4c66524ea04e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:53.362899 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 646/1307] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:43:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:43:53.364459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81895cb1-ef8f-45dd-ab57-97dbd9fbf90b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:53.364887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81895cb1-ef8f-45dd-ab57-97dbd9fbf90b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:53.365232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81895cb1-ef8f-45dd-ab57-97dbd9fbf90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:53.444609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-81895cb1-ef8f-45dd-ab57-97dbd9fbf90b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:43:53.446108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-81895cb1-ef8f-45dd-ab57-97dbd9fbf90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:53.561074 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 662/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:43:53.611018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8099d-105a-40b4-b018-2ed98e245f6e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:53.611710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8099d-105a-40b4-b018-2ed98e245f6e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:53.612263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8099d-105a-40b4-b018-2ed98e245f6e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:53.615066 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 647/1309] 10.222.0.30 () {54 vars in 963 bytes} [Sat Apr 9 20:43:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:43:53.622213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cda002-6b5b-4d95-be24-9f3097b77490 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:53.622768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cda002-6b5b-4d95-be24-9f3097b77490 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:53.623381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cda002-6b5b-4d95-be24-9f3097b77490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:53.716066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-92cda002-6b5b-4d95-be24-9f3097b77490 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:43:53.717657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-92cda002-6b5b-4d95-be24-9f3097b77490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:53.815640 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 663/1310] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Apr 9 20:43:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:43:53.827679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8099d-105a-40b4-b018-2ed98e245f6e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:43:53.830204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-add8099d-105a-40b4-b018-2ed98e245f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:53.963343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8099d-105a-40b4-b018-2ed98e245f6e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:43:54.040879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96a43-7e05-464f-9b92-6cbec89052bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:43:54.041717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96a43-7e05-464f-9b92-6cbec89052bd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:54.042093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96a43-7e05-464f-9b92-6cbec89052bd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:54.042463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96a43-7e05-464f-9b92-6cbec89052bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:54.044226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-71c96a43-7e05-464f-9b92-6cbec89052bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:54.167968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c96a43-7e05-464f-9b92-6cbec89052bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:43:54.169737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c96a43-7e05-464f-9b92-6cbec89052bd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:43:54.189017 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 648/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:43:56.803644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7738-3131-4ed6-b671-bba4a0a303b6 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:56.804179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7738-3131-4ed6-b671-bba4a0a303b6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:56.804179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7738-3131-4ed6-b671-bba4a0a303b6 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:56.805599 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 664/1312] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:43:56.811020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8cf67-c959-410e-a9f3-e0190838e424 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:56.811423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8cf67-c959-410e-a9f3-e0190838e424 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:56.811572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8cf67-c959-410e-a9f3-e0190838e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:56.906311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-16c8cf67-c959-410e-a9f3-e0190838e424 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:43:56.907576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-16c8cf67-c959-410e-a9f3-e0190838e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:57.007683 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 649/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:43:57.061821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a0d73-9733-46da-a40d-b76236d837bd None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:57.062387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a0d73-9733-46da-a40d-b76236d837bd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:57.062627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a0d73-9733-46da-a40d-b76236d837bd None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:57.064177 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 665/1314] 10.222.0.30 () {54 vars in 963 bytes} [Sat Apr 9 20:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:43:57.070359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49f7d-08ca-49be-88d6-df60cafd452d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:57.070623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49f7d-08ca-49be-88d6-df60cafd452d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:57.070876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49f7d-08ca-49be-88d6-df60cafd452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:57.144267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e7e49f7d-08ca-49be-88d6-df60cafd452d None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:43:57.145551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e7e49f7d-08ca-49be-88d6-df60cafd452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:57.222224 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 650/1315] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Apr 9 20:43:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:43:57.231331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a0d73-9733-46da-a40d-b76236d837bd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:43:57.232874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3a5a0d73-9733-46da-a40d-b76236d837bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:57.336499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a0d73-9733-46da-a40d-b76236d837bd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:43:57.424231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94183-856c-42d0-b6ab-924f92423b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:43:57.425301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94183-856c-42d0-b6ab-924f92423b5a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:43:57.425805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94183-856c-42d0-b6ab-924f92423b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:43:57.426510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94183-856c-42d0-b6ab-924f92423b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:43:57.428627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d9e94183-856c-42d0-b6ab-924f92423b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:43:57.539185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e94183-856c-42d0-b6ab-924f92423b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:43:57.540657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e94183-856c-42d0-b6ab-924f92423b5a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:43:57.559055 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 666/1316] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:00.466825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0503ff-58f5-4c37-8961-a71e136e43bf None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:00.467334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0503ff-58f5-4c37-8961-a71e136e43bf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:00.467334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0503ff-58f5-4c37-8961-a71e136e43bf None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:00.468776 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 651/1317] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:00.474071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e775-594b-487a-9feb-a913108f9f36 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:00.474486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e775-594b-487a-9feb-a913108f9f36 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:00.474596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e775-594b-487a-9feb-a913108f9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:00.542282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-af36e775-594b-487a-9feb-a913108f9f36 None None] MFA Rules not processed for user `13936368421d4c5888578cca49557609`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:00.544128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-af36e775-594b-487a-9feb-a913108f9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:00.652225 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 667/1318] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:00.700419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0503ff-58f5-4c37-8961-a71e136e43bf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:00.702015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df0503ff-58f5-4c37-8961-a71e136e43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:00.819424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0503ff-58f5-4c37-8961-a71e136e43bf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:00.892800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e98f9-5925-4e03-8094-57c82fa2f8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:00.893483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e98f9-5925-4e03-8094-57c82fa2f8fc service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:00.893755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e98f9-5925-4e03-8094-57c82fa2f8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:00.894022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e98f9-5925-4e03-8094-57c82fa2f8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:00.895660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f74e98f9-5925-4e03-8094-57c82fa2f8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:01.006432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e98f9-5925-4e03-8094-57c82fa2f8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:01.007903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e98f9-5925-4e03-8094-57c82fa2f8fc service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:01.026145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 652/1319] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:04.104608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeae66-fc44-4311-bb53-099417003b5a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:04.105194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeae66-fc44-4311-bb53-099417003b5a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:04.105194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeae66-fc44-4311-bb53-099417003b5a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:04.106642 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 668/1320] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:04.113549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62825c1-e4dc-4633-b209-b6127261e33d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:04.114206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62825c1-e4dc-4633-b209-b6127261e33d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:04.114449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62825c1-e4dc-4633-b209-b6127261e33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:04.182927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c62825c1-e4dc-4633-b209-b6127261e33d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:04.184119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c62825c1-e4dc-4633-b209-b6127261e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:04.283547 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 653/1321] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:44:04.323206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeae66-fc44-4311-bb53-099417003b5a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:04.324721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3ffeae66-fc44-4311-bb53-099417003b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:04.451049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeae66-fc44-4311-bb53-099417003b5a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:04.532421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67d60f-65fb-4e24-b3b9-8dce1a36ca0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:04.533341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67d60f-65fb-4e24-b3b9-8dce1a36ca0d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:04.533730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67d60f-65fb-4e24-b3b9-8dce1a36ca0d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:04.534098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67d60f-65fb-4e24-b3b9-8dce1a36ca0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:04.536644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3e67d60f-65fb-4e24-b3b9-8dce1a36ca0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:04.660974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67d60f-65fb-4e24-b3b9-8dce1a36ca0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:04.662482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67d60f-65fb-4e24-b3b9-8dce1a36ca0d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:04.682785 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 669/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:07.726849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f7fe8-dece-46ce-a63e-421a7ab0fdbb None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:07.727383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f7fe8-dece-46ce-a63e-421a7ab0fdbb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:07.727383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f7fe8-dece-46ce-a63e-421a7ab0fdbb None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:07.728976 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 654/1323] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:07.734399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68981a-f2a6-4519-994a-42169ef6ef3a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:07.734807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68981a-f2a6-4519-994a-42169ef6ef3a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:07.735400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68981a-f2a6-4519-994a-42169ef6ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:07.800616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3e68981a-f2a6-4519-994a-42169ef6ef3a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:07.801837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3e68981a-f2a6-4519-994a-42169ef6ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:07.912150 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 670/1324] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:07.949534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f7fe8-dece-46ce-a63e-421a7ab0fdbb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:07.951072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-981f7fe8-dece-46ce-a63e-421a7ab0fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:08.056811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f7fe8-dece-46ce-a63e-421a7ab0fdbb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:08.131139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2defec4-58c3-4f0f-902f-423de148c21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:08.131921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2defec4-58c3-4f0f-902f-423de148c21c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:08.132196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2defec4-58c3-4f0f-902f-423de148c21c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:08.132486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2defec4-58c3-4f0f-902f-423de148c21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:08.134193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2defec4-58c3-4f0f-902f-423de148c21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:08.246690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2defec4-58c3-4f0f-902f-423de148c21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:08.248119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2defec4-58c3-4f0f-902f-423de148c21c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:08.265871 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 655/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:10.672860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586291d-f469-402b-8098-4c43b3ececcb None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:10.673460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586291d-f469-402b-8098-4c43b3ececcb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:10.673460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586291d-f469-402b-8098-4c43b3ececcb None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:10.674833 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 671/1326] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:10.680438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597f04-be80-4444-b62d-4b731ed109cb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:10.680879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597f04-be80-4444-b62d-4b731ed109cb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:10.680984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597f04-be80-4444-b62d-4b731ed109cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:10.749123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ae597f04-be80-4444-b62d-4b731ed109cb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:10.750328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ae597f04-be80-4444-b62d-4b731ed109cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:10.851414 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 656/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:10.888874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586291d-f469-402b-8098-4c43b3ececcb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:10.890525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a586291d-f469-402b-8098-4c43b3ececcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:10.998577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586291d-f469-402b-8098-4c43b3ececcb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:11.074351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d69f96-99a5-46b3-8c7b-0523dbd1438b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:11.075303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69f96-99a5-46b3-8c7b-0523dbd1438b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:11.075573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69f96-99a5-46b3-8c7b-0523dbd1438b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:11.075839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69f96-99a5-46b3-8c7b-0523dbd1438b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:11.077502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c4d69f96-99a5-46b3-8c7b-0523dbd1438b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:11.189771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d69f96-99a5-46b3-8c7b-0523dbd1438b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:11.191245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d69f96-99a5-46b3-8c7b-0523dbd1438b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:11.209847 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 672/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:13.589230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f80b0-9726-438d-a079-6bbfc479adec None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:13.589795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f80b0-9726-438d-a079-6bbfc479adec None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:13.589795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f80b0-9726-438d-a079-6bbfc479adec None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:13.591201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 657/1329] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:13.596937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff00ce-9695-4142-bbd3-f384b3a145d5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:13.597403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff00ce-9695-4142-bbd3-f384b3a145d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:13.597535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff00ce-9695-4142-bbd3-f384b3a145d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:13.664060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-abff00ce-9695-4142-bbd3-f384b3a145d5 None None] MFA Rules not processed for user `13936368421d4c5888578cca49557609`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:13.665295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-abff00ce-9695-4142-bbd3-f384b3a145d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:13.761545 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 673/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:13.801197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f80b0-9726-438d-a079-6bbfc479adec None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:13.802751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df5f80b0-9726-438d-a079-6bbfc479adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:13.911929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f80b0-9726-438d-a079-6bbfc479adec None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:13.988470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402b187-39e5-4490-91da-ed06bf8f7511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:13.989144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b187-39e5-4490-91da-ed06bf8f7511 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:13.989383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b187-39e5-4490-91da-ed06bf8f7511 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:13.989653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b187-39e5-4490-91da-ed06bf8f7511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:13.991313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3402b187-39e5-4490-91da-ed06bf8f7511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:14.101966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402b187-39e5-4490-91da-ed06bf8f7511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:14.103327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402b187-39e5-4490-91da-ed06bf8f7511 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:14.122384 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 658/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:16.688854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc592a-b913-42a2-9f14-7227c15c97bc None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:16.689410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc592a-b913-42a2-9f14-7227c15c97bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:16.689410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc592a-b913-42a2-9f14-7227c15c97bc None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:16.690838 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 674/1332] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:16.696142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0098-6ce7-4bd0-8136-7202283b6ea9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:16.696616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0098-6ce7-4bd0-8136-7202283b6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:16.696729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0098-6ce7-4bd0-8136-7202283b6ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:16.764851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3bcc0098-6ce7-4bd0-8136-7202283b6ea9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:16.766118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3bcc0098-6ce7-4bd0-8136-7202283b6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:16.876058 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 659/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:44:16.912656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc592a-b913-42a2-9f14-7227c15c97bc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:16.914266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6bcc592a-b913-42a2-9f14-7227c15c97bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:17.021782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc592a-b913-42a2-9f14-7227c15c97bc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:17.101577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017bd5-2ae2-4651-87e1-3676f5ca48f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:17.102385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017bd5-2ae2-4651-87e1-3676f5ca48f8 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:17.102665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017bd5-2ae2-4651-87e1-3676f5ca48f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:17.102931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017bd5-2ae2-4651-87e1-3676f5ca48f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:17.104728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b017bd5-2ae2-4651-87e1-3676f5ca48f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:17.218799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017bd5-2ae2-4651-87e1-3676f5ca48f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:17.220298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017bd5-2ae2-4651-87e1-3676f5ca48f8 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:17.239504 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 675/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:19.618963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf525c-1a63-4460-825d-fa81eeed1ccb None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:19.619502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf525c-1a63-4460-825d-fa81eeed1ccb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:19.619502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf525c-1a63-4460-825d-fa81eeed1ccb None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:19.620878 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 660/1335] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:19.626256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90df7-f7ae-4e41-8afe-5165591885d5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:19.626672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90df7-f7ae-4e41-8afe-5165591885d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:19.626931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90df7-f7ae-4e41-8afe-5165591885d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:19.696489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-07a90df7-f7ae-4e41-8afe-5165591885d5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:19.697650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-07a90df7-f7ae-4e41-8afe-5165591885d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:19.794509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 676/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:19.842572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf525c-1a63-4460-825d-fa81eeed1ccb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:19.844121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a2bf525c-1a63-4460-825d-fa81eeed1ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:19.960293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf525c-1a63-4460-825d-fa81eeed1ccb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:20.048532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ac83-e7ce-4f5f-b21e-cfdeb9893d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:20.049221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ac83-e7ce-4f5f-b21e-cfdeb9893d95 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:20.049498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ac83-e7ce-4f5f-b21e-cfdeb9893d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:20.049767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ac83-e7ce-4f5f-b21e-cfdeb9893d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:20.051398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6fb1ac83-e7ce-4f5f-b21e-cfdeb9893d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:20.162072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ac83-e7ce-4f5f-b21e-cfdeb9893d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:20.163519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ac83-e7ce-4f5f-b21e-cfdeb9893d95 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:20.181381 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 661/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:22.878798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820969-1daa-43a3-af19-3703a727fbcf None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:22.879369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820969-1daa-43a3-af19-3703a727fbcf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:22.879369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820969-1daa-43a3-af19-3703a727fbcf None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:22.880711 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 677/1338] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:22.886163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65aba-4c17-4f74-acb6-25cb7c939797 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:22.886578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65aba-4c17-4f74-acb6-25cb7c939797 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:22.886684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65aba-4c17-4f74-acb6-25cb7c939797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:22.958171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9dc65aba-4c17-4f74-acb6-25cb7c939797 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:22.959399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9dc65aba-4c17-4f74-acb6-25cb7c939797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:23.062237 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 662/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:23.100407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae820969-1daa-43a3-af19-3703a727fbcf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:23.102522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ae820969-1daa-43a3-af19-3703a727fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:23.217065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae820969-1daa-43a3-af19-3703a727fbcf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:23.292018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e495c-c883-42b3-b37b-8384c519295e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:23.292683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e495c-c883-42b3-b37b-8384c519295e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:23.292970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e495c-c883-42b3-b37b-8384c519295e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:23.293277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e495c-c883-42b3-b37b-8384c519295e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:23.294944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-438e495c-c883-42b3-b37b-8384c519295e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:23.428215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e495c-c883-42b3-b37b-8384c519295e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:23.429635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e495c-c883-42b3-b37b-8384c519295e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:23.448455 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 678/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:27.764060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba928f6-6040-4d31-93a3-6d7ffe294b44 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:27.764639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba928f6-6040-4d31-93a3-6d7ffe294b44 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:27.764639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba928f6-6040-4d31-93a3-6d7ffe294b44 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:27.766196 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 663/1341] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:27.771320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96d8a5-94af-4907-ac2d-27345678dca0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:27.771750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96d8a5-94af-4907-ac2d-27345678dca0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:27.772022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96d8a5-94af-4907-ac2d-27345678dca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:27.841674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0f96d8a5-94af-4907-ac2d-27345678dca0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:27.842749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0f96d8a5-94af-4907-ac2d-27345678dca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:27.958666 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 679/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:27.998362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba928f6-6040-4d31-93a3-6d7ffe294b44 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:28.000810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ba928f6-6040-4d31-93a3-6d7ffe294b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:28.099822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba928f6-6040-4d31-93a3-6d7ffe294b44 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:28.103925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d730a-fed5-49ed-a8a5-9a71c1f7d850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:28.104697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d730a-fed5-49ed-a8a5-9a71c1f7d850 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:28.104981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d730a-fed5-49ed-a8a5-9a71c1f7d850 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:28.105291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d730a-fed5-49ed-a8a5-9a71c1f7d850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:28.115337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d730a-fed5-49ed-a8a5-9a71c1f7d850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:28.116810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d730a-fed5-49ed-a8a5-9a71c1f7d850 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:28.127019 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 664/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:31.094751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5099eb-7491-41af-bc4b-a7e855db682a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:31.095261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5099eb-7491-41af-bc4b-a7e855db682a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:31.095582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5099eb-7491-41af-bc4b-a7e855db682a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:31.097620 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 680/1344] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:31.104277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3f19c-72c4-4264-a98d-897fd2a05cc5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:31.104766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3f19c-72c4-4264-a98d-897fd2a05cc5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:31.104978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3f19c-72c4-4264-a98d-897fd2a05cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:31.137608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-76e3f19c-72c4-4264-a98d-897fd2a05cc5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:31.138779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76e3f19c-72c4-4264-a98d-897fd2a05cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:31.215862 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 665/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:31.254662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5099eb-7491-41af-bc4b-a7e855db682a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:31.266920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5099eb-7491-41af-bc4b-a7e855db682a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:31.271099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599f2c-b511-4e65-a3c5-b34fd2f43f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:31.271848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599f2c-b511-4e65-a3c5-b34fd2f43f16 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:31.272233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599f2c-b511-4e65-a3c5-b34fd2f43f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:31.272591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599f2c-b511-4e65-a3c5-b34fd2f43f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:31.282148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599f2c-b511-4e65-a3c5-b34fd2f43f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:31.283604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599f2c-b511-4e65-a3c5-b34fd2f43f16 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:31.293499 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 681/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:35.710284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957b6c-1209-4ad2-8106-6a853b915717 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:35.710865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957b6c-1209-4ad2-8106-6a853b915717 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:35.710865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957b6c-1209-4ad2-8106-6a853b915717 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:35.712380 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 666/1347] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:35.717617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6058be-6fd5-44e7-a7ca-5a74bf28ea79 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:35.718047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6058be-6fd5-44e7-a7ca-5a74bf28ea79 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:35.718152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6058be-6fd5-44e7-a7ca-5a74bf28ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:35.736598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7b6058be-6fd5-44e7-a7ca-5a74bf28ea79 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:35.737836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b6058be-6fd5-44e7-a7ca-5a74bf28ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:35.745914 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 682/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:44:35.783729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957b6c-1209-4ad2-8106-6a853b915717 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:35.794787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957b6c-1209-4ad2-8106-6a853b915717 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:35.798498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2bc50-fd48-4fef-a881-29fe19173659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:35.799137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2bc50-fd48-4fef-a881-29fe19173659 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:35.799427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2bc50-fd48-4fef-a881-29fe19173659 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:35.799728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2bc50-fd48-4fef-a881-29fe19173659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:35.808559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2bc50-fd48-4fef-a881-29fe19173659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:35.810168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2bc50-fd48-4fef-a881-29fe19173659 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:35.819666 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 667/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:41.195873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a6c2-0c41-4e64-ba39-1c1e4172b6ac None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:41.196751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a6c2-0c41-4e64-ba39-1c1e4172b6ac None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:41.205913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a6c2-0c41-4e64-ba39-1c1e4172b6ac None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:41.214907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 683/1350] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:44:41 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:41.219430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0b72e-29f8-485d-a7fb-333de2f61776 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:41.225169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0b72e-29f8-485d-a7fb-333de2f61776 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:41.225664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0b72e-29f8-485d-a7fb-333de2f61776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:41.305976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bdf0b72e-29f8-485d-a7fb-333de2f61776 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:41.307584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bdf0b72e-29f8-485d-a7fb-333de2f61776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:41.379380 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 668/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:46.044033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9322f-17d3-4639-ba44-786ce9442dca None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:46.044940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9322f-17d3-4639-ba44-786ce9442dca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:46.045192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9322f-17d3-4639-ba44-786ce9442dca None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:46.046862 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 684/1352] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:46.051589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaf448-715c-4b44-90c8-50cc20e670a9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:46.052010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaf448-715c-4b44-90c8-50cc20e670a9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:46.052140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaf448-715c-4b44-90c8-50cc20e670a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:46.071593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f6aaf448-715c-4b44-90c8-50cc20e670a9 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:46.072835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6aaf448-715c-4b44-90c8-50cc20e670a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:46.082312 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 669/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:47.520473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab998c0-50a5-466a-8f46-84e8267902e7 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:47.521057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab998c0-50a5-466a-8f46-84e8267902e7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:47.521057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab998c0-50a5-466a-8f46-84e8267902e7 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:47.522587 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 685/1354] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:47.528566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0134-9e47-46d7-94a6-186e6c4c0e83 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:47.529015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0134-9e47-46d7-94a6-186e6c4c0e83 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:47.529144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0134-9e47-46d7-94a6-186e6c4c0e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:47.547833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6e4d0134-9e47-46d7-94a6-186e6c4c0e83 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:47.549022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e4d0134-9e47-46d7-94a6-186e6c4c0e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:47.559318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 670/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:51.323914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bab05a-9c8e-4e00-beab-bf823284641f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:51.324481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bab05a-9c8e-4e00-beab-bf823284641f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:51.324481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bab05a-9c8e-4e00-beab-bf823284641f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:51.326347 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 686/1356] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:51.331556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd961d6-add2-4ad6-b0a3-e2aeb23b073f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:51.331969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd961d6-add2-4ad6-b0a3-e2aeb23b073f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:51.332075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd961d6-add2-4ad6-b0a3-e2aeb23b073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:51.350359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5bd961d6-add2-4ad6-b0a3-e2aeb23b073f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:51.351830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5bd961d6-add2-4ad6-b0a3-e2aeb23b073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:51.359999 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 671/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:51.410216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd0e43-c117-44af-a0a1-07ba5aab2d40 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:51.410494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd0e43-c117-44af-a0a1-07ba5aab2d40 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:51.410986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd0e43-c117-44af-a0a1-07ba5aab2d40 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:51.412460 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 687/1358] 10.222.0.30 () {54 vars in 960 bytes} [Sat Apr 9 20:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:51.417945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b3986-08f7-4d53-a436-942d8820f0cb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:51.418313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b3986-08f7-4d53-a436-942d8820f0cb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:51.418654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b3986-08f7-4d53-a436-942d8820f0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:51.477520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7f1b3986-08f7-4d53-a436-942d8820f0cb None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:51.478798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7f1b3986-08f7-4d53-a436-942d8820f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:51.579053 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 672/1359] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 20:44:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:51.587683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd0e43-c117-44af-a0a1-07ba5aab2d40 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:51.604041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd0e43-c117-44af-a0a1-07ba5aab2d40 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:51.610228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df507479-787a-49a3-ae98-680c7fd65ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:51.611461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507479-787a-49a3-ae98-680c7fd65ed6 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:51.611760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507479-787a-49a3-ae98-680c7fd65ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:51.612289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507479-787a-49a3-ae98-680c7fd65ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:51.621121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df507479-787a-49a3-ae98-680c7fd65ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:51.622932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df507479-787a-49a3-ae98-680c7fd65ed6 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:51.632830 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 688/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:44:54.200869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7c693-6c1b-4783-893b-8f38df6e9d46 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:54.201452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7c693-6c1b-4783-893b-8f38df6e9d46 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:54.201452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7c693-6c1b-4783-893b-8f38df6e9d46 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:54.202795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 673/1361] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:54.208183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f1853-aad8-4b45-9a90-0d4caed37552 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:54.208637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f1853-aad8-4b45-9a90-0d4caed37552 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:54.208919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f1853-aad8-4b45-9a90-0d4caed37552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:54.229262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-925f1853-aad8-4b45-9a90-0d4caed37552 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:54.230591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-925f1853-aad8-4b45-9a90-0d4caed37552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:54.240033 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 689/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:54.285073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7c693-6c1b-4783-893b-8f38df6e9d46 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:54.301208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7c693-6c1b-4783-893b-8f38df6e9d46 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:54.307176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80ea3a-0abe-44ad-9742-c26a0abee437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:54.308106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80ea3a-0abe-44ad-9742-c26a0abee437 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:54.308527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80ea3a-0abe-44ad-9742-c26a0abee437 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:54.308949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80ea3a-0abe-44ad-9742-c26a0abee437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:54.317893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80ea3a-0abe-44ad-9742-c26a0abee437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:54.319661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80ea3a-0abe-44ad-9742-c26a0abee437 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:54.329696 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 674/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:56.963602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f06e-98e4-42ef-a61c-06685a53924a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:56.964117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f06e-98e4-42ef-a61c-06685a53924a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:56.964117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f06e-98e4-42ef-a61c-06685a53924a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:56.965570 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 690/1364] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:56.971156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855699-bd90-4fb5-b573-a0c1453e71e6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:56.971541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855699-bd90-4fb5-b573-a0c1453e71e6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:56.971705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855699-bd90-4fb5-b573-a0c1453e71e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:56.990249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-27855699-bd90-4fb5-b573-a0c1453e71e6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:56.991375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-27855699-bd90-4fb5-b573-a0c1453e71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:56.999150 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 675/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:57.045759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0576-e9ee-4e02-95fc-3e904506efd1 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:57.046042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0576-e9ee-4e02-95fc-3e904506efd1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:57.046342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0576-e9ee-4e02-95fc-3e904506efd1 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:57.047741 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 691/1366] 10.222.0.30 () {54 vars in 960 bytes} [Sat Apr 9 20:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:57.053204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9be5c-11fe-4382-8928-fc22fe0f76e8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:57.053492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9be5c-11fe-4382-8928-fc22fe0f76e8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:57.053764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9be5c-11fe-4382-8928-fc22fe0f76e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:57.072974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-48d9be5c-11fe-4382-8928-fc22fe0f76e8 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:57.074183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-48d9be5c-11fe-4382-8928-fc22fe0f76e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:57.084017 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 676/1367] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:57.091669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c0576-e9ee-4e02-95fc-3e904506efd1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:57.106842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c0576-e9ee-4e02-95fc-3e904506efd1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:57.112749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bd364-8402-4d97-8236-67e9f9e73de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:57.113430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bd364-8402-4d97-8236-67e9f9e73de2 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:57.113708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bd364-8402-4d97-8236-67e9f9e73de2 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:57.113973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bd364-8402-4d97-8236-67e9f9e73de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:57.122439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bd364-8402-4d97-8236-67e9f9e73de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:57.124050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bd364-8402-4d97-8236-67e9f9e73de2 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:57.133754 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 692/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:44:59.640628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2350b0-e917-4284-a2b7-4ec236f7a6c3 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:59.641432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2350b0-e917-4284-a2b7-4ec236f7a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:59.641866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2350b0-e917-4284-a2b7-4ec236f7a6c3 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:59.643916 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 677/1369] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:44:59.649463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95091-48d6-4066-8c95-a903023b1d53 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:59.650421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95091-48d6-4066-8c95-a903023b1d53 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:59.650887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95091-48d6-4066-8c95-a903023b1d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:59.676731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4ba95091-48d6-4066-8c95-a903023b1d53 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:44:59.678308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ba95091-48d6-4066-8c95-a903023b1d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:44:59.687192 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 693/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:44:59.757945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2350b0-e917-4284-a2b7-4ec236f7a6c3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:44:59.801111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2350b0-e917-4284-a2b7-4ec236f7a6c3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:44:59.808561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ae27-28ed-426f-99a0-2c1b0a189988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:44:59.809674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ae27-28ed-426f-99a0-2c1b0a189988 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:44:59.810093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ae27-28ed-426f-99a0-2c1b0a189988 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:44:59.810513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ae27-28ed-426f-99a0-2c1b0a189988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:44:59.821373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60ae27-28ed-426f-99a0-2c1b0a189988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:44:59.824285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60ae27-28ed-426f-99a0-2c1b0a189988 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:44:59.838228 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 678/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:02.414910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114991e8-d95f-4fab-8d41-d33ce8989358 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:02.415817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114991e8-d95f-4fab-8d41-d33ce8989358 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:02.416295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114991e8-d95f-4fab-8d41-d33ce8989358 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:02.417918 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 694/1372] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:02.424331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61a46-846f-4516-a5ee-e96012cea4b0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:02.425196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61a46-846f-4516-a5ee-e96012cea4b0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:02.425704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61a46-846f-4516-a5ee-e96012cea4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:02.457147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-97b61a46-846f-4516-a5ee-e96012cea4b0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:02.458679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97b61a46-846f-4516-a5ee-e96012cea4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:02.467374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 679/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:02.512897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114991e8-d95f-4fab-8d41-d33ce8989358 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:02.528929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114991e8-d95f-4fab-8d41-d33ce8989358 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:02.534955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa58cf7-b29d-46c6-9b71-162f6ed37310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:02.535878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa58cf7-b29d-46c6-9b71-162f6ed37310 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:02.536374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa58cf7-b29d-46c6-9b71-162f6ed37310 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:02.536852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa58cf7-b29d-46c6-9b71-162f6ed37310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:02.545897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa58cf7-b29d-46c6-9b71-162f6ed37310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:02.547775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa58cf7-b29d-46c6-9b71-162f6ed37310 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:02.562611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 695/1374] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:03.497299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3393f-d42e-4dfa-853a-50ba310e5074 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:03.499540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3393f-d42e-4dfa-853a-50ba310e5074 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:03.499540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3393f-d42e-4dfa-853a-50ba310e5074 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:03.502250 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 680/1375] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:03.508203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854abff2-62c6-4f5b-baac-d5b2a84e56bf None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:03.508757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854abff2-62c6-4f5b-baac-d5b2a84e56bf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:03.508984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854abff2-62c6-4f5b-baac-d5b2a84e56bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:03.529419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-854abff2-62c6-4f5b-baac-d5b2a84e56bf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:03.530595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-854abff2-62c6-4f5b-baac-d5b2a84e56bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:03.538708 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 696/1376] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:03.867982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7492-ed0f-48a8-85c1-728bb7a20caf None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:03.868814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7492-ed0f-48a8-85c1-728bb7a20caf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:03.868814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7492-ed0f-48a8-85c1-728bb7a20caf None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:03.870413 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 681/1377] 10.222.0.30 () {54 vars in 962 bytes} [Sat Apr 9 20:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:03.875440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3056d90-4ecf-461b-a725-6d9b6f14a1c1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:03.875843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3056d90-4ecf-461b-a725-6d9b6f14a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:03.876228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3056d90-4ecf-461b-a725-6d9b6f14a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:03.935617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d3056d90-4ecf-461b-a725-6d9b6f14a1c1 None None] MFA Rules not processed for user `6504d578b1b64feb93ba69d947a971e9`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:03.937166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d3056d90-4ecf-461b-a725-6d9b6f14a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:03.999531 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 697/1378] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Apr 9 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:04.007710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f7492-ed0f-48a8-85c1-728bb7a20caf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:04.022051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f7492-ed0f-48a8-85c1-728bb7a20caf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:04.025861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8ed6-702a-4a5c-af75-6e6b0150aba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:04.026634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8ed6-702a-4a5c-af75-6e6b0150aba8 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:04.027016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8ed6-702a-4a5c-af75-6e6b0150aba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:04.027397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8ed6-702a-4a5c-af75-6e6b0150aba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:04.041213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd8ed6-702a-4a5c-af75-6e6b0150aba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:04.042793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd8ed6-702a-4a5c-af75-6e6b0150aba8 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:04.054196 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 682/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:05.194351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4b35-2b1b-4e61-8f94-a772ae86ba49 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:05.194351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4b35-2b1b-4e61-8f94-a772ae86ba49 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:05.194351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4b35-2b1b-4e61-8f94-a772ae86ba49 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:05.194351 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 698/1380] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:05.199270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd5fb4-605e-4f6f-b5c7-3f54edeb5168 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:05.199270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd5fb4-605e-4f6f-b5c7-3f54edeb5168 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:05.199270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd5fb4-605e-4f6f-b5c7-3f54edeb5168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:05.199270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d8dd5fb4-605e-4f6f-b5c7-3f54edeb5168 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:05.199270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d8dd5fb4-605e-4f6f-b5c7-3f54edeb5168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:05.199270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 683/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:05.200629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4b35-2b1b-4e61-8f94-a772ae86ba49 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:05.203340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4b35-2b1b-4e61-8f94-a772ae86ba49 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:05.210027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4d5ce-a7ca-4dc5-a775-49272f180b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:05.210027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d5ce-a7ca-4dc5-a775-49272f180b2f service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:05.210965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d5ce-a7ca-4dc5-a775-49272f180b2f service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:05.210965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d5ce-a7ca-4dc5-a775-49272f180b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:05.222775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4d5ce-a7ca-4dc5-a775-49272f180b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:05.223930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4d5ce-a7ca-4dc5-a775-49272f180b2f service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:05.238142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 699/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:08.043873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d178-9482-462b-8ffc-abcf9c5caa85 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:08.044450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d178-9482-462b-8ffc-abcf9c5caa85 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:08.044450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d178-9482-462b-8ffc-abcf9c5caa85 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:08.045910 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 684/1383] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:08.051535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d59293-2248-4bd9-a66e-d02ac8184c54 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:08.051977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d59293-2248-4bd9-a66e-d02ac8184c54 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:08.052070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d59293-2248-4bd9-a66e-d02ac8184c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:08.079310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-18d59293-2248-4bd9-a66e-d02ac8184c54 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:08.080884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-18d59293-2248-4bd9-a66e-d02ac8184c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:08.096338 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 700/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:08.141753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d178-9482-462b-8ffc-abcf9c5caa85 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:08.160634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d178-9482-462b-8ffc-abcf9c5caa85 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:08.167104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b67f5e-ec57-4838-af21-e08434c879e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:08.168058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67f5e-ec57-4838-af21-e08434c879e2 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:08.168545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67f5e-ec57-4838-af21-e08434c879e2 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:08.169014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67f5e-ec57-4838-af21-e08434c879e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:08.179040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b67f5e-ec57-4838-af21-e08434c879e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:08.181224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b67f5e-ec57-4838-af21-e08434c879e2 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:08.193219 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 685/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:10.583699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd70e-6bca-4bbf-b874-3edad0ca6aaa None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:10.584390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd70e-6bca-4bbf-b874-3edad0ca6aaa None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:10.584390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd70e-6bca-4bbf-b874-3edad0ca6aaa None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:10.585778 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 701/1386] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:10.590928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde7fd-589a-433c-899c-4ed27c621479 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:10.591395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde7fd-589a-433c-899c-4ed27c621479 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:10.591483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde7fd-589a-433c-899c-4ed27c621479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:10.609181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-73dde7fd-589a-433c-899c-4ed27c621479 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:10.610380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-73dde7fd-589a-433c-899c-4ed27c621479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:10.619476 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 686/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:10.667095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bd70e-6bca-4bbf-b874-3edad0ca6aaa None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:10.683418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bd70e-6bca-4bbf-b874-3edad0ca6aaa None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:10.689138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cff9b2-5d64-47f1-8318-ef971d20696d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:10.689849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff9b2-5d64-47f1-8318-ef971d20696d service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:10.690109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff9b2-5d64-47f1-8318-ef971d20696d service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:10.690598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff9b2-5d64-47f1-8318-ef971d20696d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:10.698999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cff9b2-5d64-47f1-8318-ef971d20696d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:10.700631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cff9b2-5d64-47f1-8318-ef971d20696d service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:10.710487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 702/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:13.110802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db8ed-428e-4eb7-8438-dc8fd957fe7f None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:13.111832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db8ed-428e-4eb7-8438-dc8fd957fe7f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:13.112197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db8ed-428e-4eb7-8438-dc8fd957fe7f None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:13.114307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 687/1389] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:13.121094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1890701-dc01-46c3-8935-56d1fab297ee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:13.121603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1890701-dc01-46c3-8935-56d1fab297ee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:13.121695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1890701-dc01-46c3-8935-56d1fab297ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:13.140677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a1890701-dc01-46c3-8935-56d1fab297ee None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:13.142032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a1890701-dc01-46c3-8935-56d1fab297ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:13.152318 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 703/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:13.210149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658db8ed-428e-4eb7-8438-dc8fd957fe7f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:13.226269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658db8ed-428e-4eb7-8438-dc8fd957fe7f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:13.232724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163353b-a048-479a-b0b7-d35ba734d18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:13.233428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163353b-a048-479a-b0b7-d35ba734d18c service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:13.233743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163353b-a048-479a-b0b7-d35ba734d18c service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:13.234039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163353b-a048-479a-b0b7-d35ba734d18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:13.243223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163353b-a048-479a-b0b7-d35ba734d18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:13.244817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163353b-a048-479a-b0b7-d35ba734d18c service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:13.254397 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 688/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:15.763394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2352c-55c5-4153-b2c2-bd95ebbc699e None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:15.764032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2352c-55c5-4153-b2c2-bd95ebbc699e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:15.764129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2352c-55c5-4153-b2c2-bd95ebbc699e None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:15.766014 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 704/1392] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:15.772507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4537a-99ce-4266-8ec0-fbf9796120fe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:15.772979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4537a-99ce-4266-8ec0-fbf9796120fe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:15.773313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4537a-99ce-4266-8ec0-fbf9796120fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:15.794498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-66d4537a-99ce-4266-8ec0-fbf9796120fe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:15.795731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66d4537a-99ce-4266-8ec0-fbf9796120fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:15.804377 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 689/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:15.853856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2352c-55c5-4153-b2c2-bd95ebbc699e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:15.872657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2352c-55c5-4153-b2c2-bd95ebbc699e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:15.879830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dc4de-b975-44a7-a785-cf53cad377fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:15.880621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc4de-b975-44a7-a785-cf53cad377fe service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:15.880972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc4de-b975-44a7-a785-cf53cad377fe service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:15.881344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc4de-b975-44a7-a785-cf53cad377fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:15.892657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dc4de-b975-44a7-a785-cf53cad377fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:15.894870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dc4de-b975-44a7-a785-cf53cad377fe service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:15.906433 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 705/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:18.432033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeac66-45bd-4eb8-b3ab-edab37d585f7 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:18.432716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeac66-45bd-4eb8-b3ab-edab37d585f7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:18.432716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeac66-45bd-4eb8-b3ab-edab37d585f7 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:18.434010 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 690/1395] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:18.439300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8d82-105c-4106-b28a-7110dce82f63 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:18.439781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8d82-105c-4106-b28a-7110dce82f63 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:18.439951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8d82-105c-4106-b28a-7110dce82f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:18.458511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-543f8d82-105c-4106-b28a-7110dce82f63 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:18.465343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-543f8d82-105c-4106-b28a-7110dce82f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:18.474009 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 706/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:18.518955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeac66-45bd-4eb8-b3ab-edab37d585f7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:18.533696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeac66-45bd-4eb8-b3ab-edab37d585f7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:18.539273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391306b-d721-4a53-9bba-15ec5eb08b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:18.539908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391306b-d721-4a53-9bba-15ec5eb08b5c service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:18.540243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391306b-d721-4a53-9bba-15ec5eb08b5c service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:18.540562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391306b-d721-4a53-9bba-15ec5eb08b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:18.548993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391306b-d721-4a53-9bba-15ec5eb08b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:18.552549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391306b-d721-4a53-9bba-15ec5eb08b5c service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:18.562482 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 691/1397] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:20.605160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413e46-8666-4060-bd2f-a3d4593c2bdb None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:20.605770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413e46-8666-4060-bd2f-a3d4593c2bdb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:20.605770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413e46-8666-4060-bd2f-a3d4593c2bdb None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:20.606995 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 707/1398] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:20.614030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fba218-c428-4422-ac89-9a44ea708430 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:20.614547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fba218-c428-4422-ac89-9a44ea708430 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:20.614547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fba218-c428-4422-ac89-9a44ea708430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:20.633397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a0fba218-c428-4422-ac89-9a44ea708430 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:20.634593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a0fba218-c428-4422-ac89-9a44ea708430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:20.642797 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 692/1399] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:20.701583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00140a9e-0c52-4e16-99ed-0e819d0cba65 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:20.701907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00140a9e-0c52-4e16-99ed-0e819d0cba65 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:20.702141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00140a9e-0c52-4e16-99ed-0e819d0cba65 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:20.703666 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 708/1400] 10.222.0.30 () {54 vars in 961 bytes} [Sat Apr 9 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:20.709850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88a24-2381-484d-a5fc-5a580d5003a1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:20.710226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88a24-2381-484d-a5fc-5a580d5003a1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:20.710571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88a24-2381-484d-a5fc-5a580d5003a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:20.760815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-10e88a24-2381-484d-a5fc-5a580d5003a1 None None] MFA Rules not processed for user `3efd3561844146239d5a9aa46ff7f401`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:20.762091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-10e88a24-2381-484d-a5fc-5a580d5003a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:20.827386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 693/1401] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Apr 9 20:45:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:20.835326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00140a9e-0c52-4e16-99ed-0e819d0cba65 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:20.846724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00140a9e-0c52-4e16-99ed-0e819d0cba65 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:20.851671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925bf4-4f1a-4803-ae36-363def22be88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:20.852343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925bf4-4f1a-4803-ae36-363def22be88 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:20.852625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925bf4-4f1a-4803-ae36-363def22be88 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:20.852892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925bf4-4f1a-4803-ae36-363def22be88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:20.863013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba925bf4-4f1a-4803-ae36-363def22be88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:20.864409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba925bf4-4f1a-4803-ae36-363def22be88 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:20.873912 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 709/1402] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:20.928620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e886da-31dd-45f7-b7d2-a04e049476d6 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:20.928962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e886da-31dd-45f7-b7d2-a04e049476d6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:20.929207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e886da-31dd-45f7-b7d2-a04e049476d6 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:20.930613 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 694/1403] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:20.936093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c783-7f79-4653-93e5-befb4e1f7b8d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:20.936351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c783-7f79-4653-93e5-befb4e1f7b8d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:20.936622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c783-7f79-4653-93e5-befb4e1f7b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:20.954816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aaf1c783-7f79-4653-93e5-befb4e1f7b8d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:20.956066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aaf1c783-7f79-4653-93e5-befb4e1f7b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:20.964225 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 710/1404] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:21.009023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e886da-31dd-45f7-b7d2-a04e049476d6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:21.025793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e886da-31dd-45f7-b7d2-a04e049476d6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:21.031676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e55d46-8635-4051-8cb1-e67a1bdd40b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:21.032328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e55d46-8635-4051-8cb1-e67a1bdd40b9 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:21.032596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e55d46-8635-4051-8cb1-e67a1bdd40b9 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:21.032869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e55d46-8635-4051-8cb1-e67a1bdd40b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:21.041447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e55d46-8635-4051-8cb1-e67a1bdd40b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:21.043049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e55d46-8635-4051-8cb1-e67a1bdd40b9 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:21.052629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 695/1405] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:21.313881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe754d4-bdc5-4407-bf93-215654778981 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:21.314170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe754d4-bdc5-4407-bf93-215654778981 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:21.314450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe754d4-bdc5-4407-bf93-215654778981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:21.363987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8fe754d4-bdc5-4407-bf93-215654778981 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:21.365241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8fe754d4-bdc5-4407-bf93-215654778981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:21.429625 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 711/1406] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:45:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:21.474250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab0d0a-aff9-48ff-9a77-8615c9bdc0fe None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:21.474507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab0d0a-aff9-48ff-9a77-8615c9bdc0fe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:21.474782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab0d0a-aff9-48ff-9a77-8615c9bdc0fe None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:21.476287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 696/1407] 10.222.0.30 () {54 vars in 942 bytes} [Sat Apr 9 20:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:21.482444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58368cba-479e-4b3a-9db5-62c3f8a6a994 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:21.482729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58368cba-479e-4b3a-9db5-62c3f8a6a994 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:21.483005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58368cba-479e-4b3a-9db5-62c3f8a6a994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:21.532357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-58368cba-479e-4b3a-9db5-62c3f8a6a994 None None] MFA Rules not processed for user `c6ff773b27b94f59b97edddcab55716f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:21.533800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-58368cba-479e-4b3a-9db5-62c3f8a6a994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:21.609251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 712/1408] 10.222.0.30 () {58 vars in 1039 bytes} [Sat Apr 9 20:45:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:21.618538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab0d0a-aff9-48ff-9a77-8615c9bdc0fe None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:21.632918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab0d0a-aff9-48ff-9a77-8615c9bdc0fe None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:21.638165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377ce87-e773-408d-8757-807b53999e07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:21.638828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377ce87-e773-408d-8757-807b53999e07 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:21.639104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377ce87-e773-408d-8757-807b53999e07 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:21.639375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377ce87-e773-408d-8757-807b53999e07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:21.647505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377ce87-e773-408d-8757-807b53999e07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:21.649162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377ce87-e773-408d-8757-807b53999e07 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:21.657632 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 697/1409] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 20:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 20:45:45.041591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c3d7-82e1-4916-9c6f-9361d42fea22 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:45.042266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c3d7-82e1-4916-9c6f-9361d42fea22 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:45.042266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c3d7-82e1-4916-9c6f-9361d42fea22 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:45.043517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 713/1410] 10.222.0.30 () {54 vars in 918 bytes} [Sat Apr 9 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:45.050113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e0955-4c02-4a97-96d8-3a3bede955a6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:45.050897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e0955-4c02-4a97-96d8-3a3bede955a6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:45.050897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e0955-4c02-4a97-96d8-3a3bede955a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:45.072738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-138e0955-4c02-4a97-96d8-3a3bede955a6 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:45.074026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-138e0955-4c02-4a97-96d8-3a3bede955a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:45.083996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 698/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Apr 9 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:45.098355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6710-bf1c-45d0-a761-be8f53cd22da None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:45.098611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6710-bf1c-45d0-a761-be8f53cd22da None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:45.098911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6710-bf1c-45d0-a761-be8f53cd22da None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:45.100238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 714/1412] 10.222.0.30 () {54 vars in 918 bytes} [Sat Apr 9 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:45.104978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a740-d035-4e41-af83-39cc2e0f470b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:45.105285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a740-d035-4e41-af83-39cc2e0f470b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:45.105557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a740-d035-4e41-af83-39cc2e0f470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:45.125229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1d63a740-d035-4e41-af83-39cc2e0f470b None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:45.126408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1d63a740-d035-4e41-af83-39cc2e0f470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:45.136932 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 699/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Apr 9 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:48.013593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedb758-8a3f-40cf-b0c7-fce24dadd258 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:48.014489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedb758-8a3f-40cf-b0c7-fce24dadd258 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:48.014489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedb758-8a3f-40cf-b0c7-fce24dadd258 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:48.016766 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:48.022228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1bf47-1da4-4a03-8e0e-83d7fd5fa4f6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:48.022674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1bf47-1da4-4a03-8e0e-83d7fd5fa4f6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:48.022781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1bf47-1da4-4a03-8e0e-83d7fd5fa4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:48.044942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b4f1bf47-1da4-4a03-8e0e-83d7fd5fa4f6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:48.046739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b4f1bf47-1da4-4a03-8e0e-83d7fd5fa4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:48.061062 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:48.105132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedb758-8a3f-40cf-b0c7-fce24dadd258 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:48.122665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedb758-8a3f-40cf-b0c7-fce24dadd258 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:48.129280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052f19b-6f8a-446a-b8f6-4d399481b08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:48.129949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f19b-6f8a-446a-b8f6-4d399481b08e service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:48.130232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f19b-6f8a-446a-b8f6-4d399481b08e service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:48.130509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f19b-6f8a-446a-b8f6-4d399481b08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:48.138898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052f19b-6f8a-446a-b8f6-4d399481b08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:48.140518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052f19b-6f8a-446a-b8f6-4d399481b08e service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:48.150911 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 716/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:49.606967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce878eb-484c-48fd-8fc8-90aa9a518223 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:49.607454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce878eb-484c-48fd-8fc8-90aa9a518223 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:49.607454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce878eb-484c-48fd-8fc8-90aa9a518223 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:49.608887 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:49.615571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bf04-b454-4a18-b0c5-a4272f310ee2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:49.616031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bf04-b454-4a18-b0c5-a4272f310ee2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:49.616142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bf04-b454-4a18-b0c5-a4272f310ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:49.639813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2780bf04-b454-4a18-b0c5-a4272f310ee2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:49.640998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2780bf04-b454-4a18-b0c5-a4272f310ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:49.650195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:49.879950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce878eb-484c-48fd-8fc8-90aa9a518223 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:49.896569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce878eb-484c-48fd-8fc8-90aa9a518223 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:49.902537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb09f0-5cd1-4b41-89b2-b08e8c350078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:49.903167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb09f0-5cd1-4b41-89b2-b08e8c350078 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:49.903444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb09f0-5cd1-4b41-89b2-b08e8c350078 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:49.903709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb09f0-5cd1-4b41-89b2-b08e8c350078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:49.911709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb09f0-5cd1-4b41-89b2-b08e8c350078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:49.913303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb09f0-5cd1-4b41-89b2-b08e8c350078 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:49.922342 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 702/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:51.300329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffdd56-f1b6-4a81-867d-7f6561974c81 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:51.301081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffdd56-f1b6-4a81-867d-7f6561974c81 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:51.301081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffdd56-f1b6-4a81-867d-7f6561974c81 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:51.302345 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:51.308685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615ef6-a7a6-4298-8df2-841984b68905 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:51.309430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615ef6-a7a6-4298-8df2-841984b68905 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:51.309614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615ef6-a7a6-4298-8df2-841984b68905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:51.337368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ff615ef6-a7a6-4298-8df2-841984b68905 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:51.338568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ff615ef6-a7a6-4298-8df2-841984b68905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:51.347287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:51.514790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffdd56-f1b6-4a81-867d-7f6561974c81 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:51.533240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffdd56-f1b6-4a81-867d-7f6561974c81 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:51.541396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eceff3-aaf3-45e2-8104-977e6224eccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:51.542167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eceff3-aaf3-45e2-8104-977e6224eccc service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:51.542451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eceff3-aaf3-45e2-8104-977e6224eccc service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:51.542730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eceff3-aaf3-45e2-8104-977e6224eccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:51.552913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eceff3-aaf3-45e2-8104-977e6224eccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:51.554483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eceff3-aaf3-45e2-8104-977e6224eccc service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:51.564560 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 719/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:52.918150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc91e-7f14-4a7a-9ed0-f9d9ea56e4e7 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:52.918716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc91e-7f14-4a7a-9ed0-f9d9ea56e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:52.918716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc91e-7f14-4a7a-9ed0-f9d9ea56e4e7 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:52.920097 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:52.925312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cb139-da08-4700-b29a-d4da0f15912c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:52.925821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cb139-da08-4700-b29a-d4da0f15912c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:52.925921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cb139-da08-4700-b29a-d4da0f15912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:52.943970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3c1cb139-da08-4700-b29a-d4da0f15912c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:52.945237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c1cb139-da08-4700-b29a-d4da0f15912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:52.953781 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:53.110519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcc91e-7f14-4a7a-9ed0-f9d9ea56e4e7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:53.131946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcc91e-7f14-4a7a-9ed0-f9d9ea56e4e7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:53.138362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdad724-e5bc-4c21-bd94-e130dffd49a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:53.138999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdad724-e5bc-4c21-bd94-e130dffd49a1 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:53.139276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdad724-e5bc-4c21-bd94-e130dffd49a1 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:53.139543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdad724-e5bc-4c21-bd94-e130dffd49a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:53.147592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdad724-e5bc-4c21-bd94-e130dffd49a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:53.149214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdad724-e5bc-4c21-bd94-e130dffd49a1 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:53.158414 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 705/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:54.549800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fc99-b402-4293-a27d-b3057c37884b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:54.550384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fc99-b402-4293-a27d-b3057c37884b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:54.550384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fc99-b402-4293-a27d-b3057c37884b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:54.552003 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:54.558173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fb15d-b081-404b-b92c-ff3040efc681 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:54.558645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fb15d-b081-404b-b92c-ff3040efc681 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:54.558738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fb15d-b081-404b-b92c-ff3040efc681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:54.579928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f66fb15d-b081-404b-b92c-ff3040efc681 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:54.581177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f66fb15d-b081-404b-b92c-ff3040efc681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:54.589784 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:54.750092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2fc99-b402-4293-a27d-b3057c37884b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:54.767180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2fc99-b402-4293-a27d-b3057c37884b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:54.775824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f9b0-2632-4e21-b881-45c5b5b22f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:54.776461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f9b0-2632-4e21-b881-45c5b5b22f8f service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:54.776738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f9b0-2632-4e21-b881-45c5b5b22f8f service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:54.777011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f9b0-2632-4e21-b881-45c5b5b22f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:54.785347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271f9b0-2632-4e21-b881-45c5b5b22f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:54.787146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271f9b0-2632-4e21-b881-45c5b5b22f8f service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:54.797262 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 722/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:56.116847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9b85-b74a-4bb9-b94c-62a2f9186c02 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:56.117897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9b85-b74a-4bb9-b94c-62a2f9186c02 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:56.117897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9b85-b74a-4bb9-b94c-62a2f9186c02 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:56.119762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:56.126189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349e75-a758-4fba-84c5-8fb870aaebe8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:56.126904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349e75-a758-4fba-84c5-8fb870aaebe8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:56.127066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349e75-a758-4fba-84c5-8fb870aaebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:56.147348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-63349e75-a758-4fba-84c5-8fb870aaebe8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:56.148565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-63349e75-a758-4fba-84c5-8fb870aaebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:56.158272 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:56.316868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd9b85-b74a-4bb9-b94c-62a2f9186c02 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:56.334800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd9b85-b74a-4bb9-b94c-62a2f9186c02 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:56.340951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c5a92-c826-4022-b36b-39e5a5f40cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:56.341612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5a92-c826-4022-b36b-39e5a5f40cb6 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:56.341883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5a92-c826-4022-b36b-39e5a5f40cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:56.342226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5a92-c826-4022-b36b-39e5a5f40cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:56.351561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c5a92-c826-4022-b36b-39e5a5f40cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:56.353164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c5a92-c826-4022-b36b-39e5a5f40cb6 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:56.363270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 708/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:57.685905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670e4ab-beac-47fc-988b-17e57cbbd1ce None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:57.686750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670e4ab-beac-47fc-988b-17e57cbbd1ce None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:57.686750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670e4ab-beac-47fc-988b-17e57cbbd1ce None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:57.689118 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:45:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:57.696203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd8ce-5c69-402b-b570-0bae21268a94 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:57.696627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd8ce-5c69-402b-b570-0bae21268a94 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:57.696627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd8ce-5c69-402b-b570-0bae21268a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:57.723932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-da5fd8ce-5c69-402b-b570-0bae21268a94 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:57.725173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-da5fd8ce-5c69-402b-b570-0bae21268a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:57.734520 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:57.895312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670e4ab-beac-47fc-988b-17e57cbbd1ce None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:57.911183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670e4ab-beac-47fc-988b-17e57cbbd1ce None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:57.916746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e608c1-ae12-475e-9dcd-7412370e5174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:57.917414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e608c1-ae12-475e-9dcd-7412370e5174 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:57.917724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e608c1-ae12-475e-9dcd-7412370e5174 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:57.917991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e608c1-ae12-475e-9dcd-7412370e5174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:57.926484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e608c1-ae12-475e-9dcd-7412370e5174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:57.928086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e608c1-ae12-475e-9dcd-7412370e5174 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:57.937656 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 725/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:59.255997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8d20-91a8-4432-b057-fdcf89679ad2 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:59.259438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8d20-91a8-4432-b057-fdcf89679ad2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:59.259438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8d20-91a8-4432-b057-fdcf89679ad2 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:59.259438 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:45:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:45:59.264008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba21e8d-d584-4672-995b-0750f64a1e3b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:59.264492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba21e8d-d584-4672-995b-0750f64a1e3b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:59.264603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba21e8d-d584-4672-995b-0750f64a1e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:59.284299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6ba21e8d-d584-4672-995b-0750f64a1e3b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:45:59.285602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6ba21e8d-d584-4672-995b-0750f64a1e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:45:59.293936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:45:59.453970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8d20-91a8-4432-b057-fdcf89679ad2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:45:59.473421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8d20-91a8-4432-b057-fdcf89679ad2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:45:59.480510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eafe01-4e45-4602-a862-87e3774137cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:45:59.481209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eafe01-4e45-4602-a862-87e3774137cb service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:45:59.481489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eafe01-4e45-4602-a862-87e3774137cb service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:45:59.481758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eafe01-4e45-4602-a862-87e3774137cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:45:59.491178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eafe01-4e45-4602-a862-87e3774137cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:45:59.492814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eafe01-4e45-4602-a862-87e3774137cb service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:45:59.502509 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 711/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:00.814239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3b3ba-1e99-43d9-8917-5ff025a94a85 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:00.815174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3b3ba-1e99-43d9-8917-5ff025a94a85 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:00.815174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3b3ba-1e99-43d9-8917-5ff025a94a85 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:00.817049 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:00.823061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b891e-0797-475d-98b8-8f5e8f1ba0c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:00.823511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b891e-0797-475d-98b8-8f5e8f1ba0c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:00.823614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b891e-0797-475d-98b8-8f5e8f1ba0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:00.845521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-490b891e-0797-475d-98b8-8f5e8f1ba0c0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:00.846829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-490b891e-0797-475d-98b8-8f5e8f1ba0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:00.856419 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:01.019431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3b3ba-1e99-43d9-8917-5ff025a94a85 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:01.043819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3b3ba-1e99-43d9-8917-5ff025a94a85 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:01.052314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1701e6-f027-45bc-b227-c89e902b38fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:01.052957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1701e6-f027-45bc-b227-c89e902b38fd service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:01.053257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1701e6-f027-45bc-b227-c89e902b38fd service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:01.053518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1701e6-f027-45bc-b227-c89e902b38fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:01.062120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1701e6-f027-45bc-b227-c89e902b38fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:01.063731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1701e6-f027-45bc-b227-c89e902b38fd service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:01.073417 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 728/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:03.367166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6d886-32c5-4672-98e7-ee99a6684d8b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:03.368089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6d886-32c5-4672-98e7-ee99a6684d8b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:03.368089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6d886-32c5-4672-98e7-ee99a6684d8b None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:03.370235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:03.375768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc429ed5-2d65-425f-b955-a086b7ad347e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:03.376206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc429ed5-2d65-425f-b955-a086b7ad347e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:03.376311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc429ed5-2d65-425f-b955-a086b7ad347e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:03.395959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fc429ed5-2d65-425f-b955-a086b7ad347e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:03.397169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fc429ed5-2d65-425f-b955-a086b7ad347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:03.405748 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:03.445587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6d886-32c5-4672-98e7-ee99a6684d8b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:03.457533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6d886-32c5-4672-98e7-ee99a6684d8b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:03.461673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e192-a075-4be3-8611-91ffdc263657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:03.462325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e192-a075-4be3-8611-91ffdc263657 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:03.462605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e192-a075-4be3-8611-91ffdc263657 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:03.462877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e192-a075-4be3-8611-91ffdc263657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:03.472598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e192-a075-4be3-8611-91ffdc263657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:03.474066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e192-a075-4be3-8611-91ffdc263657 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:03.483694 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 714/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:05.992310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ca092-0061-407f-81bb-9c1b6ea9e7b3 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:05.992936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ca092-0061-407f-81bb-9c1b6ea9e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:05.992936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ca092-0061-407f-81bb-9c1b6ea9e7b3 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:05.994264 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:06.000775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd9d8-bb5b-42bb-8b02-b9c15d770ea6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:06.001573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd9d8-bb5b-42bb-8b02-b9c15d770ea6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:06.001849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd9d8-bb5b-42bb-8b02-b9c15d770ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:06.021425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a0abd9d8-bb5b-42bb-8b02-b9c15d770ea6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:06.022617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a0abd9d8-bb5b-42bb-8b02-b9c15d770ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:06.032008 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:46:06.071815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ca092-0061-407f-81bb-9c1b6ea9e7b3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:06.089604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ca092-0061-407f-81bb-9c1b6ea9e7b3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:06.095834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955dc29-3a0d-46cc-a02d-f58c5e2b9387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:06.096765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955dc29-3a0d-46cc-a02d-f58c5e2b9387 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:06.097213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955dc29-3a0d-46cc-a02d-f58c5e2b9387 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:06.097523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955dc29-3a0d-46cc-a02d-f58c5e2b9387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:06.107393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955dc29-3a0d-46cc-a02d-f58c5e2b9387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:06.108843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955dc29-3a0d-46cc-a02d-f58c5e2b9387 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:06.119232 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 731/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:08.788541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e58150-e823-4414-b28b-c9bb09bd6dcc None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:08.789469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e58150-e823-4414-b28b-c9bb09bd6dcc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:08.789469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e58150-e823-4414-b28b-c9bb09bd6dcc None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:08.791357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:08.800194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c333a-fd98-4af4-abd2-f253551450f4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:08.800663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c333a-fd98-4af4-abd2-f253551450f4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:08.800840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c333a-fd98-4af4-abd2-f253551450f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:08.824526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c83c333a-fd98-4af4-abd2-f253551450f4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:08.825765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c83c333a-fd98-4af4-abd2-f253551450f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:08.833468 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:08.877236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e58150-e823-4414-b28b-c9bb09bd6dcc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:08.889824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e58150-e823-4414-b28b-c9bb09bd6dcc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:08.893978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b64af1-c389-4d85-8a63-36b8a1d64c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:08.894619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64af1-c389-4d85-8a63-36b8a1d64c9a service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:08.894903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64af1-c389-4d85-8a63-36b8a1d64c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:08.895178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64af1-c389-4d85-8a63-36b8a1d64c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:08.904552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b64af1-c389-4d85-8a63-36b8a1d64c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:08.906061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b64af1-c389-4d85-8a63-36b8a1d64c9a service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:08.915457 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 717/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:11.408119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea6fe-a46c-431f-bf6a-6e664883a88e None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:11.408724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea6fe-a46c-431f-bf6a-6e664883a88e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:11.408724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea6fe-a46c-431f-bf6a-6e664883a88e None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:11.410482 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:11.418380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191ea8a-73d7-46d9-8c0d-df9f9af44acc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:11.418870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191ea8a-73d7-46d9-8c0d-df9f9af44acc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:11.418962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191ea8a-73d7-46d9-8c0d-df9f9af44acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:11.437949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0191ea8a-73d7-46d9-8c0d-df9f9af44acc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:11.439166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0191ea8a-73d7-46d9-8c0d-df9f9af44acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:11.448654 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:46:11.487987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea6fe-a46c-431f-bf6a-6e664883a88e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:11.500021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea6fe-a46c-431f-bf6a-6e664883a88e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:11.504147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6ff83-96bc-471b-b574-2861a647c5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:11.504789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ff83-96bc-471b-b574-2861a647c5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:11.505071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ff83-96bc-471b-b574-2861a647c5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:11.505364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ff83-96bc-471b-b574-2861a647c5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:11.514520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6ff83-96bc-471b-b574-2861a647c5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:11.515957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6ff83-96bc-471b-b574-2861a647c5a5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:11.525346 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 734/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:46:13.937778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3996-1364-45ee-8870-b44b59602745 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:13.938351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3996-1364-45ee-8870-b44b59602745 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:13.938351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3996-1364-45ee-8870-b44b59602745 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:13.940855 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:13.947278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2fa19-4893-40ff-a724-f351b33fb063 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:13.947736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2fa19-4893-40ff-a724-f351b33fb063 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:13.947840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2fa19-4893-40ff-a724-f351b33fb063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:13.971161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b0e2fa19-4893-40ff-a724-f351b33fb063 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:13.972624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0e2fa19-4893-40ff-a724-f351b33fb063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:13.981504 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:14.024703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3996-1364-45ee-8870-b44b59602745 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:14.026826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-86ab3996-1364-45ee-8870-b44b59602745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:14.042633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3996-1364-45ee-8870-b44b59602745 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:14.047377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b83df0-6c24-422c-8661-ec3f5e60539e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:14.048023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b83df0-6c24-422c-8661-ec3f5e60539e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:14.048301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b83df0-6c24-422c-8661-ec3f5e60539e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:14.048573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b83df0-6c24-422c-8661-ec3f5e60539e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:14.059161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b83df0-6c24-422c-8661-ec3f5e60539e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:14.060632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b83df0-6c24-422c-8661-ec3f5e60539e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:14.070720 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 720/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:16.571744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1eb2b-e378-43af-9f4e-20555e0b7356 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:16.572374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1eb2b-e378-43af-9f4e-20555e0b7356 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:16.572374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1eb2b-e378-43af-9f4e-20555e0b7356 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:16.573744 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:16.580168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9208b-adc7-483e-8cfa-1d448fec360e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:16.580988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9208b-adc7-483e-8cfa-1d448fec360e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:16.581128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9208b-adc7-483e-8cfa-1d448fec360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:16.600378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0fe9208b-adc7-483e-8cfa-1d448fec360e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:16.601626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0fe9208b-adc7-483e-8cfa-1d448fec360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:16.610523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:16.653117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1eb2b-e378-43af-9f4e-20555e0b7356 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:16.666649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1eb2b-e378-43af-9f4e-20555e0b7356 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:16.670527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523220a8-70b2-40c1-8f1b-759cd029cd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:16.671178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523220a8-70b2-40c1-8f1b-759cd029cd6e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:16.671453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523220a8-70b2-40c1-8f1b-759cd029cd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:16.671719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523220a8-70b2-40c1-8f1b-759cd029cd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:16.680958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523220a8-70b2-40c1-8f1b-759cd029cd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:16.682478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523220a8-70b2-40c1-8f1b-759cd029cd6e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:16.692124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 737/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:19.162339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ead59-9bd0-4040-92fb-19c19168c8d2 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:19.163251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ead59-9bd0-4040-92fb-19c19168c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:19.163251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ead59-9bd0-4040-92fb-19c19168c8d2 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:19.165435 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:19.174610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011350-25a6-43d5-96ba-f59af2d2f55b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:19.175029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011350-25a6-43d5-96ba-f59af2d2f55b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:19.175171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011350-25a6-43d5-96ba-f59af2d2f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:19.199823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-90011350-25a6-43d5-96ba-f59af2d2f55b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:19.201051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-90011350-25a6-43d5-96ba-f59af2d2f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:19.210265 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:19.249125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ead59-9bd0-4040-92fb-19c19168c8d2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:19.261370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ead59-9bd0-4040-92fb-19c19168c8d2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:19.265668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40788e-0b21-4690-977a-4572f5d325c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:19.266307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40788e-0b21-4690-977a-4572f5d325c3 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:19.266588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40788e-0b21-4690-977a-4572f5d325c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:19.266857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40788e-0b21-4690-977a-4572f5d325c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:19.275970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40788e-0b21-4690-977a-4572f5d325c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:19.277469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40788e-0b21-4690-977a-4572f5d325c3 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:19.286959 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 723/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:21.731233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58a77-6651-4d5e-a237-075f19958756 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:21.731813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58a77-6651-4d5e-a237-075f19958756 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:21.731813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58a77-6651-4d5e-a237-075f19958756 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:21.733869 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:21.741435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0c29-bfbc-4fee-8ece-a13f0b87eed0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:21.741843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0c29-bfbc-4fee-8ece-a13f0b87eed0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:21.741989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0c29-bfbc-4fee-8ece-a13f0b87eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:21.769281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5fbc0c29-bfbc-4fee-8ece-a13f0b87eed0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:21.770498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5fbc0c29-bfbc-4fee-8ece-a13f0b87eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:21.780011 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:21.821177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c58a77-6651-4d5e-a237-075f19958756 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:21.835388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c58a77-6651-4d5e-a237-075f19958756 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:21.839365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08e1c8-d9e3-40dc-b11c-af5e23b685d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:21.840002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08e1c8-d9e3-40dc-b11c-af5e23b685d3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:21.840272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08e1c8-d9e3-40dc-b11c-af5e23b685d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:21.840537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08e1c8-d9e3-40dc-b11c-af5e23b685d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:21.849388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08e1c8-d9e3-40dc-b11c-af5e23b685d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:21.850833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08e1c8-d9e3-40dc-b11c-af5e23b685d3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:21.859830 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 740/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:24.281600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f0263-2dd7-4241-9575-d4b485e1ad23 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:24.282534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f0263-2dd7-4241-9575-d4b485e1ad23 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:24.282534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f0263-2dd7-4241-9575-d4b485e1ad23 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:24.284496 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:24.292092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c14dd-dc60-4a2b-9984-8010851c3f4e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:24.292557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c14dd-dc60-4a2b-9984-8010851c3f4e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:24.292647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c14dd-dc60-4a2b-9984-8010851c3f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:24.311546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ca1c14dd-dc60-4a2b-9984-8010851c3f4e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:24.312768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ca1c14dd-dc60-4a2b-9984-8010851c3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:24.321877 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:24.360582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f0263-2dd7-4241-9575-d4b485e1ad23 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:24.375912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f0263-2dd7-4241-9575-d4b485e1ad23 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:24.381219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45ee0-b0d0-4a4d-a80c-24b27dac3ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:24.381895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45ee0-b0d0-4a4d-a80c-24b27dac3ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:24.382174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45ee0-b0d0-4a4d-a80c-24b27dac3ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:24.382446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45ee0-b0d0-4a4d-a80c-24b27dac3ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:24.392493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45ee0-b0d0-4a4d-a80c-24b27dac3ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:24.393997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45ee0-b0d0-4a4d-a80c-24b27dac3ae0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:24.403927 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 726/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:46:26.867798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2804b-bbe2-4d6c-9b42-45497b94bf40 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:26.868352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2804b-bbe2-4d6c-9b42-45497b94bf40 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:26.868352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2804b-bbe2-4d6c-9b42-45497b94bf40 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:26.870484 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:46:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:46:26.879408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc0b7-6b1c-43bd-8198-75a1b800d498 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:26.879816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc0b7-6b1c-43bd-8198-75a1b800d498 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:26.879995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc0b7-6b1c-43bd-8198-75a1b800d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:26.904405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-676cc0b7-6b1c-43bd-8198-75a1b800d498 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:46:26.905664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-676cc0b7-6b1c-43bd-8198-75a1b800d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:46:26.915960 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:46:26.954472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2804b-bbe2-4d6c-9b42-45497b94bf40 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:46:26.966690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2804b-bbe2-4d6c-9b42-45497b94bf40 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:46:26.971006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762636f-6c19-45b7-b1a3-fa8c54b7fffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:46:26.971645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762636f-6c19-45b7-b1a3-fa8c54b7fffa service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:46:26.971925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762636f-6c19-45b7-b1a3-fa8c54b7fffa service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:46:26.972221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762636f-6c19-45b7-b1a3-fa8c54b7fffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:46:26.981958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762636f-6c19-45b7-b1a3-fa8c54b7fffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:46:26.983479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762636f-6c19-45b7-b1a3-fa8c54b7fffa service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:46:26.993575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 743/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:47:01.262277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df638d-a9b6-482c-94e5-c13152334bca None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:01.262933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df638d-a9b6-482c-94e5-c13152334bca None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:01.262933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df638d-a9b6-482c-94e5-c13152334bca None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:01.264221 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 728/1471] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:01.270919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57d55-0450-40a1-8869-7da5a5728c02 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:01.271688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57d55-0450-40a1-8869-7da5a5728c02 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:01.271859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57d55-0450-40a1-8869-7da5a5728c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:01.294339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-46c57d55-0450-40a1-8869-7da5a5728c02 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:01.295521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46c57d55-0450-40a1-8869-7da5a5728c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:01.304393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 744/1472] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:01.363822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f528a-9431-4a89-bce9-e384f2a42b93 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:01.364102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f528a-9431-4a89-bce9-e384f2a42b93 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:01.364374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f528a-9431-4a89-bce9-e384f2a42b93 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:01.365867 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 729/1473] 10.222.0.30 () {54 vars in 961 bytes} [Sat Apr 9 20:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:01.370760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0446d85-4735-4b71-bd83-c9dd1aa70714 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:01.371048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0446d85-4735-4b71-bd83-c9dd1aa70714 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:01.371293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0446d85-4735-4b71-bd83-c9dd1aa70714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:01.390659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e0446d85-4735-4b71-bd83-c9dd1aa70714 None None] MFA Rules not processed for user `3efd3561844146239d5a9aa46ff7f401`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:01.391884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e0446d85-4735-4b71-bd83-c9dd1aa70714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:01.399556 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 745/1474] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Apr 9 20:47:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:01.406972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f528a-9431-4a89-bce9-e384f2a42b93 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:47:01.419554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f528a-9431-4a89-bce9-e384f2a42b93 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:47:01.423862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933130d9-3dff-4652-a0a0-e0c459784647 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:47:01.424492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933130d9-3dff-4652-a0a0-e0c459784647 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:01.424763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933130d9-3dff-4652-a0a0-e0c459784647 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:01.425067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933130d9-3dff-4652-a0a0-e0c459784647 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:01.438767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933130d9-3dff-4652-a0a0-e0c459784647 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:47:01.440780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933130d9-3dff-4652-a0a0-e0c459784647 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:47:01.450443 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 730/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:47:03.896539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a4f8-0da4-4fbd-92cb-5273c84c649f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:03.897518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a4f8-0da4-4fbd-92cb-5273c84c649f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:03.897518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a4f8-0da4-4fbd-92cb-5273c84c649f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:03.899659 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 746/1476] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:47:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:03.905155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e043c-d1c6-4c31-b44a-147785249ae7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:03.905610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e043c-d1c6-4c31-b44a-147785249ae7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:03.905727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e043c-d1c6-4c31-b44a-147785249ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:03.925028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0a0e043c-d1c6-4c31-b44a-147785249ae7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:03.926242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0a0e043c-d1c6-4c31-b44a-147785249ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:03.934555 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 731/1477] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:03.959312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1a4f8-0da4-4fbd-92cb-5273c84c649f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:47:03.974620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1a4f8-0da4-4fbd-92cb-5273c84c649f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:47:03.980857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b05e-2e10-4258-80c1-f6c755cd4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:47:03.981530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b05e-2e10-4258-80c1-f6c755cd4d4f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:03.981786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b05e-2e10-4258-80c1-f6c755cd4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:03.982054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b05e-2e10-4258-80c1-f6c755cd4d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:03.982806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72b05e-2e10-4258-80c1-f6c755cd4d4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:47:03.984954 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-ef72b05e-2e10-4258-80c1-f6c755cd4d4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:47:03.984954 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:47:03.984954 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:47:03.986171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72b05e-2e10-4258-80c1-f6c755cd4d4f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:47:04.005980 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 747/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Apr 9 20:47:03 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:47:06.409834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6affd42-caa3-46d7-939e-460fbad76d25 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:06.410585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6affd42-caa3-46d7-939e-460fbad76d25 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:06.410585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6affd42-caa3-46d7-939e-460fbad76d25 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:06.412517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 732/1479] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:47:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:06.418877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b126de-8d42-475d-b2f8-4ddb73b7ac43 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:06.419338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b126de-8d42-475d-b2f8-4ddb73b7ac43 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:06.419440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b126de-8d42-475d-b2f8-4ddb73b7ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:06.439830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-59b126de-8d42-475d-b2f8-4ddb73b7ac43 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:06.441056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-59b126de-8d42-475d-b2f8-4ddb73b7ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:06.449746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 748/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:06.498670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6affd42-caa3-46d7-939e-460fbad76d25 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:47:06.519910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6affd42-caa3-46d7-939e-460fbad76d25 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:47:06.525493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c85bf0-70a0-4884-b2af-62114e3788a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:47:06.526133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c85bf0-70a0-4884-b2af-62114e3788a7 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:06.526410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c85bf0-70a0-4884-b2af-62114e3788a7 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:06.526676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c85bf0-70a0-4884-b2af-62114e3788a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:06.535161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c85bf0-70a0-4884-b2af-62114e3788a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:47:06.536794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c85bf0-70a0-4884-b2af-62114e3788a7 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:47:06.546298 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 733/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:47:09.079701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc11d-ea45-42be-b3e5-2d7e6ef2c005 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:09.080552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc11d-ea45-42be-b3e5-2d7e6ef2c005 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:09.080552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc11d-ea45-42be-b3e5-2d7e6ef2c005 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:09.082740 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 749/1482] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:47:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:09.089322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eced191-d385-4dcf-93d7-514755eeb6d2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:09.089791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eced191-d385-4dcf-93d7-514755eeb6d2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:09.089913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eced191-d385-4dcf-93d7-514755eeb6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:09.111255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4eced191-d385-4dcf-93d7-514755eeb6d2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:09.112465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4eced191-d385-4dcf-93d7-514755eeb6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:09.121351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 734/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:09.162046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bc11d-ea45-42be-b3e5-2d7e6ef2c005 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:47:09.174757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bc11d-ea45-42be-b3e5-2d7e6ef2c005 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:47:09.179118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680ad7a-d60c-4257-a635-9a9fabdfa3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:47:09.179773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680ad7a-d60c-4257-a635-9a9fabdfa3bc service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:09.180047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680ad7a-d60c-4257-a635-9a9fabdfa3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:09.180316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680ad7a-d60c-4257-a635-9a9fabdfa3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:09.189571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680ad7a-d60c-4257-a635-9a9fabdfa3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:47:09.191070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680ad7a-d60c-4257-a635-9a9fabdfa3bc service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:47:09.200488 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 750/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:47:11.617711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfd9cf-7b42-4971-bd1d-51bb9cb4410f None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:11.618291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfd9cf-7b42-4971-bd1d-51bb9cb4410f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:11.618291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfd9cf-7b42-4971-bd1d-51bb9cb4410f None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:11.619658 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 735/1485] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:11.625203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2235fa8-f6b3-4291-94d7-87805d51cfeb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:11.625648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2235fa8-f6b3-4291-94d7-87805d51cfeb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:11.625753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2235fa8-f6b3-4291-94d7-87805d51cfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:11.646144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c2235fa8-f6b3-4291-94d7-87805d51cfeb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:11.647701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c2235fa8-f6b3-4291-94d7-87805d51cfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:11.658835 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 751/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:11.699286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfd9cf-7b42-4971-bd1d-51bb9cb4410f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:47:11.716445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfd9cf-7b42-4971-bd1d-51bb9cb4410f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:47:11.722088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba60a0-c45e-41a0-98a8-54ff099f45a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:47:11.722785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba60a0-c45e-41a0-98a8-54ff099f45a1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:11.723056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba60a0-c45e-41a0-98a8-54ff099f45a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:11.723318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba60a0-c45e-41a0-98a8-54ff099f45a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:11.735362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba60a0-c45e-41a0-98a8-54ff099f45a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:47:11.737723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba60a0-c45e-41a0-98a8-54ff099f45a1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:47:11.750628 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 736/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:47:14.255657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f91f-0797-4ae7-89fa-106bc4db447e None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:14.256409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f91f-0797-4ae7-89fa-106bc4db447e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:14.256409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f91f-0797-4ae7-89fa-106bc4db447e None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:14.258709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 752/1488] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:14.265211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9603eb-71eb-4011-9e89-182fc0471ffe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:14.266188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9603eb-71eb-4011-9e89-182fc0471ffe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:14.266188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9603eb-71eb-4011-9e89-182fc0471ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:14.286037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ad9603eb-71eb-4011-9e89-182fc0471ffe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:14.287339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ad9603eb-71eb-4011-9e89-182fc0471ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:14.296946 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 737/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:14.342436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790f91f-0797-4ae7-89fa-106bc4db447e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:47:14.362050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790f91f-0797-4ae7-89fa-106bc4db447e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:47:14.367103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c1df0-d90e-4900-bf77-a1522f609fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:47:14.367754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c1df0-d90e-4900-bf77-a1522f609fad service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:14.368023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c1df0-d90e-4900-bf77-a1522f609fad service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:14.368286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c1df0-d90e-4900-bf77-a1522f609fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:14.377609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c1df0-d90e-4900-bf77-a1522f609fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:47:14.379059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c1df0-d90e-4900-bf77-a1522f609fad service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:47:14.388139 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 753/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:47:16.919962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b23bc-d472-427b-9c14-9778efc88cef None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:16.920549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b23bc-d472-427b-9c14-9778efc88cef None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:16.920549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b23bc-d472-427b-9c14-9778efc88cef None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:16.922059 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 738/1491] 10.222.0.30 () {54 vars in 926 bytes} [Sat Apr 9 20:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:47:16.928361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f751-04db-45a6-97b0-73f4d0c74f37 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:16.929006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f751-04db-45a6-97b0-73f4d0c74f37 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:16.929006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f751-04db-45a6-97b0-73f4d0c74f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:16.946999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b410f751-04db-45a6-97b0-73f4d0c74f37 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:47:16.948247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b410f751-04db-45a6-97b0-73f4d0c74f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:47:16.956503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 754/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Apr 9 20:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:47:16.997631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b23bc-d472-427b-9c14-9778efc88cef None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:47:17.014851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b23bc-d472-427b-9c14-9778efc88cef None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:47:17.021021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15e46-d101-4b1c-9421-a0938e523b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:47:17.021994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15e46-d101-4b1c-9421-a0938e523b19 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:47:17.022331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15e46-d101-4b1c-9421-a0938e523b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:47:17.022691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15e46-d101-4b1c-9421-a0938e523b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:47:17.036071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15e46-d101-4b1c-9421-a0938e523b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:47:17.037606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15e46-d101-4b1c-9421-a0938e523b19 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:47:17.047116 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 739/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:49:09.372025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987758-ca9c-4e0f-9d22-3daf4fc99a1a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.372700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987758-ca9c-4e0f-9d22-3daf4fc99a1a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.372700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987758-ca9c-4e0f-9d22-3daf4fc99a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.393439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-98987758-ca9c-4e0f-9d22-3daf4fc99a1a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:49:09.394607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98987758-ca9c-4e0f-9d22-3daf4fc99a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:49:09.402910 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 755/1494] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:49:09.410885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfd7a-8a27-44c8-b555-5bc144f87d6e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.411402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfd7a-8a27-44c8-b555-5bc144f87d6e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.411402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfd7a-8a27-44c8-b555-5bc144f87d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.429660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0e2dfd7a-8a27-44c8-b555-5bc144f87d6e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:49:09.430834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0e2dfd7a-8a27-44c8-b555-5bc144f87d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:49:09.440172 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 740/1495] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:49:09.444961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987758-ca9c-4e0f-9d22-3daf4fc99a1a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:09.455113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987758-ca9c-4e0f-9d22-3daf4fc99a1a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:09.460101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:09.460786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.461175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.461443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.462143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:49:09.462445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:09.463488 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:09.463488 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:49:09.463488 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:49:09.464360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:09.476553 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 756/1496] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:49:09.485443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dfd7a-8a27-44c8-b555-5bc144f87d6e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:09.495171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dfd7a-8a27-44c8-b555-5bc144f87d6e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:09.500400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:09.501069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.501347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.501614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.502325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:09.504091 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:09.504091 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 20:49:09.504091 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 20:49:09.505336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:09.544262 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 741/1497] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:49:09 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:49:09.549120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:09.564760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15990166-240e-4e98-aa20-4c5630f53fcc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:09.626199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:09.626791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.627085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.627343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.628108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:09.629167 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:09.629167 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:49:09.629167 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:49:09.630362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:09.651639 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 757/1498] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:49:09 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:49:09.656099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:09.666439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4bdcc-746c-439a-a2de-da6bb1632416 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:09.671332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:09.672025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.672306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.672577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.673333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:09.674482 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:09.674482 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 20:49:09.674482 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 20:49:09.675498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:09.688189 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 742/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:49:09.692232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:09.701924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804fec9-59dd-46a0-a06c-04886fd08c90 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:09.706465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fa037-4cd6-4939-8959-6553d67ca337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:09.707142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fa037-4cd6-4939-8959-6553d67ca337 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.707395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fa037-4cd6-4939-8959-6553d67ca337 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.707668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fa037-4cd6-4939-8959-6553d67ca337 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.708390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fa037-4cd6-4939-8959-6553d67ca337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:09.709475 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-f28fa037-4cd6-4939-8959-6553d67ca337 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:09.709475 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:49:09.709475 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:49:09.710361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fa037-4cd6-4939-8959-6553d67ca337 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:09.723616 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 758/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:49:09.727645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:09.737903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb44b8-c390-4265-9c0f-4beb42d3a9fe admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:09.742932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:09.743852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.744133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.744404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] PATH_INFO: `/v3/projects/27f0d91f85c44ae98933016e02532a99/users/43ff0c84a7ac4e7aae66da1c45aaa18c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.759423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f0d91f85c44ae98933016e02532a99, user_id=43ff0c84a7ac4e7aae66da1c45aaa18c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:09.760461 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:09.760461 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 20:49:09.760461 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 20:49:09.762465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:09.777392 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 743/1501] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:49:09 2022] PUT /identity/v3/projects/27f0d91f85c44ae98933016e02532a99/users/43ff0c84a7ac4e7aae66da1c45aaa18c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:49:09.788933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa0e9-a73e-4d3b-86cd-ba34f2fcd6be None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.789264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa0e9-a73e-4d3b-86cd-ba34f2fcd6be None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.789544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa0e9-a73e-4d3b-86cd-ba34f2fcd6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.818568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b8baa0e9-a73e-4d3b-86cd-ba34f2fcd6be None None] MFA Rules not processed for user `43ff0c84a7ac4e7aae66da1c45aaa18c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:49:09.819797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b8baa0e9-a73e-4d3b-86cd-ba34f2fcd6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:49:09.885531 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 759/1502] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:49:09.899458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:09.977357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85ba1f-94ea-4d60-904a-ac88d8468dce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:09.984856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:09.985554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:09.985826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:09.986093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:09.994528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:09.996136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:10.005001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 744/1503] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:49:10.079859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fb1d5-4e50-4149-aa41-bb9b2d8b72ca None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:10.080148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fb1d5-4e50-4149-aa41-bb9b2d8b72ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:10.080422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fb1d5-4e50-4149-aa41-bb9b2d8b72ca None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:10.081804 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 760/1504] 10.222.0.30 () {52 vars in 829 bytes} [Sat Apr 9 20:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:49:10.085496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:10.152310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc37041-e29e-4fca-a1c2-594c489e5af1 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:10.156712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:10.157629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:10.157903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:10.158173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] PATH_INFO: `/v3/users/43ff0c84a7ac4e7aae66da1c45aaa18c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:10.159411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ff0c84a7ac4e7aae66da1c45aaa18c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:10.160424 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:10.160424 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 20:49:10.160424 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 20:49:10.161937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:10.232630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ff0c84a7ac4e7aae66da1c45aaa18c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:10.233406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ff0c84a7ac4e7aae66da1c45aaa18c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:10.245772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ff0c84a7ac4e7aae66da1c45aaa18c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:10.246518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ff0c84a7ac4e7aae66da1c45aaa18c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:10.260934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ff0c84a7ac4e7aae66da1c45aaa18c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:10.293387 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 745/1505] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:49:10 2022] DELETE /identity/v3/users/43ff0c84a7ac4e7aae66da1c45aaa18c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:49:10.298169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:10.298453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:10.298743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:10.316963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:49:10.318180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:49:10.380520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 761/1506] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:49:10.390370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:10.393023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:49:10.449056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371980f-b31b-4393-9628-b3967eced975 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:10.453649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1cd8b-6082-47bd-9261-cea1c4dfadf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:10.454311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1cd8b-6082-47bd-9261-cea1c4dfadf2 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:10.454603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1cd8b-6082-47bd-9261-cea1c4dfadf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:10.454863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1cd8b-6082-47bd-9261-cea1c4dfadf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:10.464869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1cd8b-6082-47bd-9261-cea1c4dfadf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:10.466360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1cd8b-6082-47bd-9261-cea1c4dfadf2 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:10.475745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 746/1507] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:49:10.906348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:49:10.907907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:49:10.920213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02475358-5ae2-4791-9000-276175d0ab11 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:49:10.925249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:49:10.926137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:49:10.926413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:49:10.926681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] PATH_INFO: `/v3/projects/27f0d91f85c44ae98933016e02532a99` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:49:10.928113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f0d91f85c44ae98933016e02532a99)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:49:10.929015 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:49:10.929015 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:49:10.929015 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:49:10.935591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:49:10.998225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f0d91f85c44ae98933016e02532a99', 'request_id': 'req-722318cd-383b-4324-a463-69e330abb21e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:11.004315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f0d91f85c44ae98933016e02532a99', 'request_id': 'req-722318cd-383b-4324-a463-69e330abb21e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:11.014778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f0d91f85c44ae98933016e02532a99', 'request_id': 'req-722318cd-383b-4324-a463-69e330abb21e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:11.033939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] The token cache is being invalidate because project 27f0d91f85c44ae98933016e02532a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:49:11.034176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:11.035012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-722318cd-383b-4324-a463-69e330abb21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:49:11.036619 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 762/1508] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:49:10 2022] DELETE /identity/v3/projects/27f0d91f85c44ae98933016e02532a99 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:52:27.377539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70816b-2855-4ce3-be10-9f0881c1c73b None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:27.378519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70816b-2855-4ce3-be10-9f0881c1c73b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:27.378519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70816b-2855-4ce3-be10-9f0881c1c73b None None] PATH_INFO: `/v3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:27.380645 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 747/1509] 10.222.0.32 () {54 vars in 925 bytes} [Sat Apr 9 20:52:27 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:52:27.389352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d63df3-7c76-42e0-affb-beeddff50d10 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:27.389829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d63df3-7c76-42e0-affb-beeddff50d10 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:27.389936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d63df3-7c76-42e0-affb-beeddff50d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:27.410080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-99d63df3-7c76-42e0-affb-beeddff50d10 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:52:27.411291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-99d63df3-7c76-42e0-affb-beeddff50d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:52:27.479111 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 763/1510] 10.222.0.32 () {58 vars in 1015 bytes} [Sat Apr 9 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:52:31.557485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5dc4-c97e-4861-8baf-3ad54f7e27ee None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:31.558375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5dc4-c97e-4861-8baf-3ad54f7e27ee None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:31.558663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5dc4-c97e-4861-8baf-3ad54f7e27ee None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:31.560908 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 748/1511] 10.222.0.30 () {54 vars in 960 bytes} [Sat Apr 9 20:52:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:52:31.566736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bc4e-3f00-4983-a92e-c5b3ad75278e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:31.567168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bc4e-3f00-4983-a92e-c5b3ad75278e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:31.567262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bc4e-3f00-4983-a92e-c5b3ad75278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:31.588061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8dc5bc4e-3f00-4983-a92e-c5b3ad75278e None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:52:31.589313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8dc5bc4e-3f00-4983-a92e-c5b3ad75278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:52:31.598876 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 764/1512] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:52:31.606982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5dc4-c97e-4861-8baf-3ad54f7e27ee None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:52:31.622076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5dc4-c97e-4861-8baf-3ad54f7e27ee None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:52:31.627356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1cd13-b815-40cd-9259-a019ad84a4fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:52:31.627986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1cd13-b815-40cd-9259-a019ad84a4fa service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:31.628260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1cd13-b815-40cd-9259-a019ad84a4fa service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:31.628547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1cd13-b815-40cd-9259-a019ad84a4fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:31.636510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1cd13-b815-40cd-9259-a019ad84a4fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:52:31.638122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1cd13-b815-40cd-9259-a019ad84a4fa service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:52:31.649814 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 749/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:52:31.884575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287a1b-8af4-4175-9b3c-d2a7100e9c37 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:31.884980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287a1b-8af4-4175-9b3c-d2a7100e9c37 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:31.885298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287a1b-8af4-4175-9b3c-d2a7100e9c37 None None] PATH_INFO: `/v3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:31.886727 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 765/1514] 10.222.0.25 () {54 vars in 925 bytes} [Sat Apr 9 20:52:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:52:31.893426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c97-c726-4824-9786-c399a238fcdb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:31.893693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c97-c726-4824-9786-c399a238fcdb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:31.894001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c97-c726-4824-9786-c399a238fcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:31.914241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d00c3c97-c726-4824-9786-c399a238fcdb None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:52:31.915531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d00c3c97-c726-4824-9786-c399a238fcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:52:31.925434 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 750/1515] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Apr 9 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:52:35.538555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f6de-e2eb-4288-b02f-c411a986fbc3 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:35.538998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f6de-e2eb-4288-b02f-c411a986fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:35.539110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f6de-e2eb-4288-b02f-c411a986fbc3 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:35.540455 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 766/1516] 10.222.0.30 () {54 vars in 960 bytes} [Sat Apr 9 20:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:52:35.545704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb6e1-47a8-45d0-a9b4-c737d52f706d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:35.546159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb6e1-47a8-45d0-a9b4-c737d52f706d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:35.546262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb6e1-47a8-45d0-a9b4-c737d52f706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:35.564853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-146cb6e1-47a8-45d0-a9b4-c737d52f706d None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:52:35.566201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-146cb6e1-47a8-45d0-a9b4-c737d52f706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:52:35.575115 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 751/1517] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:52:35.585424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6f6de-e2eb-4288-b02f-c411a986fbc3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:52:35.600226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6f6de-e2eb-4288-b02f-c411a986fbc3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:52:35.605898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc017792-2d07-428b-9b3f-597bf9489f95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:52:35.606552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017792-2d07-428b-9b3f-597bf9489f95 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:52:35.606856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017792-2d07-428b-9b3f-597bf9489f95 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:52:35.607127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017792-2d07-428b-9b3f-597bf9489f95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:52:35.616331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc017792-2d07-428b-9b3f-597bf9489f95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:52:35.618002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc017792-2d07-428b-9b3f-597bf9489f95 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:52:35.628323 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 767/1518] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:53:10.487825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860b8d-9b57-4d84-a6bd-fd1bf44005c4 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:10.488418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860b8d-9b57-4d84-a6bd-fd1bf44005c4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:10.488418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860b8d-9b57-4d84-a6bd-fd1bf44005c4 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:10.489827 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:53:10.495073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3281-8938-49d7-817e-b2115253676c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:10.495551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3281-8938-49d7-817e-b2115253676c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:10.495648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3281-8938-49d7-817e-b2115253676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:10.513929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-842c3281-8938-49d7-817e-b2115253676c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:53:10.515102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-842c3281-8938-49d7-817e-b2115253676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:53:10.574322 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:53:10.729674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860b8d-9b57-4d84-a6bd-fd1bf44005c4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:53:10.731493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3f860b8d-9b57-4d84-a6bd-fd1bf44005c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:53:10.809924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860b8d-9b57-4d84-a6bd-fd1bf44005c4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:53:10.816843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7fa61-0d1c-4c21-960e-ad59c26c8d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:53:10.817539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7fa61-0d1c-4c21-960e-ad59c26c8d39 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:10.817812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7fa61-0d1c-4c21-960e-ad59c26c8d39 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:10.818073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7fa61-0d1c-4c21-960e-ad59c26c8d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:10.826924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7fa61-0d1c-4c21-960e-ad59c26c8d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:53:10.828521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7fa61-0d1c-4c21-960e-ad59c26c8d39 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:53:10.838107 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 753/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:53:12.192220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fecc3-93e2-4371-a4cd-50272e040497 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:12.193082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fecc3-93e2-4371-a4cd-50272e040497 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:12.193082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fecc3-93e2-4371-a4cd-50272e040497 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:12.195103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 9 20:53:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:53:12.201164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604b67a-b478-4b31-98d9-ba03194da65a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:12.201612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604b67a-b478-4b31-98d9-ba03194da65a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:12.201761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604b67a-b478-4b31-98d9-ba03194da65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:12.227970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1604b67a-b478-4b31-98d9-ba03194da65a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:53:12.229205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1604b67a-b478-4b31-98d9-ba03194da65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:53:12.238234 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 9 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:53:12.396663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fecc3-93e2-4371-a4cd-50272e040497 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:53:12.416555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fecc3-93e2-4371-a4cd-50272e040497 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:53:12.425958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6da650-9fac-4687-8515-b7f03e97df67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:53:12.426630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6da650-9fac-4687-8515-b7f03e97df67 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:12.426911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6da650-9fac-4687-8515-b7f03e97df67 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:12.427183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6da650-9fac-4687-8515-b7f03e97df67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:12.438631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6da650-9fac-4687-8515-b7f03e97df67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:53:12.440314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6da650-9fac-4687-8515-b7f03e97df67 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:53:12.452423 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 770/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:53:16.573695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72789e-1e8b-4a68-8a5e-5ba86ac44174 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:16.574410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72789e-1e8b-4a68-8a5e-5ba86ac44174 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:16.574410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72789e-1e8b-4a68-8a5e-5ba86ac44174 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:16.575616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:53:16.582016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb15f-23e0-4f01-b0cf-75ee1337c73c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:16.582489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb15f-23e0-4f01-b0cf-75ee1337c73c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:16.582590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb15f-23e0-4f01-b0cf-75ee1337c73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:16.606824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aedfb15f-23e0-4f01-b0cf-75ee1337c73c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:53:16.608081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aedfb15f-23e0-4f01-b0cf-75ee1337c73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:53:16.617301 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:53:16.656691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72789e-1e8b-4a68-8a5e-5ba86ac44174 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:53:16.658813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8e72789e-1e8b-4a68-8a5e-5ba86ac44174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:53:16.719674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72789e-1e8b-4a68-8a5e-5ba86ac44174 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:53:16.723732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dea861-0c59-40ec-9a08-33fc5a9b6159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:53:16.724375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea861-0c59-40ec-9a08-33fc5a9b6159 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:16.724653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea861-0c59-40ec-9a08-33fc5a9b6159 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:16.724921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea861-0c59-40ec-9a08-33fc5a9b6159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:16.734143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dea861-0c59-40ec-9a08-33fc5a9b6159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:53:16.735584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dea861-0c59-40ec-9a08-33fc5a9b6159 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:53:16.745267 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 756/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:53:19.100906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea606f-1401-4399-ac30-5190de9daf43 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:19.101560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea606f-1401-4399-ac30-5190de9daf43 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:19.101560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea606f-1401-4399-ac30-5190de9daf43 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:19.103307 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 9 20:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:53:19.108578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1cd5e-ec68-431a-b7cc-121e9ed6818f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:19.109071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1cd5e-ec68-431a-b7cc-121e9ed6818f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:19.109189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1cd5e-ec68-431a-b7cc-121e9ed6818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:19.128059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-91a1cd5e-ec68-431a-b7cc-121e9ed6818f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:53:19.129309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91a1cd5e-ec68-431a-b7cc-121e9ed6818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:53:19.137745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 9 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:53:19.178306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea606f-1401-4399-ac30-5190de9daf43 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:53:19.191647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea606f-1401-4399-ac30-5190de9daf43 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:53:19.195735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d142c-2043-47e5-9281-0e60d6d74071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:53:19.196427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d142c-2043-47e5-9281-0e60d6d74071 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:53:19.196704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d142c-2043-47e5-9281-0e60d6d74071 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:53:19.196975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d142c-2043-47e5-9281-0e60d6d74071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:53:19.207195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d142c-2043-47e5-9281-0e60d6d74071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:53:19.208682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d142c-2043-47e5-9281-0e60d6d74071 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:53:19.218283 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 773/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:13.015074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0c9f-1f1c-4174-9ea8-65e47595531e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:13.015712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0c9f-1f1c-4174-9ea8-65e47595531e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:13.015712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0c9f-1f1c-4174-9ea8-65e47595531e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:13.017078 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 758/1531] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:13.022306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17a59-9645-4878-9956-5126a1460772 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:13.022786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17a59-9645-4878-9956-5126a1460772 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:13.022998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17a59-9645-4878-9956-5126a1460772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:13.042193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-32e17a59-9645-4878-9956-5126a1460772 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:13.043379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-32e17a59-9645-4878-9956-5126a1460772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:13.053052 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 774/1532] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:54:51.071293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427feb-5540-45dd-a84b-0b44ec89e400 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.072395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427feb-5540-45dd-a84b-0b44ec89e400 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.072883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427feb-5540-45dd-a84b-0b44ec89e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.082882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11991-ec49-426e-9b18-ef109bc14eb3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.083436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11991-ec49-426e-9b18-ef109bc14eb3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.083436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11991-ec49-426e-9b18-ef109bc14eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.245507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c2427feb-5540-45dd-a84b-0b44ec89e400 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.246744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c2427feb-5540-45dd-a84b-0b44ec89e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.252038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-78b11991-ec49-426e-9b18-ef109bc14eb3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.253305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-78b11991-ec49-426e-9b18-ef109bc14eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.335428 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 759/1533] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:54:51.336698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e5fc-e593-4288-9e54-8eb182791421 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.336987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e5fc-e593-4288-9e54-8eb182791421 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.337332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e5fc-e593-4288-9e54-8eb182791421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.337836 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 775/1534] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:54:51.348911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ddb0e-b988-4dcc-aabe-6bead29b7507 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.349253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ddb0e-b988-4dcc-aabe-6bead29b7507 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.349522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ddb0e-b988-4dcc-aabe-6bead29b7507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.369430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f91e5fc-e593-4288-9e54-8eb182791421 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.370663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f91e5fc-e593-4288-9e54-8eb182791421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.379363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-549ddb0e-b988-4dcc-aabe-6bead29b7507 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.380771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-549ddb0e-b988-4dcc-aabe-6bead29b7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.383671 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 760/1535] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.389809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e48d0-cdcb-42ef-947c-ac3a4ca02953 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.390202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e48d0-cdcb-42ef-947c-ac3a4ca02953 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.390530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e48d0-cdcb-42ef-947c-ac3a4ca02953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.398075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 776/1536] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:54:51.401822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92a88-4b51-4a35-ae34-996f937769ca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.402116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92a88-4b51-4a35-ae34-996f937769ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.402475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92a88-4b51-4a35-ae34-996f937769ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.415286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-276e48d0-cdcb-42ef-947c-ac3a4ca02953 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.416532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-276e48d0-cdcb-42ef-947c-ac3a4ca02953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.429638 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 761/1537] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.430960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168885-03f3-45d1-90d7-3ca606621c94 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.432971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b6f92a88-4b51-4a35-ae34-996f937769ca None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.435069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168885-03f3-45d1-90d7-3ca606621c94 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.435406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168885-03f3-45d1-90d7-3ca606621c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.437697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6f92a88-4b51-4a35-ae34-996f937769ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.452062 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 777/1538] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.452994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92a88-4b51-4a35-ae34-996f937769ca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.455836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1b168885-03f3-45d1-90d7-3ca606621c94 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.457089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1b168885-03f3-45d1-90d7-3ca606621c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.466095 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 762/1539] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.467426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eba61-6288-4478-bfd3-808e906be1de None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.467705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eba61-6288-4478-bfd3-808e906be1de None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.467980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eba61-6288-4478-bfd3-808e906be1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.470394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92a88-4b51-4a35-ae34-996f937769ca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.489832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4f7eba61-6288-4478-bfd3-808e906be1de None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.491287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4f7eba61-6288-4478-bfd3-808e906be1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.497710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.498411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.498691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.498968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.499486 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 763/1540] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.499812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:51.500141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.500243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eba61-6288-4478-bfd3-808e906be1de None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.501963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.510242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eba61-6288-4478-bfd3-808e906be1de None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.514894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.515182 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 778/1541] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:51.515602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.515877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.516146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.517163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:51.517471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.519147 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:51.519147 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 20:54:51.519147 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 20:54:51.520035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b5293-04f3-4ad6-9f90-0b601bea8d86 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.522063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.537064 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 764/1542] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:51.538468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dac18-83d2-47ff-9170-38ab7bfbe5cd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.538749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dac18-83d2-47ff-9170-38ab7bfbe5cd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.539018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dac18-83d2-47ff-9170-38ab7bfbe5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.541311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffb50-62bc-4210-82bf-15a3141d3b77 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.562034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c78dac18-83d2-47ff-9170-38ab7bfbe5cd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.563538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c78dac18-83d2-47ff-9170-38ab7bfbe5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.564827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.565889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.566167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.566441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.567742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:51.568067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.569748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.571565 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 765/1543] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.572854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd120-b07d-4b6b-bfc8-66e1da21d939 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.573223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd120-b07d-4b6b-bfc8-66e1da21d939 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.573496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd120-b07d-4b6b-bfc8-66e1da21d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.587859 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 779/1544] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:51.588634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.601956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-664cd120-b07d-4b6b-bfc8-66e1da21d939 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.603873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-664cd120-b07d-4b6b-bfc8-66e1da21d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.611728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b788-e0dd-4400-a39f-0b6917fb16a4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.615870 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 766/1545] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.617118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cd120-b07d-4b6b-bfc8-66e1da21d939 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.618421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fda1a8-d767-418a-8ad4-146a3800a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.619384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fda1a8-d767-418a-8ad4-146a3800a708 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.620453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fda1a8-d767-418a-8ad4-146a3800a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.620741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fda1a8-d767-418a-8ad4-146a3800a708 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.622187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fda1a8-d767-418a-8ad4-146a3800a708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.623467 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-71fda1a8-d767-418a-8ad4-146a3800a708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:51.623467 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:54:51.623467 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:54:51.625065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fda1a8-d767-418a-8ad4-146a3800a708 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.632149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cd120-b07d-4b6b-bfc8-66e1da21d939 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.638207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.639115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.639395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.639674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.640397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.642389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.661564 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 780/1546] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:51.663297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cf2f5-c121-4cd3-bb1d-2862f632e65c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.663793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cf2f5-c121-4cd3-bb1d-2862f632e65c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.664269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cf2f5-c121-4cd3-bb1d-2862f632e65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.670081 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 767/1547] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:51.670898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.687148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d52cf2f5-c121-4cd3-bb1d-2862f632e65c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.688406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d52cf2f5-c121-4cd3-bb1d-2862f632e65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.731830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9249-f1bc-42bf-92dc-14e390aa26a9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.737277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.737945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.738229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.738502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.739257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:51.739561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.741203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.745450 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 781/1548] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.746740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db861a8-8a14-4838-a5d7-8e79fc0769e4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.747028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db861a8-8a14-4838-a5d7-8e79fc0769e4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.747306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db861a8-8a14-4838-a5d7-8e79fc0769e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.759644 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 768/1549] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:51.759644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.764913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db363-29c5-4794-b5af-9098f680df42 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.769838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65537014-2f25-4986-bbd3-daa5d9cb51fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.770491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537014-2f25-4986-bbd3-daa5d9cb51fa admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.770773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537014-2f25-4986-bbd3-daa5d9cb51fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.771049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537014-2f25-4986-bbd3-daa5d9cb51fa admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.771173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5db861a8-8a14-4838-a5d7-8e79fc0769e4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.771734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65537014-2f25-4986-bbd3-daa5d9cb51fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.772376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5db861a8-8a14-4838-a5d7-8e79fc0769e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.773706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65537014-2f25-4986-bbd3-daa5d9cb51fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.780164 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 782/1550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.780918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db861a8-8a14-4838-a5d7-8e79fc0769e4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.790202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db861a8-8a14-4838-a5d7-8e79fc0769e4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.795117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.795780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.796065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.796342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.797169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:51.797466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.799085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.805910 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 769/1551] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:51.805910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2eb65-a604-427b-beb7-c0a603144317 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.805910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2eb65-a604-427b-beb7-c0a603144317 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.805910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2eb65-a604-427b-beb7-c0a603144317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.818242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 783/1552] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:51.818242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.822206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106ac06-5a1f-40e6-9737-c0598be40f0f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.823101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5ab2eb65-a604-427b-beb7-c0a603144317 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.824317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5ab2eb65-a604-427b-beb7-c0a603144317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.877933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721fed8-6b05-4b78-b69c-3b276e3618ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.878547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721fed8-6b05-4b78-b69c-3b276e3618ad admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.878826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721fed8-6b05-4b78-b69c-3b276e3618ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.879101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721fed8-6b05-4b78-b69c-3b276e3618ad admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.879824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721fed8-6b05-4b78-b69c-3b276e3618ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.881548 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 770/1553] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.882394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2eb65-a604-427b-beb7-c0a603144317 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.883044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721fed8-6b05-4b78-b69c-3b276e3618ad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.891748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2eb65-a604-427b-beb7-c0a603144317 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.896927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.897715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.897988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.898260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.899031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.900072 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:51.900072 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 20:54:51.900072 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 20:54:51.901939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.907264 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 784/1554] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:51.907264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9913-fa1d-4c2b-b309-8b31bff626c4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.907264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9913-fa1d-4c2b-b309-8b31bff626c4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.907264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9913-fa1d-4c2b-b309-8b31bff626c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.923107 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 771/1555] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/users => generated 299 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:51.923816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.924911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-eb0e9913-fa1d-4c2b-b309-8b31bff626c4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.926169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eb0e9913-fa1d-4c2b-b309-8b31bff626c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.934125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5993c81-480e-475c-903d-6aa6aac70209 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:51.937998 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 785/1556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.939272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbf53-7ff9-417a-be7b-3b3620e2b168 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.939482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:51.939590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbf53-7ff9-417a-be7b-3b3620e2b168 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.939818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbf53-7ff9-417a-be7b-3b3620e2b168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.940140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:51.940547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:51.940819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:51.941575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:51.943485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:51.958235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-942dbf53-7ff9-417a-be7b-3b3620e2b168 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:51.959441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-942dbf53-7ff9-417a-be7b-3b3620e2b168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:51.972517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 786/1557] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:51.972517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dbf53-7ff9-417a-be7b-3b3620e2b168 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.974771 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 772/1558] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:51.975648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:51.983134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dbf53-7ff9-417a-be7b-3b3620e2b168 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.036592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924744-c434-402f-863c-aaa6376f5b11 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.037968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a259c3-2d7c-4049-9d03-6631df9f7ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.038648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a259c3-2d7c-4049-9d03-6631df9f7ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.038930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a259c3-2d7c-4049-9d03-6631df9f7ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.039204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a259c3-2d7c-4049-9d03-6631df9f7ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.039887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a259c3-2d7c-4049-9d03-6631df9f7ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.041313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.041866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a259c3-2d7c-4049-9d03-6631df9f7ba7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.042024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.042275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.042545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.043287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.045310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.066877 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 787/1559] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.066877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5ccce-152a-48e7-a164-4204b7774766 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.066877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5ccce-152a-48e7-a164-4204b7774766 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.066877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5ccce-152a-48e7-a164-4204b7774766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.073420 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 773/1560] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:51 2022] POST /identity/v3/projects => generated 395 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.073420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.086636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-26c5ccce-152a-48e7-a164-4204b7774766 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:52.087846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-26c5ccce-152a-48e7-a164-4204b7774766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:52.130376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242e853-6f65-47f1-b9c5-9aa7a1de149d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.134970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.135639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.135922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.136202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.136944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.138601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.144558 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 788/1561] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:52.148469 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 774/1562] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.149447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.149819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5ccce-152a-48e7-a164-4204b7774766 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.159337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a2d93-9b08-4c7f-b59c-dfabd2fff5e1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.159496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5ccce-152a-48e7-a164-4204b7774766 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.164035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.164174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.164656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.164756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.164929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.165020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.165225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.165367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.165939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:52.166101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.166234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.167722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.167822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.180728 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 789/1563] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.180728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.180965 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 775/1564] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:52.180965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.190578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2363e-e8cc-48ff-8423-da45e3014d60 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.194691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a46a1-c96b-43fa-9d37-f13b5685eb57 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.195121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.195776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.196050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.196318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.196993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.198932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.199838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.200525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.200804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.201123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.201850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:52.202159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.203803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.215744 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 790/1565] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:52.215744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.223129 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 776/1566] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.223129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.229017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32884c-9dd8-4cde-87b4-621a70d588c9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.231564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad62592-3c11-478c-a090-39fd65c01530 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.233779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.234480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.234757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.235029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.236108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.236459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.237167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.237441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.237707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.237795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.238375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.240274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.247845 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 791/1567] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.248549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.259255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e41e3-74ef-43cc-8849-376f5bdab5e5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.262959 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 777/1568] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/users => generated 298 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.263624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.266807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.267510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.267783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.268050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.268764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:54:52.269092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.270717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.272895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88eae-8111-4583-b3c6-cf52769a89dd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.277368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.278026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.278301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.278572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.279286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.280866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.282951 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 792/1569] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:52.283784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.293603 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 778/1570] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.293869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f6ec-138f-412a-b6d8-0de9da6e1f16 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.294637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.301690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.302400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.302674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.302929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.303681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.305324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.306395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38632e-cadb-4633-934b-fea1e003be84 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.310961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.311575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.311851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.312113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.312864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.314811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.315618 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 793/1571] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.316422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.325938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9321e-4c40-425a-a347-dcec6d456d3d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.330667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.331314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.331585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.331852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.332540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.334521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.340790 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 779/1572] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.341706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.363841 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 794/1573] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.363841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.402044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e5d14-3b10-492a-8888-a82d597865ee admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.421577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72515121-b6be-4147-b0f9-6779965b9a35 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.426517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.427190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.427461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.427726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.428441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.430091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.439800 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 795/1574] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.442992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.450787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59545-7a40-4723-a428-402f61557806 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.455589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.456262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.456544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.456639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.456821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.457267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.457549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.457630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.457823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.458573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.459206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.460261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.468982 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 796/1575] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.469775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.473612 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 780/1576] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.473612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.480749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b1499-9123-4140-9c5a-ef165cb6d0f5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.481989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab7945-b559-42a2-a6da-5c74177ef323 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.485879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.486745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.486929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.487037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.487281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] PATH_INFO: `/v3/projects/430f19ffcb28429189b8c76282d2077b/users/2d51c9bfc0124777b559e1d2cd1e2d50/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.487572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.487852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.488131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.488814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.490769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.502250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=430f19ffcb28429189b8c76282d2077b, user_id=2d51c9bfc0124777b559e1d2cd1e2d50, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.504907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.517019 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 797/1577] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.517371 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 781/1578] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:52 2022] PUT /identity/v3/projects/430f19ffcb28429189b8c76282d2077b/users/2d51c9bfc0124777b559e1d2cd1e2d50/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:52.518145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.521841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.578058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145937e-9c21-4a22-9d60-197a177d7e1c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.582800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.583460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.583732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.584000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.584680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.585029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460b114-b48e-47d8-9176-88233f5800d9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.586712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.589709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.590711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.591062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.591407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] PATH_INFO: `/v3/projects/132a3cf21adc4ce8a00f6c26761cb996/users/a24beaf728454be58cfed6a585166e91/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.605678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132a3cf21adc4ce8a00f6c26761cb996, user_id=a24beaf728454be58cfed6a585166e91, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.606820 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:52.606820 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:54:52.606820 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:54:52.607833 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 782/1579] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.608751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.609151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.618849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991517-d4c3-4835-b390-f9191686d7d7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.628085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 798/1580] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:52 2022] PUT /identity/v3/projects/132a3cf21adc4ce8a00f6c26761cb996/users/a24beaf728454be58cfed6a585166e91/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:52.628922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.676812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.677449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.677737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.678025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.678710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.680681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.690715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe032d5c-0bca-4008-b3ff-01154de5c547 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.695576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.696514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.696798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.697075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] PATH_INFO: `/v3/projects/39e74001028342baa30ed78eefca10d5/users/85dad9708390443b9fee68588ca69716/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.702121 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 783/1581] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.703048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.712080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e74001028342baa30ed78eefca10d5, user_id=85dad9708390443b9fee68588ca69716, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.713369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2ee0-291f-4881-b96f-12104e0a4100 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.714866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.718083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.718831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.719114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.719395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.720146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.721969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.728737 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 799/1582] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:52 2022] PUT /identity/v3/projects/39e74001028342baa30ed78eefca10d5/users/85dad9708390443b9fee68588ca69716/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:52.729582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.736399 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 784/1583] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.736399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.744351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24eef4-36d3-41bb-9854-c5ed63f8ff45 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.795487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523adef-875a-422a-92f1-21095bd5dc81 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.800444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf653-62a7-4aa5-b7cd-d6cb23dd98ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.801165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf653-62a7-4aa5-b7cd-d6cb23dd98ba admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.801481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf653-62a7-4aa5-b7cd-d6cb23dd98ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.801788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf653-62a7-4aa5-b7cd-d6cb23dd98ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.802515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cf653-62a7-4aa5-b7cd-d6cb23dd98ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.804158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cf653-62a7-4aa5-b7cd-d6cb23dd98ba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.804670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.805382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.805655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.805927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.807334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.809282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.814015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 800/1584] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.815067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba8e15-7af2-4340-a39f-40e1561b09d5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.815355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba8e15-7af2-4340-a39f-40e1561b09d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.815634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba8e15-7af2-4340-a39f-40e1561b09d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.835235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 785/1585] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:52.835235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.835512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-42ba8e15-7af2-4340-a39f-40e1561b09d5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:52.835512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-42ba8e15-7af2-4340-a39f-40e1561b09d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:52.844434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d1aaf-bf09-4012-9f0c-f02e4f775f16 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.847773 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 801/1586] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:52.849321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ea976-277d-4405-9587-552f3ba7c4e2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.849765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ea976-277d-4405-9587-552f3ba7c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.850064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ea976-277d-4405-9587-552f3ba7c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.854642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.855450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.855763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.856158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.856814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.858827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.873080 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 786/1587] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.873080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.879815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d32ea976-277d-4405-9587-552f3ba7c4e2 None None] MFA Rules not processed for user `a24beaf728454be58cfed6a585166e91`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:52.881079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d32ea976-277d-4405-9587-552f3ba7c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:52.882654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358afa-7d49-4aaa-a2cf-ba5f6dcd75bf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.887250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.887930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.888204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.888471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.889221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.890903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.901145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 787/1588] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:52.902284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.911611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041fc53-96f1-4b0d-ab4e-a53be68983c0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:52.916172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:52.917056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.917339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.917605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] PATH_INFO: `/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c/users/9b6de40886804ad791f4039382c3747c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.932602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfb0a0b08e044a28171febe8b4a4d9c, user_id=9b6de40886804ad791f4039382c3747c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:52.935262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:52.942881 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 802/1589] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:52.944541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f619a9-9c6f-4f9b-80c7-0948343716d7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:52.944831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f619a9-9c6f-4f9b-80c7-0948343716d7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:52.945261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f619a9-9c6f-4f9b-80c7-0948343716d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:52.950602 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 788/1590] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:52 2022] PUT /identity/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c/users/9b6de40886804ad791f4039382c3747c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:52.953878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:52.972245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-40f619a9-9c6f-4f9b-80c7-0948343716d7 None None] MFA Rules not processed for user `85dad9708390443b9fee68588ca69716`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:52.973513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-40f619a9-9c6f-4f9b-80c7-0948343716d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:53.012494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d659-bb94-47bf-92b7-04f76e0e19df admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.017997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.019005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.019282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.019550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421/users/c87fb11072e34ee194e32b634c10b4a8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.033886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22480ed945441e39568d90ae3891421, user_id=c87fb11072e34ee194e32b634c10b4a8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.034259 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 803/1591] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:53.036743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.037947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f619a9-9c6f-4f9b-80c7-0948343716d7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.049197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f619a9-9c6f-4f9b-80c7-0948343716d7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.051510 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 789/1592] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:52 2022] PUT /identity/v3/projects/a22480ed945441e39568d90ae3891421/users/c87fb11072e34ee194e32b634c10b4a8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:53.052443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.107095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.107823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.108104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.108370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.109161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.111167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.120814 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 804/1593] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:53.120814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.129659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d1ce1-e279-4bc8-b034-b9bc12547546 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.131207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c618-d769-4085-9c50-bfc1786c7f5b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.133339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.133988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.134319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.134534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.135791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.136472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.136753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.137027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.137783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.139390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.143532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.144963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.149349 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 805/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:53.153362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.154455 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 790/1595] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:53.155098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.163022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5f9d6-11a0-4122-9335-2844c9192297 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.165246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972088ed-55c5-433d-9a5f-2743fd44ed45 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.168811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899fdac-302b-4d62-8685-b15855c049e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.169517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899fdac-302b-4d62-8685-b15855c049e8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.169813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899fdac-302b-4d62-8685-b15855c049e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.170084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899fdac-302b-4d62-8685-b15855c049e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.170892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.171012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899fdac-302b-4d62-8685-b15855c049e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.171589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.171919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.172182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.172705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899fdac-302b-4d62-8685-b15855c049e8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.172927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.175324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.184892 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 806/1596] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:53.186266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e741-6035-4156-9f17-1b316f73657d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.186545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e741-6035-4156-9f17-1b316f73657d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.186819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e741-6035-4156-9f17-1b316f73657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.215294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 791/1597] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:53.215893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-91e8e741-6035-4156-9f17-1b316f73657d None None] MFA Rules not processed for user `9b6de40886804ad791f4039382c3747c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:53.216508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.217780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91e8e741-6035-4156-9f17-1b316f73657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:53.286256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b8fd-488b-43f9-b4a5-2df14420f497 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.289498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 807/1598] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:53.291205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfda7-6769-4bbc-baac-f9c9d6ce37ef None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.291205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfda7-6769-4bbc-baac-f9c9d6ce37ef None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.291380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfda7-6769-4bbc-baac-f9c9d6ce37ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.296541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.297386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.297873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.298270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.300045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.302102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.319001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e0ecfda7-6769-4bbc-baac-f9c9d6ce37ef None None] MFA Rules not processed for user `c87fb11072e34ee194e32b634c10b4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:53.320235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e0ecfda7-6769-4bbc-baac-f9c9d6ce37ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:53.341805 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 792/1599] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:53.341805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.387493 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 808/1600] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:53.388330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecfda7-6769-4bbc-baac-f9c9d6ce37ef None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.398910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecfda7-6769-4bbc-baac-f9c9d6ce37ef None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.417452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf73b-c14b-4c46-8be1-f462d5acefe2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.421991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.422991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.422991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.423195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.423920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.425563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.444531 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 793/1601] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:53.445778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.457873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f2a6-0849-4910-8dad-ed87a7091846 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.468181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.469154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.469434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.469763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] PATH_INFO: `/v3/projects/47d1b7dc90f744f3861133f61e9b773a/users/dd3b417af048460da3ef7f6250a9b796/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.483918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.484847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.485635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.485794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] PATH_INFO: `/v3/projects/39b97c882b8f492e8e422c14ccd8c344/users/c8cf356949864c629a2d1ff724adb7d0/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.491016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d1b7dc90f744f3861133f61e9b773a, user_id=dd3b417af048460da3ef7f6250a9b796, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.494171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.503726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b97c882b8f492e8e422c14ccd8c344, user_id=c8cf356949864c629a2d1ff724adb7d0, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.506784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.512101 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 794/1602] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:53 2022] PUT /identity/v3/projects/47d1b7dc90f744f3861133f61e9b773a/users/dd3b417af048460da3ef7f6250a9b796/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:53.513396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.529982 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 809/1603] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:53 2022] PUT /identity/v3/projects/39b97c882b8f492e8e422c14ccd8c344/users/c8cf356949864c629a2d1ff724adb7d0/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:53.541825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.595886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84e82-c4c0-4bc3-8841-20cb163c79d7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.616771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671824-72cb-431a-9baa-c64933d2a8d2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.621840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.622521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.622799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.623313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.623973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.626006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.653987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 810/1604] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:53.654672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.657147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.657861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.658143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.658416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.659109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.661074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.684708 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 795/1605] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:53.685913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.696061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363acf8-ad50-4c96-87f9-37a169c6ff17 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.724152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27beec-1bb9-4796-a7ff-a549df7da22a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.729752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.730454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.730736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.731012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.731702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.733782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.757778 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 811/1606] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:53.758508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.761311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79dd9-95db-40a2-a6ad-60def8a8137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.762398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79dd9-95db-40a2-a6ad-60def8a8137b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.762862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79dd9-95db-40a2-a6ad-60def8a8137b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.763313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79dd9-95db-40a2-a6ad-60def8a8137b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.764188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79dd9-95db-40a2-a6ad-60def8a8137b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.766702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79dd9-95db-40a2-a6ad-60def8a8137b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.770795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4739-a24f-4f60-aebc-df74249ee704 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.778256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059d4e6-9107-4921-8c72-d893a5f01677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.779457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d4e6-9107-4921-8c72-d893a5f01677 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.779894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d4e6-9107-4921-8c72-d893a5f01677 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.780174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d4e6-9107-4921-8c72-d893a5f01677 admin admin] PATH_INFO: `/v3/projects/df9a285949864b4a9f48c4381ffc88d4/users/49f0adaee61347b0bd3a989c5275e09e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.797635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059d4e6-9107-4921-8c72-d893a5f01677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9a285949864b4a9f48c4381ffc88d4, user_id=49f0adaee61347b0bd3a989c5275e09e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.800427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059d4e6-9107-4921-8c72-d893a5f01677 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.801649 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 796/1607] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:53.803066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd1c4-1da4-454b-8fb7-e370370bf098 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.803362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd1c4-1da4-454b-8fb7-e370370bf098 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.803641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd1c4-1da4-454b-8fb7-e370370bf098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.833858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9d7cd1c4-1da4-454b-8fb7-e370370bf098 None None] MFA Rules not processed for user `dd3b417af048460da3ef7f6250a9b796`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:53.834497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9d7cd1c4-1da4-454b-8fb7-e370370bf098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:53.840862 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 812/1608] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:53 2022] PUT /identity/v3/projects/df9a285949864b4a9f48c4381ffc88d4/users/49f0adaee61347b0bd3a989c5275e09e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:53.843640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8a07-3cb8-4d71-9336-e60cc3d40bad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.843640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8a07-3cb8-4d71-9336-e60cc3d40bad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.843833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8a07-3cb8-4d71-9336-e60cc3d40bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.880565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ef2f8a07-3cb8-4d71-9336-e60cc3d40bad None None] MFA Rules not processed for user `c8cf356949864c629a2d1ff724adb7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:53.881892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef2f8a07-3cb8-4d71-9336-e60cc3d40bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:53.904216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 797/1609] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:53.904216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd1c4-1da4-454b-8fb7-e370370bf098 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.957789 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 813/1610] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:53.961465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8a07-3cb8-4d71-9336-e60cc3d40bad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:53.969558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd1c4-1da4-454b-8fb7-e370370bf098 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.975285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8a07-3cb8-4d71-9336-e60cc3d40bad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:53.975463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.975995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.976279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.976746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.977585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.979978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:53.986017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:53.986998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:53.987737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:53.988229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:53.989567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:53.991803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.003964 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 814/1611] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:54.004915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.009214 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 798/1612] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:53 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:54.010540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.021700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13480e-0bcd-476f-815b-b028b9c5b34b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.026031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca32c5f-e39e-49d6-a5ec-4d8309ddc333 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.027115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f3bc6-647f-48e9-8e4c-f199c7c6d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.028020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f3bc6-647f-48e9-8e4c-f199c7c6d9be admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.028480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f3bc6-647f-48e9-8e4c-f199c7c6d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.028936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f3bc6-647f-48e9-8e4c-f199c7c6d9be admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.029988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f3bc6-647f-48e9-8e4c-f199c7c6d9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.031854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f3bc6-647f-48e9-8e4c-f199c7c6d9be admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.031958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.032661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.033008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.033381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.034360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.036955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.043771 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 815/1613] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:54.045403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7659b57-8839-4106-a622-eb29608aa12f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.045872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7659b57-8839-4106-a622-eb29608aa12f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.046315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7659b57-8839-4106-a622-eb29608aa12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.067316 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 799/1614] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/users => generated 298 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:54.068998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.077302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a7659b57-8839-4106-a622-eb29608aa12f None None] MFA Rules not processed for user `49f0adaee61347b0bd3a989c5275e09e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:54.078921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a7659b57-8839-4106-a622-eb29608aa12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:54.084940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e984d8-2eeb-43b0-8896-a304805a9eff admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.094656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.095429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.095915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.096772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.097576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.099586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.135977 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 800/1615] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:54.138022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.159468 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 816/1616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:54.160921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7659b57-8839-4106-a622-eb29608aa12f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.174559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7659b57-8839-4106-a622-eb29608aa12f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.216527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c654-08c9-4c9c-857e-ad13d95d5802 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.220195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.220886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.221225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.221504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.222271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.224248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.258974 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 801/1617] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:54.258974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.261709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.262478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.262758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.263030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] PATH_INFO: `/v3/projects/e6983f4fb6624a2ea3d482d79202ed5b/users/824856226f55468ca7557eea6a178f76/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.283238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6983f4fb6624a2ea3d482d79202ed5b, user_id=824856226f55468ca7557eea6a178f76, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.286737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.312971 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 817/1618] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:54 2022] PUT /identity/v3/projects/e6983f4fb6624a2ea3d482d79202ed5b/users/824856226f55468ca7557eea6a178f76/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:54.314613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.340241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9662-c8fd-4697-b463-7ec304e21621 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.396865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f3cf7-99a3-47da-98c4-85b3ca838168 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.402074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.403189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.403558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.403959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] PATH_INFO: `/v3/projects/0863ece4267940eead6853624975c77a/users/e52deeafb96a42d79af98a9cef06dbc3/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.407949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.408642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.408921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.409273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.410024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.411781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.422410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0863ece4267940eead6853624975c77a, user_id=e52deeafb96a42d79af98a9cef06dbc3, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.422620 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 802/1619] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:54.423345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.426525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.434557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecd0bc-e4a9-4b70-97e5-c11d36fcf1e0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.451020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.451020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.451020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.451020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.452126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.452459 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 818/1620] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:54 2022] PUT /identity/v3/projects/0863ece4267940eead6853624975c77a/users/e52deeafb96a42d79af98a9cef06dbc3/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:54.453926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.454269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.471726 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 803/1621] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:54.472658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.486037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8616f3-b64e-49ac-8c31-0d3c551a53ba admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.541836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9421c-ed84-4fb5-a8fd-63e83fa35985 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.548644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.549763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.549866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.550374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.550481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.550750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.551028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.551312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.551746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.552419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.553812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.554813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.582169 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 819/1622] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:54.582827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.595005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f03c8-c247-4f27-8f0a-ac7490b30459 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.598553 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 804/1623] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:54.600422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.675794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.676496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.678179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.678474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.679211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.682175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.688423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403c72d-0baf-442d-ac3b-dd41686625f0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.693559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.694886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.695394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.695829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.697410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.699180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.711523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 805/1624] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:54.712481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.723223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d9336-65de-4cc5-b277-c9db091e9603 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.728221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.729198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.729479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.729750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] PATH_INFO: `/v3/projects/7b27eec02e724d94b0f0ec0858bc906d/users/b215dcc97d474db3a889c74db76eda81/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.732314 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 820/1625] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:54.733373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.744237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d552b6-0696-48d9-b15a-9102806bfb9d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.749007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.750211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b27eec02e724d94b0f0ec0858bc906d, user_id=b215dcc97d474db3a889c74db76eda81, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.750323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.750323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.750514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.751313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.753417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.757289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.773316 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 821/1626] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:54.774284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.786126 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 806/1627] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:54 2022] PUT /identity/v3/projects/7b27eec02e724d94b0f0ec0858bc906d/users/b215dcc97d474db3a889c74db76eda81/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:54.786829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43e78-03d2-48ec-a9b0-d75e1a48ea6f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.787599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.864137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.864482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.864830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.865853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] PATH_INFO: `/v3/projects/e980dea4e70f4eb0aa552688239f757c/users/e3ab387d2da84f82ac0359cb62843dc0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.878837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dc835-fec4-4afe-9ee7-067c8627b2a3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:54.884105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:54.884889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:54.885409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:54.885755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:54.886699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.888123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e980dea4e70f4eb0aa552688239f757c, user_id=e3ab387d2da84f82ac0359cb62843dc0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:54.888502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.891537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:54.906520 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 807/1628] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:54.909507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.916804 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 822/1629] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:54 2022] PUT /identity/v3/projects/e980dea4e70f4eb0aa552688239f757c/users/e3ab387d2da84f82ac0359cb62843dc0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:54.916804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:54.934357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a63ee-bafe-4afb-a077-d7c2a295463f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.037319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.038121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.038477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.038814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.039584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.042227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.046256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e635c-5933-4a55-99ca-d1175e0dfbda admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.051566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.052492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.052856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.053298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] PATH_INFO: `/v3/projects/e6983f4fb6624a2ea3d482d79202ed5b/users/824856226f55468ca7557eea6a178f76/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.055712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6983f4fb6624a2ea3d482d79202ed5b, user_id=824856226f55468ca7557eea6a178f76, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.058750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.078595 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 823/1630] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:54 2022] PUT /identity/v3/projects/e6983f4fb6624a2ea3d482d79202ed5b/users/824856226f55468ca7557eea6a178f76/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:55.078595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.078882 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 808/1631] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:54 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:55.078882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.086588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3314f-31c9-4745-8566-c529122274f1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.153847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.155276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.155276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.155456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] PATH_INFO: `/v3/projects/0863ece4267940eead6853624975c77a/users/e52deeafb96a42d79af98a9cef06dbc3/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.158620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0863ece4267940eead6853624975c77a, user_id=e52deeafb96a42d79af98a9cef06dbc3, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.161326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.169260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feddec4-6c11-4296-958d-674a383e410c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.178824 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 809/1632] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:55 2022] PUT /identity/v3/projects/0863ece4267940eead6853624975c77a/users/e52deeafb96a42d79af98a9cef06dbc3/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:55.180042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.235813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.236922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.237400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.237757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.238603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.241093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.252354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 824/1633] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:55.253271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.262516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e2c17-da8e-41bb-bad4-bdfd7c53a622 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.263265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e02f8-28b8-4979-925c-d2d9ed3535ff admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.268145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.268366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.268823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.269133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.269406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.269523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.269855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.270195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] PATH_INFO: `/v3/projects/49a926a88661416394b9f040a6d2654d/users/7fb802048185487881a18765503f81a2/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.270290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.271913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.283287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 810/1634] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:55.285646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a926a88661416394b9f040a6d2654d, user_id=7fb802048185487881a18765503f81a2, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.286210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.289238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.298535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb358f-0fc0-4d75-8099-4546b7531a05 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.308195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 825/1635] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:55 2022] PUT /identity/v3/projects/49a926a88661416394b9f040a6d2654d/users/7fb802048185487881a18765503f81a2/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:55.311396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.366462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e754d55-e603-4f9f-923f-6f267afd58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.367173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754d55-e603-4f9f-923f-6f267afd58a9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.367445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754d55-e603-4f9f-923f-6f267afd58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.367716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754d55-e603-4f9f-923f-6f267afd58a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.368633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e754d55-e603-4f9f-923f-6f267afd58a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.370429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e754d55-e603-4f9f-923f-6f267afd58a9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.377197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6a9b6-4aa8-4b2c-8c60-a1dcff7349aa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.382166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59241c3a-396e-4d91-adee-ba66f5a83a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.382871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241c3a-396e-4d91-adee-ba66f5a83a56 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.383188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241c3a-396e-4d91-adee-ba66f5a83a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.383489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241c3a-396e-4d91-adee-ba66f5a83a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.384387 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 811/1636] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:55.384594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59241c3a-396e-4d91-adee-ba66f5a83a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.385783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275b89-49f0-4555-bcd2-befd80078c20 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.386226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275b89-49f0-4555-bcd2-befd80078c20 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.386322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59241c3a-396e-4d91-adee-ba66f5a83a56 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.386509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275b89-49f0-4555-bcd2-befd80078c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.397813 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 826/1637] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:55.399011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ce3d3-5205-472e-9265-07a914623bec None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.399328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ce3d3-5205-472e-9265-07a914623bec None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.399630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ce3d3-5205-472e-9265-07a914623bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.420339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9e275b89-49f0-4555-bcd2-befd80078c20 None None] MFA Rules not processed for user `824856226f55468ca7557eea6a178f76`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:55.421788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9e275b89-49f0-4555-bcd2-befd80078c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:55.427102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-202ce3d3-5205-472e-9265-07a914623bec None None] MFA Rules not processed for user `e52deeafb96a42d79af98a9cef06dbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:55.428292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-202ce3d3-5205-472e-9265-07a914623bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:55.501214 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 812/1638] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:55.502826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275b89-49f0-4555-bcd2-befd80078c20 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.521830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275b89-49f0-4555-bcd2-befd80078c20 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.527231 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 827/1639] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:55.527231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ce3d3-5205-472e-9265-07a914623bec None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.530253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.531180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.531455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.531728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] PATH_INFO: `/v3/projects/69c87457ed8a416cbe13057e7795c6fd/users/1801b75acfe74bbb86e24d5eebdfcc4b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.537259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ce3d3-5205-472e-9265-07a914623bec None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.541574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.542828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.542948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.543316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] PATH_INFO: `/v3/projects/7b27eec02e724d94b0f0ec0858bc906d/users/b215dcc97d474db3a889c74db76eda81/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.545480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b27eec02e724d94b0f0ec0858bc906d, user_id=b215dcc97d474db3a889c74db76eda81, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.548453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.552172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c87457ed8a416cbe13057e7795c6fd, user_id=1801b75acfe74bbb86e24d5eebdfcc4b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.555389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.560556 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 828/1640] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:55 2022] PUT /identity/v3/projects/7b27eec02e724d94b0f0ec0858bc906d/users/b215dcc97d474db3a889c74db76eda81/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:55.561751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.579604 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 813/1641] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:55 2022] PUT /identity/v3/projects/69c87457ed8a416cbe13057e7795c6fd/users/1801b75acfe74bbb86e24d5eebdfcc4b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:55.583582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.654304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b781-933a-4542-8602-e170ef2cd097 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.669183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63df87-1542-41f0-ac69-6848c3d2684b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.676005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.676914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.677379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.677655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] PATH_INFO: `/v3/projects/e980dea4e70f4eb0aa552688239f757c/users/e3ab387d2da84f82ac0359cb62843dc0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.681133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e980dea4e70f4eb0aa552688239f757c, user_id=e3ab387d2da84f82ac0359cb62843dc0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.684374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.716483 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 814/1642] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:55 2022] PUT /identity/v3/projects/e980dea4e70f4eb0aa552688239f757c/users/e3ab387d2da84f82ac0359cb62843dc0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:55.716483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.724896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48440b-af15-44ef-a2ff-822bc7225df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.725634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48440b-af15-44ef-a2ff-822bc7225df7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.725917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48440b-af15-44ef-a2ff-822bc7225df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.726191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48440b-af15-44ef-a2ff-822bc7225df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.726919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48440b-af15-44ef-a2ff-822bc7225df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.728589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48440b-af15-44ef-a2ff-822bc7225df7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.739942 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 829/1643] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:55.741513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fa18-a744-48a0-b0fa-6b5aed091b8d None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.741797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fa18-a744-48a0-b0fa-6b5aed091b8d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.742071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fa18-a744-48a0-b0fa-6b5aed091b8d None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.744060 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 830/1644] 10.222.0.30 () {54 vars in 960 bytes} [Sat Apr 9 20:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:55.745258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5894a-524b-4d63-9d58-bfbe234044c0 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.745539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5894a-524b-4d63-9d58-bfbe234044c0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.745811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5894a-524b-4d63-9d58-bfbe234044c0 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.747289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 831/1645] 10.222.0.30 () {54 vars in 960 bytes} [Sat Apr 9 20:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:55.748641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8ebb-4860-49fd-ba2f-45bd2a9c09cc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.748870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8ebb-4860-49fd-ba2f-45bd2a9c09cc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.749180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8ebb-4860-49fd-ba2f-45bd2a9c09cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.780220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fb4a8ebb-4860-49fd-ba2f-45bd2a9c09cc None None] MFA Rules not processed for user `b215dcc97d474db3a889c74db76eda81`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:55.781849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fb4a8ebb-4860-49fd-ba2f-45bd2a9c09cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:55.808860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9a9be-a8cd-4f2a-ac4e-d9b871418c9f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.814787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.815718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.816001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.816277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] PATH_INFO: `/v3/projects/5019d4a722184338b9d68039381b4027/users/dc9680f4010349b3bc771b2de4fde6e0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.836755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5019d4a722184338b9d68039381b4027, user_id=dc9680f4010349b3bc771b2de4fde6e0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.840524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:55.864191 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 815/1646] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:55 2022] PUT /identity/v3/projects/5019d4a722184338b9d68039381b4027/users/dc9680f4010349b3bc771b2de4fde6e0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:55.865512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:55.882744 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 832/1647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:55.887762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa37ffd-19b9-465e-99eb-2509edb6d4de None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.888055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa37ffd-19b9-465e-99eb-2509edb6d4de None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.888336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa37ffd-19b9-465e-99eb-2509edb6d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.925851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1fa37ffd-19b9-465e-99eb-2509edb6d4de None None] MFA Rules not processed for user `e3ab387d2da84f82ac0359cb62843dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:55.927507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1fa37ffd-19b9-465e-99eb-2509edb6d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:55.956630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2c48-c733-4de3-8857-23f0b5091103 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:55.966625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:55.967457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:55.967745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:55.968022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:55.971231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:55.973812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.007336 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 816/1648] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:56.008420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:56.020446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107571-e476-4483-b3da-ef133ba2ef5d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:56.025852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93899ef3-4c3a-471f-a5b9-c85adb1e4baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:56.026461 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 833/1649] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:56.027071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93899ef3-4c3a-471f-a5b9-c85adb1e4baf admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.027476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93899ef3-4c3a-471f-a5b9-c85adb1e4baf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.027759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23abaf-2c92-4520-b225-87bcbb308258 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.028029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93899ef3-4c3a-471f-a5b9-c85adb1e4baf admin admin] PATH_INFO: `/v3/projects/49a926a88661416394b9f040a6d2654d/users/7fb802048185487881a18765503f81a2/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.028122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23abaf-2c92-4520-b225-87bcbb308258 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.028306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23abaf-2c92-4520-b225-87bcbb308258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.033146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93899ef3-4c3a-471f-a5b9-c85adb1e4baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a926a88661416394b9f040a6d2654d, user_id=7fb802048185487881a18765503f81a2, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:56.036078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93899ef3-4c3a-471f-a5b9-c85adb1e4baf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.051774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 817/1650] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:56 2022] PUT /identity/v3/projects/49a926a88661416394b9f040a6d2654d/users/7fb802048185487881a18765503f81a2/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:56.053622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187bb30-412e-4c72-b496-a0bc6c5181b9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.054170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187bb30-412e-4c72-b496-a0bc6c5181b9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.054590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187bb30-412e-4c72-b496-a0bc6c5181b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.115950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4d23abaf-2c92-4520-b225-87bcbb308258 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:56.117539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d23abaf-2c92-4520-b225-87bcbb308258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:56.118497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1187bb30-412e-4c72-b496-a0bc6c5181b9 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:56.119841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1187bb30-412e-4c72-b496-a0bc6c5181b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:56.239175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 834/1651] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:56.239874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23abaf-2c92-4520-b225-87bcbb308258 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:56.263615 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 818/1652] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:56.267580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187bb30-412e-4c72-b496-a0bc6c5181b9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:56.330434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23abaf-2c92-4520-b225-87bcbb308258 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:56.339503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:56.340209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.340488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.340761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.341735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:56.343414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.368399 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 835/1653] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:56.369375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:56.383114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9662e3a-49cc-4ec2-a88b-7ec2f4b1dd7e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:56.394225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0856c-130c-4384-81e9-67f9dd67d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:56.395739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0856c-130c-4384-81e9-67f9dd67d4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.395739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0856c-130c-4384-81e9-67f9dd67d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.395998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0856c-130c-4384-81e9-67f9dd67d4e3 admin admin] PATH_INFO: `/v3/projects/69c87457ed8a416cbe13057e7795c6fd/users/1801b75acfe74bbb86e24d5eebdfcc4b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.398004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0856c-130c-4384-81e9-67f9dd67d4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c87457ed8a416cbe13057e7795c6fd, user_id=1801b75acfe74bbb86e24d5eebdfcc4b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:56.400719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0856c-130c-4384-81e9-67f9dd67d4e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.403798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187bb30-412e-4c72-b496-a0bc6c5181b9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:56.412606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:56.413563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.413842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.414159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.414861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:56.420513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.430403 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 836/1654] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:56 2022] PUT /identity/v3/projects/69c87457ed8a416cbe13057e7795c6fd/users/1801b75acfe74bbb86e24d5eebdfcc4b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:56.443118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb9da-9f28-4e6c-954b-b04f1e2d2dc3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.443563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb9da-9f28-4e6c-954b-b04f1e2d2dc3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.443978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb9da-9f28-4e6c-954b-b04f1e2d2dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.477658 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 819/1655] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:56 2022] POST /identity/v3/projects => generated 395 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:56.477658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:56.479445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-52deb9da-9f28-4e6c-954b-b04f1e2d2dc3 None None] MFA Rules not processed for user `7fb802048185487881a18765503f81a2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:56.481241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-52deb9da-9f28-4e6c-954b-b04f1e2d2dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:56.594930 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 837/1656] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:56.594930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb9da-9f28-4e6c-954b-b04f1e2d2dc3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:56.615251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03abc-be05-48c1-bf83-8577c1b337e1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:56.616131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb9da-9f28-4e6c-954b-b04f1e2d2dc3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:56.625439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:56.627750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.629284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.629605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766e54-9145-404b-91c7-cc1d59858e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:56.630918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766e54-9145-404b-91c7-cc1d59858e50 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.630918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766e54-9145-404b-91c7-cc1d59858e50 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.630918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766e54-9145-404b-91c7-cc1d59858e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.631570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.745626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:56.747343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.756092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3766e54-9145-404b-91c7-cc1d59858e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:56.758067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3766e54-9145-404b-91c7-cc1d59858e50 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.768485 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 838/1657] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:56.771226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:56.779518 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 820/1658] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:56.781623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db8e4-0721-487f-9957-523450fe4fa5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.781913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db8e4-0721-487f-9957-523450fe4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.783559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db8e4-0721-487f-9957-523450fe4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.845697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f74db8e4-0721-487f-9957-523450fe4fa5 None None] MFA Rules not processed for user `1801b75acfe74bbb86e24d5eebdfcc4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:56.846875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f74db8e4-0721-487f-9957-523450fe4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:56.907120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ac8f7-789f-403e-bac4-20698610754e service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:56.917813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:56.918753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.919025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.919331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] PATH_INFO: `/v3/projects/5019d4a722184338b9d68039381b4027/users/dc9680f4010349b3bc771b2de4fde6e0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.927916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5019d4a722184338b9d68039381b4027, user_id=dc9680f4010349b3bc771b2de4fde6e0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:56.931259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:56.962405 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 839/1659] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:56 2022] PUT /identity/v3/projects/5019d4a722184338b9d68039381b4027/users/dc9680f4010349b3bc771b2de4fde6e0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:56.965988 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 821/1660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:56.975425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1211e-90f3-45fa-9b32-87923cff96e3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:56.976062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1211e-90f3-45fa-9b32-87923cff96e3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:56.976557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1211e-90f3-45fa-9b32-87923cff96e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:56.979838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.020569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-92a1211e-90f3-45fa-9b32-87923cff96e3 None None] MFA Rules not processed for user `dc9680f4010349b3bc771b2de4fde6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:57.022609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-92a1211e-90f3-45fa-9b32-87923cff96e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:57.105081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde63a1-866f-4be4-92a0-d4f4f8b95fe4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.112301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.112937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.113246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.113518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.114216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.116059 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 822/1661] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:54:57.116990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1211e-90f3-45fa-9b32-87923cff96e3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.127408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.165157 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 840/1662] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:56 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:57.166065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.185463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a72e7-31df-456d-9493-65307b8f5922 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.193655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1211e-90f3-45fa-9b32-87923cff96e3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.198669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.200649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.200838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.201337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.201920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.202250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.202812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.203497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.203736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.207231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.235746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 841/1663] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:57.244089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.263682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e74e0-5c35-45c6-a94f-fc0d1637a0fd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.273316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.275132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.275565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.275984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.277160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.280303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.302313 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 842/1664] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:54:57.303516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.304496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.305477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.317764 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 823/1665] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:57.318804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.323046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911616e-81a7-4247-8f7c-0ac34d971f7a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.331168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.331913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8870-a972-4874-8547-c940811e5009 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.332174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.332825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.333597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.338720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c11f17-972f-4e61-9cb4-49df022f4921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.339746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c11f17-972f-4e61-9cb4-49df022f4921 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.340123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c11f17-972f-4e61-9cb4-49df022f4921 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.340674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c11f17-972f-4e61-9cb4-49df022f4921 admin admin] PATH_INFO: `/v3/projects/11512ab5dc41425abfd94276cf39520d/users/9a9210afd68b4af0b9c5a2e439871395/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.359000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c11f17-972f-4e61-9cb4-49df022f4921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11512ab5dc41425abfd94276cf39520d, user_id=9a9210afd68b4af0b9c5a2e439871395, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.362674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c11f17-972f-4e61-9cb4-49df022f4921 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.379692 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 824/1666] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:57 2022] PUT /identity/v3/projects/11512ab5dc41425abfd94276cf39520d/users/9a9210afd68b4af0b9c5a2e439871395/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:57.381302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd643e9b-9f8b-4d99-a3db-b338e9810142 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.381694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd643e9b-9f8b-4d99-a3db-b338e9810142 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.382076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd643e9b-9f8b-4d99-a3db-b338e9810142 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.384137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 825/1667] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:57.390566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143ed36-55a3-4079-ac11-3bae3f4759db None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.391066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143ed36-55a3-4079-ac11-3bae3f4759db None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.391346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143ed36-55a3-4079-ac11-3bae3f4759db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.422946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.423625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1143ed36-55a3-4079-ac11-3bae3f4759db None None] MFA Rules not processed for user `9a9210afd68b4af0b9c5a2e439871395`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:57.424598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.425250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1143ed36-55a3-4079-ac11-3bae3f4759db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:57.442353 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 843/1668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:57.444452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:54:57.456535 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Apr 09 20:54:57.456853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.476391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f82aa-4500-4a51-a5a4-039b03d12e15 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.564965 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 826/1669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:54:57.566639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143ed36-55a3-4079-ac11-3bae3f4759db None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.567899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.568971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.569427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.569640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.571020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.578144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.580509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 844/1670] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:54:57 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:57.674355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143ed36-55a3-4079-ac11-3bae3f4759db None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.681395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.682555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.682836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.683346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.793639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.795274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.810507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:57.819305 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 827/1671] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:57.832294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc1782-1ea8-45f0-b11a-4b10c5552e06 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:57.839800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf88e1-de57-4321-b198-82bfda8d2f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:57.840482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf88e1-de57-4321-b198-82bfda8d2f9b service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:57.840972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf88e1-de57-4321-b198-82bfda8d2f9b service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:57.841287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf88e1-de57-4321-b198-82bfda8d2f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:57.943186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf88e1-de57-4321-b198-82bfda8d2f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:57.944823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf88e1-de57-4321-b198-82bfda8d2f9b service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:57.955533 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 845/1672] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:54:58.044974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:58.072331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e7ea8-ba53-4783-bcbf-1660380340ac service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:58.083756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:58.084760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.084760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.084971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.206275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:58.208249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:58.226763 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 828/1673] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:58.275144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab30c33-3d31-4d29-9361-da14234ecf19 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.275634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab30c33-3d31-4d29-9361-da14234ecf19 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.276203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab30c33-3d31-4d29-9361-da14234ecf19 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.277762 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 846/1674] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:58.292703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:54:58.305935 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Apr 09 20:54:58.309297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:58.330565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bee9-37ca-4a80-8395-014e7453931d service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:58.337209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823f4f-4d3c-4417-b3aa-18c979447c4d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:58.338585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823f4f-4d3c-4417-b3aa-18c979447c4d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.339177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823f4f-4d3c-4417-b3aa-18c979447c4d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.339585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823f4f-4d3c-4417-b3aa-18c979447c4d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.341607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823f4f-4d3c-4417-b3aa-18c979447c4d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:58.343771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823f4f-4d3c-4417-b3aa-18c979447c4d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:58.345687 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 829/1675] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:54:58 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:58.434484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7ae29-2e53-46d0-99ff-5fc1a6adf287 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.434764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7ae29-2e53-46d0-99ff-5fc1a6adf287 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.435040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7ae29-2e53-46d0-99ff-5fc1a6adf287 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.436815 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 847/1676] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:58.447885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f051e-f6e7-4285-bff0-c24ff327ae40 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.448173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f051e-f6e7-4285-bff0-c24ff327ae40 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.448449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f051e-f6e7-4285-bff0-c24ff327ae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.520069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df69246-65c7-4ee8-90c6-02256a5a8d07 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.520497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df69246-65c7-4ee8-90c6-02256a5a8d07 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.520726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df69246-65c7-4ee8-90c6-02256a5a8d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.541921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4df69246-65c7-4ee8-90c6-02256a5a8d07 None None] MFA Rules not processed for user `c87fb11072e34ee194e32b634c10b4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:58.543157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4df69246-65c7-4ee8-90c6-02256a5a8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:58.567102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4e7f051e-f6e7-4285-bff0-c24ff327ae40 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:58.568351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4e7f051e-f6e7-4285-bff0-c24ff327ae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:58.625568 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 848/1677] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:58.631265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df69246-65c7-4ee8-90c6-02256a5a8d07 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:58.673746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 830/1678] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:58.675289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38a83-3642-4bb7-bb63-f740d6229ce0 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.675567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38a83-3642-4bb7-bb63-f740d6229ce0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.675843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38a83-3642-4bb7-bb63-f740d6229ce0 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.677460 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 831/1679] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:58.684599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38a83-3642-4bb7-bb63-f740d6229ce0 None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:54:58.706063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38a83-3642-4bb7-bb63-f740d6229ce0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:58.718893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38a83-3642-4bb7-bb63-f740d6229ce0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:58.724153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b215dcc97d474db3a889c74db76eda81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b27eec02e724d94b0f0ec0858bc906d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:58.725199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.725572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.725803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] PATH_INFO: `/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.728946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorizing `identity:get_project(project_id=1bfb0a0b08e044a28171febe8b4a4d9c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:58.731982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:58.736120 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 832/1680] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:54:58 2022] GET /identity/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c => generated 395 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:58.737611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:58.747666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df69246-65c7-4ee8-90c6-02256a5a8d07 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:58.756119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:58.757539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.757869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.758159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] PATH_INFO: `/v3/users/c8cf356949864c629a2d1ff724adb7d0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.760142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cf356949864c629a2d1ff724adb7d0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:58.760769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911647-bedc-41e0-82ac-de9d662cbeff tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:58.761269 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:58.761269 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 20:54:58.761269 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 20:54:58.762896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:58.776717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6ab11-f981-4de4-87cf-98738361ebaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:58.777429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6ab11-f981-4de4-87cf-98738361ebaa service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.777749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6ab11-f981-4de4-87cf-98738361ebaa service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.778018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6ab11-f981-4de4-87cf-98738361ebaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.790769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6ab11-f981-4de4-87cf-98738361ebaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:58.792626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6ab11-f981-4de4-87cf-98738361ebaa service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:58.804543 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 833/1681] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:58.806084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:58.806436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:58.806777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:58.864072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cf356949864c629a2d1ff724adb7d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:58.864808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cf356949864c629a2d1ff724adb7d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:58.865308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] MFA Rules not processed for user `2d51c9bfc0124777b559e1d2cd1e2d50`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:58.866827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:58.878524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cf356949864c629a2d1ff724adb7d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:58.888764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cf356949864c629a2d1ff724adb7d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:58.890640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cf356949864c629a2d1ff724adb7d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:58.919120 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 849/1682] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:54:58 2022] DELETE /identity/v3/users/c8cf356949864c629a2d1ff724adb7d0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:58.920158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:58.921816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:58.945398 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 834/1683] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:58.946351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:58.950052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:58.963815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3687555-3043-4dcb-96fd-6ff8f4eeadf3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.000286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a15d0-e400-497f-b60d-d623fcbd7dcf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.006052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27395026-6548-4324-9989-669df00f06ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.006820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395026-6548-4324-9989-669df00f06ff service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.007175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395026-6548-4324-9989-669df00f06ff service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.007511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395026-6548-4324-9989-669df00f06ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.009417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-27395026-6548-4324-9989-669df00f06ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.035345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.036320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.036666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.036999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] PATH_INFO: `/v3/users/85dad9708390443b9fee68588ca69716` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.038364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dad9708390443b9fee68588ca69716)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.040569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.078448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27395026-6548-4324-9989-669df00f06ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.080145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27395026-6548-4324-9989-669df00f06ff service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.090418 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 850/1684] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:59.091935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1c5f-3e8a-40b2-a5ea-6e6e28e552a1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.092308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1c5f-3e8a-40b2-a5ea-6e6e28e552a1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.092587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1c5f-3e8a-40b2-a5ea-6e6e28e552a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.099244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dad9708390443b9fee68588ca69716'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.100366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dad9708390443b9fee68588ca69716'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.108356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dad9708390443b9fee68588ca69716'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.109113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dad9708390443b9fee68588ca69716'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.110537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-216f1c5f-3e8a-40b2-a5ea-6e6e28e552a1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:59.112169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-216f1c5f-3e8a-40b2-a5ea-6e6e28e552a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.118454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dad9708390443b9fee68588ca69716'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.125795 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 851/1685] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:59.127452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc82b7-0b17-4df4-8c42-e5bea21b211c None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.128020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc82b7-0b17-4df4-8c42-e5bea21b211c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.128610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc82b7-0b17-4df4-8c42-e5bea21b211c None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.130157 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 852/1686] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:59.131009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc82b7-0b17-4df4-8c42-e5bea21b211c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.133197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-21fc82b7-0b17-4df4-8c42-e5bea21b211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.143721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 835/1687] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:54:58 2022] DELETE /identity/v3/users/85dad9708390443b9fee68588ca69716 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:59.144978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.147701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.157213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc82b7-0b17-4df4-8c42-e5bea21b211c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.216937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.217662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.217940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.218247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.218936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.220885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.222325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af256806-2e3d-400f-9ffb-3d92f0439b73 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.225996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66818c5e-8689-4dcb-acb3-846a920b1238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.226727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66818c5e-8689-4dcb-acb3-846a920b1238 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.227072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66818c5e-8689-4dcb-acb3-846a920b1238 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.227410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66818c5e-8689-4dcb-acb3-846a920b1238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.236746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66818c5e-8689-4dcb-acb3-846a920b1238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.238905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66818c5e-8689-4dcb-acb3-846a920b1238 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.246721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 853/1688] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:54:59 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:59.247558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:54:59.249128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.251723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 836/1689] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:59.252887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d96d7-d5ed-468a-983d-b70f4351ee53 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.253330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d96d7-d5ed-468a-983d-b70f4351ee53 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.253607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d96d7-d5ed-468a-983d-b70f4351ee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.271219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-271d96d7-d5ed-468a-983d-b70f4351ee53 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:59.272610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-271d96d7-d5ed-468a-983d-b70f4351ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.330573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.333474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.348731 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 837/1690] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:59.353304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4440f-8dc7-437b-b2ae-936aac057b22 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.353588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4440f-8dc7-437b-b2ae-936aac057b22 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.353867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4440f-8dc7-437b-b2ae-936aac057b22 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.355653 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 838/1691] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:54:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:59.356445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4440f-8dc7-437b-b2ae-936aac057b22 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.370622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4440f-8dc7-437b-b2ae-936aac057b22 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.375925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7419be-d6e8-4ce4-995e-39de20abe1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.376608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7419be-d6e8-4ce4-995e-39de20abe1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.376941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7419be-d6e8-4ce4-995e-39de20abe1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.377265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7419be-d6e8-4ce4-995e-39de20abe1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.378147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7419be-d6e8-4ce4-995e-39de20abe1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.380247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7419be-d6e8-4ce4-995e-39de20abe1f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.409652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca060-c463-49db-82a3-81a44e6d810d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.414305 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 839/1692] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:54:59 2022] POST /identity/v3/users => generated 308 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:54:59.415942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b215dcc97d474db3a889c74db76eda81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b27eec02e724d94b0f0ec0858bc906d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.417225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.418255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.418255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] PATH_INFO: `/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.418397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4417c8-0810-4cca-a359-bf64be8beae1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.418397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4417c8-0810-4cca-a359-bf64be8beae1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.418634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4417c8-0810-4cca-a359-bf64be8beae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.419588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorizing `identity:get_project(project_id=1bfb0a0b08e044a28171febe8b4a4d9c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.422441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.424777 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 854/1693] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:54:59 2022] GET /identity/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c => generated 395 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:59.425589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.427391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.438797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9e4417c8-0810-4cca-a359-bf64be8beae1 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:54:59.440520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9e4417c8-0810-4cca-a359-bf64be8beae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.452397 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 840/1694] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:54:59.453579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4417c8-0810-4cca-a359-bf64be8beae1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.466070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4417c8-0810-4cca-a359-bf64be8beae1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.471202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.471958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.472313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.472640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.473551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.475416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.494746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 841/1695] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:59.495895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.498032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.499330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d905541-8f05-4cdd-bfb3-b4abf7aaa861 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.503739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.504562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.505011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.505325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.516515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.518026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.530180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 855/1696] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:59.531095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.541163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6eda39-9880-4c76-af2e-1fc0ee801d22 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.547222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721ab1-4cea-497f-87c0-38b12bf51b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.548277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721ab1-4cea-497f-87c0-38b12bf51b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.548560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721ab1-4cea-497f-87c0-38b12bf51b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.548827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721ab1-4cea-497f-87c0-38b12bf51b0c admin admin] PATH_INFO: `/v3/projects/587189385a484c4abec9ab7e2da31334/users/f4225fb3976e48d79456a0a988a399cf/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.566351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721ab1-4cea-497f-87c0-38b12bf51b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=587189385a484c4abec9ab7e2da31334, user_id=f4225fb3976e48d79456a0a988a399cf, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.569623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721ab1-4cea-497f-87c0-38b12bf51b0c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.569770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4d89a-99e0-4ef5-bbe4-06ef6853043e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.573516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.574451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.574995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.575301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.586591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.587103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 856/1697] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:59 2022] PUT /identity/v3/projects/587189385a484c4abec9ab7e2da31334/users/f4225fb3976e48d79456a0a988a399cf/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:59.588049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.589052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7df44-013f-4a30-804b-58038b7ddc3e None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.589545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7df44-013f-4a30-804b-58038b7ddc3e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.590004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7df44-013f-4a30-804b-58038b7ddc3e None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.591442 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 857/1698] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:54:59.592297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7df44-013f-4a30-804b-58038b7ddc3e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.600548 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 842/1699] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:54:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:54:59.601846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:54:59.619184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.636255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018849ab-fc24-48f8-9090-338031dfd762 service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.688116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7df44-013f-4a30-804b-58038b7ddc3e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.695049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.695786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.696238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.696725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.697779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.699558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.716795 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 858/1700] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:54:59.716795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.721399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:54:59.733439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b215dcc97d474db3a889c74db76eda81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b27eec02e724d94b0f0ec0858bc906d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.734401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.734682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.734966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] PATH_INFO: `/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.736744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorizing `identity:get_project(project_id=1bfb0a0b08e044a28171febe8b4a4d9c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.739977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.742383 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 843/1701] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:54:59 2022] GET /identity/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c => generated 395 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:54:59.743273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.751303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70387a55-e5ba-4d78-8214-f8863502ddeb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.756471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d26cb-dc05-4974-a23b-db5eb1799f20 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:54:59.759468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.761969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.762472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.762891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] PATH_INFO: `/v3/projects/39b97c882b8f492e8e422c14ccd8c344` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.763842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:54:59.764443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b97c882b8f492e8e422c14ccd8c344)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.764814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:54:59.765201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:54:59.765639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] PATH_INFO: `/v3/projects/587189385a484c4abec9ab7e2da31334/users/f4225fb3976e48d79456a0a988a399cf/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:54:59.766978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.768161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=587189385a484c4abec9ab7e2da31334, user_id=f4225fb3976e48d79456a0a988a399cf, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:54:59.771273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:54:59.791047 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 844/1702] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:54:59 2022] PUT /identity/v3/projects/587189385a484c4abec9ab7e2da31334/users/f4225fb3976e48d79456a0a988a399cf/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:59.848801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b97c882b8f492e8e422c14ccd8c344', 'request_id': 'req-381e6da7-aed3-4999-b3ee-20f6446d4ab9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.856890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b97c882b8f492e8e422c14ccd8c344', 'request_id': 'req-381e6da7-aed3-4999-b3ee-20f6446d4ab9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.868028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b97c882b8f492e8e422c14ccd8c344', 'request_id': 'req-381e6da7-aed3-4999-b3ee-20f6446d4ab9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.883466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] The token cache is being invalidate because project 39b97c882b8f492e8e422c14ccd8c344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:54:59.883878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.885015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:54:59.890604 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 859/1703] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:54:59 2022] DELETE /identity/v3/projects/39b97c882b8f492e8e422c14ccd8c344 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:54:59.891671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:54:59.894441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:00.025665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09161a2e-cbe3-4297-a0d2-720d17ce3736 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:00.128684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:00.129760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:00.130087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:00.130363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] PATH_INFO: `/v3/users/1801b75acfe74bbb86e24d5eebdfcc4b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:00.131596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1801b75acfe74bbb86e24d5eebdfcc4b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:00.134747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:00.247348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1801b75acfe74bbb86e24d5eebdfcc4b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.248108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1801b75acfe74bbb86e24d5eebdfcc4b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.276986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1801b75acfe74bbb86e24d5eebdfcc4b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.278146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1801b75acfe74bbb86e24d5eebdfcc4b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.290869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1801b75acfe74bbb86e24d5eebdfcc4b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.335257 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 845/1704] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:54:59 2022] DELETE /identity/v3/users/1801b75acfe74bbb86e24d5eebdfcc4b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:00.367630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:00.369071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:00.478452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:00.480082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:00.500953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6da7-aed3-4999-b3ee-20f6446d4ab9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:00.619727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46998fcb-4a71-4b07-970e-ca160248ac8a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:00.632110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:00.633761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:00.634038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:00.634309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] PATH_INFO: `/v3/projects/39e74001028342baa30ed78eefca10d5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:00.638278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e74001028342baa30ed78eefca10d5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:00.641744 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.641744 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 20:55:00.641744 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 20:55:00.643751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:00.647132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5eeb7-5cb1-4e17-aa28-dd9c87cdf1b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:00.648136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5eeb7-5cb1-4e17-aa28-dd9c87cdf1b1 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:00.648852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5eeb7-5cb1-4e17-aa28-dd9c87cdf1b1 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:00.649152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5eeb7-5cb1-4e17-aa28-dd9c87cdf1b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:00.653390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dbf5eeb7-5cb1-4e17-aa28-dd9c87cdf1b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:00.726629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5eeb7-5cb1-4e17-aa28-dd9c87cdf1b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:00.728462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e74001028342baa30ed78eefca10d5', 'request_id': 'req-5b2c47a8-0aeb-4046-8277-101d39b05968'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.729018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5eeb7-5cb1-4e17-aa28-dd9c87cdf1b1 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:00.736112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e74001028342baa30ed78eefca10d5', 'request_id': 'req-5b2c47a8-0aeb-4046-8277-101d39b05968'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.745302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 860/1705] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:00.747274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:00.747563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:00.748164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:00.751656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e74001028342baa30ed78eefca10d5', 'request_id': 'req-5b2c47a8-0aeb-4046-8277-101d39b05968'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.756879 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 861/1706] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:00.761755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:00.765196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:00.781368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] The token cache is being invalidate because project 39e74001028342baa30ed78eefca10d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:00.781645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.785172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:00.788253 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 846/1707] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:00 2022] DELETE /identity/v3/projects/39e74001028342baa30ed78eefca10d5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:00.792956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:00.795636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:00.924324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c47a8-0aeb-4046-8277-101d39b05968 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:00.928891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:00.929935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:00.930331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:00.930487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] PATH_INFO: `/v3/users/e52deeafb96a42d79af98a9cef06dbc3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:00.931767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52deeafb96a42d79af98a9cef06dbc3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:00.934154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:00.935595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:00.937908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.003049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52deeafb96a42d79af98a9cef06dbc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.004319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52deeafb96a42d79af98a9cef06dbc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.013821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52deeafb96a42d79af98a9cef06dbc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.014921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52deeafb96a42d79af98a9cef06dbc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.032714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52deeafb96a42d79af98a9cef06dbc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.081853 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 847/1708] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:00 2022] DELETE /identity/v3/users/e52deeafb96a42d79af98a9cef06dbc3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:01.085961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:01.087651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.089782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76b996-9685-4ec8-a143-f7faa8d7f508 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:01.186175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbac20-b9cd-4173-9ee4-185980b41b91 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:01.195016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:01.199296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.199904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.201638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] PATH_INFO: `/v3/projects/69c87457ed8a416cbe13057e7795c6fd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.204842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c87457ed8a416cbe13057e7795c6fd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:01.208673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:01.234720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c7a4f-18ad-445a-a966-0633f4ba8921 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:01.236302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7a4f-18ad-445a-a966-0633f4ba8921 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.236420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7a4f-18ad-445a-a966-0633f4ba8921 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.236859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7a4f-18ad-445a-a966-0633f4ba8921 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.238714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c7a4f-18ad-445a-a966-0633f4ba8921 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:01.242237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c7a4f-18ad-445a-a966-0633f4ba8921 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:01.245908 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 862/1709] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:00 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:55:01.247516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78c22-dbc7-4d53-a0e4-b6b366b0a78a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.247904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78c22-dbc7-4d53-a0e4-b6b366b0a78a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.248361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78c22-dbc7-4d53-a0e4-b6b366b0a78a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.250602 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 863/1710] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:01.257567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.257984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.258360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.290488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c87457ed8a416cbe13057e7795c6fd', 'request_id': 'req-01b30eeb-7eee-4706-9513-95f00545cd4f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.307706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c87457ed8a416cbe13057e7795c6fd', 'request_id': 'req-01b30eeb-7eee-4706-9513-95f00545cd4f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.312336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:01.316869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.325351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c87457ed8a416cbe13057e7795c6fd', 'request_id': 'req-01b30eeb-7eee-4706-9513-95f00545cd4f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.349433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] The token cache is being invalidate because project 69c87457ed8a416cbe13057e7795c6fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:01.349723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.351900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-01b30eeb-7eee-4706-9513-95f00545cd4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:01.355244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 848/1711] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:01 2022] DELETE /identity/v3/projects/69c87457ed8a416cbe13057e7795c6fd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:01.362780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2425-0151-49b2-b3dd-02ef91d7eca2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.363595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2425-0151-49b2-b3dd-02ef91d7eca2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.363884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2425-0151-49b2-b3dd-02ef91d7eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.412417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6c6a2425-0151-49b2-b3dd-02ef91d7eca2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:01.420540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c6a2425-0151-49b2-b3dd-02ef91d7eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.435400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 864/1712] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:01.468010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:01.469699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.495095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f71911-e62b-4681-beea-be71dd7183d5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:01.506683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1dacd-3e1f-409b-9794-1b0ee79c3c2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:01.508013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1dacd-3e1f-409b-9794-1b0ee79c3c2e service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.508306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1dacd-3e1f-409b-9794-1b0ee79c3c2e service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.508583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1dacd-3e1f-409b-9794-1b0ee79c3c2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.538209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1dacd-3e1f-409b-9794-1b0ee79c3c2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:01.543717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1dacd-3e1f-409b-9794-1b0ee79c3c2e service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:01.566586 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 849/1713] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:01.571108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.571422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.571708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.574672 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 865/1714] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:55:01.575431 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 850/1715] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:01.586314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46305b-23c7-4532-a70d-522a5f510e00 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.586314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46305b-23c7-4532-a70d-522a5f510e00 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.586314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46305b-23c7-4532-a70d-522a5f510e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.586595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:01.586595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.624371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ad46305b-23c7-4532-a70d-522a5f510e00 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:01.632097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ad46305b-23c7-4532-a70d-522a5f510e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.663268 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 866/1716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:01.665904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46305b-23c7-4532-a70d-522a5f510e00 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:01.693721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46305b-23c7-4532-a70d-522a5f510e00 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:01.709691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:01.716353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.716353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.716353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.716353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:01.716353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:01.721179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:01.749671 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 867/1717] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:01.751966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:01.771253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f415fc-ba28-47c7-be85-80fe322826d4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:01.788033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:01.788729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:01.789532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:01.789816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:01.790526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:01.790968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:01.792488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:01.801939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.863311 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 868/1718] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:01 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:01.864593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:01.866675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:01.944484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951cc5-c46d-44b0-a2ac-22c51df7b9be None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.007320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756bcb4-5c71-4631-94de-f7b4dac61707 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.025979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.027007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.027287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.027621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] PATH_INFO: `/v3/projects/0863ece4267940eead6853624975c77a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.029666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0863ece4267940eead6853624975c77a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:02.033612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:02.070390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.071719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.073123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.073317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.074600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:02.076686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:02.085427 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 851/1719] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:01 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:55:02.086715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:02.120099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee99b5-563f-4e4d-b605-9d7b62ee4c9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.134241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.135054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.135410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.135580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.136500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:02.139182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:02.171464 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 852/1720] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:02 2022] POST /identity/v3/users => generated 301 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:02.171464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:02.173380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.173938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0863ece4267940eead6853624975c77a', 'request_id': 'req-d1d17594-cab6-4469-948b-5b1ddf44796f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.185580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0863ece4267940eead6853624975c77a', 'request_id': 'req-d1d17594-cab6-4469-948b-5b1ddf44796f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.218014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0863ece4267940eead6853624975c77a', 'request_id': 'req-d1d17594-cab6-4469-948b-5b1ddf44796f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.244108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] The token cache is being invalidate because project 0863ece4267940eead6853624975c77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:02.244528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.246857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.258089 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 869/1721] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:01 2022] DELETE /identity/v3/projects/0863ece4267940eead6853624975c77a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:02.259186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:02.261451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.284664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd55f4-12ae-4908-ac66-a46d08baca85 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.360423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17594-cab6-4469-948b-5b1ddf44796f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.383852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d0759-1f0a-4b3f-bb69-78ebeb773aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.384435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.384552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d0759-1f0a-4b3f-bb69-78ebeb773aea service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.384792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d0759-1f0a-4b3f-bb69-78ebeb773aea service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.385106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d0759-1f0a-4b3f-bb69-78ebeb773aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.386154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.386620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.386990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c0d0759-1f0a-4b3f-bb69-78ebeb773aea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.387315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.388229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:02.390461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:02.402254 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 870/1722] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:02.403479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:02.406388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.420179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e029911-be1d-4ec3-9de5-9faba51fe12f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.425686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.426858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.427341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.427960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] PATH_INFO: `/v3/users/49f0adaee61347b0bd3a989c5275e09e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.429184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f0adaee61347b0bd3a989c5275e09e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:02.431420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:02.476155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d0759-1f0a-4b3f-bb69-78ebeb773aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:02.478825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d0759-1f0a-4b3f-bb69-78ebeb773aea service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:02.492425 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 853/1723] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:02.493100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f0adaee61347b0bd3a989c5275e09e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.494338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f0adaee61347b0bd3a989c5275e09e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.501713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f0adaee61347b0bd3a989c5275e09e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.509565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9c4d-da9e-430d-a077-ef0cbb606029 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.509858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9c4d-da9e-430d-a077-ef0cbb606029 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.510137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9c4d-da9e-430d-a077-ef0cbb606029 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.511635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 854/1724] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:02.512849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.513231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.513509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.519415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f0adaee61347b0bd3a989c5275e09e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.521971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f0adaee61347b0bd3a989c5275e09e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:02.534902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:02.536162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.585465 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 855/1725] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:02.586095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:02.589022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.607801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b063b-67b4-484e-bb9a-885084873d34 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.612849 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 871/1726] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:02 2022] DELETE /identity/v3/users/49f0adaee61347b0bd3a989c5275e09e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:02.612849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:02.614701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.736520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373ebc-8b6d-4d5a-890b-48dc6aa8018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.737269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373ebc-8b6d-4d5a-890b-48dc6aa8018e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.737615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373ebc-8b6d-4d5a-890b-48dc6aa8018e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.737882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373ebc-8b6d-4d5a-890b-48dc6aa8018e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.738960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1373ebc-8b6d-4d5a-890b-48dc6aa8018e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:02.741727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1373ebc-8b6d-4d5a-890b-48dc6aa8018e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:02.758948 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 856/1727] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:02.760451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b42ab-3106-498e-9a55-5e573f1c1e60 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.760713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b42ab-3106-498e-9a55-5e573f1c1e60 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.761091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b42ab-3106-498e-9a55-5e573f1c1e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.803574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ba5b42ab-3106-498e-9a55-5e573f1c1e60 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:02.807392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba5b42ab-3106-498e-9a55-5e573f1c1e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.836098 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 857/1728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:02.837893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230429ae-80da-4ffb-bc27-ecdd8f830be4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.839474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230429ae-80da-4ffb-bc27-ecdd8f830be4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.839841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230429ae-80da-4ffb-bc27-ecdd8f830be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:02.882116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:02.900047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.910229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-230429ae-80da-4ffb-bc27-ecdd8f830be4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:02.911913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-230429ae-80da-4ffb-bc27-ecdd8f830be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:02.929345 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 858/1729] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:02.929345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230429ae-80da-4ffb-bc27-ecdd8f830be4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:02.962508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230429ae-80da-4ffb-bc27-ecdd8f830be4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:02.979691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:02.982482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:02.983064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:02.983569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] PATH_INFO: `/v3/projects/c16b0ae6fece49df9063907aa97f8639/users/b41bdd61ec4043b8ab68c53117601467/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.005890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16b0ae6fece49df9063907aa97f8639, user_id=b41bdd61ec4043b8ab68c53117601467, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:03.017200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:03.050909 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 859/1730] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:02 2022] PUT /identity/v3/projects/c16b0ae6fece49df9063907aa97f8639/users/b41bdd61ec4043b8ab68c53117601467/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:03.052118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:03.144657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbc5df-9458-4d79-91da-5144d6113811 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:03.146055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6d8a8-4cc5-4ed8-a6ba-b16eab759f62 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:03.156274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:03.157255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.158413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.158795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.159833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:03.160242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:03.162220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:03.185158 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 860/1731] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:03.186511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:03.193736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:03.315344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5ab90-3e7e-400c-b78c-a7fa3486f261 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:03.316245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5ab90-3e7e-400c-b78c-a7fa3486f261 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.316530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5ab90-3e7e-400c-b78c-a7fa3486f261 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.321501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5ab90-3e7e-400c-b78c-a7fa3486f261 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.326866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5ab90-3e7e-400c-b78c-a7fa3486f261 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:03.332367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5ab90-3e7e-400c-b78c-a7fa3486f261 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:03.334228 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 872/1732] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:02 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 724 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:03.336473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7bf67-b74f-4c0c-9e3d-18c914dd9ddc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.337915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7bf67-b74f-4c0c-9e3d-18c914dd9ddc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.337915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7bf67-b74f-4c0c-9e3d-18c914dd9ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.393572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eb3fb-6f33-4eaf-a831-ea32a0a6a40d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:03.414751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:03.415434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.415709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.415979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.416659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-13f7bf67-b74f-4c0c-9e3d-18c914dd9ddc None None] MFA Rules not processed for user `b41bdd61ec4043b8ab68c53117601467`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:03.419564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-13f7bf67-b74f-4c0c-9e3d-18c914dd9ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:03.445805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:03.456548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:03.480470 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 861/1733] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:03.482705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:03.507994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f449e33-d11d-4217-af5f-30f5dc59683d service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:03.525893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a5d4e-99f9-45be-abc4-4a5669335002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:03.525893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a5d4e-99f9-45be-abc4-4a5669335002 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.526209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a5d4e-99f9-45be-abc4-4a5669335002 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.526209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a5d4e-99f9-45be-abc4-4a5669335002 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.526901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a5d4e-99f9-45be-abc4-4a5669335002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:03.528822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a5d4e-99f9-45be-abc4-4a5669335002 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:03.558818 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 873/1734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:03.563048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7a07a-9913-4950-8d3b-29b7273f1080 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.563358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7a07a-9913-4950-8d3b-29b7273f1080 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.564620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7a07a-9913-4950-8d3b-29b7273f1080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.590349 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 862/1735] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:03 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:03.591694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30033ad-9230-4620-9a28-ee9f93f0a9fd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.591993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30033ad-9230-4620-9a28-ee9f93f0a9fd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.592256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30033ad-9230-4620-9a28-ee9f93f0a9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.615150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c1b7a07a-9913-4950-8d3b-29b7273f1080 None None] MFA Rules not processed for user `dd3b417af048460da3ef7f6250a9b796`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:03.616702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c1b7a07a-9913-4950-8d3b-29b7273f1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:03.645574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b30033ad-9230-4620-9a28-ee9f93f0a9fd None None] MFA Rules not processed for user `c87fb11072e34ee194e32b634c10b4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:03.648276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b30033ad-9230-4620-9a28-ee9f93f0a9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:03.717191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 874/1736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:03.717191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34f51-f8b1-463d-af3b-4be1f783c892 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.717191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34f51-f8b1-463d-af3b-4be1f783c892 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.717191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34f51-f8b1-463d-af3b-4be1f783c892 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.718583 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 875/1737] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:03.719621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34f51-f8b1-463d-af3b-4be1f783c892 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:03.804039 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 863/1738] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:03.804895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30033ad-9230-4620-9a28-ee9f93f0a9fd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:03.867412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34f51-f8b1-463d-af3b-4be1f783c892 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:03.875648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:03.876786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:03.879156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:03.879593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:03.880684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:03.882912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:03.930108 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 876/1739] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:03 2022] POST /identity/v3/projects => generated 403 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:03.932331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:03.934494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:03.939736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30033ad-9230-4620-9a28-ee9f93f0a9fd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.085156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.086114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.087668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.088158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.092401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.094417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.103663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.107219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.131718 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 864/1740] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:03 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:04.134914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.153926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba809ab-3233-4e27-a920-7233436bb2c7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.160624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.161439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.161792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.162159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.164070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.222139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94b4bd-ea65-4fb0-a605-9837f85661a9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.247622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b215dcc97d474db3a889c74db76eda81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b27eec02e724d94b0f0ec0858bc906d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.248937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.249928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.249928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] PATH_INFO: `/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.252754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorizing `identity:get_project(project_id=1bfb0a0b08e044a28171febe8b4a4d9c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.255895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.266605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.268248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.275540 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 877/1741] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:03 2022] GET /identity/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c => generated 395 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:04.276663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.279361 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 865/1742] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:04.280460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.282310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.296972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a77da7-ccfe-40b2-af08-5bfea8d0cf13 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.302047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.302952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.303369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.303683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] PATH_INFO: `/v3/projects/df9a285949864b4a9f48c4381ffc88d4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.305095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9a285949864b4a9f48c4381ffc88d4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.307161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.334283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef083-f6a5-4013-867f-3ec75f0197f0 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.351326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.352265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.352543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.353446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.354152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.375409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.403995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9a285949864b4a9f48c4381ffc88d4', 'request_id': 'req-7e8253e9-8b16-460d-8c5e-e4a5d885a258'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.415977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9a285949864b4a9f48c4381ffc88d4', 'request_id': 'req-7e8253e9-8b16-460d-8c5e-e4a5d885a258'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.440133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 878/1743] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:04 2022] POST /identity/v3/users => generated 308 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:04.448844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.460726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9a285949864b4a9f48c4381ffc88d4', 'request_id': 'req-7e8253e9-8b16-460d-8c5e-e4a5d885a258'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.491355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29b3d-d53f-4bee-b651-4a6e82bbba74 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.507689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] The token cache is being invalidate because project df9a285949864b4a9f48c4381ffc88d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:04.510024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.518825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.521276 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 866/1744] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:04 2022] DELETE /identity/v3/projects/df9a285949864b4a9f48c4381ffc88d4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:04.526407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.528723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.618476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.619342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.620107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.620503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.622161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.624454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.639240 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 879/1745] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:04.640885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.643865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.643998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8253e9-8b16-460d-8c5e-e4a5d885a258 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.648803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bd7b6-2448-45bf-94c2-50ef381d70d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.649543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd7b6-2448-45bf-94c2-50ef381d70d5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.650371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd7b6-2448-45bf-94c2-50ef381d70d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.650371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd7b6-2448-45bf-94c2-50ef381d70d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.650791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bd7b6-2448-45bf-94c2-50ef381d70d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.652935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bd7b6-2448-45bf-94c2-50ef381d70d5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.665672 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 867/1746] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:04.666876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd38d4-1538-4f20-8363-f4cafd353585 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.669407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd38d4-1538-4f20-8363-f4cafd353585 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.669678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd38d4-1538-4f20-8363-f4cafd353585 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.675747 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 868/1747] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:04.676314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd38d4-1538-4f20-8363-f4cafd353585 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.680805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a1dd38d4-1538-4f20-8363-f4cafd353585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.683225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2f26-5305-4783-ad0c-f4589edaa88e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.688417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.693383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.693826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.694211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] PATH_INFO: `/v3/users/dc9680f4010349b3bc771b2de4fde6e0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.696055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9680f4010349b3bc771b2de4fde6e0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.698330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.701049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd38d4-1538-4f20-8363-f4cafd353585 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.718434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.719167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.719444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.719716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.722755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.731105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.749600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 869/1748] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:04.750816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.767627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7431-8410-45f7-953d-f38902ed276a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:04.775767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9680f4010349b3bc771b2de4fde6e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.776806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9680f4010349b3bc771b2de4fde6e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.778082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:04.783403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.783793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.784078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] PATH_INFO: `/v3/projects/518cfd91210e4869abd01857686570f3/users/73e7a9edf3004ffdad0f6ff3f4432eae/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.789399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9680f4010349b3bc771b2de4fde6e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.811089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9680f4010349b3bc771b2de4fde6e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.812382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-287abb99-ad18-48f5-8efb-bf022e30f316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9680f4010349b3bc771b2de4fde6e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:04.819595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=518cfd91210e4869abd01857686570f3, user_id=73e7a9edf3004ffdad0f6ff3f4432eae, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:04.825856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:04.852412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 880/1749] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:04 2022] DELETE /identity/v3/users/dc9680f4010349b3bc771b2de4fde6e0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:04.855259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:04.855921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:04.857423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:04.858247 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 870/1750] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:04 2022] PUT /identity/v3/projects/518cfd91210e4869abd01857686570f3/users/73e7a9edf3004ffdad0f6ff3f4432eae/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:04.859444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:04.862060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.909307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:04.910596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:04.969248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5b09-71c8-4e74-9dfb-3e932348b26f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:05.064865 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 881/1751] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:55:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:05.066480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:05.068112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:05.127950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:05.129786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.131876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.132706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] PATH_INFO: `/v3/projects/6ee0500c405447a4b728688b79fd44b8/users/56c30591fe4544fab50c8a638e92c5b4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.196230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee0500c405447a4b728688b79fd44b8, user_id=56c30591fe4544fab50c8a638e92c5b4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:05.203864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:05.228553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa293d8-14f4-4e25-86bc-1668965d4e06 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:05.235639 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 871/1752] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:04 2022] PUT /identity/v3/projects/6ee0500c405447a4b728688b79fd44b8/users/56c30591fe4544fab50c8a638e92c5b4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:05.245257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:05.250171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:05.359106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dfa98-84ce-4d95-ac9a-6726c855e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:05.359814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dfa98-84ce-4d95-ac9a-6726c855e985 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.360439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dfa98-84ce-4d95-ac9a-6726c855e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.364747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dfa98-84ce-4d95-ac9a-6726c855e985 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.365603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dfa98-84ce-4d95-ac9a-6726c855e985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:05.368192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dfa98-84ce-4d95-ac9a-6726c855e985 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:05.397019 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 882/1753] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:05.399344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6cb-de78-4ef7-a66b-0f25f3091664 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.399631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6cb-de78-4ef7-a66b-0f25f3091664 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.399907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6cb-de78-4ef7-a66b-0f25f3091664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.406064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377d95-5bb3-4be0-a1bc-88fc342edd15 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:05.416407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:05.417126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.417410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.417682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.459740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ec72c6cb-de78-4ef7-a66b-0f25f3091664 None None] MFA Rules not processed for user `56c30591fe4544fab50c8a638e92c5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:05.460895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec72c6cb-de78-4ef7-a66b-0f25f3091664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:05.589991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:05.591714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:05.592557 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 883/1754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:05.594491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7656-ae65-4cfa-9d33-4509762c9eee None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.595221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7656-ae65-4cfa-9d33-4509762c9eee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.595627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7656-ae65-4cfa-9d33-4509762c9eee None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.597507 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 884/1755] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:05.598496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7656-ae65-4cfa-9d33-4509762c9eee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:05.612760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7656-ae65-4cfa-9d33-4509762c9eee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:05.624173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:05.626180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.626601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.627017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] PATH_INFO: `/v3/projects/518cfd91210e4869abd01857686570f3/users/73e7a9edf3004ffdad0f6ff3f4432eae/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.630958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=518cfd91210e4869abd01857686570f3, user_id=73e7a9edf3004ffdad0f6ff3f4432eae, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:05.635734 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 872/1756] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:05.636748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:05.641450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:05.664859 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 885/1757] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:05 2022] PUT /identity/v3/projects/518cfd91210e4869abd01857686570f3/users/73e7a9edf3004ffdad0f6ff3f4432eae/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:05.666161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:05.668027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:05.677228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78f419-1375-4166-90e2-86600c9b2e5f service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:05.800565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:05.804193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:05.825516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae5cd3-73bf-4684-aaf1-db888b314867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:05.827434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae5cd3-73bf-4684-aaf1-db888b314867 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.827864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae5cd3-73bf-4684-aaf1-db888b314867 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.828812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae5cd3-73bf-4684-aaf1-db888b314867 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.830571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae5cd3-73bf-4684-aaf1-db888b314867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:05.835112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae5cd3-73bf-4684-aaf1-db888b314867 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:05.896476 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 873/1758] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:05 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:05.896677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241762c-a50e-4755-8a50-932731c6b741 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:05.897471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241762c-a50e-4755-8a50-932731c6b741 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:05.898484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241762c-a50e-4755-8a50-932731c6b741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:05.958717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db059-ea10-4146-b08a-f50d4c179fed admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:05.965879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8241762c-a50e-4755-8a50-932731c6b741 None None] MFA Rules not processed for user `73e7a9edf3004ffdad0f6ff3f4432eae`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:05.969001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8241762c-a50e-4755-8a50-932731c6b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:06.168283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:06.169202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.169489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.169761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.186030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:06.193982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:06.205354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 886/1759] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:05 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:06.206604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:06.256306 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 874/1760] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:06.315510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01db2-0f63-4803-aaa4-a5da0738a28d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:06.322095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20c97f-00b1-4d81-8e7c-94f78b2a8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:06.323652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20c97f-00b1-4d81-8e7c-94f78b2a8ccf admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.323939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20c97f-00b1-4d81-8e7c-94f78b2a8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.324264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20c97f-00b1-4d81-8e7c-94f78b2a8ccf admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.324988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20c97f-00b1-4d81-8e7c-94f78b2a8ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:06.327282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20c97f-00b1-4d81-8e7c-94f78b2a8ccf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:06.358471 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 887/1761] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:06 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:06.361760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241762c-a50e-4755-8a50-932731c6b741 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:06.387423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241762c-a50e-4755-8a50-932731c6b741 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:06.399889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:06.402821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.403140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.403882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.405910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:06.412417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:06.421791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374e4f0-6cc0-4a4a-930e-6ec328952b00 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.422120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374e4f0-6cc0-4a4a-930e-6ec328952b00 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.422447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374e4f0-6cc0-4a4a-930e-6ec328952b00 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.426168 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 888/1762] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:06.431868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374e4f0-6cc0-4a4a-930e-6ec328952b00 None None] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:06.442749 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 875/1763] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:06.443782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:06.468199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce645-685a-45b0-828e-76abd192c624 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:06.482192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:06.483163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.483455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.483775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] PATH_INFO: `/v3/projects/951c79be3c884406a6c2cdca21f97cda/users/18efe1470cfa4fba81efede8dc2d1ebf/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.508007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951c79be3c884406a6c2cdca21f97cda, user_id=18efe1470cfa4fba81efede8dc2d1ebf, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:06.512016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:06.538421 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 876/1764] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:06 2022] PUT /identity/v3/projects/951c79be3c884406a6c2cdca21f97cda/users/18efe1470cfa4fba81efede8dc2d1ebf/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:06.540209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:06.551605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:06.597001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374e4f0-6cc0-4a4a-930e-6ec328952b00 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:06.598702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a374e4f0-6cc0-4a4a-930e-6ec328952b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:06.703958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374e4f0-6cc0-4a4a-930e-6ec328952b00 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:06.711366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fdbb1-d22d-42c0-bc9f-ee15b5f87fd6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:06.717583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:06.720726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.720970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.721267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.809868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b215dcc97d474db3a889c74db76eda81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b27eec02e724d94b0f0ec0858bc906d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:06.810791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.812024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.812327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] PATH_INFO: `/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.814933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorizing `identity:get_project(project_id=1bfb0a0b08e044a28171febe8b4a4d9c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:06.823906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:06.837077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 889/1765] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:06 2022] GET /identity/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c => generated 395 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:06.838086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:06.867941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:06.870918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:06.906120 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 877/1766] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:06.907245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:06.909028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:06.959205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d34b-68a9-4ac2-8d96-1e022b9d3baf tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:06.973751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3386d7-6a84-43ad-8942-b95af1742600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:06.974224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3386d7-6a84-43ad-8942-b95af1742600 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:06.974507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3386d7-6a84-43ad-8942-b95af1742600 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:06.974774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3386d7-6a84-43ad-8942-b95af1742600 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:06.975543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3386d7-6a84-43ad-8942-b95af1742600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:06.977326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3386d7-6a84-43ad-8942-b95af1742600 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:07.004435 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 890/1767] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:07.008306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d28e2-829e-4c69-b558-3897f31ce527 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.008596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d28e2-829e-4c69-b558-3897f31ce527 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.008874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d28e2-829e-4c69-b558-3897f31ce527 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.023382 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 891/1768] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:07 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:07.024402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d28e2-829e-4c69-b558-3897f31ce527 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:07.062386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d28e2-829e-4c69-b558-3897f31ce527 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:07.070220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:07.071943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.072473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.072904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] PATH_INFO: `/v3/projects/951c79be3c884406a6c2cdca21f97cda/users/18efe1470cfa4fba81efede8dc2d1ebf/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.078082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9836cc-59b1-4fce-9204-73419d85ff9c service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:07.078501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=951c79be3c884406a6c2cdca21f97cda, user_id=18efe1470cfa4fba81efede8dc2d1ebf, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:07.083136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:07.099371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:07.099749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 892/1769] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:07 2022] PUT /identity/v3/projects/951c79be3c884406a6c2cdca21f97cda/users/18efe1470cfa4fba81efede8dc2d1ebf/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:07.100030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.100311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.100581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.101459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:07.108476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.131742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:07.135775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:07.159253 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 878/1770] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:07.162589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:07.164385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.199597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b79f8-cd7d-442e-a789-d5b36af0abd0 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:07.280042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:07.361814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:07.362782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.363061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.363329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] PATH_INFO: `/v3/projects/5019d4a722184338b9d68039381b4027` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.367923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5019d4a722184338b9d68039381b4027)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:07.371343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:07.425853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31624f31-9932-4cd4-a0c1-5ab7389d28ae admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:07.444601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fd93f-ed98-483b-9613-33b7bc21a9d6 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:07.445751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fd93f-ed98-483b-9613-33b7bc21a9d6 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.446039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fd93f-ed98-483b-9613-33b7bc21a9d6 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.446310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fd93f-ed98-483b-9613-33b7bc21a9d6 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.447750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fd93f-ed98-483b-9613-33b7bc21a9d6 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:07.449948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fd93f-ed98-483b-9613-33b7bc21a9d6 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:07.464929 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 893/1771] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:07 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:07.466523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884cd1b-76a5-4388-88c5-dea08bdc3670 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.466809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884cd1b-76a5-4388-88c5-dea08bdc3670 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.467091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884cd1b-76a5-4388-88c5-dea08bdc3670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.533759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5019d4a722184338b9d68039381b4027', 'request_id': 'req-39f32745-2337-4a49-b028-aae37d7f372a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:07.567532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5019d4a722184338b9d68039381b4027', 'request_id': 'req-39f32745-2337-4a49-b028-aae37d7f372a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:07.598910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5019d4a722184338b9d68039381b4027', 'request_id': 'req-39f32745-2337-4a49-b028-aae37d7f372a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:07.599787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7884cd1b-76a5-4388-88c5-dea08bdc3670 None None] MFA Rules not processed for user `18efe1470cfa4fba81efede8dc2d1ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:07.601025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7884cd1b-76a5-4388-88c5-dea08bdc3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.634175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] The token cache is being invalidate because project 5019d4a722184338b9d68039381b4027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:07.634507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:07.637401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:07.648900 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 879/1772] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:07 2022] DELETE /identity/v3/projects/5019d4a722184338b9d68039381b4027 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:07.648900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:07.648900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.735647 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 894/1773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:07.735647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef923f-655b-488c-9860-6c02d02bcd97 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.735647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef923f-655b-488c-9860-6c02d02bcd97 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.735647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef923f-655b-488c-9860-6c02d02bcd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.763403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f2ef923f-655b-488c-9860-6c02d02bcd97 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:07.767125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f2ef923f-655b-488c-9860-6c02d02bcd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.800339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f32745-2337-4a49-b028-aae37d7f372a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:07.816236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:07.816910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.817363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.818284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.821178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.897512 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 895/1774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:07.897512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e758342-185b-4dc2-aee5-fc7e80efb899 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.897512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e758342-185b-4dc2-aee5-fc7e80efb899 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.897512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e758342-185b-4dc2-aee5-fc7e80efb899 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.899333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 896/1775] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:07.900854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:07.901055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:07.901428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:07.939856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:07.941241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.943916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:07.945654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:07.958747 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 897/1776] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:07.958747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:07.958747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.967214 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 880/1777] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:07.968167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:07.982574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:07.989432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:07.992697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71d98-3534-4814-90e9-5e00f818d9e5 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.005780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.006814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.007105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.007394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.008291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:08.008603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.010579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.054495 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 881/1778] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:08.059944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:08.090745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550111b8-8ec5-4f9d-ad36-206b4df886ce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.106880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.114527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.114527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.114794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.115511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.126736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.156519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e1f4-80dc-4c10-a7d8-e23a3136d9d2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.182532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.183519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.183896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.184268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.185941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.188213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.205845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 882/1780] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:08 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:08.207670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:08.208751 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 898/1780] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:07 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:08.211105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:08.237924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46a932-831a-4b05-adf0-a8473f957856 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.301665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bcfbf-969b-4bd9-ac5a-31d79b876614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.302999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bcfbf-969b-4bd9-ac5a-31d79b876614 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.302999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bcfbf-969b-4bd9-ac5a-31d79b876614 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.303357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bcfbf-969b-4bd9-ac5a-31d79b876614 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.304223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bcfbf-969b-4bd9-ac5a-31d79b876614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.306392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bcfbf-969b-4bd9-ac5a-31d79b876614 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.332550 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 899/1781] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:08 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:08.334866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aeea6-aae7-4603-9cd4-08ec17a69bee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.335356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aeea6-aae7-4603-9cd4-08ec17a69bee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.335656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aeea6-aae7-4603-9cd4-08ec17a69bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.347894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea781d-7cbf-46a0-ae75-46e07d1cbd3c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.356030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f1d02-5a54-43bc-859d-dbc43f139936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.356900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1d02-5a54-43bc-859d-dbc43f139936 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.357304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1d02-5a54-43bc-859d-dbc43f139936 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.357882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1d02-5a54-43bc-859d-dbc43f139936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.360260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-498aeea6-aae7-4603-9cd4-08ec17a69bee None None] MFA Rules not processed for user `c87fb11072e34ee194e32b634c10b4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:08.361594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-498aeea6-aae7-4603-9cd4-08ec17a69bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:08.434370 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 900/1782] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:08.435517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aeea6-aae7-4603-9cd4-08ec17a69bee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:08.441781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1d02-5a54-43bc-859d-dbc43f139936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.443840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1d02-5a54-43bc-859d-dbc43f139936 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.461508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aeea6-aae7-4603-9cd4-08ec17a69bee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.466696 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 883/1783] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:08.469787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fe758-88fb-4952-a264-a1d6dfdf4c5e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.470354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fe758-88fb-4952-a264-a1d6dfdf4c5e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.471389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.471653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fe758-88fb-4952-a264-a1d6dfdf4c5e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.472090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.472379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.472653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.473454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.475212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.476635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 884/1784] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:08.484532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fe758-88fb-4952-a264-a1d6dfdf4c5e None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:08.503736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 901/1785] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:08.509433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:08.521510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fe758-88fb-4952-a264-a1d6dfdf4c5e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:08.524360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-461fe758-88fb-4952-a264-a1d6dfdf4c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:08.537576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e48ce-7675-413c-be0b-9c65a5b5f9b7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.551710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.554101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.555121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.556901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.564102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.566579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.594675 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 902/1786] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:08.598555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:08.619146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540636-acfc-493f-88a0-739816c6f237 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.630765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed549ba-fe9b-474e-86f5-a913643776da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.631967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed549ba-fe9b-474e-86f5-a913643776da admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.633249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed549ba-fe9b-474e-86f5-a913643776da admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.635588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed549ba-fe9b-474e-86f5-a913643776da admin admin] PATH_INFO: `/v3/projects/10c5c17262b94d898c4aaa03102b4dd8/users/111ebd03dde445c99b447894d3ad03e7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.672016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed549ba-fe9b-474e-86f5-a913643776da admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c5c17262b94d898c4aaa03102b4dd8, user_id=111ebd03dde445c99b447894d3ad03e7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.675678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed549ba-fe9b-474e-86f5-a913643776da admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.701513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 903/1787] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:08 2022] PUT /identity/v3/projects/10c5c17262b94d898c4aaa03102b4dd8/users/111ebd03dde445c99b447894d3ad03e7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:08.704576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fe758-88fb-4952-a264-a1d6dfdf4c5e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:08.712326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8bf5-af16-4667-9e81-57250e34fe17 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.713071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8bf5-af16-4667-9e81-57250e34fe17 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.713071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8bf5-af16-4667-9e81-57250e34fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.755046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-04bb8bf5-af16-4667-9e81-57250e34fe17 None None] MFA Rules not processed for user `111ebd03dde445c99b447894d3ad03e7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:08.756204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-04bb8bf5-af16-4667-9e81-57250e34fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:08.840495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b215dcc97d474db3a889c74db76eda81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b27eec02e724d94b0f0ec0858bc906d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:08.843161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:08.843554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:08.843939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] PATH_INFO: `/v3/projects/11512ab5dc41425abfd94276cf39520d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:08.845953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorizing `identity:get_project(project_id=11512ab5dc41425abfd94276cf39520d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:08.851511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:08.856513 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 885/1788] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:08 2022] GET /identity/v3/projects/11512ab5dc41425abfd94276cf39520d => generated 395 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:55:08.861082 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 904/1789] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:08.865915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.042456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89143c3-34ec-47b2-91bf-41d3f363bd31 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.050930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.051680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.051960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.052226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.053678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.060712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.067995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a87055-7c29-41b7-91c7-3d44b1f6f47a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.068321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a87055-7c29-41b7-91c7-3d44b1f6f47a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.068569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a87055-7c29-41b7-91c7-3d44b1f6f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.113956 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 886/1790] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:08 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:55:09.114152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-15a87055-7c29-41b7-91c7-3d44b1f6f47a None None] MFA Rules not processed for user `f4225fb3976e48d79456a0a988a399cf`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:09.114880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.116289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-15a87055-7c29-41b7-91c7-3d44b1f6f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:09.223739 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 905/1791] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:09.224580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a87055-7c29-41b7-91c7-3d44b1f6f47a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.225370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54efe7-fa27-46e1-be01-440a00495cee admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.235711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.236547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.236999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.237825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.240891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:09.310093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a87055-7c29-41b7-91c7-3d44b1f6f47a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.317239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.317945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.318028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.318217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.318488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.319563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.319664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.321621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.329758 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 887/1792] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:09.348093 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 906/1793] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:09 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:09.351998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.364441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7b83e-1b6c-4b25-993d-963b081eb80c service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.374747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.377849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.378202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.378479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.379325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.380967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.394287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 888/1794] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:55:09.403677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.406374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.416866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479195e-0cc3-4ce2-8fe0-f4319a92fc7c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.423694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add7cab-74ed-442c-99e2-ab049db031dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.424352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add7cab-74ed-442c-99e2-ab049db031dd service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.424632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add7cab-74ed-442c-99e2-ab049db031dd service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.424901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add7cab-74ed-442c-99e2-ab049db031dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.426976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4ab9-f813-4855-882b-47c6854dd543 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.427097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8add7cab-74ed-442c-99e2-ab049db031dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:09.433980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.434895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.435179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.435455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] PATH_INFO: `/v3/projects/5ff28b9e122a4051be554e19bdf4d2c9/users/705c703f699a4b0cb5b74e2c55ea56c1/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.452993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff28b9e122a4051be554e19bdf4d2c9, user_id=705c703f699a4b0cb5b74e2c55ea56c1, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.456061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.488199 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 889/1795] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:09 2022] PUT /identity/v3/projects/5ff28b9e122a4051be554e19bdf4d2c9/users/705c703f699a4b0cb5b74e2c55ea56c1/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:09.488199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.489817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:09.507831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add7cab-74ed-442c-99e2-ab049db031dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.509692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add7cab-74ed-442c-99e2-ab049db031dd service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.519195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 907/1796] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:09.520945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79743-085b-4667-b45b-7152213402a0 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.521215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79743-085b-4667-b45b-7152213402a0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.521498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79743-085b-4667-b45b-7152213402a0 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.523322 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 908/1797] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:09.524322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e79743-085b-4667-b45b-7152213402a0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.581297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651a1c-0d71-4596-8acb-1defa3475fdc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.587186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.588372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.588744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.589130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] PATH_INFO: `/v3/users/9b6de40886804ad791f4039382c3747c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.590524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6de40886804ad791f4039382c3747c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.592583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.627329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e79743-085b-4667-b45b-7152213402a0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.633576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.634593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.634908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.635281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.636134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.637941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.662829 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 909/1798] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:09.665829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:55:09.671150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6de40886804ad791f4039382c3747c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:09.671629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6de40886804ad791f4039382c3747c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:09.680204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6de40886804ad791f4039382c3747c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:09.680980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6de40886804ad791f4039382c3747c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:09.702228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6de40886804ad791f4039382c3747c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:09.736522 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 890/1799] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:09 2022] DELETE /identity/v3/users/9b6de40886804ad791f4039382c3747c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:09.737950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.739696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:09.777626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.830124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421c06-2560-4563-a084-9666473ce43d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.838417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be1542-99ff-45db-bf74-411032e4b771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.839349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be1542-99ff-45db-bf74-411032e4b771 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.839936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be1542-99ff-45db-bf74-411032e4b771 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.840230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be1542-99ff-45db-bf74-411032e4b771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.842685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a9be1542-99ff-45db-bf74-411032e4b771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:09.856106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a74d-3a6d-49e4-a612-a534d25d61a7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:09.916423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ab387d2da84f82ac0359cb62843dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e980dea4e70f4eb0aa552688239f757c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:09.917399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.917812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.917967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:09.919143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.921472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.922603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be1542-99ff-45db-bf74-411032e4b771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:09.924166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be1542-99ff-45db-bf74-411032e4b771 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:09.925117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 910/1800] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:55:09 2022] GET /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 383 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:09.926213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:09.928024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:09.954285 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 891/1801] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:09.955833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078f0c-2d74-413e-8d7a-0325f5892581 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:09.956058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078f0c-2d74-413e-8d7a-0325f5892581 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:09.956352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078f0c-2d74-413e-8d7a-0325f5892581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.001637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-55078f0c-2d74-413e-8d7a-0325f5892581 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:10.003138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-55078f0c-2d74-413e-8d7a-0325f5892581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.036152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b7122-f848-4622-a464-9cfba7a148ed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:10.045269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8328f2b-ce1f-4942-8d1a-f518d36edf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:10.046421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328f2b-ce1f-4942-8d1a-f518d36edf10 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:10.046794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328f2b-ce1f-4942-8d1a-f518d36edf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:10.047161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328f2b-ce1f-4942-8d1a-f518d36edf10 admin admin] PATH_INFO: `/v3/projects/5ff28b9e122a4051be554e19bdf4d2c9/users/705c703f699a4b0cb5b74e2c55ea56c1/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.049555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328f2b-ce1f-4942-8d1a-f518d36edf10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff28b9e122a4051be554e19bdf4d2c9, user_id=705c703f699a4b0cb5b74e2c55ea56c1, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:10.067163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328f2b-ce1f-4942-8d1a-f518d36edf10 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:10.105082 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 911/1802] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:09 2022] PUT /identity/v3/projects/5ff28b9e122a4051be554e19bdf4d2c9/users/705c703f699a4b0cb5b74e2c55ea56c1/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:10.105082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:10.105082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:10.105082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.134307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:10.136302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.157517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 892/1803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:10.159241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:10.160726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:10.161244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.244545 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 912/1804] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:10.254636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] MFA Rules not processed for user `705c703f699a4b0cb5b74e2c55ea56c1`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:10.257875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:10.258520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.268760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.435509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37aadc-1022-43dd-8e5f-472449734377 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:10.447620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:10.448327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:10.448608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:10.448881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.469439 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 893/1805] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:10.469439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:10.470852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.539275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:10.541109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:10.553592 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 913/1806] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:10.554775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:10.556598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.576045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb1150-a2bb-47d8-81aa-07ca771c5ee6 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:10.583084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:10.584047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:10.584402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:10.584735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] PATH_INFO: `/v3/users/b41bdd61ec4043b8ab68c53117601467` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.586252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41bdd61ec4043b8ab68c53117601467)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:10.588385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:10.667255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41bdd61ec4043b8ab68c53117601467'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.668780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f37b67-1a65-4673-9528-b7750f8a9e2d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:10.670435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41bdd61ec4043b8ab68c53117601467'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.680587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:10.685462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:10.686155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:10.686625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] PATH_INFO: `/v3/users/c87fb11072e34ee194e32b634c10b4a8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.690852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87fb11072e34ee194e32b634c10b4a8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:10.694097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:10.698557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41bdd61ec4043b8ab68c53117601467'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.722516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41bdd61ec4043b8ab68c53117601467'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.725718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41bdd61ec4043b8ab68c53117601467'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.774139 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 914/1807] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:10 2022] DELETE /identity/v3/users/b41bdd61ec4043b8ab68c53117601467 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:10.775030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:10.783321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.827253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87fb11072e34ee194e32b634c10b4a8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.829001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87fb11072e34ee194e32b634c10b4a8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.852553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87fb11072e34ee194e32b634c10b4a8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.853957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87fb11072e34ee194e32b634c10b4a8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.872896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5480ad40-5e60-456d-9fd5-654a83f1082b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87fb11072e34ee194e32b634c10b4a8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:10.903674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 894/1808] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:10 2022] DELETE /identity/v3/users/c87fb11072e34ee194e32b634c10b4a8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:10.903674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebecb8-8e26-4218-9d37-69d41e04363a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:10.903674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebecb8-8e26-4218-9d37-69d41e04363a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:10.903674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebecb8-8e26-4218-9d37-69d41e04363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:10.924272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e5ebecb8-8e26-4218-9d37-69d41e04363a None None] MFA Rules not processed for user `111ebd03dde445c99b447894d3ad03e7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:10.925922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e5ebecb8-8e26-4218-9d37-69d41e04363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:10.929902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7178-cb55-401a-a018-a16a2050a2d9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:11.001128 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 895/1809] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:11.002638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:11.002993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:11.003348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:11.027292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:11.028864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.062708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99100-2cfa-4d0e-b7ae-82f825ece2af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:11.066446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99100-2cfa-4d0e-b7ae-82f825ece2af service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:11.066824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99100-2cfa-4d0e-b7ae-82f825ece2af service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:11.067091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99100-2cfa-4d0e-b7ae-82f825ece2af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:11.072448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-05e99100-2cfa-4d0e-b7ae-82f825ece2af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.111556 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 896/1810] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:11.112603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:11.114392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.129562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0712f-2c3e-4b4d-be24-96186b1ab32e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:11.137114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:11.137849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:11.138130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:11.138406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] PATH_INFO: `/v3/users/56c30591fe4544fab50c8a638e92c5b4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:11.143564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c30591fe4544fab50c8a638e92c5b4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:11.149011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:11.240360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e99100-2cfa-4d0e-b7ae-82f825ece2af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:11.246282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e99100-2cfa-4d0e-b7ae-82f825ece2af service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:11.269022 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 915/1811] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 20:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:11.272541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:11.273570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:11.273896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:11.287968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c30591fe4544fab50c8a638e92c5b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:11.290530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c30591fe4544fab50c8a638e92c5b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:11.303946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c30591fe4544fab50c8a638e92c5b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:11.305017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c30591fe4544fab50c8a638e92c5b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:11.356196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:11.356196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.370173 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 916/1812] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:11.371157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:11.372994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.376693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c30591fe4544fab50c8a638e92c5b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:11.428089 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 897/1813] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:11 2022] DELETE /identity/v3/users/56c30591fe4544fab50c8a638e92c5b4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:11.429198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:11.439974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.576156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2972b03-ccb8-498e-86f3-67b5db7bcac4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:11.578035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:11.580127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:11.580409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:11.580687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:11.585846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.650985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed221fa-4de5-4c14-b8d6-0438c4f81d13 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:11.744987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:11.746498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:11.774944 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 898/1814] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:11.776005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:11.777396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.807441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c494db-9273-4107-a1a3-06252aebc565 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:11.832117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:11.833048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:11.833343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:11.833615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] PATH_INFO: `/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:11.834993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfb0a0b08e044a28171febe8b4a4d9c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:11.836955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:11.892253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799c4c7-cfb2-41ab-9437-de440cc09cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:11.897980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c4c7-cfb2-41ab-9437-de440cc09cbd service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:11.898321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c4c7-cfb2-41ab-9437-de440cc09cbd service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:11.898645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c4c7-cfb2-41ab-9437-de440cc09cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:11.906142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2799c4c7-cfb2-41ab-9437-de440cc09cbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:11.973432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfb0a0b08e044a28171febe8b4a4d9c', 'request_id': 'req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:11.988831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfb0a0b08e044a28171febe8b4a4d9c', 'request_id': 'req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.006239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfb0a0b08e044a28171febe8b4a4d9c', 'request_id': 'req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.033193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] The token cache is being invalidate because project 1bfb0a0b08e044a28171febe8b4a4d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:12.033486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.034176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.037475 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 899/1815] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:11 2022] DELETE /identity/v3/projects/1bfb0a0b08e044a28171febe8b4a4d9c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:12.041708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:12.061945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:12.182003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799c4c7-cfb2-41ab-9437-de440cc09cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:12.186294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799c4c7-cfb2-41ab-9437-de440cc09cbd service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:12.227172 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 917/1816] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 856 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:12.230690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4c123-c0ff-412f-9002-3d415fa4e9b2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:12.234370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4c123-c0ff-412f-9002-3d415fa4e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:12.234804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4c123-c0ff-412f-9002-3d415fa4e9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:12.265900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e39758-d525-4a9d-a8cb-7c1d39b1a29f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:12.272196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:12.273192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:12.273702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:12.274200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:12.276411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:12.288168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b0b4c123-c0ff-412f-9002-3d415fa4e9b2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:12.289932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0b4c123-c0ff-412f-9002-3d415fa4e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:12.458872 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 918/1817] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:12.460332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4dcf-712d-44ed-9e80-7da372994fa1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:12.460616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4dcf-712d-44ed-9e80-7da372994fa1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:12.465273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4dcf-712d-44ed-9e80-7da372994fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:12.492066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:12.493619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:12.513402 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 900/1818] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:12.514352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:12.516122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:12.537318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da6f50-84e5-4c7f-812b-b747f180d7bd service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:12.543911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:12.544477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:12.544756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:12.545411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] PATH_INFO: `/v3/users/b215dcc97d474db3a889c74db76eda81` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:12.548070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b215dcc97d474db3a889c74db76eda81)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:12.570663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:12.609351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-374d4dcf-712d-44ed-9e80-7da372994fa1 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:12.610971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-374d4dcf-712d-44ed-9e80-7da372994fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:12.629299 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 919/1819] 10.222.0.32 () {58 vars in 1015 bytes} [Sat Apr 9 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:12.630325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d4dcf-712d-44ed-9e80-7da372994fa1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:12.650785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d4dcf-712d-44ed-9e80-7da372994fa1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:12.659758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:12.661467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:12.662638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:12.664766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:12.684262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:12.686321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:12.700962 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 920/1820] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:12.702762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:12.715970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b215dcc97d474db3a889c74db76eda81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.716682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b215dcc97d474db3a889c74db76eda81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.719505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a69e-62d1-49bc-b984-3a4d1e85ae51 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:12.729198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:12.730018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:12.730368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b215dcc97d474db3a889c74db76eda81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.731135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b215dcc97d474db3a889c74db76eda81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.733259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:12.733640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:12.739284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:12.745149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b215dcc97d474db3a889c74db76eda81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:12.773966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:12.775642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:12.785341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 901/1821] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:12 2022] DELETE /identity/v3/users/b215dcc97d474db3a889c74db76eda81 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:12.800389 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 921/1822] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:13.748167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:13.750220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:14.010359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363765e1-53d5-4d1a-98a3-8f703fce3412 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:14.016335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:14.017730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:14.018025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:14.018613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] PATH_INFO: `/v3/projects/7b27eec02e724d94b0f0ec0858bc906d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:14.019901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b27eec02e724d94b0f0ec0858bc906d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:14.022097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:14.089182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:14.091929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:14.126438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b27eec02e724d94b0f0ec0858bc906d', 'request_id': 'req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.126821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28325486-2b60-4439-89b7-5cd163aaa811 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:14.143903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b27eec02e724d94b0f0ec0858bc906d', 'request_id': 'req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.158965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b27eec02e724d94b0f0ec0858bc906d', 'request_id': 'req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.189517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] The token cache is being invalidate because project 7b27eec02e724d94b0f0ec0858bc906d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:14.189843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.190505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.192333 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 902/1823] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:13 2022] DELETE /identity/v3/projects/7b27eec02e724d94b0f0ec0858bc906d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:14.196400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:14.197865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:14.257276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:14.258186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:14.258470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:14.258747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] PATH_INFO: `/v3/projects/c16b0ae6fece49df9063907aa97f8639` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:14.265507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16b0ae6fece49df9063907aa97f8639)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:14.271542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:14.377795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecfd3d-0b01-43cc-a971-d114ba2cc1b9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:14.402661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16b0ae6fece49df9063907aa97f8639', 'request_id': 'req-6c08addd-9c8a-4479-badc-2bf1002424b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.423746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16b0ae6fece49df9063907aa97f8639', 'request_id': 'req-6c08addd-9c8a-4479-badc-2bf1002424b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.448896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16b0ae6fece49df9063907aa97f8639', 'request_id': 'req-6c08addd-9c8a-4479-badc-2bf1002424b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.489672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] The token cache is being invalidate because project c16b0ae6fece49df9063907aa97f8639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:14.489982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.492085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.495728 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 922/1824] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:14 2022] DELETE /identity/v3/projects/c16b0ae6fece49df9063907aa97f8639 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:14.502031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:14.509342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:14.596043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:14.596043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:14.596043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:14.596043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] PATH_INFO: `/v3/users/9a9210afd68b4af0b9c5a2e439871395` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:14.596556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9210afd68b4af0b9c5a2e439871395)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:14.604968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:14.759209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08addd-9c8a-4479-badc-2bf1002424b4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:14.775135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9210afd68b4af0b9c5a2e439871395'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.776513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9210afd68b4af0b9c5a2e439871395'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.778787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:14.779741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:14.780052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:14.783066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] PATH_INFO: `/v3/users/73e7a9edf3004ffdad0f6ff3f4432eae` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:14.787794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e7a9edf3004ffdad0f6ff3f4432eae)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:14.806702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:14.816242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9210afd68b4af0b9c5a2e439871395'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.817459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9210afd68b4af0b9c5a2e439871395'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.845869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9210afd68b4af0b9c5a2e439871395'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.923579 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 903/1825] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:14 2022] DELETE /identity/v3/users/9a9210afd68b4af0b9c5a2e439871395 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:14.983344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e7a9edf3004ffdad0f6ff3f4432eae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:14.986105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e7a9edf3004ffdad0f6ff3f4432eae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:15.000891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e7a9edf3004ffdad0f6ff3f4432eae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:15.024043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e7a9edf3004ffdad0f6ff3f4432eae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:15.025289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e7a9edf3004ffdad0f6ff3f4432eae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:15.064253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 923/1826] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:14 2022] DELETE /identity/v3/users/73e7a9edf3004ffdad0f6ff3f4432eae => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:15.803153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:15.805523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:15.971940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b870-c942-4736-a6ff-3805e4dedb78 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:15.987542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:15.988962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:16.109264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:16.110956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:16.111451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:16.112013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] PATH_INFO: `/v3/projects/a22480ed945441e39568d90ae3891421` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:16.114119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22480ed945441e39568d90ae3891421)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:16.117705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:16.176971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d5d56-5786-4f4e-9c2e-c305e57c0cd3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:16.210835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22480ed945441e39568d90ae3891421', 'request_id': 'req-35aad255-a0ef-49a6-8c1c-ebd340970057'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.255951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22480ed945441e39568d90ae3891421', 'request_id': 'req-35aad255-a0ef-49a6-8c1c-ebd340970057'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.281748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22480ed945441e39568d90ae3891421', 'request_id': 'req-35aad255-a0ef-49a6-8c1c-ebd340970057'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.348939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] The token cache is being invalidate because project a22480ed945441e39568d90ae3891421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:16.352163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.372027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.381340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 904/1827] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:15 2022] DELETE /identity/v3/projects/a22480ed945441e39568d90ae3891421 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:16.383389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:16.388785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:16.400612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:16.401563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:16.401846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:16.402154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] PATH_INFO: `/v3/projects/11512ab5dc41425abfd94276cf39520d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:16.406005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11512ab5dc41425abfd94276cf39520d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:16.408011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:16.455464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aad255-a0ef-49a6-8c1c-ebd340970057 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:16.503874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:16.506279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:16.506578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:16.507998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] PATH_INFO: `/v3/projects/6ee0500c405447a4b728688b79fd44b8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:16.518659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee0500c405447a4b728688b79fd44b8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:16.526871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:16.546313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11512ab5dc41425abfd94276cf39520d', 'request_id': 'req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.567918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11512ab5dc41425abfd94276cf39520d', 'request_id': 'req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.588458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11512ab5dc41425abfd94276cf39520d', 'request_id': 'req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.620512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] The token cache is being invalidate because project 11512ab5dc41425abfd94276cf39520d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:16.620899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.621699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-57d90f9a-b78c-4ea5-983b-e92aa3e3889f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.627616 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 924/1828] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:15 2022] DELETE /identity/v3/projects/11512ab5dc41425abfd94276cf39520d => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:16.629476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:16.632110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:16.632244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:16.669954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] MFA Rules not processed for user `2d51c9bfc0124777b559e1d2cd1e2d50`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:16.673080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:16.692742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee0500c405447a4b728688b79fd44b8', 'request_id': 'req-7af45621-473a-4d88-8af4-94d79990b7f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.713429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee0500c405447a4b728688b79fd44b8', 'request_id': 'req-7af45621-473a-4d88-8af4-94d79990b7f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.729973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee0500c405447a4b728688b79fd44b8', 'request_id': 'req-7af45621-473a-4d88-8af4-94d79990b7f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.762611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] The token cache is being invalidate because project 6ee0500c405447a4b728688b79fd44b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:16.762896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.765645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.777556 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 905/1829] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:16 2022] DELETE /identity/v3/projects/6ee0500c405447a4b728688b79fd44b8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:16.777556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:16.787736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:16.810190 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 925/1830] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:16.811578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:16.814024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:16.875391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af45621-473a-4d88-8af4-94d79990b7f4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:16.881961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:16.883033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:16.883446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:16.885578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] PATH_INFO: `/v3/users/e3ab387d2da84f82ac0359cb62843dc0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:16.887623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ab387d2da84f82ac0359cb62843dc0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:16.890143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:16.961282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e4d0-269d-4fc0-8813-5c66008641bd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:16.967694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:16.969083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:16.969579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:16.970075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] PATH_INFO: `/v3/projects/518cfd91210e4869abd01857686570f3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:16.971573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=518cfd91210e4869abd01857686570f3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:16.974129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:16.974464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ab387d2da84f82ac0359cb62843dc0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.975208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ab387d2da84f82ac0359cb62843dc0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.992405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ab387d2da84f82ac0359cb62843dc0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:16.994104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ab387d2da84f82ac0359cb62843dc0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.006237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-98db71be-23f6-443c-a00f-6b8e3499391d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ab387d2da84f82ac0359cb62843dc0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.040906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518cfd91210e4869abd01857686570f3', 'request_id': 'req-6f095423-b98f-40bc-8846-0ab039bdabf7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.052557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518cfd91210e4869abd01857686570f3', 'request_id': 'req-6f095423-b98f-40bc-8846-0ab039bdabf7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.064054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518cfd91210e4869abd01857686570f3', 'request_id': 'req-6f095423-b98f-40bc-8846-0ab039bdabf7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.082200 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 906/1831] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:16 2022] DELETE /identity/v3/users/e3ab387d2da84f82ac0359cb62843dc0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:17.084967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e193-cbfa-46dc-8292-abc392c4596b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.084967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e193-cbfa-46dc-8292-abc392c4596b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.084967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e193-cbfa-46dc-8292-abc392c4596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.114930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] The token cache is being invalidate because project 518cfd91210e4869abd01857686570f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:17.118669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.120153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ab78e193-cbfa-46dc-8292-abc392c4596b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:17.120802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.121598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab78e193-cbfa-46dc-8292-abc392c4596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.127065 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 926/1832] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:16 2022] DELETE /identity/v3/projects/518cfd91210e4869abd01857686570f3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:17.128263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:17.133428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.278841 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 907/1833] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:17.280629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221b6d-c129-4940-af83-b9985a62f6da None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.281196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221b6d-c129-4940-af83-b9985a62f6da None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.281673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221b6d-c129-4940-af83-b9985a62f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.354114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e0221b6d-c129-4940-af83-b9985a62f6da None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:17.362693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e0221b6d-c129-4940-af83-b9985a62f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.379824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f095423-b98f-40bc-8846-0ab039bdabf7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:17.393908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:17.394844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.395120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.395389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] PATH_INFO: `/v3/users/18efe1470cfa4fba81efede8dc2d1ebf` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.397871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=18efe1470cfa4fba81efede8dc2d1ebf)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:17.400576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:17.500936 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 908/1834] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:17.507424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9192c4-d463-4739-9281-b5dd35cb6249 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.507885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9192c4-d463-4739-9281-b5dd35cb6249 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.508251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9192c4-d463-4739-9281-b5dd35cb6249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.525308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18efe1470cfa4fba81efede8dc2d1ebf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.526817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18efe1470cfa4fba81efede8dc2d1ebf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.548983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18efe1470cfa4fba81efede8dc2d1ebf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.569256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1a9192c4-d463-4739-9281-b5dd35cb6249 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:17.570802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1a9192c4-d463-4739-9281-b5dd35cb6249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.580390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18efe1470cfa4fba81efede8dc2d1ebf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.581183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18efe1470cfa4fba81efede8dc2d1ebf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:17.586903 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 909/1835] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:17.588541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f47d5-7391-433f-8ec5-2dc14581bf47 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.589064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f47d5-7391-433f-8ec5-2dc14581bf47 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.589557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f47d5-7391-433f-8ec5-2dc14581bf47 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.591278 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 910/1836] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:17.596426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d76515-02e3-4beb-b83a-5b200b9bb6bd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.597149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d76515-02e3-4beb-b83a-5b200b9bb6bd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.606078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d76515-02e3-4beb-b83a-5b200b9bb6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.639694 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 927/1837] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:17 2022] DELETE /identity/v3/users/18efe1470cfa4fba81efede8dc2d1ebf => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:17.640796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:17.643337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.645989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d5d76515-02e3-4beb-b83a-5b200b9bb6bd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:17.649472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d5d76515-02e3-4beb-b83a-5b200b9bb6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.833637 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 911/1838] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:17.833637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db0825-0e27-4fb3-9bee-32816c83d73c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.833637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db0825-0e27-4fb3-9bee-32816c83d73c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.833637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db0825-0e27-4fb3-9bee-32816c83d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.878532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f2db0825-0e27-4fb3-9bee-32816c83d73c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:17.879915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dccf3-57a1-494e-a660-a2f8324c98fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:17.880058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2db0825-0e27-4fb3-9bee-32816c83d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.886131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:17.887043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.887481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.888788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.894687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:17.916457 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 912/1839] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:17.916457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd24b5-71ab-4780-893c-1da51018f60a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:17.916457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd24b5-71ab-4780-893c-1da51018f60a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:17.916457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd24b5-71ab-4780-893c-1da51018f60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:17.942498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a3dd24b5-71ab-4780-893c-1da51018f60a None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:17.943790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3dd24b5-71ab-4780-893c-1da51018f60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:18.067782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:18.070749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:18.085926 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 928/1840] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 20:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:18.087045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:18.113629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daf0c0-88c6-42dc-a2bd-3531d7604df4 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:18.136731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:18.137483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:18.137765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:18.138040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:18.138797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:18.139073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:18.140791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:18.170888 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 929/1841] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:18.171950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:18.196132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697d8e-492f-4d8a-b9a3-5d04310f21f9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:18.212457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:18.212913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:18.213980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:18.214301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:18.215057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:18.215367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:18.222922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:18.249342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 930/1842] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:18.250342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:18.252235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:18.262792 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 913/1843] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:18.263876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd24b5-71ab-4780-893c-1da51018f60a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:18.269146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d45df-57dd-43ab-9dd8-828a10aee961 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:18.274684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:18.275889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:18.276347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:18.276790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] PATH_INFO: `/v3/projects/e980dea4e70f4eb0aa552688239f757c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:18.279683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e980dea4e70f4eb0aa552688239f757c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:18.282431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:18.313277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd24b5-71ab-4780-893c-1da51018f60a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:18.337840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:18.338615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:18.338959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:18.339298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:18.340098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:18.343221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:18.380356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e980dea4e70f4eb0aa552688239f757c', 'request_id': 'req-4270b575-20a1-49fe-b7e4-4c274454f40c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:18.395143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e980dea4e70f4eb0aa552688239f757c', 'request_id': 'req-4270b575-20a1-49fe-b7e4-4c274454f40c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:18.414450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e980dea4e70f4eb0aa552688239f757c', 'request_id': 'req-4270b575-20a1-49fe-b7e4-4c274454f40c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:18.425555 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 914/1844] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:18 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:18.430654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:18.465027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] The token cache is being invalidate because project e980dea4e70f4eb0aa552688239f757c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:18.465417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:18.466223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:18.477418 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 931/1845] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:18 2022] DELETE /identity/v3/projects/e980dea4e70f4eb0aa552688239f757c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:18.486399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:18.489633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:18.595235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5774c0-11e2-466d-9d58-440f4671e80b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:18.619094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:18.620006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:18.620386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:18.626039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:18.638176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:18.643373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:18.666487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270b575-20a1-49fe-b7e4-4c274454f40c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:18.685168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bc5f6-8bf4-4c01-8ca4-4dd6ca361f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:18.686052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc5f6-8bf4-4c01-8ca4-4dd6ca361f71 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:18.686501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc5f6-8bf4-4c01-8ca4-4dd6ca361f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:18.686837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc5f6-8bf4-4c01-8ca4-4dd6ca361f71 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:18.687551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bc5f6-8bf4-4c01-8ca4-4dd6ca361f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:18.690130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bc5f6-8bf4-4c01-8ca4-4dd6ca361f71 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:18.764015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 932/1846] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:18 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:18.766102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77136-8a55-4c28-8a2a-cfbce89590f3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:18.766393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77136-8a55-4c28-8a2a-cfbce89590f3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:18.766669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77136-8a55-4c28-8a2a-cfbce89590f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:18.770197 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 915/1847] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:18 2022] POST /identity/v3/projects => generated 395 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:18.774716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:18.778527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:18.832891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-92e77136-8a55-4c28-8a2a-cfbce89590f3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:18.835781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-92e77136-8a55-4c28-8a2a-cfbce89590f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:18.987423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49f409-8439-454a-b7c8-81fbe7948e52 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:18.997509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.000581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.001640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.002067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] PATH_INFO: `/v3/projects/951c79be3c884406a6c2cdca21f97cda` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.003932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=951c79be3c884406a6c2cdca21f97cda)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.006428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.018052 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 933/1848] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:19.019547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77136-8a55-4c28-8a2a-cfbce89590f3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.036577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77136-8a55-4c28-8a2a-cfbce89590f3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:19.043678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.046316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.046769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.047055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.047861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.050602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.067224 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 934/1849] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:19.068215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.083278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.101663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951c79be3c884406a6c2cdca21f97cda', 'request_id': 'req-b010bb7b-e294-42a3-a919-e15c019ac30c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:19.110199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951c79be3c884406a6c2cdca21f97cda', 'request_id': 'req-b010bb7b-e294-42a3-a919-e15c019ac30c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:19.130873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951c79be3c884406a6c2cdca21f97cda', 'request_id': 'req-b010bb7b-e294-42a3-a919-e15c019ac30c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:19.138330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b76ec6-2068-4358-92c5-0c0de84b06a2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:19.160443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] The token cache is being invalidate because project 951c79be3c884406a6c2cdca21f97cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:19.160964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:19.161916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:19.168393 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 916/1850] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:18 2022] DELETE /identity/v3/projects/951c79be3c884406a6c2cdca21f97cda => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:19.169420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.171105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.320700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87077a5-8630-4a16-b6e2-b710cd24e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.322060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87077a5-8630-4a16-b6e2-b710cd24e6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.322509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87077a5-8630-4a16-b6e2-b710cd24e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.322888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87077a5-8630-4a16-b6e2-b710cd24e6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.323855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87077a5-8630-4a16-b6e2-b710cd24e6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.336510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87077a5-8630-4a16-b6e2-b710cd24e6a2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.367402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010bb7b-e294-42a3-a919-e15c019ac30c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:19.386744 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 935/1851] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:19 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:19.386947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.388116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.388413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.389631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defbc17-206a-4433-9d0a-0c9f98bd5d28 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.390175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defbc17-206a-4433-9d0a-0c9f98bd5d28 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.390542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defbc17-206a-4433-9d0a-0c9f98bd5d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.390880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.396697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.437104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.440965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.443579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3defbc17-206a-4433-9d0a-0c9f98bd5d28 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:19.450964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3defbc17-206a-4433-9d0a-0c9f98bd5d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.463048 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 917/1852] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:19.463882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.465581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.472106 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 936/1853] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:19.473259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19aa9-98bf-441a-b914-9ceead72ba19 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.473545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19aa9-98bf-441a-b914-9ceead72ba19 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.473819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19aa9-98bf-441a-b914-9ceead72ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.482759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e361-2568-4611-9688-700b9ebcaa92 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:19.502841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.503775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.504497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.505452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.507053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.510951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.522365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2fe19aa9-98bf-441a-b914-9ceead72ba19 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:19.523998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2fe19aa9-98bf-441a-b914-9ceead72ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.531867 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 918/1854] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:19.533454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.536096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.549802 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 937/1855] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:19.552974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19aa9-98bf-441a-b914-9ceead72ba19 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.575089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f84f-dd54-4325-87e1-6240cbae5362 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:19.581371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19aa9-98bf-441a-b914-9ceead72ba19 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:19.587532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.588230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.588516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.588785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.589624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.591293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.607882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728e91-208a-4e5f-9138-a5438cb4ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.609005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728e91-208a-4e5f-9138-a5438cb4ee92 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.609320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728e91-208a-4e5f-9138-a5438cb4ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.609600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728e91-208a-4e5f-9138-a5438cb4ee92 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.610704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728e91-208a-4e5f-9138-a5438cb4ee92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:19.611148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728e91-208a-4e5f-9138-a5438cb4ee92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.619703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728e91-208a-4e5f-9138-a5438cb4ee92 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.639272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 919/1856] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:19.640954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.643992 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 938/1857] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:19.645530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec714-da45-43b5-b4ba-c1d0e3180ef3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.646375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec714-da45-43b5-b4ba-c1d0e3180ef3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.646757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec714-da45-43b5-b4ba-c1d0e3180ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.654019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6df33-18e4-4f39-aeb8-77f2e1d9449f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:19.664067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:19.665187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:19.665612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:19.665975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] PATH_INFO: `/v3/projects/eb2447d5bc83456ab7bd6a3878bcaaa8/users/21b8a2de5b20457dadb5a3b610cd6d9b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:19.704466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2447d5bc83456ab7bd6a3878bcaaa8, user_id=21b8a2de5b20457dadb5a3b610cd6d9b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:19.709020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:19.723651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-43eec714-da45-43b5-b4ba-c1d0e3180ef3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:19.726446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-43eec714-da45-43b5-b4ba-c1d0e3180ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:19.748001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 920/1858] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:19 2022] PUT /identity/v3/projects/eb2447d5bc83456ab7bd6a3878bcaaa8/users/21b8a2de5b20457dadb5a3b610cd6d9b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:19.750715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.946868 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 939/1859] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:19.948942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eec714-da45-43b5-b4ba-c1d0e3180ef3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:19.997117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eec714-da45-43b5-b4ba-c1d0e3180ef3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.009725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905f0b-bf4a-4149-9c9b-4570788c5b03 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.013322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460f58e-16b5-4bfe-8793-8163a27c9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.014068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460f58e-16b5-4bfe-8793-8163a27c9a0f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.014370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460f58e-16b5-4bfe-8793-8163a27c9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.014635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460f58e-16b5-4bfe-8793-8163a27c9a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.015350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460f58e-16b5-4bfe-8793-8163a27c9a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.017670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460f58e-16b5-4bfe-8793-8163a27c9a0f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.034865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b077-69fc-4082-a882-5db6bd3f3665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.038612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b077-69fc-4082-a882-5db6bd3f3665 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.038898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b077-69fc-4082-a882-5db6bd3f3665 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.039376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b077-69fc-4082-a882-5db6bd3f3665 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.040657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b077-69fc-4082-a882-5db6bd3f3665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.062459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b077-69fc-4082-a882-5db6bd3f3665 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.085929 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 940/1860] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:19 2022] POST /identity/v3/projects => generated 407 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:20.088395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8842-72ec-4dc6-8dd1-43bbe442421a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.088777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8842-72ec-4dc6-8dd1-43bbe442421a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.089479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8842-72ec-4dc6-8dd1-43bbe442421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.115646 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 921/1861] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:20.122547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26914d-ab02-4f8f-8a54-e8723bb8f333 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.124515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26914d-ab02-4f8f-8a54-e8723bb8f333 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.125158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26914d-ab02-4f8f-8a54-e8723bb8f333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.160361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-57ac8842-72ec-4dc6-8dd1-43bbe442421a None None] MFA Rules not processed for user `21b8a2de5b20457dadb5a3b610cd6d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:20.162868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-57ac8842-72ec-4dc6-8dd1-43bbe442421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:20.177134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ba26914d-ab02-4f8f-8a54-e8723bb8f333 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:20.178538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba26914d-ab02-4f8f-8a54-e8723bb8f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:20.298947 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 922/1862] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:20.299845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26914d-ab02-4f8f-8a54-e8723bb8f333 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.329315 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 941/1863] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:20.329315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8842-72ec-4dc6-8dd1-43bbe442421a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.411192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8842-72ec-4dc6-8dd1-43bbe442421a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.420825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26914d-ab02-4f8f-8a54-e8723bb8f333 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.424050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.424866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.425214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.425487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.426423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.428877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.429275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.430046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.430930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.431214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.432075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:20.432766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.435251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.469215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 923/1864] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:20.470836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.480415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 942/1865] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/users => generated 304 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:20.482047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.487058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21da4e-317f-4ebb-9612-4a043ba0e4bb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.493799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.494910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.495191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.495536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] PATH_INFO: `/v3/projects/4c5056fc922845399c2d04bca2e27d84/users/ac91f0e4b0e54c488d21875005061048/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.510762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4777f-83f3-40f2-b206-90a346c114d5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.530121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.534271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.534812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.535093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.535970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.536244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5056fc922845399c2d04bca2e27d84, user_id=ac91f0e4b0e54c488d21875005061048, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.538897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.540072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.570790 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 924/1866] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:20 2022] PUT /identity/v3/projects/4c5056fc922845399c2d04bca2e27d84/users/ac91f0e4b0e54c488d21875005061048/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:20.570790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.581290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:20.585196 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 943/1867] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:20.586251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.668011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd33a-ef50-4e3c-b633-3a35991637ad admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.673108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c6cf7-7814-447e-8769-fde3e1d3091a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.674124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.675128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.675642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.676167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.677679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.679426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.716523 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 944/1868] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:20.717875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.762202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172fa03-4a0f-4a3d-aed0-ba34d746a208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.763148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172fa03-4a0f-4a3d-aed0-ba34d746a208 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.763786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172fa03-4a0f-4a3d-aed0-ba34d746a208 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.764235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172fa03-4a0f-4a3d-aed0-ba34d746a208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.777505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172fa03-4a0f-4a3d-aed0-ba34d746a208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.779454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172fa03-4a0f-4a3d-aed0-ba34d746a208 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.792587 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 925/1869] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:20.795079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5767ba-59d6-4519-8d3e-418c4c9401c4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.795607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5767ba-59d6-4519-8d3e-418c4c9401c4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.796118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5767ba-59d6-4519-8d3e-418c4c9401c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.842656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8d5767ba-59d6-4519-8d3e-418c4c9401c4 None None] MFA Rules not processed for user `ac91f0e4b0e54c488d21875005061048`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:20.844651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d5767ba-59d6-4519-8d3e-418c4c9401c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:20.845105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1979992-41a2-41ef-be6f-1c34f1139579 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.850346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.851118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.851794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.851794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.852564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.854315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.866910 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 945/1870] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:20.871096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.882192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd51d0-3271-4b4b-95c1-e51a0f427121 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.887683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.888636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.888967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.889430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.891335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.893519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:20.927649 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 946/1871] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/users => generated 292 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:20.928491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:20.942553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb27c2-c161-4712-846f-bd9820230cb5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:20.948934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:20.949805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:20.950146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:20.950500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:20.951444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:20.953878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.001837 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 947/1872] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/users => generated 305 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:21.005028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.026646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f574-212d-4e27-a359-754a772f3d74 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.033180 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 926/1873] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:21.033180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5767ba-59d6-4519-8d3e-418c4c9401c4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.036302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.037447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.037676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.038041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.039572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.040944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.070235 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 948/1874] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:21.070459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.072511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5767ba-59d6-4519-8d3e-418c4c9401c4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.079517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.080329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.080693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.081073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.081900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.098350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25078b62-63ff-487d-9a4c-cab12cbc2497 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.107816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.108107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.108847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.109251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.110447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.111484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.116058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.137510 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 927/1875] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:21.140949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.141107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 949/1876] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:21.141107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.171408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9da10-ed16-47a8-a654-1083807514bc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.185360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f2b17-bd41-4615-9da4-d5a62b85a0ad admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.188757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.190123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.192525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.192957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] PATH_INFO: `/v3/projects/4ee380bfbed24392b2d2109797df00c3/users/29c6e39b83554a2fa29443538b34c590/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.204710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.205520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.205804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.206078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.207130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.208723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.267630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee380bfbed24392b2d2109797df00c3, user_id=29c6e39b83554a2fa29443538b34c590, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.270454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.287367 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 928/1877] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:21 2022] POST /identity/v3/projects => generated 395 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:21.287367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.312591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 950/1878] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:21 2022] PUT /identity/v3/projects/4ee380bfbed24392b2d2109797df00c3/users/29c6e39b83554a2fa29443538b34c590/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:21.314009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.514897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa59ba5-419e-43fb-a23d-667cb087d5b2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.516657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac181cb-9d27-4644-870b-b83a027afb14 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.523006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.524516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.525093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.525864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.527455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.528160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.529371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.529656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.530132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] PATH_INFO: `/v3/projects/c1279809035b498e982fc5452be4b0a3/users/f6a653e02a3a4a9abd657bde31444925/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.534255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.562615 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 929/1879] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:21.564111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.572876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1279809035b498e982fc5452be4b0a3, user_id=f6a653e02a3a4a9abd657bde31444925, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.576070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.590311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e9bf-4141-4ade-b23d-cf700ca436f7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.596436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0b2be-d162-4651-b1a1-d5102163cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.597332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b2be-d162-4651-b1a1-d5102163cfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.597678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b2be-d162-4651-b1a1-d5102163cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.598039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b2be-d162-4651-b1a1-d5102163cfa4 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.598856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0b2be-d162-4651-b1a1-d5102163cfa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.601111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0b2be-d162-4651-b1a1-d5102163cfa4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:21.643148 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 930/1880] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:21 2022] POST /identity/v3/users => generated 304 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:21.646877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f542e15-426c-42e0-beab-1dfcbf0549cb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.650329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f542e15-426c-42e0-beab-1dfcbf0549cb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.651813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f542e15-426c-42e0-beab-1dfcbf0549cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.660140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 951/1881] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:21 2022] PUT /identity/v3/projects/c1279809035b498e982fc5452be4b0a3/users/f6a653e02a3a4a9abd657bde31444925/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:21.661335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:21.767299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9f542e15-426c-42e0-beab-1dfcbf0549cb None None] MFA Rules not processed for user `29c6e39b83554a2fa29443538b34c590`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:21.768643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9f542e15-426c-42e0-beab-1dfcbf0549cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:21.904862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc7d9-bce7-40a6-9416-eeba066f3431 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:21.916153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:21.917257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:21.917414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:21.917688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] PATH_INFO: `/v3/projects/c759b75f393d41f5885d084346557894/users/b43c1912a5ad474d9cdc541530e83b08/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:21.958609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c759b75f393d41f5885d084346557894, user_id=b43c1912a5ad474d9cdc541530e83b08, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:21.961486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.003163 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 952/1882] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:21 2022] PUT /identity/v3/projects/c759b75f393d41f5885d084346557894/users/b43c1912a5ad474d9cdc541530e83b08/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:22.011796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:22.012791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 931/1883] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:22.013915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f542e15-426c-42e0-beab-1dfcbf0549cb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:22.050205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f542e15-426c-42e0-beab-1dfcbf0549cb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:22.213462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e6d03-ddcd-4b43-b74d-00932ff7739e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:22.254802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:22.260511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.261241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.262572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.263321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b0093-7d53-484b-ada6-fc407f97a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:22.265062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b0093-7d53-484b-ada6-fc407f97a9cc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.265400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:22.266002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b0093-7d53-484b-ada6-fc407f97a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.275984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b0093-7d53-484b-ada6-fc407f97a9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.277067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.277424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b0093-7d53-484b-ada6-fc407f97a9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:22.279946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b0093-7d53-484b-ada6-fc407f97a9cc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.313302 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 932/1884] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:22.330921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666bf32-649e-4da1-b0e3-f5096c510e16 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.331184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666bf32-649e-4da1-b0e3-f5096c510e16 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.331500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666bf32-649e-4da1-b0e3-f5096c510e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.331601 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 953/1885] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:22.332591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:22.364761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3f22-c952-47c0-b0bc-0fbf27816628 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:22.379500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:22.380204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.381414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.382993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.384065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:22.396044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.417101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9666bf32-649e-4da1-b0e3-f5096c510e16 None None] MFA Rules not processed for user `b43c1912a5ad474d9cdc541530e83b08`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:22.428969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9666bf32-649e-4da1-b0e3-f5096c510e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:22.487995 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 954/1886] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:22 2022] POST /identity/v3/projects => generated 407 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:22.487995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:22.635471 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 933/1887] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:22.636577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666bf32-649e-4da1-b0e3-f5096c510e16 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:22.655467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6d11-4bbe-4a46-8920-6d38d122ccdb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:22.663739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:22.664792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.665061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.665441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] PATH_INFO: `/v3/projects/c1279809035b498e982fc5452be4b0a3/users/f6a653e02a3a4a9abd657bde31444925/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.667839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666bf32-649e-4da1-b0e3-f5096c510e16 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:22.670429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1279809035b498e982fc5452be4b0a3, user_id=f6a653e02a3a4a9abd657bde31444925, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:22.673934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.687577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:22.689734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.692476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.693322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] PATH_INFO: `/v3/projects/f2c8bb81a37d4962a32ed4f83dc6a444/users/ef1722a1e527452192beb680db3bf2c6/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.718515 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 955/1888] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:22 2022] PUT /identity/v3/projects/c1279809035b498e982fc5452be4b0a3/users/f6a653e02a3a4a9abd657bde31444925/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:22.719922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:22.739877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c8bb81a37d4962a32ed4f83dc6a444, user_id=ef1722a1e527452192beb680db3bf2c6, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:22.742857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.778666 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 934/1889] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:22 2022] PUT /identity/v3/projects/f2c8bb81a37d4962a32ed4f83dc6a444/users/ef1722a1e527452192beb680db3bf2c6/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:22.780537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:22.894437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5c7f-4ced-4b5b-b0c2-7594d9b5e8c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:22.913202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fcb66-87e9-47f1-8472-86131e8b0e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:22.913202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcb66-87e9-47f1-8472-86131e8b0e3e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.913202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcb66-87e9-47f1-8472-86131e8b0e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.913782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcb66-87e9-47f1-8472-86131e8b0e3e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.915452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fcb66-87e9-47f1-8472-86131e8b0e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:22.920880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fcb66-87e9-47f1-8472-86131e8b0e3e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.924144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43281aa1-794d-4a03-bfec-aee56db1da16 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:22.942734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:22.945623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.946788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.947401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:22.950683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:22.965295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:22.978844 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 956/1890] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:22 2022] POST /identity/v3/users => generated 310 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:22.981135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7394-fd0c-4ec1-b2d0-a0542869fdf8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:22.981430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7394-fd0c-4ec1-b2d0-a0542869fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:22.984544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7394-fd0c-4ec1-b2d0-a0542869fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.029221 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 935/1891] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:22 2022] POST /identity/v3/projects => generated 411 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:23.034195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.074351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ea7e7394-fd0c-4ec1-b2d0-a0542869fdf8 None None] MFA Rules not processed for user `f6a653e02a3a4a9abd657bde31444925`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:23.075622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea7e7394-fd0c-4ec1-b2d0-a0542869fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:23.177993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842b3b4-0c9c-4e6f-90dd-6dacefb597d2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.188198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.190525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.191219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.191878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.193007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.196300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.211276 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 936/1892] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:23.212878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.217406 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 957/1893] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:23.218897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e7394-fd0c-4ec1-b2d0-a0542869fdf8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.227675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e075-0842-4b66-a1dd-b8bcdab34402 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.238810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e7394-fd0c-4ec1-b2d0-a0542869fdf8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.247532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.249093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.249858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.254996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.254996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.254996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.255456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.255763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.256547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.257950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.259549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.265341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.273890 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 937/1894] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:23.274959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.291924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0af02-8c65-4886-8730-7050e5e5dddc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.300517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.301847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.302505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.302754 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 958/1895] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:23 2022] POST /identity/v3/users => generated 312 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:23.302865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] PATH_INFO: `/v3/projects/f2c8bb81a37d4962a32ed4f83dc6a444/users/ef1722a1e527452192beb680db3bf2c6/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.303750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.307513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c8bb81a37d4962a32ed4f83dc6a444, user_id=ef1722a1e527452192beb680db3bf2c6, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.312266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.331553 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 938/1896] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:23 2022] PUT /identity/v3/projects/f2c8bb81a37d4962a32ed4f83dc6a444/users/ef1722a1e527452192beb680db3bf2c6/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:23.332387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.415942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09656c89-2e85-43d6-b489-0703d61d0d8e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.467020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d08f7-72c6-4fe9-8272-6629f58cf261 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.472675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.474656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.474935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.475209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] PATH_INFO: `/v3/projects/873c2913cc97419faffe40549c09a3a4/users/e1639b94d57d4fdfab1d2d15e85365e3/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.523218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873c2913cc97419faffe40549c09a3a4, user_id=e1639b94d57d4fdfab1d2d15e85365e3, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.527599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.557430 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 939/1897] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:23 2022] PUT /identity/v3/projects/873c2913cc97419faffe40549c09a3a4/users/e1639b94d57d4fdfab1d2d15e85365e3/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:23.558230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.608898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a18de9-997a-4d12-968d-4c0d90794973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.609607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a18de9-997a-4d12-968d-4c0d90794973 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.610749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a18de9-997a-4d12-968d-4c0d90794973 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.610749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a18de9-997a-4d12-968d-4c0d90794973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.679967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bca8f-4045-4ed3-ae00-d285d126fa23 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.690563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a18de9-997a-4d12-968d-4c0d90794973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.692354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a18de9-997a-4d12-968d-4c0d90794973 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.692844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.693772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.694122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.694616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.695583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.697305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.704728 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 959/1898] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:23.706607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217dc5f-c230-4c6f-9f77-ba381a84b456 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.706900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217dc5f-c230-4c6f-9f77-ba381a84b456 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.707165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217dc5f-c230-4c6f-9f77-ba381a84b456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.736789 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 940/1899] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:23.738881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.743277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1217dc5f-c230-4c6f-9f77-ba381a84b456 None None] MFA Rules not processed for user `ef1722a1e527452192beb680db3bf2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:23.744630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1217dc5f-c230-4c6f-9f77-ba381a84b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:23.764819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9735-7237-4060-b948-5209b3577cf6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.772656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.773618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.774015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.774426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.775456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.778438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.804787 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 941/1900] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:23.806349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.820258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b6494-7d50-4beb-aa39-368cb053e459 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:23.829301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:23.830381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:23.830671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:23.831092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] PATH_INFO: `/v3/projects/c03c067d9bad4a4fa89e14bae804a73e/users/ec2400fba7cd4f44a2ed86dc1637525d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:23.867004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03c067d9bad4a4fa89e14bae804a73e, user_id=ec2400fba7cd4f44a2ed86dc1637525d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:23.872350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:23.917725 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 960/1901] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:23.918747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217dc5f-c230-4c6f-9f77-ba381a84b456 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.926504 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 942/1902] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:23 2022] PUT /identity/v3/projects/c03c067d9bad4a4fa89e14bae804a73e/users/ec2400fba7cd4f44a2ed86dc1637525d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:23.930109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:23.951262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217dc5f-c230-4c6f-9f77-ba381a84b456 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:24.070789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc863d-f51d-4615-98fe-e82b0c654aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:24.071693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc863d-f51d-4615-98fe-e82b0c654aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.071977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc863d-f51d-4615-98fe-e82b0c654aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.072251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc863d-f51d-4615-98fe-e82b0c654aaa admin admin] PATH_INFO: `/v3/projects/873c2913cc97419faffe40549c09a3a4/users/e1639b94d57d4fdfab1d2d15e85365e3/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.074425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc863d-f51d-4615-98fe-e82b0c654aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=873c2913cc97419faffe40549c09a3a4, user_id=e1639b94d57d4fdfab1d2d15e85365e3, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:24.077841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc863d-f51d-4615-98fe-e82b0c654aaa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:24.090669 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 961/1903] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:23 2022] PUT /identity/v3/projects/873c2913cc97419faffe40549c09a3a4/users/e1639b94d57d4fdfab1d2d15e85365e3/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:24.110746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7acb7-17c1-4ca8-a6a7-f2689a9437a8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.113318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7acb7-17c1-4ca8-a6a7-f2689a9437a8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.114333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7acb7-17c1-4ca8-a6a7-f2689a9437a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.140294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839903e6-dccf-4c70-8181-38cb2b91feae admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:24.185282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-66f7acb7-17c1-4ca8-a6a7-f2689a9437a8 None None] MFA Rules not processed for user `e1639b94d57d4fdfab1d2d15e85365e3`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:24.187133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-66f7acb7-17c1-4ca8-a6a7-f2689a9437a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:24.292887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:24.293794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.294074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.294347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.295090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:24.297057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:24.327104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 943/1904] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:24.328027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:24.332085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 962/1905] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:24.333503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7acb7-17c1-4ca8-a6a7-f2689a9437a8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:24.348152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7acb7-17c1-4ca8-a6a7-f2689a9437a8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:24.354914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:24.356389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.356845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.357275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] PATH_INFO: `/v3/projects/c03c067d9bad4a4fa89e14bae804a73e/users/ec2400fba7cd4f44a2ed86dc1637525d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.360562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03c067d9bad4a4fa89e14bae804a73e, user_id=ec2400fba7cd4f44a2ed86dc1637525d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:24.363943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:24.380761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 963/1906] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:24 2022] PUT /identity/v3/projects/c03c067d9bad4a4fa89e14bae804a73e/users/ec2400fba7cd4f44a2ed86dc1637525d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:24.381916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:24.505169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780d4e1-5392-4905-b374-d6fb1c0b8598 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:24.656310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300114f-5a4c-4aa4-b5e0-79887b5c837b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:24.663367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107455b9-35ea-4e8c-a228-04223c9757cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:24.664288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107455b9-35ea-4e8c-a228-04223c9757cb service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.664492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107455b9-35ea-4e8c-a228-04223c9757cb service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.664734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107455b9-35ea-4e8c-a228-04223c9757cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.690540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:24.695977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.697734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.701244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] PATH_INFO: `/v3/users/29c6e39b83554a2fa29443538b34c590` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.706730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c6e39b83554a2fa29443538b34c590)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:24.717284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:24.736745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107455b9-35ea-4e8c-a228-04223c9757cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:24.738584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107455b9-35ea-4e8c-a228-04223c9757cb service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:24.749901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 944/1907] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:24.751347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.751820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.752022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.784702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] MFA Rules not processed for user `ec2400fba7cd4f44a2ed86dc1637525d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:24.785964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:24.857841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c6e39b83554a2fa29443538b34c590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:24.858888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c6e39b83554a2fa29443538b34c590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:24.878862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c6e39b83554a2fa29443538b34c590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:24.893874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c6e39b83554a2fa29443538b34c590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:24.894479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-543f454c-32c1-45e8-a02f-6fc68ac194a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c6e39b83554a2fa29443538b34c590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:24.928519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 964/1908] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:24 2022] DELETE /identity/v3/users/29c6e39b83554a2fa29443538b34c590 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:24.933799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:24.934087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:24.934354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:24.954423 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 945/1909] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:24.972664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:24.974263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.054795 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 965/1910] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:25.065130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:25.067107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.147957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6215bb4-d6e1-4cbf-bf1c-af355e93ce76 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:25.219096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:25.220128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.220624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.220997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.232166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:25.233931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:25.246706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 946/1911] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:25.346308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:25.347506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:25.349946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.354877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.364099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb0363-65f5-4db2-ba72-3950d7b23579 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:25.370333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:25.371272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.371552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.371910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] PATH_INFO: `/v3/users/ac91f0e4b0e54c488d21875005061048` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.374072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac91f0e4b0e54c488d21875005061048)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:25.377581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:25.443650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac91f0e4b0e54c488d21875005061048'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:25.444705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac91f0e4b0e54c488d21875005061048'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:25.452436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac91f0e4b0e54c488d21875005061048'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:25.459027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ed09-1369-4c30-91ef-c2d9f58a7739 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:25.464671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac91f0e4b0e54c488d21875005061048'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:25.465463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9cac3a0c-4d37-4630-80ee-c9257fb8737f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac91f0e4b0e54c488d21875005061048'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:25.465834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:25.466701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.467404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.467869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.470230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.496146 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 966/1912] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:25 2022] DELETE /identity/v3/users/ac91f0e4b0e54c488d21875005061048 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:25.497785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d1f8e-70be-4606-b2a8-028150545275 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.498069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d1f8e-70be-4606-b2a8-028150545275 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.498421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d1f8e-70be-4606-b2a8-028150545275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.522749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-021d1f8e-70be-4606-b2a8-028150545275 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:25.524240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-021d1f8e-70be-4606-b2a8-028150545275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.544724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:25.546983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:25.569974 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 947/1913] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:25.616706 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 967/1914] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:25.627527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:25.631367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.655504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa73f8-a65b-4794-a0a1-1378b46ea4d9 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:25.758411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07220a0c-b486-4cf0-b79b-93096ab2cd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:25.759396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07220a0c-b486-4cf0-b79b-93096ab2cd7b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.760199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07220a0c-b486-4cf0-b79b-93096ab2cd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.760199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07220a0c-b486-4cf0-b79b-93096ab2cd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.772241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07220a0c-b486-4cf0-b79b-93096ab2cd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:25.773748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07220a0c-b486-4cf0-b79b-93096ab2cd7b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:25.787201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 948/1915] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:25.819868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bd83-aa52-4e00-80bc-840e884eab00 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.820155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bd83-aa52-4e00-80bc-840e884eab00 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.820609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bd83-aa52-4e00-80bc-840e884eab00 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.823007 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 968/1916] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:25.831050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.831346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.831624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.859353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:25.862296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.874262 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 949/1917] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:25.896118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900bd83-aa52-4e00-80bc-840e884eab00 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:25.898666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0900bd83-aa52-4e00-80bc-840e884eab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.919750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900bd83-aa52-4e00-80bc-840e884eab00 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:25.926065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:25.927011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:25.927481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:25.928534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:25.938714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:25.941564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:25.960155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:25.961980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:25.985127 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 969/1918] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:26.076359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2391-930d-4745-8951-1001d87c58a0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:26.082385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:26.083060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:26.083339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:26.083602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:26.085518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.170834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:26.172626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:26.184485 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 950/1919] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:55:26.213638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:26.215179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.230319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfed1f-a4c6-4f0b-be9a-0d1ff11f8ca0 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:26.235275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:26.236170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:26.236508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:26.236702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] PATH_INFO: `/v3/users/b43c1912a5ad474d9cdc541530e83b08` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:26.237918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43c1912a5ad474d9cdc541530e83b08)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:26.239860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:26.299763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43c1912a5ad474d9cdc541530e83b08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.300649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43c1912a5ad474d9cdc541530e83b08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.319415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43c1912a5ad474d9cdc541530e83b08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.324038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:26.327640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.349534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7b9ea-3523-4295-8957-72e0d67f933e service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:26.371011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:26.380703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43c1912a5ad474d9cdc541530e83b08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.381708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-109c520e-0048-490b-881f-169b905ae5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43c1912a5ad474d9cdc541530e83b08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.385823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:26.387182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:26.387457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] PATH_INFO: `/v3/projects/4ee380bfbed24392b2d2109797df00c3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:26.389353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee380bfbed24392b2d2109797df00c3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:26.392144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:26.432058 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 970/1920] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:26 2022] DELETE /identity/v3/users/b43c1912a5ad474d9cdc541530e83b08 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:26.435190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:26.435486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:26.435768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:26.466321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:26.467786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.487967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee380bfbed24392b2d2109797df00c3', 'request_id': 'req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.496028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee380bfbed24392b2d2109797df00c3', 'request_id': 'req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.505965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee380bfbed24392b2d2109797df00c3', 'request_id': 'req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.533761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] The token cache is being invalidate because project 4ee380bfbed24392b2d2109797df00c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:26.537224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.538464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.543771 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 951/1921] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:26 2022] DELETE /identity/v3/projects/4ee380bfbed24392b2d2109797df00c3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:26.544689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:26.546829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.572065 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 971/1922] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:26.573399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:26.574773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.599991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1b8ec-4dc3-4785-88d2-b53e4de1b113 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:26.609961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:26.610981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:26.611273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:26.611554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] PATH_INFO: `/v3/users/e1639b94d57d4fdfab1d2d15e85365e3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:26.613263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1639b94d57d4fdfab1d2d15e85365e3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:26.615834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:26.668329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cf40e-885c-4752-aca2-e6c4f5dd012c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:26.673737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:26.674821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:26.675190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:26.675530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] PATH_INFO: `/v3/projects/4c5056fc922845399c2d04bca2e27d84` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:26.690595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5056fc922845399c2d04bca2e27d84)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:26.693640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:26.696582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1639b94d57d4fdfab1d2d15e85365e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.697325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1639b94d57d4fdfab1d2d15e85365e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.706005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1639b94d57d4fdfab1d2d15e85365e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.716381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1639b94d57d4fdfab1d2d15e85365e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.717072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1639b94d57d4fdfab1d2d15e85365e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.739223 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 972/1923] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:26 2022] DELETE /identity/v3/users/e1639b94d57d4fdfab1d2d15e85365e3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:26.739873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:26.741316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.762793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5056fc922845399c2d04bca2e27d84', 'request_id': 'req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.773276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5056fc922845399c2d04bca2e27d84', 'request_id': 'req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.803961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5056fc922845399c2d04bca2e27d84', 'request_id': 'req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.821573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] The token cache is being invalidate because project 4c5056fc922845399c2d04bca2e27d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:26.822157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.822874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:26.827610 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 952/1924] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:26 2022] DELETE /identity/v3/projects/4c5056fc922845399c2d04bca2e27d84 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:26.835014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:26.840499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc56e-8417-460d-96e0-d3b4df8bc1ee admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:26.851022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:26.950816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:26.951692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:26.951878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:26.952153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:26.956257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:27.006407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66b60-cefc-4e12-a4f2-7ecdb750faf5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:27.017759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:27.018781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:27.019905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:27.020946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] PATH_INFO: `/v3/users/ef1722a1e527452192beb680db3bf2c6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:27.024914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1722a1e527452192beb680db3bf2c6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:27.027066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:27.113607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:27.115287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:27.128949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 973/1925] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:27.129914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1722a1e527452192beb680db3bf2c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.130450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1722a1e527452192beb680db3bf2c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.139032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1722a1e527452192beb680db3bf2c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.139855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1722a1e527452192beb680db3bf2c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.160177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1722a1e527452192beb680db3bf2c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.187204 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 953/1926] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:26 2022] DELETE /identity/v3/users/ef1722a1e527452192beb680db3bf2c6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:27.441654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:27.444959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:27.463255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9118f-07e5-4646-9534-78a66d6ce81f service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:27.621064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:27.621938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:27.622220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:27.622502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] PATH_INFO: `/v3/projects/873c2913cc97419faffe40549c09a3a4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:27.623994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873c2913cc97419faffe40549c09a3a4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:27.626239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:27.692838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873c2913cc97419faffe40549c09a3a4', 'request_id': 'req-ef802fcc-4770-4036-88b6-78c21b99df17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.700589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873c2913cc97419faffe40549c09a3a4', 'request_id': 'req-ef802fcc-4770-4036-88b6-78c21b99df17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.721846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:27.724523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873c2913cc97419faffe40549c09a3a4', 'request_id': 'req-ef802fcc-4770-4036-88b6-78c21b99df17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.725548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:27.745971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] The token cache is being invalidate because project 873c2913cc97419faffe40549c09a3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:27.746295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.746983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef802fcc-4770-4036-88b6-78c21b99df17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:27.753226 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 974/1927] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:27 2022] DELETE /identity/v3/projects/873c2913cc97419faffe40549c09a3a4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:27.763325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdb470-0217-4fa6-ba53-92218071a897 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:27.788970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd14bf-028f-4c0c-81d7-570068c13c07 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:27.790705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd14bf-028f-4c0c-81d7-570068c13c07 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:27.791863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd14bf-028f-4c0c-81d7-570068c13c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:27.827758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:27.829285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:27.829595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:27.829744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] PATH_INFO: `/v3/projects/c759b75f393d41f5885d084346557894` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:27.830667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5bbd14bf-028f-4c0c-81d7-570068c13c07 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:27.831480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c759b75f393d41f5885d084346557894)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:27.832913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5bbd14bf-028f-4c0c-81d7-570068c13c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:27.833449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:27.843506 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 975/1928] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:27.851423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:27.851631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:27.853518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:27.875832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:27.877266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:27.895465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 976/1929] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:27.896563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:27.898070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:27.917322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4de48-dcbc-4466-9e2f-19cc49b34448 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:27.929677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:27.931859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:27.932241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:27.932616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] PATH_INFO: `/v3/projects/f2c8bb81a37d4962a32ed4f83dc6a444` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:27.934015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c8bb81a37d4962a32ed4f83dc6a444)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:27.936334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:27.997575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c759b75f393d41f5885d084346557894', 'request_id': 'req-bb040757-c6fb-4719-831e-c25c0a938d47'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.006586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c759b75f393d41f5885d084346557894', 'request_id': 'req-bb040757-c6fb-4719-831e-c25c0a938d47'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.020518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c759b75f393d41f5885d084346557894', 'request_id': 'req-bb040757-c6fb-4719-831e-c25c0a938d47'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.039407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] The token cache is being invalidate because project c759b75f393d41f5885d084346557894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:28.039727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.040355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.054080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c8bb81a37d4962a32ed4f83dc6a444', 'request_id': 'req-29b50e33-a28d-489e-bd1d-4b3980688ba4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.057160 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 954/1930] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:27 2022] DELETE /identity/v3/projects/c759b75f393d41f5885d084346557894 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:28.058429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.060039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.075479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c8bb81a37d4962a32ed4f83dc6a444', 'request_id': 'req-29b50e33-a28d-489e-bd1d-4b3980688ba4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.091994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c8bb81a37d4962a32ed4f83dc6a444', 'request_id': 'req-29b50e33-a28d-489e-bd1d-4b3980688ba4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.105139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] The token cache is being invalidate because project f2c8bb81a37d4962a32ed4f83dc6a444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:28.105437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.106146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.108085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 977/1931] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:27 2022] DELETE /identity/v3/projects/f2c8bb81a37d4962a32ed4f83dc6a444 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:28.110307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.111995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.150414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb040757-c6fb-4719-831e-c25c0a938d47 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.175523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b50e33-a28d-489e-bd1d-4b3980688ba4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.184193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.185433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.185433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.185654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] PATH_INFO: `/v3/users/ec2400fba7cd4f44a2ed86dc1637525d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.187158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2400fba7cd4f44a2ed86dc1637525d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.189339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.231340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b14ce-53f1-4f98-99cc-397bf506ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.232040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b14ce-53f1-4f98-99cc-397bf506ee5c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.232328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b14ce-53f1-4f98-99cc-397bf506ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.232713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b14ce-53f1-4f98-99cc-397bf506ee5c admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.233738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b14ce-53f1-4f98-99cc-397bf506ee5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:28.234116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b14ce-53f1-4f98-99cc-397bf506ee5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.236160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b14ce-53f1-4f98-99cc-397bf506ee5c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.253531 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 955/1932] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:28.255023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.255333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.255611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.259277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2400fba7cd4f44a2ed86dc1637525d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.259964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2400fba7cd4f44a2ed86dc1637525d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.282871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:28.284438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.284748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2400fba7cd4f44a2ed86dc1637525d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.295492 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 956/1933] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:28.296816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.302586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.304223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2400fba7cd4f44a2ed86dc1637525d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.304901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77b2ada0-ddf9-4b7c-8781-063dcc7f0a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2400fba7cd4f44a2ed86dc1637525d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:28.326600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d7c5-2420-497d-99b4-74bfe6ef6469 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.331774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.333770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.334227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.334690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.341324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.344602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.350561 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 978/1934] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:28 2022] DELETE /identity/v3/users/ec2400fba7cd4f44a2ed86dc1637525d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:28.353489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615188-ad69-45cb-98bd-eac1815a7977 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.353945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615188-ad69-45cb-98bd-eac1815a7977 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.354633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615188-ad69-45cb-98bd-eac1815a7977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.389739 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 957/1935] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:28 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:28.392833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.395950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.400594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ea615188-ad69-45cb-98bd-eac1815a7977 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:28.402025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea615188-ad69-45cb-98bd-eac1815a7977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.571582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b47bd0-86cb-4748-9590-1aa89bfafa00 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.578446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.579942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.580442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.580907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.581938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.584273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.611267 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 979/1936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:28.613561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615188-ad69-45cb-98bd-eac1815a7977 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.629075 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 958/1937] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:28 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:28.633602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.645181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615188-ad69-45cb-98bd-eac1815a7977 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.650768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.651459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.651730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.652003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.652562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efe47-4a9e-4bce-b4ee-a3eb7b3879c3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.652737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:28.653555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.654901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.665515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.671800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.672569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.673093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.674238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.676300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.693306 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 980/1938] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:28.694600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 959/1939] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:55:28.698640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.711072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.712607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a843c-7dab-4861-b21b-a0698473b3dc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.718471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.720388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.720899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.721420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.722557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.725306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.730806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fdd42-2660-4b78-9270-4e97bfd01011 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.736847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.737588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.737872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.738145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.738881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.740557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.752399 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 981/1940] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:28.756810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.768787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5f2fc-c183-4dd8-a6b7-e67ce715bec9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.771370 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 960/1941] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:28 2022] POST /identity/v3/projects => generated 395 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:28.775398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.861666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.862895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.863172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.863442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] PATH_INFO: `/v3/projects/824b62cd9d7c4a58a76615640e1a7eb1/users/ce95355d717b4ee09c93754baa6a31fb/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.879765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=824b62cd9d7c4a58a76615640e1a7eb1, user_id=ce95355d717b4ee09c93754baa6a31fb, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.879975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e894775-422c-47c3-943c-a3ec25d03b62 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.882746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.886045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906cec6-1f8c-4e7d-ad22-fe319fadfbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.887184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906cec6-1f8c-4e7d-ad22-fe319fadfbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.887460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906cec6-1f8c-4e7d-ad22-fe319fadfbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.893140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906cec6-1f8c-4e7d-ad22-fe319fadfbd7 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.893140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906cec6-1f8c-4e7d-ad22-fe319fadfbd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.893140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906cec6-1f8c-4e7d-ad22-fe319fadfbd7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:28.903322 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 982/1942] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:28 2022] PUT /identity/v3/projects/824b62cd9d7c4a58a76615640e1a7eb1/users/ce95355d717b4ee09c93754baa6a31fb/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:28.904369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:28.906082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.925580 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 961/1943] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:28 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:55:28.927735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c31d6-4fd4-4357-ab23-b82ffe484057 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.928332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c31d6-4fd4-4357-ab23-b82ffe484057 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.928614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c31d6-4fd4-4357-ab23-b82ffe484057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.959918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e75c31d6-4fd4-4357-ab23-b82ffe484057 None None] MFA Rules not processed for user `ce95355d717b4ee09c93754baa6a31fb`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:28.961526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e75c31d6-4fd4-4357-ab23-b82ffe484057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:28.983352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd580d6-407b-4d2b-8039-2f70add56adc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:28.988996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:28.990075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:28.990358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:28.990633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] PATH_INFO: `/v3/projects/c03c067d9bad4a4fa89e14bae804a73e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:28.991832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03c067d9bad4a4fa89e14bae804a73e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:28.993814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.029922 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 962/1944] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:29.031224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c31d6-4fd4-4357-ab23-b82ffe484057 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.044511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c31d6-4fd4-4357-ab23-b82ffe484057 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.046131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03c067d9bad4a4fa89e14bae804a73e', 'request_id': 'req-13dc8953-17f5-43c4-ad79-2783a745df6e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:29.051361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03c067d9bad4a4fa89e14bae804a73e', 'request_id': 'req-13dc8953-17f5-43c4-ad79-2783a745df6e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:29.062936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03c067d9bad4a4fa89e14bae804a73e', 'request_id': 'req-13dc8953-17f5-43c4-ad79-2783a745df6e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:29.082301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] The token cache is being invalidate because project c03c067d9bad4a4fa89e14bae804a73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:29.082587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:29.083275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:29.088502 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 983/1945] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:28 2022] DELETE /identity/v3/projects/c03c067d9bad4a4fa89e14bae804a73e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:29.089392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.091358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:29.115334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a031aa-038f-4dba-bb50-35dab61551f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.116020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a031aa-038f-4dba-bb50-35dab61551f7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.116298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a031aa-038f-4dba-bb50-35dab61551f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.116567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a031aa-038f-4dba-bb50-35dab61551f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.117692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a031aa-038f-4dba-bb50-35dab61551f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.119474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a031aa-038f-4dba-bb50-35dab61551f7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.137570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 963/1946] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:29.139078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.139411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.139688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.164442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:29.166158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:29.185227 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 964/1947] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:29.186517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.189775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:29.228730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2a1ac-b8ff-4e3e-b53e-8f1d66a1c268 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.239926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc8953-17f5-43c4-ad79-2783a745df6e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.243484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f813d2-c950-4a4b-860f-819dd432dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.244855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f813d2-c950-4a4b-860f-819dd432dc76 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.245378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f813d2-c950-4a4b-860f-819dd432dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.245808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f813d2-c950-4a4b-860f-819dd432dc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.246070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.246670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f813d2-c950-4a4b-860f-819dd432dc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.246806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.247083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.247352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.248048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.248734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f813d2-c950-4a4b-860f-819dd432dc76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.250166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.262885 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 965/1948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:29.264765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47058-880d-4790-8d15-826bd47a8f9a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.265145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47058-880d-4790-8d15-826bd47a8f9a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.265569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47058-880d-4790-8d15-826bd47a8f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.291120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-87c47058-880d-4790-8d15-826bd47a8f9a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:29.292275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-87c47058-880d-4790-8d15-826bd47a8f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:29.301913 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 966/1949] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:29.302760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c47058-880d-4790-8d15-826bd47a8f9a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.308538 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 984/1950] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:29 2022] POST /identity/v3/projects => generated 391 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:29.308684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.316003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c47058-880d-4790-8d15-826bd47a8f9a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.380211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.381229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.381507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.381910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] PATH_INFO: `/v3/projects/2c23a8d6534a4426b2ea106417c8b68a/users/9c775742dfc04cec8559f9e4d13239b0/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.387956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f9f35-0e06-4d28-9453-5d72e7b2bdf0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.393402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.393544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.393833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.394106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.395415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:29.395415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.396857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.400132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c23a8d6534a4426b2ea106417c8b68a, user_id=9c775742dfc04cec8559f9e4d13239b0, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.403037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.408484 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 985/1951] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:29.409371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.424026 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 967/1952] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:29 2022] PUT /identity/v3/projects/2c23a8d6534a4426b2ea106417c8b68a/users/9c775742dfc04cec8559f9e4d13239b0/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:29.424026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.424313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997297-6779-4dd0-82ca-c32f5ac74b6c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.490410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875eebf-e592-4188-b7d0-a9d9e39de185 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.493359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b22a08-9c70-4ee4-9bce-16bc28fe44ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.494178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22a08-9c70-4ee4-9bce-16bc28fe44ca admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.494531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22a08-9c70-4ee4-9bce-16bc28fe44ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.494872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22a08-9c70-4ee4-9bce-16bc28fe44ca admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.495324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.495758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b22a08-9c70-4ee4-9bce-16bc28fe44ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.495973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.496271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.496546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.497290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.498348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b22a08-9c70-4ee4-9bce-16bc28fe44ca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.499256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.521706 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 986/1953] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:29 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:29.523268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59713d8-0046-4553-9f89-1ebaf75cb889 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.523575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59713d8-0046-4553-9f89-1ebaf75cb889 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.523896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59713d8-0046-4553-9f89-1ebaf75cb889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.533406 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 968/1954] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:29 2022] POST /identity/v3/projects => generated 395 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:29.534433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.544703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a59713d8-0046-4553-9f89-1ebaf75cb889 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:29.546051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a59713d8-0046-4553-9f89-1ebaf75cb889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:29.609542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def61f3-54ee-4ff7-8cf7-22184e73fc8f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.615226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.615971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.616267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.616574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.617343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.619256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.637408 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 969/1955] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:29.638474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.640876 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 987/1956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:29.642359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59713d8-0046-4553-9f89-1ebaf75cb889 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.655021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59713d8-0046-4553-9f89-1ebaf75cb889 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.660453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.661692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.662167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.662626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] PATH_INFO: `/v3/projects/3e5a3b1cb32a4e2ca7c665a6720d857e/users/dc7ff1d929e846448003f9a4a8cf43f7/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.673717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11235984-0efa-4d5c-8420-49dd167379de admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.680773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.681519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.681799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.682074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.683318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.686050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.695146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5a3b1cb32a4e2ca7c665a6720d857e, user_id=dc7ff1d929e846448003f9a4a8cf43f7, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.699501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.713846 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 970/1957] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:29 2022] POST /identity/v3/users => generated 298 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:29.715290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.718645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:29.730541 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 988/1958] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:29 2022] PUT /identity/v3/projects/3e5a3b1cb32a4e2ca7c665a6720d857e/users/dc7ff1d929e846448003f9a4a8cf43f7/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:29.733656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.794259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c2b3-6bab-4168-881a-a7f23863c19a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.885682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d84ab-e7c3-4ab9-a98e-cdaf53240a73 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.889484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.890332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.890997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.890997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.897601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.898310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.898588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.898860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.902758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.905203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.910697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.918100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.933323 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 989/1959] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:29.934271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.940820 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 971/1960] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:29.941960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:29.949406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6dae-c931-428d-a9bd-8a68b6b0f5c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.956483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.957596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.958307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.958591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.960339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.962039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.967786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d26d2-04f2-4c00-959c-7b6855ef8e3b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:29.977233 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 990/1961] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:29.986231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:29.986935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:29.987216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:29.987489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:29.988835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:29.989903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:29.994155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:30.008515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa091d4-e38b-4015-af04-3168e74b5a53 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:30.014136 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 972/1962] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:30.016230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dbcbd-9db4-4c2a-8a1b-8d62d241f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:30.017645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dbcbd-9db4-4c2a-8a1b-8d62d241f338 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.018160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dbcbd-9db4-4c2a-8a1b-8d62d241f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.018453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:30.018802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dbcbd-9db4-4c2a-8a1b-8d62d241f338 admin admin] PATH_INFO: `/v3/projects/3e5a3b1cb32a4e2ca7c665a6720d857e/users/dc7ff1d929e846448003f9a4a8cf43f7/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.021006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dbcbd-9db4-4c2a-8a1b-8d62d241f338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5a3b1cb32a4e2ca7c665a6720d857e, user_id=dc7ff1d929e846448003f9a4a8cf43f7, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:30.023751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dbcbd-9db4-4c2a-8a1b-8d62d241f338 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:30.037772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521d356-d99b-44cc-b307-80077c399303 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:30.048724 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 991/1963] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:29 2022] PUT /identity/v3/projects/3e5a3b1cb32a4e2ca7c665a6720d857e/users/dc7ff1d929e846448003f9a4a8cf43f7/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:30.051174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.051474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.051783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.095450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] MFA Rules not processed for user `dc7ff1d929e846448003f9a4a8cf43f7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:30.096337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:30.134095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c7c6d-6446-4e30-a9ad-2a3c071ee254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:30.135206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7c6d-6446-4e30-a9ad-2a3c071ee254 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.135528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7c6d-6446-4e30-a9ad-2a3c071ee254 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.135849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7c6d-6446-4e30-a9ad-2a3c071ee254 admin admin] PATH_INFO: `/v3/projects/5fc90b2020ab417e8b6ba2bfb69d6ba5/users/58162fde653b45ed9ca0a2f5e066eea5/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.152880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c7c6d-6446-4e30-a9ad-2a3c071ee254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc90b2020ab417e8b6ba2bfb69d6ba5, user_id=58162fde653b45ed9ca0a2f5e066eea5, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:30.156174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c7c6d-6446-4e30-a9ad-2a3c071ee254 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:30.194137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 973/1964] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:30 2022] PUT /identity/v3/projects/5fc90b2020ab417e8b6ba2bfb69d6ba5/users/58162fde653b45ed9ca0a2f5e066eea5/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:30.211052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662373db-ebc2-4330-95a6-f82c19c03cc8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.211385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662373db-ebc2-4330-95a6-f82c19c03cc8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.211668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662373db-ebc2-4330-95a6-f82c19c03cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.248576 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 992/1965] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:30.268150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:30.269929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:30.280405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-662373db-ebc2-4330-95a6-f82c19c03cc8 None None] MFA Rules not processed for user `58162fde653b45ed9ca0a2f5e066eea5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:30.282296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-662373db-ebc2-4330-95a6-f82c19c03cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:30.418681 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 974/1966] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:30.424738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662373db-ebc2-4330-95a6-f82c19c03cc8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:30.426148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7c62b-690d-40d1-b298-23ce09b1e034 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:30.527606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662373db-ebc2-4330-95a6-f82c19c03cc8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:30.545400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:30.546794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.547180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.547555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.548500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:30.550592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:30.577009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:30.577799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.578096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.578375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.580297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:30.659543 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 975/1967] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:30 2022] POST /identity/v3/projects => generated 393 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:55:30.660677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:30.696366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:30.700506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:30.722833 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 993/1968] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:30.815458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576ba5f-d196-4241-89e6-30010a232585 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:30.820429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:30.821421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.821881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.822830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.823750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:30.826814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:30.855030 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 976/1969] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:30 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:30.861924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:30.880227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83676ccc-2060-4645-b62b-db48d9a20dc7 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:30.885735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:30.886798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.887205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.888282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.889229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:30.891192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:30.910935 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 994/1970] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:30.915224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:30.931733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c35d3-4338-49a1-a678-2728e45852fa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:30.940281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:30.941451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:30.941907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:30.942914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] PATH_INFO: `/v3/projects/2e3774f1979c4262aa63db6f010db5d9/users/17413b2e061d409bbf043d80a2570da4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:30.969992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3774f1979c4262aa63db6f010db5d9, user_id=17413b2e061d409bbf043d80a2570da4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:30.972789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:30.992474 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 977/1971] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:30 2022] PUT /identity/v3/projects/2e3774f1979c4262aa63db6f010db5d9/users/17413b2e061d409bbf043d80a2570da4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:30.997700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:31.028873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb7570-d991-4913-afa3-4fb975c8b1c7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:31.245308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fe916-2056-4873-b4f1-7fe50609f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:31.246231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fe916-2056-4873-b4f1-7fe50609f962 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:31.246559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fe916-2056-4873-b4f1-7fe50609f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:31.246836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fe916-2056-4873-b4f1-7fe50609f962 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:31.248535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fe916-2056-4873-b4f1-7fe50609f962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:31.251436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fe916-2056-4873-b4f1-7fe50609f962 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:31.264241 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 995/1972] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:31.268637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:31.281069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c9f20-25ab-487c-a6bd-1b39d582644e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:31.290539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9872e3-1415-46c6-a2b2-338f5ebf967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:31.291895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9872e3-1415-46c6-a2b2-338f5ebf967a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:31.292386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9872e3-1415-46c6-a2b2-338f5ebf967a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:31.292885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9872e3-1415-46c6-a2b2-338f5ebf967a admin admin] PATH_INFO: `/v3/projects/2e3774f1979c4262aa63db6f010db5d9/users/17413b2e061d409bbf043d80a2570da4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:31.296052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9872e3-1415-46c6-a2b2-338f5ebf967a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3774f1979c4262aa63db6f010db5d9, user_id=17413b2e061d409bbf043d80a2570da4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:31.299732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9872e3-1415-46c6-a2b2-338f5ebf967a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:31.329248 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 978/1973] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:31 2022] PUT /identity/v3/projects/2e3774f1979c4262aa63db6f010db5d9/users/17413b2e061d409bbf043d80a2570da4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:31.340227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cfa9-b2a7-40c7-848d-95a4174ce57b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:31.340645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cfa9-b2a7-40c7-848d-95a4174ce57b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:31.341103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cfa9-b2a7-40c7-848d-95a4174ce57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:31.369980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0868cfa9-b2a7-40c7-848d-95a4174ce57b None None] MFA Rules not processed for user `17413b2e061d409bbf043d80a2570da4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:31.371722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0868cfa9-b2a7-40c7-848d-95a4174ce57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:31.481390 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 996/1974] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:31.493402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:31.493742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:31.494098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:31.513218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] MFA Rules not processed for user `58162fde653b45ed9ca0a2f5e066eea5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:31.514627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:31.577253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6a51-5871-411c-9a8f-ae01af4e6ef3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:31.577558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6a51-5871-411c-9a8f-ae01af4e6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:31.577925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6a51-5871-411c-9a8f-ae01af4e6ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:31.647571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 979/1975] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:31.648714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-45ae6a51-5871-411c-9a8f-ae01af4e6ef3 None None] MFA Rules not processed for user `9c775742dfc04cec8559f9e4d13239b0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:31.651447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-45ae6a51-5871-411c-9a8f-ae01af4e6ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:31.652160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:31.655654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:31.748190 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 997/1976] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:31.758172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6a51-5871-411c-9a8f-ae01af4e6ef3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:31.795260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5071b-94fa-47c1-8950-816aaec786d6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:31.816042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:31.816705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:31.816990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:31.817312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:31.879128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6a51-5871-411c-9a8f-ae01af4e6ef3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:31.885077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:31.886024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:31.886148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:31.886348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:31.887075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:31.889364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:31.927255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:31.930382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:31.935927 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 998/1977] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:31 2022] POST /identity/v3/projects => generated 397 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:31.943046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:31.957438 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 980/1978] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:31.958226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:31.972525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d1315-8810-4ca1-a98f-1811769066e6 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:32.031615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707255c3-6858-4166-8a3d-5b8bb6593b19 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:32.040588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:32.042997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.043826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.046343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.047427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:32.050839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:32.064201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a49653-0bcf-4878-82d1-9f3199973633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:32.064897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a49653-0bcf-4878-82d1-9f3199973633 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.065350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a49653-0bcf-4878-82d1-9f3199973633 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.065636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a49653-0bcf-4878-82d1-9f3199973633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.080139 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 999/1979] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:31 2022] POST /identity/v3/users => generated 305 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:32.081963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:32.095474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80554364-069e-4e4e-bf6e-e76d1bc65acb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:32.101371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:32.102109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.102494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.102769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.104060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:32.106364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:32.121309 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1000/1980] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:32.123113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:32.137413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a49653-0bcf-4878-82d1-9f3199973633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:32.139129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a49653-0bcf-4878-82d1-9f3199973633 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:32.141492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124848-1e97-4948-a25b-5c2979d7f59f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:32.149104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 981/1981] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:32.152686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:32.153647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.153927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.154197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] PATH_INFO: `/v3/projects/e5e32e456ce8498cba865bda8f8445f1/users/9003c87ee6804a7a86aa2c1e6ec97124/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.156440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11901-f7eb-40ba-b2fe-3e48629837b1 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.156720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11901-f7eb-40ba-b2fe-3e48629837b1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.156991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11901-f7eb-40ba-b2fe-3e48629837b1 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.158402 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 982/1982] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:55:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:32.169471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd19b-fa33-4892-a82f-7ef44adb38f1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.169927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd19b-fa33-4892-a82f-7ef44adb38f1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.170248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd19b-fa33-4892-a82f-7ef44adb38f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.186672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e32e456ce8498cba865bda8f8445f1, user_id=9003c87ee6804a7a86aa2c1e6ec97124, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:32.191993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:32.211946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-322fd19b-fa33-4892-a82f-7ef44adb38f1 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:32.213599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-322fd19b-fa33-4892-a82f-7ef44adb38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:32.219624 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1001/1983] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:32 2022] PUT /identity/v3/projects/e5e32e456ce8498cba865bda8f8445f1/users/9003c87ee6804a7a86aa2c1e6ec97124/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:32.220773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:32.302213 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 983/1984] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:32.311329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90b673-b253-4dac-a16a-db7bc862b93e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:32.317079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:32.317849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.318197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.318559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.319405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:32.321125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:32.331206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1002/1985] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:55:32.336534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd19b-fa33-4892-a82f-7ef44adb38f1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:32.352135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd19b-fa33-4892-a82f-7ef44adb38f1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:32.357751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13188d1e-5a23-43a0-9a06-1e0d39ae7349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:32.358805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13188d1e-5a23-43a0-9a06-1e0d39ae7349 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.359085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13188d1e-5a23-43a0-9a06-1e0d39ae7349 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.359390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13188d1e-5a23-43a0-9a06-1e0d39ae7349 admin admin] PATH_INFO: `/v3/projects/e5e32e456ce8498cba865bda8f8445f1/users/9003c87ee6804a7a86aa2c1e6ec97124/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.361912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13188d1e-5a23-43a0-9a06-1e0d39ae7349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e32e456ce8498cba865bda8f8445f1, user_id=9003c87ee6804a7a86aa2c1e6ec97124, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:32.364709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13188d1e-5a23-43a0-9a06-1e0d39ae7349 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:32.376178 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 984/1986] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:32 2022] PUT /identity/v3/projects/e5e32e456ce8498cba865bda8f8445f1/users/9003c87ee6804a7a86aa2c1e6ec97124/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:32.622286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:32.643144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644a34-3c36-4279-a094-f2b5c79ca1d7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:32.724285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cdc1d-e7d1-4376-9e57-6ac3d6f82bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:32.724964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cdc1d-e7d1-4376-9e57-6ac3d6f82bfa service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:32.725297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cdc1d-e7d1-4376-9e57-6ac3d6f82bfa service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:32.725564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cdc1d-e7d1-4376-9e57-6ac3d6f82bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:32.746195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cdc1d-e7d1-4376-9e57-6ac3d6f82bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:32.747947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cdc1d-e7d1-4376-9e57-6ac3d6f82bfa service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:32.759697 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1003/1987] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:33.752334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf646d-71f7-4fb5-80af-084b3f62bd80 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:33.753166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf646d-71f7-4fb5-80af-084b3f62bd80 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:33.753701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf646d-71f7-4fb5-80af-084b3f62bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:33.786768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5fdf646d-71f7-4fb5-80af-084b3f62bd80 None None] MFA Rules not processed for user `9003c87ee6804a7a86aa2c1e6ec97124`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:33.788089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5fdf646d-71f7-4fb5-80af-084b3f62bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:33.876151 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 985/1988] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:33.886848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4069a-7af0-4de8-ab9d-a05635cea976 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:33.888370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4069a-7af0-4de8-ab9d-a05635cea976 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:33.888932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4069a-7af0-4de8-ab9d-a05635cea976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:33.907066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b6b4069a-7af0-4de8-ab9d-a05635cea976 None None] MFA Rules not processed for user `9c775742dfc04cec8559f9e4d13239b0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:33.908957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6b4069a-7af0-4de8-ab9d-a05635cea976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:33.965693 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1004/1989] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:33.977334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf646d-71f7-4fb5-80af-084b3f62bd80 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:33.990165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf646d-71f7-4fb5-80af-084b3f62bd80 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:33.996551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163954b6-e9d8-4a52-bdba-d64ca1c37b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:33.997331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163954b6-e9d8-4a52-bdba-d64ca1c37b22 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:33.997676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163954b6-e9d8-4a52-bdba-d64ca1c37b22 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:33.998010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163954b6-e9d8-4a52-bdba-d64ca1c37b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:34.006377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163954b6-e9d8-4a52-bdba-d64ca1c37b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:34.007980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163954b6-e9d8-4a52-bdba-d64ca1c37b22 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:34.017014 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 986/1990] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:55:34.301728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea557ea-3003-4670-ae77-ae6d2f444823 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:34.302094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea557ea-3003-4670-ae77-ae6d2f444823 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:34.302409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea557ea-3003-4670-ae77-ae6d2f444823 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:34.304148 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1005/1991] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:34.309704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b044416-de5a-4c2c-aace-081ff2a3ea0d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:34.310139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b044416-de5a-4c2c-aace-081ff2a3ea0d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:34.310492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b044416-de5a-4c2c-aace-081ff2a3ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:34.332324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1b044416-de5a-4c2c-aace-081ff2a3ea0d None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:34.333617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1b044416-de5a-4c2c-aace-081ff2a3ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:34.395673 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 987/1992] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:34.413545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea557ea-3003-4670-ae77-ae6d2f444823 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:34.425298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea557ea-3003-4670-ae77-ae6d2f444823 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:34.431058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a5f64-c148-4a6e-b414-c1fbee3d03e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:34.431989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a5f64-c148-4a6e-b414-c1fbee3d03e2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:34.432510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a5f64-c148-4a6e-b414-c1fbee3d03e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:34.432964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a5f64-c148-4a6e-b414-c1fbee3d03e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:34.447607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a5f64-c148-4a6e-b414-c1fbee3d03e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:34.449137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a5f64-c148-4a6e-b414-c1fbee3d03e2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:34.458598 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1006/1993] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:55:37.050290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b044416-de5a-4c2c-aace-081ff2a3ea0d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:37.203567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b044416-de5a-4c2c-aace-081ff2a3ea0d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:37.216290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:37.217380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:37.217734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:37.218077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] PATH_INFO: `/v3/users/ce95355d717b4ee09c93754baa6a31fb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:37.219422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce95355d717b4ee09c93754baa6a31fb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:37.221871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:37.304223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce95355d717b4ee09c93754baa6a31fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:37.305331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce95355d717b4ee09c93754baa6a31fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:37.315134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce95355d717b4ee09c93754baa6a31fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:37.316133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce95355d717b4ee09c93754baa6a31fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:37.325402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce95355d717b4ee09c93754baa6a31fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:37.355145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 988/1994] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:37 2022] DELETE /identity/v3/users/ce95355d717b4ee09c93754baa6a31fb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:37.360762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34878b9-5144-4641-b232-b9516a34778a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:37.361311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34878b9-5144-4641-b232-b9516a34778a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:37.361311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34878b9-5144-4641-b232-b9516a34778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:37.383983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b34878b9-5144-4641-b232-b9516a34778a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:37.385238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b34878b9-5144-4641-b232-b9516a34778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:37.483581 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1007/1995] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:37.496457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:37.498142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:37.630149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a4f3-7d3a-454a-95e0-5aab28c664f8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:37.634031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:37.634703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:37.646440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:37.646743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:37.667114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:37.668252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:37.690931 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 989/1996] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:37.984036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34878b9-5144-4641-b232-b9516a34778a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:37.985902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b34878b9-5144-4641-b232-b9516a34778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:38.007907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34878b9-5144-4641-b232-b9516a34778a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:38.026342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:38.027434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:38.027804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:38.028081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] PATH_INFO: `/v3/projects/824b62cd9d7c4a58a76615640e1a7eb1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:38.029539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824b62cd9d7c4a58a76615640e1a7eb1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:38.032088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:38.098195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824b62cd9d7c4a58a76615640e1a7eb1', 'request_id': 'req-db42dce4-39e4-4725-add8-38e1dac1a2b6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.103452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824b62cd9d7c4a58a76615640e1a7eb1', 'request_id': 'req-db42dce4-39e4-4725-add8-38e1dac1a2b6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.112287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824b62cd9d7c4a58a76615640e1a7eb1', 'request_id': 'req-db42dce4-39e4-4725-add8-38e1dac1a2b6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.123915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] The token cache is being invalidate because project 824b62cd9d7c4a58a76615640e1a7eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:38.124299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.124948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.126895 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1008/1997] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:37 2022] DELETE /identity/v3/projects/824b62cd9d7c4a58a76615640e1a7eb1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:38.130707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:38.140942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a61c7-99e4-4fe1-8943-bfbd24967eb1 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:38.197618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:38.198600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:38.198888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:38.199213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] PATH_INFO: `/v3/users/dc7ff1d929e846448003f9a4a8cf43f7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:38.200683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7ff1d929e846448003f9a4a8cf43f7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:38.203472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:38.261063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7ff1d929e846448003f9a4a8cf43f7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.261770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7ff1d929e846448003f9a4a8cf43f7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.270911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7ff1d929e846448003f9a4a8cf43f7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.271868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7ff1d929e846448003f9a4a8cf43f7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.281547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10b35358-04a6-4ffd-94ea-90b3803b06b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7ff1d929e846448003f9a4a8cf43f7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.302481 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 990/1998] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:38 2022] DELETE /identity/v3/users/dc7ff1d929e846448003f9a4a8cf43f7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:38.565213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:38.566843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:38.580737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dce4-39e4-4725-add8-38e1dac1a2b6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:38.665521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:38.666437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:38.666708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:38.666985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] PATH_INFO: `/v3/projects/3e5a3b1cb32a4e2ca7c665a6720d857e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:38.668368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5a3b1cb32a4e2ca7c665a6720d857e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:38.670721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:38.724395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5a3b1cb32a4e2ca7c665a6720d857e', 'request_id': 'req-d2e93776-8b47-4388-82c7-e5234d81cc38'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.733866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5a3b1cb32a4e2ca7c665a6720d857e', 'request_id': 'req-d2e93776-8b47-4388-82c7-e5234d81cc38'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.748210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5a3b1cb32a4e2ca7c665a6720d857e', 'request_id': 'req-d2e93776-8b47-4388-82c7-e5234d81cc38'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.764869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] The token cache is being invalidate because project 3e5a3b1cb32a4e2ca7c665a6720d857e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:38.765837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.766508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d2e93776-8b47-4388-82c7-e5234d81cc38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:38.769425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1009/1999] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:38 2022] DELETE /identity/v3/projects/3e5a3b1cb32a4e2ca7c665a6720d857e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:38.773815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e805e-4c9d-4e80-9d16-9e9b5b1d36dc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:38.774548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e805e-4c9d-4e80-9d16-9e9b5b1d36dc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:38.774828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e805e-4c9d-4e80-9d16-9e9b5b1d36dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:38.795168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-349e805e-4c9d-4e80-9d16-9e9b5b1d36dc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:38.796563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-349e805e-4c9d-4e80-9d16-9e9b5b1d36dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:38.864404 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 991/2000] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:38.866197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737fd1-5721-4cc0-b396-411145844b48 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:38.866490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737fd1-5721-4cc0-b396-411145844b48 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:38.866818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737fd1-5721-4cc0-b396-411145844b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:38.898394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f8737fd1-5721-4cc0-b396-411145844b48 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:38.902425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f8737fd1-5721-4cc0-b396-411145844b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:38.914852 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1010/2001] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:38.915862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e805e-4c9d-4e80-9d16-9e9b5b1d36dc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:38.927917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e805e-4c9d-4e80-9d16-9e9b5b1d36dc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:38.933433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:38.934131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:38.934419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:38.935132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:38.935960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:38.936355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:38.938512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:38.954101 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 992/2002] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:38.958718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737fd1-5721-4cc0-b396-411145844b48 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:38.978778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737fd1-5721-4cc0-b396-411145844b48 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:38.988430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:38.989480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:38.991303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:38.991721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:38.992641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:38.997819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.046585 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1011/2003] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:38 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:39.050978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.062901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2b774-5c2a-4fab-93d5-3c4af83eb4bf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.126374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.127207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.127576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.127975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.128921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.131011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.158679 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 993/2004] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:39 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:39.162320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.174801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681dc53-9c85-4554-9e6a-b1b67868b8ec admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.180165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.181164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.181583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.182059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.182977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.184619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.207292 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1012/2005] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:55:39.211132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.222846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3fedf-9fec-49be-89c7-d9b7c25feb34 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.230165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301548-0816-4963-b626-45af81d59ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.231070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301548-0816-4963-b626-45af81d59ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.231469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301548-0816-4963-b626-45af81d59ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.232399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301548-0816-4963-b626-45af81d59ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.233247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301548-0816-4963-b626-45af81d59ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.235399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301548-0816-4963-b626-45af81d59ee5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.246896 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 994/2006] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:39.251308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.261654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00284a09-7d83-430f-8b98-dafdc3fbf5d1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.266571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.267492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.267765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.268041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] PATH_INFO: `/v3/projects/b21b82d625c249269c02db9bbe700c7c/users/0bcc50583d0c4b9aa9d9c9b7ad87a576/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.284351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21b82d625c249269c02db9bbe700c7c, user_id=0bcc50583d0c4b9aa9d9c9b7ad87a576, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.287092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.305175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1013/2007] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:39 2022] PUT /identity/v3/projects/b21b82d625c249269c02db9bbe700c7c/users/0bcc50583d0c4b9aa9d9c9b7ad87a576/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:39.316854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bbea2-c8cc-4dbd-8554-bc0b85809022 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.317313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bbea2-c8cc-4dbd-8554-bc0b85809022 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.317599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bbea2-c8cc-4dbd-8554-bc0b85809022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.347008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-548bbea2-c8cc-4dbd-8554-bc0b85809022 None None] MFA Rules not processed for user `0bcc50583d0c4b9aa9d9c9b7ad87a576`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:39.348160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-548bbea2-c8cc-4dbd-8554-bc0b85809022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:39.422811 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 995/2008] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:39.426804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.494149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0064e7-68f6-4d83-8db8-1ee31c6ddd2e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.499032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.499715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.499991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.500265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.500952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.502945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.537506 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1014/2009] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:39 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:39.538948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bbea2-c8cc-4dbd-8554-bc0b85809022 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.550456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bbea2-c8cc-4dbd-8554-bc0b85809022 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.608559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.609204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.609831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.610108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.610799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.612747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.637964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 996/2010] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:39 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:39.639560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.650911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d6d6c-c5e4-487d-97db-6914e9412bbe admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.656511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.657243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.657513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.657800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.658507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.660146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.672225 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1015/2011] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:39.675956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.686553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0b03-3a02-4a71-a0c4-eb63d42b703b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.692867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.693952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.694327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.694693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] PATH_INFO: `/v3/projects/92ecd38c1e92486fa25acf2c581b5315/users/0424b6c2d71a46b68f80812a75ac3efc/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.712619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ecd38c1e92486fa25acf2c581b5315, user_id=0424b6c2d71a46b68f80812a75ac3efc, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.715422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.730764 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 997/2012] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:39 2022] PUT /identity/v3/projects/92ecd38c1e92486fa25acf2c581b5315/users/0424b6c2d71a46b68f80812a75ac3efc/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:39.735515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.747929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7322-d41d-4e9d-90ff-50afd0a47040 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.812046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3b97b-2f1e-4a05-bff8-9d2f2bcb1f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.812810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b97b-2f1e-4a05-bff8-9d2f2bcb1f57 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.813189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b97b-2f1e-4a05-bff8-9d2f2bcb1f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.813696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b97b-2f1e-4a05-bff8-9d2f2bcb1f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.814327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3b97b-2f1e-4a05-bff8-9d2f2bcb1f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.816431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3b97b-2f1e-4a05-bff8-9d2f2bcb1f57 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.829475 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1016/2013] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:39.831003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:39.843511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccbd7c-f930-4889-a2bc-e3f9114b8f19 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:39.850160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fea93a-9872-4a16-bce8-c49878e2ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:39.851179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea93a-9872-4a16-bce8-c49878e2ee9e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.851542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea93a-9872-4a16-bce8-c49878e2ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.851813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea93a-9872-4a16-bce8-c49878e2ee9e admin admin] PATH_INFO: `/v3/projects/92ecd38c1e92486fa25acf2c581b5315/users/0424b6c2d71a46b68f80812a75ac3efc/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.853894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fea93a-9872-4a16-bce8-c49878e2ee9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ecd38c1e92486fa25acf2c581b5315, user_id=0424b6c2d71a46b68f80812a75ac3efc, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:39.856745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fea93a-9872-4a16-bce8-c49878e2ee9e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:39.873138 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 998/2014] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:39 2022] PUT /identity/v3/projects/92ecd38c1e92486fa25acf2c581b5315/users/0424b6c2d71a46b68f80812a75ac3efc/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:39.881399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:39.882026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:39.882508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:39.925394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] MFA Rules not processed for user `0424b6c2d71a46b68f80812a75ac3efc`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:39.928304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:40.020409 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1017/2015] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:40.030204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18671053-0952-4e89-b956-9f5e2f3c1ab2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:40.030607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18671053-0952-4e89-b956-9f5e2f3c1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:40.030958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18671053-0952-4e89-b956-9f5e2f3c1ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:40.052663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-18671053-0952-4e89-b956-9f5e2f3c1ab2 None None] MFA Rules not processed for user `0bcc50583d0c4b9aa9d9c9b7ad87a576`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:40.052663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-18671053-0952-4e89-b956-9f5e2f3c1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:40.151176 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 999/2016] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:40.163445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:40.165002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:40.295647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603886-3254-4ab9-8248-685dba9da4f7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:40.303834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0696ae0-8df0-46c2-8dcc-730f2618abd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:40.306523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696ae0-8df0-46c2-8dcc-730f2618abd4 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:40.306908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696ae0-8df0-46c2-8dcc-730f2618abd4 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:40.307254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696ae0-8df0-46c2-8dcc-730f2618abd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:40.321461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0696ae0-8df0-46c2-8dcc-730f2618abd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:40.324358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0696ae0-8df0-46c2-8dcc-730f2618abd4 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:40.342082 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1018/2017] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:43.140590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd29827-5e86-4ad1-9842-8cd9fd3ff386 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:43.141827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd29827-5e86-4ad1-9842-8cd9fd3ff386 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:43.142610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd29827-5e86-4ad1-9842-8cd9fd3ff386 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:43.145730 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1000/2018] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:55:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:43.162075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257d36-78ed-4362-afef-6e1d1c7275da None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:43.162663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257d36-78ed-4362-afef-6e1d1c7275da None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:43.162663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257d36-78ed-4362-afef-6e1d1c7275da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:43.194338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-37257d36-78ed-4362-afef-6e1d1c7275da None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:43.195757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-37257d36-78ed-4362-afef-6e1d1c7275da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:43.227131 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1019/2019] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:43.462641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd29827-5e86-4ad1-9842-8cd9fd3ff386 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:43.464612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7dd29827-5e86-4ad1-9842-8cd9fd3ff386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:43.486788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd29827-5e86-4ad1-9842-8cd9fd3ff386 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:43.497844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:43.499404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:43.499997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:43.500595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:43.513510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:43.515629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:43.532353 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1001/2020] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:44.040640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37257d36-78ed-4362-afef-6e1d1c7275da None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:44.054288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37257d36-78ed-4362-afef-6e1d1c7275da None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:44.062125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840476c8-bfea-4b68-85f9-cce593877cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:44.063009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840476c8-bfea-4b68-85f9-cce593877cd8 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:44.063425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840476c8-bfea-4b68-85f9-cce593877cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:44.063840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840476c8-bfea-4b68-85f9-cce593877cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:44.066288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-840476c8-bfea-4b68-85f9-cce593877cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:44.170887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840476c8-bfea-4b68-85f9-cce593877cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:44.172540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840476c8-bfea-4b68-85f9-cce593877cd8 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:44.186530 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1020/2021] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:44.425182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:44.428156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:44.562237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790ff36-935e-4acf-b7a8-a1a267a2fb76 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:44.579740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:44.583071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:44.583805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:44.584285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] PATH_INFO: `/v3/users/a24beaf728454be58cfed6a585166e91` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:44.586001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24beaf728454be58cfed6a585166e91)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:44.588388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:44.671611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24beaf728454be58cfed6a585166e91'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:44.673226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24beaf728454be58cfed6a585166e91'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:44.681670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24beaf728454be58cfed6a585166e91'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:44.683028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24beaf728454be58cfed6a585166e91'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:44.708987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24beaf728454be58cfed6a585166e91'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:44.762783 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1002/2022] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:44 2022] DELETE /identity/v3/users/a24beaf728454be58cfed6a585166e91 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:44.764607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:44.764907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:44.765206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:44.794047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:44.795596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:44.886970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1021/2023] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:44.901544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:44.903072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:45.001003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136cdb-d737-48a1-a82c-606ee964b5a4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:45.005558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b021ca5-31a5-407d-ae0a-9858b57583ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:45.006417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b021ca5-31a5-407d-ae0a-9858b57583ed service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:45.008571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b021ca5-31a5-407d-ae0a-9858b57583ed service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:45.008871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b021ca5-31a5-407d-ae0a-9858b57583ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:45.029372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b021ca5-31a5-407d-ae0a-9858b57583ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:45.030835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b021ca5-31a5-407d-ae0a-9858b57583ed service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:45.041552 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1003/2024] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:45.227097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:45.228787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:45.243629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6c92d-7030-401f-b65b-1855e6e6c343 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:45.249824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:45.250754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:45.251029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:45.251422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] PATH_INFO: `/v3/users/21b8a2de5b20457dadb5a3b610cd6d9b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:45.252743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b8a2de5b20457dadb5a3b610cd6d9b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:45.254889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:45.397419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b8a2de5b20457dadb5a3b610cd6d9b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.398328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b8a2de5b20457dadb5a3b610cd6d9b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.428610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b8a2de5b20457dadb5a3b610cd6d9b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.462548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b8a2de5b20457dadb5a3b610cd6d9b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.463337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b8a2de5b20457dadb5a3b610cd6d9b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.513519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1022/2025] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:45 2022] DELETE /identity/v3/users/21b8a2de5b20457dadb5a3b610cd6d9b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:45.517484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:45.519207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:45.519647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:45.554819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:45.556462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:45.659827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:45.661770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:45.704526 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1004/2026] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:45.742533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:45.744563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:45.794354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dea60-e63e-482d-86d7-c4c8d428ce41 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:45.810435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:45.812365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:45.812804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:45.814383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] PATH_INFO: `/v3/users/dd3b417af048460da3ef7f6250a9b796` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:45.818006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3b417af048460da3ef7f6250a9b796)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:45.821114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:45.871297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7d28-aa9b-4fe0-a27d-5a89ddb3d36b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:45.878875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328126a5-14d0-45c6-afd8-3e5866535aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:45.881999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328126a5-14d0-45c6-afd8-3e5866535aea service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:45.881999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328126a5-14d0-45c6-afd8-3e5866535aea service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:45.881999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328126a5-14d0-45c6-afd8-3e5866535aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:45.895059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328126a5-14d0-45c6-afd8-3e5866535aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:45.896886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328126a5-14d0-45c6-afd8-3e5866535aea service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:45.915314 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1005/2027] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:45.932691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3b417af048460da3ef7f6250a9b796'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.933420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3b417af048460da3ef7f6250a9b796'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.944918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3b417af048460da3ef7f6250a9b796'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.963210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3b417af048460da3ef7f6250a9b796'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:45.964702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3b417af048460da3ef7f6250a9b796'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.011588 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1023/2028] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:45 2022] DELETE /identity/v3/users/dd3b417af048460da3ef7f6250a9b796 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:46.013501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:46.013788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:46.014061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:46.044547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:46.046055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:46.137511 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1006/2029] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:46.146899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:46.148519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:46.163449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:46.165877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:46.173622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc6d4a-3aaa-4d39-998d-7da4708497f6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:46.184484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:46.185544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:46.185824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:46.186276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] PATH_INFO: `/v3/projects/132a3cf21adc4ce8a00f6c26761cb996` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:46.187547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=132a3cf21adc4ce8a00f6c26761cb996)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:46.190119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:46.286367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132a3cf21adc4ce8a00f6c26761cb996', 'request_id': 'req-b13161ed-9847-4226-b4d2-3c9a6442b2df'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.287965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30e120-1803-45b0-96c2-e03afe9356dd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:46.294171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132a3cf21adc4ce8a00f6c26761cb996', 'request_id': 'req-b13161ed-9847-4226-b4d2-3c9a6442b2df'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.309163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132a3cf21adc4ce8a00f6c26761cb996', 'request_id': 'req-b13161ed-9847-4226-b4d2-3c9a6442b2df'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.338938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] The token cache is being invalidate because project 132a3cf21adc4ce8a00f6c26761cb996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:46.339328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.340130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.345098 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1024/2030] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:46 2022] DELETE /identity/v3/projects/132a3cf21adc4ce8a00f6c26761cb996 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:46.346034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:46.347528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:46.426378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:46.427541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:46.427900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:46.428248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:46.433108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:46.436303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13161ed-9847-4226-b4d2-3c9a6442b2df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:46.442407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:46.446771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:46.447295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:46.447771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] PATH_INFO: `/v3/users/824856226f55468ca7557eea6a178f76` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:46.449546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824856226f55468ca7557eea6a178f76)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:46.451836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:46.467353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:46.469165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:46.490798 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1007/2031] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:46.522319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824856226f55468ca7557eea6a178f76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.523001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824856226f55468ca7557eea6a178f76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.531416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824856226f55468ca7557eea6a178f76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.542516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824856226f55468ca7557eea6a178f76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.543234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a6364929-9491-4f7d-9408-20b78fa8d4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824856226f55468ca7557eea6a178f76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:46.574161 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1025/2032] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:46 2022] DELETE /identity/v3/users/824856226f55468ca7557eea6a178f76 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:46.910714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:46.923873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416f0ae-6d1a-4886-b7fd-fa824b6a8ab2 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:46.987711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:46.988618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:46.988902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:46.989209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] PATH_INFO: `/v3/projects/e6983f4fb6624a2ea3d482d79202ed5b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:46.990420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6983f4fb6624a2ea3d482d79202ed5b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:46.992407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:47.052353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6983f4fb6624a2ea3d482d79202ed5b', 'request_id': 'req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.062036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6983f4fb6624a2ea3d482d79202ed5b', 'request_id': 'req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.081857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6983f4fb6624a2ea3d482d79202ed5b', 'request_id': 'req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.099521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] The token cache is being invalidate because project e6983f4fb6624a2ea3d482d79202ed5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:47.099937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.100758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0e278bf2-d9a3-45fa-a986-b6d2505ccda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.108532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1008/2033] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:46 2022] DELETE /identity/v3/projects/e6983f4fb6624a2ea3d482d79202ed5b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:47.109918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.110205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.110549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.140051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:47.141550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.267513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1026/2034] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:47.277546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.278045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.278331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.301073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:47.314741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.338021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:47.338620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.353584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1009/2035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:47.355317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:47.356923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.375761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180dba7-3059-4a4c-9511-366a259c273b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:47.384685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c29a-4842-40ae-a96a-8cef660d3ce2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:47.396711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:47.397649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.397923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.398183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] PATH_INFO: `/v3/projects/eb2447d5bc83456ab7bd6a3878bcaaa8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.399898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2447d5bc83456ab7bd6a3878bcaaa8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:47.401908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:47.404770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:47.406527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.406930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.407355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] PATH_INFO: `/v3/projects/47d1b7dc90f744f3861133f61e9b773a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.408730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d1b7dc90f744f3861133f61e9b773a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:47.411322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:47.492677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d1b7dc90f744f3861133f61e9b773a', 'request_id': 'req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.503011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d1b7dc90f744f3861133f61e9b773a', 'request_id': 'req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.514753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2447d5bc83456ab7bd6a3878bcaaa8', 'request_id': 'req-55cbfeb6-91db-464e-9713-850e794287be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.516127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d1b7dc90f744f3861133f61e9b773a', 'request_id': 'req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.520167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2447d5bc83456ab7bd6a3878bcaaa8', 'request_id': 'req-55cbfeb6-91db-464e-9713-850e794287be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.530652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2447d5bc83456ab7bd6a3878bcaaa8', 'request_id': 'req-55cbfeb6-91db-464e-9713-850e794287be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.533776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] The token cache is being invalidate because project 47d1b7dc90f744f3861133f61e9b773a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:47.534220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.535194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.536962 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1010/2036] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:47 2022] DELETE /identity/v3/projects/47d1b7dc90f744f3861133f61e9b773a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:47.541290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:47.542648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.543487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] The token cache is being invalidate because project eb2447d5bc83456ab7bd6a3878bcaaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:47.543778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.544468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.546478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1027/2037] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:47 2022] DELETE /identity/v3/projects/eb2447d5bc83456ab7bd6a3878bcaaa8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:47.549826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:47.551983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.617291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbfeb6-91db-464e-9713-850e794287be admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:47.621097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaf15c-05de-40f9-8b77-5dd26ac58b4f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:47.622377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:47.623338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.623612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.623887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] PATH_INFO: `/v3/users/7fb802048185487881a18765503f81a2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.625348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb802048185487881a18765503f81a2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:47.626047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:47.626726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.627009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.627246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:47.627351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.628006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:47.628313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:47.629984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:47.642613 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1011/2038] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:47.647018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:47.648711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.671091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612b47a-7bc4-436a-8b7a-8c356a762ad1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:47.678158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a59661-2600-4781-895e-621446676508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:47.679508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a59661-2600-4781-895e-621446676508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.680096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a59661-2600-4781-895e-621446676508 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.680548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a59661-2600-4781-895e-621446676508 admin admin] PATH_INFO: `/v3/users/f6a653e02a3a4a9abd657bde31444925` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.682334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a59661-2600-4781-895e-621446676508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a653e02a3a4a9abd657bde31444925)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:47.685076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a59661-2600-4781-895e-621446676508 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:47.695845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb802048185487881a18765503f81a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.696603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb802048185487881a18765503f81a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.705946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb802048185487881a18765503f81a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.722292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb802048185487881a18765503f81a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.723772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb802048185487881a18765503f81a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.744155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a59661-2600-4781-895e-621446676508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a653e02a3a4a9abd657bde31444925'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.745436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a59661-2600-4781-895e-621446676508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a653e02a3a4a9abd657bde31444925'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.755844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a59661-2600-4781-895e-621446676508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a653e02a3a4a9abd657bde31444925'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.756881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a59661-2600-4781-895e-621446676508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a653e02a3a4a9abd657bde31444925'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.769330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1028/2039] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:47 2022] DELETE /identity/v3/users/7fb802048185487881a18765503f81a2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:47.770516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:47.772137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:47.777066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a59661-2600-4781-895e-621446676508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a653e02a3a4a9abd657bde31444925'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:47.830613 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1012/2040] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:47 2022] DELETE /identity/v3/users/f6a653e02a3a4a9abd657bde31444925 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:47.846385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655b826-9a03-4810-82d5-d25c04099bcb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:47.923191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:47.923993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:47.924381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:47.924757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:47.926219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:47.930408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:47.978957 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1029/2041] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:47 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:47.982254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a59661-2600-4781-895e-621446676508 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:47.984079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76a59661-2600-4781-895e-621446676508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.009913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a59661-2600-4781-895e-621446676508 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.111489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.112234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.112523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.112801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.113577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.115524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.150865 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1013/2042] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:47 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:55:48.155044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.170316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9d88a-c6ab-4e9d-91f3-255beea1f02b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.176629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.177623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.178563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.178984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.180487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.183382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.205834 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1030/2043] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:48.210984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.224024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec89e-4d0a-4090-a3cd-aa85a76d4ad5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.247805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847c846-25f8-441d-ae15-5ff391674466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.248804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c846-25f8-441d-ae15-5ff391674466 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.249384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c846-25f8-441d-ae15-5ff391674466 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.249800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c846-25f8-441d-ae15-5ff391674466 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.250973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847c846-25f8-441d-ae15-5ff391674466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.253564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847c846-25f8-441d-ae15-5ff391674466 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.277102 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1014/2044] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:55:48.278668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.289265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c0af8-b934-4059-aefe-703973cb60c9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.296751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.297913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.298341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.298781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] PATH_INFO: `/v3/projects/08fdacb13c2b449581a193ace4bc6a96/users/4b5944d7fb154068b102bbe1ba914d72/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.319594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fdacb13c2b449581a193ace4bc6a96, user_id=4b5944d7fb154068b102bbe1ba914d72, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.334584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.352590 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1031/2045] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:48 2022] PUT /identity/v3/projects/08fdacb13c2b449581a193ace4bc6a96/users/4b5944d7fb154068b102bbe1ba914d72/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:48.365366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f163f-7cfc-413b-b140-47b4201e3006 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.365672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f163f-7cfc-413b-b140-47b4201e3006 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.365940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f163f-7cfc-413b-b140-47b4201e3006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.398216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9e3f163f-7cfc-413b-b140-47b4201e3006 None None] MFA Rules not processed for user `4b5944d7fb154068b102bbe1ba914d72`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:48.399736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9e3f163f-7cfc-413b-b140-47b4201e3006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.440556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.442331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.505221 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1015/2046] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:48.510294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f163f-7cfc-413b-b140-47b4201e3006 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.564757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cbfd-04da-4b78-8ae9-e9e5fec67e71 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.569933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.571303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.571687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.572087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] PATH_INFO: `/v3/projects/49a926a88661416394b9f040a6d2654d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.573612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a926a88661416394b9f040a6d2654d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.576247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.612400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f163f-7cfc-413b-b140-47b4201e3006 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.617882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56194e-e91b-4c59-a160-0004c91daa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.618713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56194e-e91b-4c59-a160-0004c91daa2d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.620119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56194e-e91b-4c59-a160-0004c91daa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.620504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56194e-e91b-4c59-a160-0004c91daa2d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.621303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56194e-e91b-4c59-a160-0004c91daa2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.623443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56194e-e91b-4c59-a160-0004c91daa2d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.641572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a926a88661416394b9f040a6d2654d', 'request_id': 'req-2dc0c54b-0798-48db-bc55-9e4ce76ac787'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.648119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a926a88661416394b9f040a6d2654d', 'request_id': 'req-2dc0c54b-0798-48db-bc55-9e4ce76ac787'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.656243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a926a88661416394b9f040a6d2654d', 'request_id': 'req-2dc0c54b-0798-48db-bc55-9e4ce76ac787'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.663140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1016/2047] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:48 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:48.664925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.665603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.665901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.675317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] The token cache is being invalidate because project 49a926a88661416394b9f040a6d2654d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:48.676309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.677257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.679430 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1032/2048] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:48 2022] DELETE /identity/v3/projects/49a926a88661416394b9f040a6d2654d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:48.680546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.682457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.689719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] MFA Rules not processed for user `111ebd03dde445c99b447894d3ad03e7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:48.690932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.757059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c54b-0798-48db-bc55-9e4ce76ac787 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.757280 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1017/2049] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:48.758181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.759529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.820807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.821770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.822047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.822315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] PATH_INFO: `/v3/projects/c1279809035b498e982fc5452be4b0a3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.823560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1279809035b498e982fc5452be4b0a3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.825414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a9825-6dca-47b0-a586-7fb49ca45539 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:48.825588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.830282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3582d-eb43-4c75-b628-f86f21e72e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:48.830958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3582d-eb43-4c75-b628-f86f21e72e58 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.831234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3582d-eb43-4c75-b628-f86f21e72e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.831506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3582d-eb43-4c75-b628-f86f21e72e58 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.832203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3582d-eb43-4c75-b628-f86f21e72e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:48.834186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3582d-eb43-4c75-b628-f86f21e72e58 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:48.858325 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1018/2050] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:48 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:48.860258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07d26-c96c-4c93-bd69-db99c1ddadab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.860542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07d26-c96c-4c93-bd69-db99c1ddadab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.860815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07d26-c96c-4c93-bd69-db99c1ddadab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:48.881597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-38c07d26-c96c-4c93-bd69-db99c1ddadab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:48.881854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1279809035b498e982fc5452be4b0a3', 'request_id': 'req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.882929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-38c07d26-c96c-4c93-bd69-db99c1ddadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.888578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1279809035b498e982fc5452be4b0a3', 'request_id': 'req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.899597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1279809035b498e982fc5452be4b0a3', 'request_id': 'req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.912068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] The token cache is being invalidate because project c1279809035b498e982fc5452be4b0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:48.912419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.913142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:48.915439 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1033/2051] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:48 2022] DELETE /identity/v3/projects/c1279809035b498e982fc5452be4b0a3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:48.916291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:48.921870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:48.977923 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1019/2052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:48.979244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40eb22-7beb-4fea-9f25-376db59e4202 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:48.979783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40eb22-7beb-4fea-9f25-376db59e4202 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:48.980066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40eb22-7beb-4fea-9f25-376db59e4202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.010349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-dc40eb22-7beb-4fea-9f25-376db59e4202 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:49.011987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dc40eb22-7beb-4fea-9f25-376db59e4202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:49.022472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1020/2053] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:49.023818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392649-7ddb-4b80-bafd-1a46bf4551b8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.024102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392649-7ddb-4b80-bafd-1a46bf4551b8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.024378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392649-7ddb-4b80-bafd-1a46bf4551b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.034534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5d1ce-4b34-46d9-ad42-337c7328ec59 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.039652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.040421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.041233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.041580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.043044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.045357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.048360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-68392649-7ddb-4b80-bafd-1a46bf4551b8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:49.049606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-68392649-7ddb-4b80-bafd-1a46bf4551b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:49.058112 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1021/2054] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:49.058763 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1034/2055] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:49.059655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac46c4-c4b5-4cb4-9be4-474a23d8e93c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.059939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac46c4-c4b5-4cb4-9be4-474a23d8e93c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.060256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac46c4-c4b5-4cb4-9be4-474a23d8e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.066239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.084984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-eaac46c4-c4b5-4cb4-9be4-474a23d8e93c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:49.088042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eaac46c4-c4b5-4cb4-9be4-474a23d8e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:49.091938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bef05-8312-454d-8169-a2cf0445e30b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.100740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.102225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.102608 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1022/2056] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:49.103456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac46c4-c4b5-4cb4-9be4-474a23d8e93c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.104368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.104818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] PATH_INFO: `/v3/projects/52a8acfb70684381b3ff7befaf40aa23/users/548dab8112aa49cc825d33a974e9fc63/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.116801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac46c4-c4b5-4cb4-9be4-474a23d8e93c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.121706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.122391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.122793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.123067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.123800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:49.124104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.125851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.138018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a8acfb70684381b3ff7befaf40aa23, user_id=548dab8112aa49cc825d33a974e9fc63, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.142106 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1023/2057] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:49.142106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.144111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.156922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398bf61-983c-457f-9544-165202b57028 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.162289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1035/2058] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:49 2022] PUT /identity/v3/projects/52a8acfb70684381b3ff7befaf40aa23/users/548dab8112aa49cc825d33a974e9fc63/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:49.163445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.236222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.237898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.238631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.239044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.245614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:49.248910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.251049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.264598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6cd9-c838-43eb-9071-dcdc0450e224 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.265418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1024/2059] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:49.269928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.271543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.274130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.274608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.276688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.279382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.281577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.290865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a402d3a-7dcf-4ca4-ab38-5f0b6dc84526 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.296794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.299580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.299947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.300359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.301254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.303147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.328008 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1036/2060] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:49 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:49.331007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.335809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1025/2061] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:49.335809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.358704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c1dc-36b7-485c-9d4a-3c6013b45a93 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.426132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.427323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.427671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.428160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.429388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.431775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.455569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb0347-6e04-4a45-b222-9ab3650c14d2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.463600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.464887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.465219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.465497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.466552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.472926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.481830 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1026/2062] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:49 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:49.484637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.503018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5689489-564a-4216-97d9-51fe5faa5ba8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.513939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.514861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.515144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.515419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] PATH_INFO: `/v3/projects/52a8acfb70684381b3ff7befaf40aa23/users/548dab8112aa49cc825d33a974e9fc63/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.522638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a8acfb70684381b3ff7befaf40aa23, user_id=548dab8112aa49cc825d33a974e9fc63, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.525803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.527331 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1037/2063] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:49 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:49.528582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.553097 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1027/2064] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:49 2022] PUT /identity/v3/projects/52a8acfb70684381b3ff7befaf40aa23/users/548dab8112aa49cc825d33a974e9fc63/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:49.553449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.706213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8783634-0fa0-45f0-933c-7f94bb6acba3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.797466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a05acf-52cb-4b3b-99a0-76246a291f76 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.804626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaad41-4a70-4694-a632-1d835f64ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.805546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaad41-4a70-4694-a632-1d835f64ec86 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.805788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaad41-4a70-4694-a632-1d835f64ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.806416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaad41-4a70-4694-a632-1d835f64ec86 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.807143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaad41-4a70-4694-a632-1d835f64ec86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.809244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaad41-4a70-4694-a632-1d835f64ec86 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.840168 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1028/2065] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:49 2022] POST /identity/v3/users => generated 291 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:49.842727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040a4b-a56b-4fb5-8f64-fdbf74284bea None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.843022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040a4b-a56b-4fb5-8f64-fdbf74284bea None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.843338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040a4b-a56b-4fb5-8f64-fdbf74284bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.869683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.871887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.872857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.873739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.875365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.878522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.880088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-14040a4b-a56b-4fb5-8f64-fdbf74284bea None None] MFA Rules not processed for user `548dab8112aa49cc825d33a974e9fc63`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:49.880666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-14040a4b-a56b-4fb5-8f64-fdbf74284bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:49.896636 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1038/2066] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:49.897925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.909544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585bef5-3203-46bf-800a-1e085b23b857 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.916850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.917889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.918372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.918877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.920117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.922258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.935618 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1039/2067] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:49.937125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:49.956484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1838d-a546-48b2-b712-65e885ff24d9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:49.964392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:49.965396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:49.965852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:49.967375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:49.968281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:49.970588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:49.994883 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1040/2068] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:49.999311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.016697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9cd5-ef6b-4f81-974d-c739c7ce5af2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.021806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1029/2069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:50.021806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040a4b-a56b-4fb5-8f64-fdbf74284bea None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.028245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.029569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.030080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.030565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.031563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.033834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:50.034263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040a4b-a56b-4fb5-8f64-fdbf74284bea None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.040164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.042390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.042796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.043077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] PATH_INFO: `/v3/projects/51c2a88012224851ae8069f9a969f0d2/users/31b5f1ba8c2843fd879fd2241dc60d37/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.051001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1041/2070] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:50.052277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.054576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.063345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c2a88012224851ae8069f9a969f0d2, user_id=31b5f1ba8c2843fd879fd2241dc60d37, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.068132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:50.090976 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1030/2071] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:50 2022] PUT /identity/v3/projects/51c2a88012224851ae8069f9a969f0d2/users/31b5f1ba8c2843fd879fd2241dc60d37/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:50.100807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.155860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145be19-0849-4a1e-97e4-edc3bec799c0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.226758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f20ad-609e-40ca-bd0e-57fb151a4e0e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.234033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6dc4c-db93-489b-a54f-b8b6f366a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.235367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6dc4c-db93-489b-a54f-b8b6f366a748 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.235672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6dc4c-db93-489b-a54f-b8b6f366a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.237203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6dc4c-db93-489b-a54f-b8b6f366a748 admin admin] PATH_INFO: `/v3/projects/214a04a002984b78be0d28cc5364764f/users/73f234bc51954a4f9cf8117728f600e6/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.249978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160cd16-ee77-4bfb-97ec-f478a005d8fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.251200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160cd16-ee77-4bfb-97ec-f478a005d8fc service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.251710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160cd16-ee77-4bfb-97ec-f478a005d8fc service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.252181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160cd16-ee77-4bfb-97ec-f478a005d8fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.262158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6dc4c-db93-489b-a54f-b8b6f366a748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214a04a002984b78be0d28cc5364764f, user_id=73f234bc51954a4f9cf8117728f600e6, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.266680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6dc4c-db93-489b-a54f-b8b6f366a748 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:50.269643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d160cd16-ee77-4bfb-97ec-f478a005d8fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.288318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1031/2072] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:50 2022] PUT /identity/v3/projects/214a04a002984b78be0d28cc5364764f/users/73f234bc51954a4f9cf8117728f600e6/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:50.289976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd7ba1-70b0-46fc-9146-dc81b3184647 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.290269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd7ba1-70b0-46fc-9146-dc81b3184647 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.290541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd7ba1-70b0-46fc-9146-dc81b3184647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.333430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cefd7ba1-70b0-46fc-9146-dc81b3184647 None None] MFA Rules not processed for user `31b5f1ba8c2843fd879fd2241dc60d37`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:50.335029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cefd7ba1-70b0-46fc-9146-dc81b3184647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.385025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160cd16-ee77-4bfb-97ec-f478a005d8fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.386651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160cd16-ee77-4bfb-97ec-f478a005d8fc service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:50.398383 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1042/2073] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:50.399753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.400099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.400335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.440124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1032/2074] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:50.441458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd7ba1-70b0-46fc-9146-dc81b3184647 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.497015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] MFA Rules not processed for user `73f234bc51954a4f9cf8117728f600e6`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:50.498323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.529393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd7ba1-70b0-46fc-9146-dc81b3184647 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.542121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.544957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.545267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.545547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] PATH_INFO: `/v3/users/4b5944d7fb154068b102bbe1ba914d72` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.547050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5944d7fb154068b102bbe1ba914d72)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.549006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:50.643568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5944d7fb154068b102bbe1ba914d72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:50.645489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5944d7fb154068b102bbe1ba914d72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:50.654699 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1043/2075] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:50.656771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.659396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.661005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5944d7fb154068b102bbe1ba914d72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:50.662051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5944d7fb154068b102bbe1ba914d72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:50.678517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5944d7fb154068b102bbe1ba914d72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:50.707756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1033/2076] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:50 2022] DELETE /identity/v3/users/4b5944d7fb154068b102bbe1ba914d72 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:50.708892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.711202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.732217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9e88-e7a5-44ac-b370-4a5608fd4241 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.782999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.783776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.784064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.784341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.786433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.797739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb573dec-3e37-4440-be78-26fe2afdb5a6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.813392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbccc8b-d0a3-4b79-89fa-e6d8e28f291a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.814708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccc8b-d0a3-4b79-89fa-e6d8e28f291a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.815577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccc8b-d0a3-4b79-89fa-e6d8e28f291a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.816410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccc8b-d0a3-4b79-89fa-e6d8e28f291a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.819880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8dbccc8b-d0a3-4b79-89fa-e6d8e28f291a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.851464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.853101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:50.863994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1044/2077] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:50.864807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:50.867646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.900715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbccc8b-d0a3-4b79-89fa-e6d8e28f291a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.903233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbccc8b-d0a3-4b79-89fa-e6d8e28f291a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:50.931742 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1034/2078] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:50.936507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6fd4-acd2-4a63-9d85-5b69a525bf34 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.936785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6fd4-acd2-4a63-9d85-5b69a525bf34 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.937092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6fd4-acd2-4a63-9d85-5b69a525bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.981665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf14b6-0e78-4881-a662-153f957a6fae service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:50.986411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-172f6fd4-acd2-4a63-9d85-5b69a525bf34 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:50.988204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:50.988512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:50.988796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:50.989156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:50.989947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-172f6fd4-acd2-4a63-9d85-5b69a525bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:50.990081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:50.991938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.014965 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1035/2079] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:51.032509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1045/2080] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:50 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:51.033388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f6fd4-acd2-4a63-9d85-5b69a525bf34 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.043504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.046332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:51.047171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f6fd4-acd2-4a63-9d85-5b69a525bf34 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.137838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.138966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.139259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.139538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.140484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.143085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.169232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664bade-ae81-47cf-b351-d338d8449a5e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.173744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.174465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.174752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.175028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.178752 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1036/2081] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:51 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:51.183264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.191120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.193256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.205555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489631-cae5-49d6-b411-df60c824a48c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.207721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1046/2082] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:51.212385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.213381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.213658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.213933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.214716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.216465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.228941 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1037/2083] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:51.234024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.244084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533d64a-fed0-4b57-a84d-137b78b21bb1 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.249526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.250422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.250698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.250965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] PATH_INFO: `/v3/projects/a5884c935b10477dbfc163d18debbc43/users/838cd2caaf94442099616d59f65df83b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.268912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5884c935b10477dbfc163d18debbc43, user_id=838cd2caaf94442099616d59f65df83b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.271625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.289083 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1047/2084] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:51 2022] PUT /identity/v3/projects/a5884c935b10477dbfc163d18debbc43/users/838cd2caaf94442099616d59f65df83b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:51.293026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.306993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d167da8-2dd1-46f2-b1df-8baad7e8eb11 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.390857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.391520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.391843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.392365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.393228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.395980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.412549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.413622 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1038/2085] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:55:51.414539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:51.418999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.429893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691a6df-8303-4bf7-80e6-02fb3b0eb9da admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.436390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.437330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.437606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.437873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] PATH_INFO: `/v3/users/31b5f1ba8c2843fd879fd2241dc60d37` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.438225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade51e45-ac42-40fb-9f09-b36fdbe1d66b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.439186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b5f1ba8c2843fd879fd2241dc60d37)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.441192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.447238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb9f17-f4eb-4aa5-bab3-0efa3117e87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.448151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb9f17-f4eb-4aa5-bab3-0efa3117e87c admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.448586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb9f17-f4eb-4aa5-bab3-0efa3117e87c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.448861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb9f17-f4eb-4aa5-bab3-0efa3117e87c admin admin] PATH_INFO: `/v3/projects/a5884c935b10477dbfc163d18debbc43/users/838cd2caaf94442099616d59f65df83b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.453973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb9f17-f4eb-4aa5-bab3-0efa3117e87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5884c935b10477dbfc163d18debbc43, user_id=838cd2caaf94442099616d59f65df83b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.456961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb9f17-f4eb-4aa5-bab3-0efa3117e87c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.473181 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1039/2086] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:51 2022] PUT /identity/v3/projects/a5884c935b10477dbfc163d18debbc43/users/838cd2caaf94442099616d59f65df83b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:51.483569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.483859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.484142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.498258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b5f1ba8c2843fd879fd2241dc60d37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:51.499134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b5f1ba8c2843fd879fd2241dc60d37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:51.507770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b5f1ba8c2843fd879fd2241dc60d37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:51.525589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b5f1ba8c2843fd879fd2241dc60d37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:51.526570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65795969-e0c1-4e2a-805d-79b084491d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b5f1ba8c2843fd879fd2241dc60d37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:51.548530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] MFA Rules not processed for user `838cd2caaf94442099616d59f65df83b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:51.550573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:51.560883 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1048/2087] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:51 2022] DELETE /identity/v3/users/31b5f1ba8c2843fd879fd2241dc60d37 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:51.564742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.564742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.564742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.589877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:51.591990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:51.668998 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1049/2088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:51.679688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.681360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:51.688562 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1040/2089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:51.717317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.720226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:51.768901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadce5d1-26b4-48b7-9bac-cf9f3f3767f4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.786049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.786584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.786878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.787068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.800226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.801429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.821584 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1050/2090] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:51.838216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:51.839778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:51.861255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a7062-a0df-4d7e-a373-f5d8cda29cc3 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.868645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef23f6-4457-448b-8e97-3898aecb1bb3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:51.875252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.876375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.876747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.877150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] PATH_INFO: `/v3/projects/08fdacb13c2b449581a193ace4bc6a96` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.880612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fdacb13c2b449581a193ace4bc6a96)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.882964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:51.884148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.885329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:51.885616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:51.886084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:51.911475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:51.913273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:51.938781 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1041/2091] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:51.977466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fdacb13c2b449581a193ace4bc6a96', 'request_id': 'req-bf7ab2d3-f127-491b-8920-965b1f913fb3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:51.991455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fdacb13c2b449581a193ace4bc6a96', 'request_id': 'req-bf7ab2d3-f127-491b-8920-965b1f913fb3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.009847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fdacb13c2b449581a193ace4bc6a96', 'request_id': 'req-bf7ab2d3-f127-491b-8920-965b1f913fb3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.025935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] The token cache is being invalidate because project 08fdacb13c2b449581a193ace4bc6a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:52.026286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.028661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf7ab2d3-f127-491b-8920-965b1f913fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.032610 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1051/2092] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:51 2022] DELETE /identity/v3/projects/08fdacb13c2b449581a193ace4bc6a96 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:52.037463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:52.052730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6a08-af44-4bc8-a5b0-a4b28481ce5b service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:52.232258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:52.233190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:52.233480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:52.233867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] PATH_INFO: `/v3/users/548dab8112aa49cc825d33a974e9fc63` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:52.236895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] RBAC: Authorizing `identity:delete_user(user_id=548dab8112aa49cc825d33a974e9fc63)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:52.238948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:52.321106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548dab8112aa49cc825d33a974e9fc63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.321858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548dab8112aa49cc825d33a974e9fc63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.332765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548dab8112aa49cc825d33a974e9fc63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.335306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548dab8112aa49cc825d33a974e9fc63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.355408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21723c15-86a7-4c63-bddb-bf69e929571e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548dab8112aa49cc825d33a974e9fc63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.385469 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1042/2093] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:52 2022] DELETE /identity/v3/users/548dab8112aa49cc825d33a974e9fc63 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:52.391376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e4ec-37d1-47a5-a4c9-3064ec6b3a15 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:52.391853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e4ec-37d1-47a5-a4c9-3064ec6b3a15 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:52.392205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e4ec-37d1-47a5-a4c9-3064ec6b3a15 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:52.394395 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1052/2094] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:55:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:52.401469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:52.401757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:52.402040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:52.432162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:52.434052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:52.525479 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1043/2095] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:52.550183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8e4ec-37d1-47a5-a4c9-3064ec6b3a15 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:52.552200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dad8e4ec-37d1-47a5-a4c9-3064ec6b3a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:52.599795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8e4ec-37d1-47a5-a4c9-3064ec6b3a15 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:52.608337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:52.612087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:52.612543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:52.617181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:52.623305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:52.624949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:52.627377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:52.628996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:52.640699 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1053/2096] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:55:52.688666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:52.691320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:52.798892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286dc0-2e6a-4dd9-8a49-c268541b2320 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:52.820389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:52.821338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:52.821619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:52.821882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] PATH_INFO: `/v3/users/58162fde653b45ed9ca0a2f5e066eea5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:52.824544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=58162fde653b45ed9ca0a2f5e066eea5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:52.826623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:52.876909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296dd70-5b11-476c-8d68-81d0050949ae service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:52.891301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:52.893884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:52.894266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:52.894870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] PATH_INFO: `/v3/projects/51c2a88012224851ae8069f9a969f0d2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:52.897498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c2a88012224851ae8069f9a969f0d2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:52.900274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:52.931690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58162fde653b45ed9ca0a2f5e066eea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.934691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58162fde653b45ed9ca0a2f5e066eea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.948122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58162fde653b45ed9ca0a2f5e066eea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.949647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58162fde653b45ed9ca0a2f5e066eea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.965277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58162fde653b45ed9ca0a2f5e066eea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:52.989842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1044/2097] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:52 2022] DELETE /identity/v3/users/58162fde653b45ed9ca0a2f5e066eea5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:52.990550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:52.992111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:52.999336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c2a88012224851ae8069f9a969f0d2', 'request_id': 'req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.005353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c2a88012224851ae8069f9a969f0d2', 'request_id': 'req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.014510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c2a88012224851ae8069f9a969f0d2', 'request_id': 'req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.028593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] The token cache is being invalidate because project 51c2a88012224851ae8069f9a969f0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:53.029107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.029859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.031446 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1054/2098] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:52 2022] DELETE /identity/v3/projects/51c2a88012224851ae8069f9a969f0d2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:55:53.032243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.033728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.100810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f35a21-5a07-4b0d-aa4c-043b8d87f16d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:53.106419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:53.108416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.108795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.109590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] PATH_INFO: `/v3/projects/52a8acfb70684381b3ff7befaf40aa23` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.111026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a8acfb70684381b3ff7befaf40aa23)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:53.113801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:53.133077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9cd47-9975-4573-9fe2-04ef5d8b27d5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:53.201143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a8acfb70684381b3ff7befaf40aa23', 'request_id': 'req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.215244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a8acfb70684381b3ff7befaf40aa23', 'request_id': 'req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.226466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8c6d7-a4df-4af7-b043-3ad2966006e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:53.227150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8c6d7-a4df-4af7-b043-3ad2966006e1 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.227441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8c6d7-a4df-4af7-b043-3ad2966006e1 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.228179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8c6d7-a4df-4af7-b043-3ad2966006e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.229912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-beb8c6d7-a4df-4af7-b043-3ad2966006e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.230176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a8acfb70684381b3ff7befaf40aa23', 'request_id': 'req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.243688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8c6d7-a4df-4af7-b043-3ad2966006e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:53.245591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8c6d7-a4df-4af7-b043-3ad2966006e1 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:53.252825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] The token cache is being invalidate because project 52a8acfb70684381b3ff7befaf40aa23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:53.254547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.258105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fb9e4ae0-2c0c-4892-afd7-937adc9ff60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.258233 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1055/2099] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:53.259763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530bdca-7644-42aa-b9f0-abff5e561c2f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.260049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530bdca-7644-42aa-b9f0-abff5e561c2f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.260274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530bdca-7644-42aa-b9f0-abff5e561c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.264347 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1045/2100] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:52 2022] DELETE /identity/v3/projects/52a8acfb70684381b3ff7befaf40aa23 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:53.264347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.264347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.264347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.295190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f530bdca-7644-42aa-b9f0-abff5e561c2f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:53.296551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f530bdca-7644-42aa-b9f0-abff5e561c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.317455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:53.318767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.381964 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1056/2101] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:53.384599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.384895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.394732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.432353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:53.433699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.446233 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1057/2102] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:53.452733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.453563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.486793 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1046/2103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:53.487720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.494086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.510440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea36b1-9611-4cb5-8589-d3f7bd7a49ff None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:53.520534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:53.521709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.522163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.522699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] PATH_INFO: `/v3/users/73f234bc51954a4f9cf8117728f600e6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.524138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f234bc51954a4f9cf8117728f600e6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:53.526510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:53.588406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119e94b-5ca9-4332-9ced-7dd0b242a75e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:53.595740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e68c-2445-4454-835c-dac433d4cde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:53.597059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e68c-2445-4454-835c-dac433d4cde2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.597549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e68c-2445-4454-835c-dac433d4cde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.600933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e68c-2445-4454-835c-dac433d4cde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.606797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f234bc51954a4f9cf8117728f600e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.607571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f234bc51954a4f9cf8117728f600e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.616309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f234bc51954a4f9cf8117728f600e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.617059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f234bc51954a4f9cf8117728f600e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.625253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e68c-2445-4454-835c-dac433d4cde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:53.627926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d20b3245-bd58-4072-ab64-cbf8556f959c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f234bc51954a4f9cf8117728f600e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:53.633784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e68c-2445-4454-835c-dac433d4cde2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:53.653137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1047/2104] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:53 2022] DELETE /identity/v3/users/73f234bc51954a4f9cf8117728f600e6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:53.654144 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1058/2105] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:53.654677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac63f1b-6b67-4dbb-acec-f2ee73b3312a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.655028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac63f1b-6b67-4dbb-acec-f2ee73b3312a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.655474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac63f1b-6b67-4dbb-acec-f2ee73b3312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.661313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b109-68b6-4ac8-80f5-b376b94597e6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.661841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b109-68b6-4ac8-80f5-b376b94597e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.662287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b109-68b6-4ac8-80f5-b376b94597e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.678561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bac63f1b-6b67-4dbb-acec-f2ee73b3312a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:53.679845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bac63f1b-6b67-4dbb-acec-f2ee73b3312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.690652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1530b109-68b6-4ac8-80f5-b376b94597e6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:53.692030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1530b109-68b6-4ac8-80f5-b376b94597e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.774897 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1059/2106] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:53.777931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea89f-e66d-43d5-9077-bf688f9cf61b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.778509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea89f-e66d-43d5-9077-bf688f9cf61b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.779048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea89f-e66d-43d5-9077-bf688f9cf61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.787870 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1048/2107] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:53.788922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac63f1b-6b67-4dbb-acec-f2ee73b3312a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.798646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac63f1b-6b67-4dbb-acec-f2ee73b3312a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:53.808133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9eaea89f-e66d-43d5-9077-bf688f9cf61b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:53.816308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9eaea89f-e66d-43d5-9077-bf688f9cf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.821355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:53.822224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.823891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.824182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.824946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:53.825279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:53.831063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:53.833761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1060/2108] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:53.834972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea89f-e66d-43d5-9077-bf688f9cf61b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.847434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea89f-e66d-43d5-9077-bf688f9cf61b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:53.854781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:53.855820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.856416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.856935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.857927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:53.858424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:53.861206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:53.869096 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1049/2109] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:53.869096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.872339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:53.888486 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1061/2110] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:53.889240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.910642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc965-b01f-4ea4-b1c6-2e00b72465e3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:53.919164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:53.920478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:53.920922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:53.921391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:53.922111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:53.924823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:53.979522 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1062/2111] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:53.980503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:53.982633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a20571-4e72-4440-8e0c-a4f19b7fe941 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.059174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.060117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.060235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.060414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.066034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970a36f-0d60-4cb6-98eb-26789fcfdd59 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.072377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d284f8-0b51-4c6e-aed7-11c0e018c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.072821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d284f8-0b51-4c6e-aed7-11c0e018c619 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.073179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d284f8-0b51-4c6e-aed7-11c0e018c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.073462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d284f8-0b51-4c6e-aed7-11c0e018c619 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.074211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d284f8-0b51-4c6e-aed7-11c0e018c619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.076598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d284f8-0b51-4c6e-aed7-11c0e018c619 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.080346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.081878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.094706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1050/2112] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:54.095719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.107932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c748b-8d00-430f-a420-71f31d8e9df8 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.114458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.115261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.115603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.116125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.117082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.120636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.124169 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1063/2113] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:53 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:54.126382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945b4a-99f1-4647-a085-4f3a34627922 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.126752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945b4a-99f1-4647-a085-4f3a34627922 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.127150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945b4a-99f1-4647-a085-4f3a34627922 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.128758 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1064/2114] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:55:54.129580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945b4a-99f1-4647-a085-4f3a34627922 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.131327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc945b4a-99f1-4647-a085-4f3a34627922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.156724 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1051/2115] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:54 2022] POST /identity/v3/users => generated 289 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:54.157729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.170918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfee7ff-36a8-4b61-a18f-5f9de5a4aeb9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.209110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945b4a-99f1-4647-a085-4f3a34627922 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.214931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.215832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.216133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.216413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] PATH_INFO: `/v3/projects/5fc90b2020ab417e8b6ba2bfb69d6ba5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.217983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc90b2020ab417e8b6ba2bfb69d6ba5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.224810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.250347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147c086-dff5-4839-8eda-467c3d942bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.251686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c086-dff5-4839-8eda-467c3d942bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.252133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c086-dff5-4839-8eda-467c3d942bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.252476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c086-dff5-4839-8eda-467c3d942bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.253340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147c086-dff5-4839-8eda-467c3d942bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.255428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147c086-dff5-4839-8eda-467c3d942bd2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.277904 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1052/2116] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:54 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:54.279461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.279892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.280175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.282354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'request_id': 'req-9e5d2399-a7ec-48b0-814f-52942a4b40c9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.290376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'request_id': 'req-9e5d2399-a7ec-48b0-814f-52942a4b40c9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.302211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'request_id': 'req-9e5d2399-a7ec-48b0-814f-52942a4b40c9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.302774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:54.304045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.322709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] The token cache is being invalidate because project 5fc90b2020ab417e8b6ba2bfb69d6ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:54.322999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.323700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.325659 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1065/2117] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:54 2022] DELETE /identity/v3/projects/5fc90b2020ab417e8b6ba2bfb69d6ba5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:54.329247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.331019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.387136 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1053/2118] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:54.388218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.389652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.419345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d2399-a7ec-48b0-814f-52942a4b40c9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.424443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.425339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.425449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.425821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.426691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.428367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.444628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1066/2119] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:54.449197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.451142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.465929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfcfe-22b5-4963-87e8-a4b45d67121a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.471593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.472723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.473066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.473369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] PATH_INFO: `/v3/users/17413b2e061d409bbf043d80a2570da4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.474717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17413b2e061d409bbf043d80a2570da4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.476966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.478846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe8bd0-6248-4b55-9cbe-57650ff2d886 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.485424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.486118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.486399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.486681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.487416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.489170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.500363 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1054/2120] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:54.501231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.505014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.533271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17413b2e061d409bbf043d80a2570da4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.534036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17413b2e061d409bbf043d80a2570da4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.541267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17413b2e061d409bbf043d80a2570da4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.549968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17413b2e061d409bbf043d80a2570da4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.551419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17413b2e061d409bbf043d80a2570da4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.565084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa696c8-2471-45ee-8d3c-f3bc282cb2a7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.568794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1067/2121] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:54 2022] DELETE /identity/v3/users/17413b2e061d409bbf043d80a2570da4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:54.568928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.569542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.569812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.570114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.570227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.571715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.572001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.587141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.591704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.601606 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1055/2122] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:54.602302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.604107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.621681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5269364-c6cc-4dd6-940a-0ac3f14b55f1 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.644749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3946-34a6-419c-b79b-da951b368be6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.649805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.650491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.650772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.651071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.651982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.653742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.664871 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1068/2123] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:54.665823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.669487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.684186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be6817-6b61-4eb0-a9d1-d1746ba1737b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.689274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81e8e-8c87-447a-b1bc-c3a9ea7798ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.689983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81e8e-8c87-447a-b1bc-c3a9ea7798ea admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.690295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81e8e-8c87-447a-b1bc-c3a9ea7798ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.690572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81e8e-8c87-447a-b1bc-c3a9ea7798ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.691691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81e8e-8c87-447a-b1bc-c3a9ea7798ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.693364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.693504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81e8e-8c87-447a-b1bc-c3a9ea7798ea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.694243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.694518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.695062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] PATH_INFO: `/v3/projects/214a04a002984b78be0d28cc5364764f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.696260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] RBAC: Authorizing `identity:delete_project(project_id=214a04a002984b78be0d28cc5364764f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.698211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.706195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1069/2124] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:54.707626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.707916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.708192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.741631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:54.743037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.757605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214a04a002984b78be0d28cc5364764f', 'request_id': 'req-023d6c4a-cc0d-4a91-b595-ddb46732889f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.765280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214a04a002984b78be0d28cc5364764f', 'request_id': 'req-023d6c4a-cc0d-4a91-b595-ddb46732889f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.774807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214a04a002984b78be0d28cc5364764f', 'request_id': 'req-023d6c4a-cc0d-4a91-b595-ddb46732889f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.790742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] The token cache is being invalidate because project 214a04a002984b78be0d28cc5364764f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:54.791308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.792045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:54.794187 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1056/2125] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:54 2022] DELETE /identity/v3/projects/214a04a002984b78be0d28cc5364764f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:54.795084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.796594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.802432 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1070/2126] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:54.803488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.804933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.891390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b3430-d9ec-4c45-b0f6-866f7813c46c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.898861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.899772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.900045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.900308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] PATH_INFO: `/v3/projects/0a58268cda414acd8a8d37632975bff4/users/3e3c1cea075e40bc8c31e7afaf024004/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.912318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d6c4a-cc0d-4a91-b595-ddb46732889f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:54.918116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:54.919027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:54.919348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:54.919645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] PATH_INFO: `/v3/projects/38e5a75a3193410580f61e9ef6b03a22/users/08df9efeeca2495c89f5187218f68fcb/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:54.933777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a58268cda414acd8a8d37632975bff4, user_id=3e3c1cea075e40bc8c31e7afaf024004, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.937265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.938668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e5a75a3193410580f61e9ef6b03a22, user_id=08df9efeeca2495c89f5187218f68fcb, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:54.944691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:54.953200 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1071/2127] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:54 2022] PUT /identity/v3/projects/0a58268cda414acd8a8d37632975bff4/users/3e3c1cea075e40bc8c31e7afaf024004/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:54.954833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.965244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:54.970516 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1057/2128] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:54 2022] PUT /identity/v3/projects/38e5a75a3193410580f61e9ef6b03a22/users/08df9efeeca2495c89f5187218f68fcb/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:54.970949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:54.973117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.040820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ec31b-5764-4148-85d6-d8fc392b4b86 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.043578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f553b-a2ab-4652-8eb6-e5c200e777d1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.047482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.048299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.048577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.048847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.055964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.057542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.065360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1058/2129] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:55.069930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.071569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.096651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.097591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.097872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.098268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] PATH_INFO: `/v3/users/838cd2caaf94442099616d59f65df83b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.099465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=838cd2caaf94442099616d59f65df83b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.101471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.142021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79bc08-fff1-4069-a040-92b30448c3b4 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.148632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.149684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.150477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.150477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] PATH_INFO: `/v3/projects/2e3774f1979c4262aa63db6f010db5d9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.151496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3774f1979c4262aa63db6f010db5d9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.151806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838cd2caaf94442099616d59f65df83b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.152654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838cd2caaf94442099616d59f65df83b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.153486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.159905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838cd2caaf94442099616d59f65df83b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.170571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838cd2caaf94442099616d59f65df83b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.173636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-267f01b1-a9ff-4fdf-aa3d-383b112bcd2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838cd2caaf94442099616d59f65df83b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.192095 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1072/2130] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:54 2022] DELETE /identity/v3/users/838cd2caaf94442099616d59f65df83b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:55.193694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89252-9288-4422-bf31-d017449048b2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.194153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89252-9288-4422-bf31-d017449048b2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.194906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89252-9288-4422-bf31-d017449048b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.214469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3774f1979c4262aa63db6f010db5d9', 'request_id': 'req-304cad10-c4f8-4773-ad3f-943ec32c6366'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.221983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3774f1979c4262aa63db6f010db5d9', 'request_id': 'req-304cad10-c4f8-4773-ad3f-943ec32c6366'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.232249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-86c89252-9288-4422-bf31-d017449048b2 None None] MFA Rules not processed for user `3e3c1cea075e40bc8c31e7afaf024004`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:55.233618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-86c89252-9288-4422-bf31-d017449048b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.235647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3774f1979c4262aa63db6f010db5d9', 'request_id': 'req-304cad10-c4f8-4773-ad3f-943ec32c6366'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.258418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] The token cache is being invalidate because project 2e3774f1979c4262aa63db6f010db5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:55.258739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.259466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-304cad10-c4f8-4773-ad3f-943ec32c6366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.262623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1059/2131] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:55 2022] DELETE /identity/v3/projects/2e3774f1979c4262aa63db6f010db5d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:55.264238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ac8fc-b8c5-47e8-9610-f415df9e3850 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.264706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ac8fc-b8c5-47e8-9610-f415df9e3850 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.265688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ac8fc-b8c5-47e8-9610-f415df9e3850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.302576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1c9ac8fc-b8c5-47e8-9610-f415df9e3850 None None] MFA Rules not processed for user `08df9efeeca2495c89f5187218f68fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:55.303978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1c9ac8fc-b8c5-47e8-9610-f415df9e3850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.321783 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1073/2132] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:55.323075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c89252-9288-4422-bf31-d017449048b2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.328568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-86c89252-9288-4422-bf31-d017449048b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.404357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1060/2133] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:55.404357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.404357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.404357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.433432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:55.434412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c89252-9288-4422-bf31-d017449048b2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.434795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.440800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.441583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.442517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.442867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.445389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.531032 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1061/2134] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:55.531994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.534463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.540688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.545983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.568024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d625c-8116-4f51-8c7e-d4f4b80fac8e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.579526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3f043-ba41-4b0a-8446-9380fa52bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.580934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f043-ba41-4b0a-8446-9380fa52bbae admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.581066 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1074/2135] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:55.581161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f043-ba41-4b0a-8446-9380fa52bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.581161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f043-ba41-4b0a-8446-9380fa52bbae admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.581807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3f043-ba41-4b0a-8446-9380fa52bbae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.582253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.586277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.593530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3f043-ba41-4b0a-8446-9380fa52bbae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.630699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b733-adbd-490c-8dd5-a244e1deaf3c service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.637154 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1062/2136] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:55.637435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.637435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.637858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.639332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.640308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.641652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba801-b4d9-48ce-a9cf-3272f1057c46 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.642086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba801-b4d9-48ce-a9cf-3272f1057c46 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.642514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba801-b4d9-48ce-a9cf-3272f1057c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.642686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.670415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8a5ba801-b4d9-48ce-a9cf-3272f1057c46 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:55.671891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8a5ba801-b4d9-48ce-a9cf-3272f1057c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.676397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1075/2137] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:55.676397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.678457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.759957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeab1e-80ec-4694-bc44-014e7d65a87a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.764006 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1063/2138] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:55.765575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ba801-b4d9-48ce-a9cf-3272f1057c46 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.768674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.769739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.770026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.770297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] PATH_INFO: `/v3/projects/a5884c935b10477dbfc163d18debbc43` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.771527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5884c935b10477dbfc163d18debbc43)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.774743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.777884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ba801-b4d9-48ce-a9cf-3272f1057c46 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.784343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.785280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.785562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.785840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.786535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.788918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.815573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1064/2139] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/users => generated 303 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:55.816609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.831089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a38b7-3472-475e-8fee-d5adbaa86784 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.832443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5884c935b10477dbfc163d18debbc43', 'request_id': 'req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.840082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5884c935b10477dbfc163d18debbc43', 'request_id': 'req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.849719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5884c935b10477dbfc163d18debbc43', 'request_id': 'req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.862618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] The token cache is being invalidate because project a5884c935b10477dbfc163d18debbc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:55.863064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.864833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:55.866849 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1076/2140] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:55 2022] DELETE /identity/v3/projects/a5884c935b10477dbfc163d18debbc43 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:55.870072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.871449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.898351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.899133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.900046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.900411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.901293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.903445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.931078 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1065/2141] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:55.931078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.932512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.942375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a569a-dfa9-419b-a95d-c3d7d9c174fe admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.944566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380058ac-0c7e-41ca-9ada-498eb9ad1894 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.948443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.949232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.949576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.949686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bb425-aa87-4d0f-8061-03d17b645f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.949954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.950587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb425-aa87-4d0f-8061-03d17b645f63 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.950769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb425-aa87-4d0f-8061-03d17b645f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.950870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:55.951040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb425-aa87-4d0f-8061-03d17b645f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.951259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.951779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bb425-aa87-4d0f-8061-03d17b645f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.953074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.953432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bb425-aa87-4d0f-8061-03d17b645f63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:55.967429 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1066/2142] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:55.967619 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1077/2143] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:55.967619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:55.969921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:55.977870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792fa85-caba-41bf-a239-8225b2cefe16 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.978170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792fa85-caba-41bf-a239-8225b2cefe16 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.978501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792fa85-caba-41bf-a239-8225b2cefe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.984882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e3118-6e2a-4628-833d-4532f2f13eaf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:55.990962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:55.991745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:55.992116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:55.992481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:55.995553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:55.997521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.001825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8792fa85-caba-41bf-a239-8225b2cefe16 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:56.003098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8792fa85-caba-41bf-a239-8225b2cefe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:56.011883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1067/2144] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:56.012734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792fa85-caba-41bf-a239-8225b2cefe16 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.017479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1078/2145] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:56.018303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.031916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792fa85-caba-41bf-a239-8225b2cefe16 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.036787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f34b1e-8388-44d5-9bc7-0c66b14e4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.037637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850678b-6bba-47ea-b474-16fd9aa4bac2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.037756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f34b1e-8388-44d5-9bc7-0c66b14e4375 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.038063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f34b1e-8388-44d5-9bc7-0c66b14e4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.038288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f34b1e-8388-44d5-9bc7-0c66b14e4375 admin admin] PATH_INFO: `/v3/projects/251c8c47f9614f20a302f5e5a6b79fa8/users/4db7d1bbb21e4da2821e00dc63c7478e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.045239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.046095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.046346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.047115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.047902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.050430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.053070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f34b1e-8388-44d5-9bc7-0c66b14e4375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251c8c47f9614f20a302f5e5a6b79fa8, user_id=4db7d1bbb21e4da2821e00dc63c7478e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.055910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f34b1e-8388-44d5-9bc7-0c66b14e4375 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.073233 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1068/2146] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:56 2022] PUT /identity/v3/projects/251c8c47f9614f20a302f5e5a6b79fa8/users/4db7d1bbb21e4da2821e00dc63c7478e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:56.074573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bc9bf-a8e0-49e6-8c0c-53d6c47f974f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.074839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bc9bf-a8e0-49e6-8c0c-53d6c47f974f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.075114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bc9bf-a8e0-49e6-8c0c-53d6c47f974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.081147 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1079/2147] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:56.082107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.093650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-834bc9bf-a8e0-49e6-8c0c-53d6c47f974f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:56.094882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-834bc9bf-a8e0-49e6-8c0c-53d6c47f974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:56.157872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd2b12-679e-40c3-bec9-8cb3f0b139b9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.171536 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1069/2148] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:56.172283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bc9bf-a8e0-49e6-8c0c-53d6c47f974f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.175664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed71cd2-0440-433d-9502-9a6318d07bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.176624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71cd2-0440-433d-9502-9a6318d07bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.176902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71cd2-0440-433d-9502-9a6318d07bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.177207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71cd2-0440-433d-9502-9a6318d07bdc admin admin] PATH_INFO: `/v3/projects/04aca5fe4e5b411785c7ffec3290f757/users/71224d7fb595446797054a3818555e1a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.191590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bc9bf-a8e0-49e6-8c0c-53d6c47f974f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.199826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.201152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.201720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.202169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.202638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed71cd2-0440-433d-9502-9a6318d07bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=04aca5fe4e5b411785c7ffec3290f757, user_id=71224d7fb595446797054a3818555e1a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.203230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.205067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.207727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed71cd2-0440-433d-9502-9a6318d07bdc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.219165 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1070/2149] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:56.220270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.232204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5942b-a7a4-4821-84cb-08a91104994e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.232964 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1080/2150] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:56 2022] PUT /identity/v3/projects/04aca5fe4e5b411785c7ffec3290f757/users/71224d7fb595446797054a3818555e1a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:56.234900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bffc1-0229-4886-96ef-7d52e52f4e49 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.235361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bffc1-0229-4886-96ef-7d52e52f4e49 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.235640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bffc1-0229-4886-96ef-7d52e52f4e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.262589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-421bffc1-0229-4886-96ef-7d52e52f4e49 None None] MFA Rules not processed for user `0bcc50583d0c4b9aa9d9c9b7ad87a576`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:56.263790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-421bffc1-0229-4886-96ef-7d52e52f4e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:56.303687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.304755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.305741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.306204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.307092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.310636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.327738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1081/2151] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:56.328729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bffc1-0229-4886-96ef-7d52e52f4e49 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.337721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1071/2152] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:56.338880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.340065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bffc1-0229-4886-96ef-7d52e52f4e49 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.345838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.346526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.346806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.347077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.347968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:56.348134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.350014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.353333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c32a8-9ab2-4c1d-ab5a-4e1ec8be7af3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.360069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.361549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.361935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.362310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] PATH_INFO: `/v3/projects/251c8c47f9614f20a302f5e5a6b79fa8/users/4db7d1bbb21e4da2821e00dc63c7478e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.363014 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1082/2153] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:56.364877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251c8c47f9614f20a302f5e5a6b79fa8, user_id=4db7d1bbb21e4da2821e00dc63c7478e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.368875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.379133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.392281 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1072/2154] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:56 2022] PUT /identity/v3/projects/251c8c47f9614f20a302f5e5a6b79fa8/users/4db7d1bbb21e4da2821e00dc63c7478e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:56.392281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.409808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da5be1-da89-43c7-858f-8e48bc293e64 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.486527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7510369-7e87-49f5-928d-85ab00b25746 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.494829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f80b0d-e766-4a23-99fd-e2e9a0e76b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.496138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f80b0d-e766-4a23-99fd-e2e9a0e76b45 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.496516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f80b0d-e766-4a23-99fd-e2e9a0e76b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.497447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.497725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f80b0d-e766-4a23-99fd-e2e9a0e76b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.498189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.498472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.498745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.498904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f80b0d-e766-4a23-99fd-e2e9a0e76b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.499524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.500961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f80b0d-e766-4a23-99fd-e2e9a0e76b45 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.501301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.517516 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1083/2155] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:56.517516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.518364 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1073/2156] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:56.519876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae797-7d41-4bce-bbb8-f4bdd89e286e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.520265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae797-7d41-4bce-bbb8-f4bdd89e286e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.521163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae797-7d41-4bce-bbb8-f4bdd89e286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.526537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c96ab-2806-44a8-8fdd-75ab2b5b9f33 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.532288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.532970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.533317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.533589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.534442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.536831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.561485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-049ae797-7d41-4bce-bbb8-f4bdd89e286e None None] MFA Rules not processed for user `4db7d1bbb21e4da2821e00dc63c7478e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:56.562921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-049ae797-7d41-4bce-bbb8-f4bdd89e286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:56.579444 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1084/2157] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:56.579444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.650210 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1074/2158] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:56.651721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae797-7d41-4bce-bbb8-f4bdd89e286e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.652223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437208-25f7-430b-86ba-24caaab83f40 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.658257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.659185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.659458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.659728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] PATH_INFO: `/v3/projects/04aca5fe4e5b411785c7ffec3290f757/users/71224d7fb595446797054a3818555e1a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.661754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04aca5fe4e5b411785c7ffec3290f757, user_id=71224d7fb595446797054a3818555e1a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.665323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.670040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae797-7d41-4bce-bbb8-f4bdd89e286e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.679182 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1085/2159] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:56 2022] PUT /identity/v3/projects/04aca5fe4e5b411785c7ffec3290f757/users/71224d7fb595446797054a3818555e1a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:56.681326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.786761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15ef85-b6b8-486d-a61e-14c18c276947 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.793644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a08d02-2fb8-4f40-9357-c94a03d6a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.793898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.794632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.795029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.795401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.796280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.796494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08d02-2fb8-4f40-9357-c94a03d6a090 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.797298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08d02-2fb8-4f40-9357-c94a03d6a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.798972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.804207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08d02-2fb8-4f40-9357-c94a03d6a090 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.807436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a08d02-2fb8-4f40-9357-c94a03d6a090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.809302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a08d02-2fb8-4f40-9357-c94a03d6a090 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.832633 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1086/2160] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:56.837305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.847359 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1075/2161] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:56.849213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.849416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.849692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.858507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711495b-fe53-4c24-9af2-9ac16c233f3f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:56.866019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:56.868021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:56.868718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:56.869200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] PATH_INFO: `/v3/users/3e3c1cea075e40bc8c31e7afaf024004` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:56.870983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3c1cea075e40bc8c31e7afaf024004)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:56.873891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:56.886111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] MFA Rules not processed for user `71224d7fb595446797054a3818555e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:56.887515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:56.945526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3c1cea075e40bc8c31e7afaf024004'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:56.945924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3c1cea075e40bc8c31e7afaf024004'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:56.953991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3c1cea075e40bc8c31e7afaf024004'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:56.965634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3c1cea075e40bc8c31e7afaf024004'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:56.966368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3c1cea075e40bc8c31e7afaf024004'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:56.989063 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1076/2162] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:56.990104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.991483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:56.995874 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1087/2163] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:56 2022] DELETE /identity/v3/users/3e3c1cea075e40bc8c31e7afaf024004 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:56.996757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:56.998283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:57.004992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ea394-9892-469f-bf8e-81a3acc89e0d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.064961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7e8b-6596-4c11-9399-8c929e70b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.065832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7e8b-6596-4c11-9399-8c929e70b6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.067156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7e8b-6596-4c11-9399-8c929e70b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.067156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7e8b-6596-4c11-9399-8c929e70b6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.068997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c7e8b-6596-4c11-9399-8c929e70b6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.071320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c7e8b-6596-4c11-9399-8c929e70b6b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.087617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10a4b-8d65-4524-843a-68d31be00d55 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.092678 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1077/2164] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:57.094564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aedf3c-2571-4031-abdc-d5010d645ce9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.095013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aedf3c-2571-4031-abdc-d5010d645ce9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.095568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aedf3c-2571-4031-abdc-d5010d645ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.096736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.098635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.099365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.099784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] PATH_INFO: `/v3/projects/ccc0c2bb67804b5683c3ad270d4d6811/users/867c29dbc88042afa976b753757e93a4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.117508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-93aedf3c-2571-4031-abdc-d5010d645ce9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:57.118710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-93aedf3c-2571-4031-abdc-d5010d645ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:57.121242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc0c2bb67804b5683c3ad270d4d6811, user_id=867c29dbc88042afa976b753757e93a4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.131919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.132135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1078/2165] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:57.132135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aedf3c-2571-4031-abdc-d5010d645ce9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.145025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aedf3c-2571-4031-abdc-d5010d645ce9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.149165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1088/2166] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:56 2022] PUT /identity/v3/projects/ccc0c2bb67804b5683c3ad270d4d6811/users/867c29dbc88042afa976b753757e93a4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:57.150768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.152522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:57.216255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.217148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.217429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.217702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.218598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.220219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.231048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ae9ad-a449-42f4-9eae-5752fdf35403 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.233610 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1079/2167] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:57.233610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.237536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:57.241452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935594-63dc-4e29-afd8-e7f6e77e9d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.242344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935594-63dc-4e29-afd8-e7f6e77e9d2a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.242778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935594-63dc-4e29-afd8-e7f6e77e9d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.243208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935594-63dc-4e29-afd8-e7f6e77e9d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.254836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935594-63dc-4e29-afd8-e7f6e77e9d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.258897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935594-63dc-4e29-afd8-e7f6e77e9d2a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.274585 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1089/2168] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:57.277492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640603c3-d212-441d-89fb-a6ac473205ab None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.278117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640603c3-d212-441d-89fb-a6ac473205ab None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.278117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640603c3-d212-441d-89fb-a6ac473205ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.322155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-640603c3-d212-441d-89fb-a6ac473205ab None None] MFA Rules not processed for user `867c29dbc88042afa976b753757e93a4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:57.323425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-640603c3-d212-441d-89fb-a6ac473205ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:57.345880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0de31-bc66-4b62-8b6a-14d1b269a522 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.352774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.353900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.354270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.354878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.422893 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1090/2169] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:57.422893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640603c3-d212-441d-89fb-a6ac473205ab None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.434950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640603c3-d212-441d-89fb-a6ac473205ab None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.445095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.447544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.457307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab22f-f4b9-44c2-bccf-4db8a990a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.458332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab22f-f4b9-44c2-bccf-4db8a990a30e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.458660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab22f-f4b9-44c2-bccf-4db8a990a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.459639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab22f-f4b9-44c2-bccf-4db8a990a30e admin admin] PATH_INFO: `/v3/projects/bb969b79526b4634bdbe1741fd142178/users/1f2fded994f74df180787ca182d1db4d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.461280 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1080/2170] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:57.462719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.480553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ab22f-f4b9-44c2-bccf-4db8a990a30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb969b79526b4634bdbe1741fd142178, user_id=1f2fded994f74df180787ca182d1db4d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.484440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ab22f-f4b9-44c2-bccf-4db8a990a30e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.492850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248fc4b-b1de-44f9-bb02-55300c3b8798 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.500855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.502157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.502498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.502842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.509226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.509226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.524600 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1091/2171] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:57 2022] PUT /identity/v3/projects/bb969b79526b4634bdbe1741fd142178/users/1f2fded994f74df180787ca182d1db4d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:57.526479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233124d9-7923-4671-8b51-63699da7392a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.531635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233124d9-7923-4671-8b51-63699da7392a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.531776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233124d9-7923-4671-8b51-63699da7392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.562026 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1081/2172] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:57 2022] POST /identity/v3/projects => generated 395 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:57.564636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.590529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-233124d9-7923-4671-8b51-63699da7392a None None] MFA Rules not processed for user `1f2fded994f74df180787ca182d1db4d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:57.591818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-233124d9-7923-4671-8b51-63699da7392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:57.640362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24e349-ecef-4414-96a4-14faa8b9bd2c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.648221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.648964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.649287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.649558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.650599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.659180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1092/2173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:57.660620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.665719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233124d9-7923-4671-8b51-63699da7392a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.680800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233124d9-7923-4671-8b51-63699da7392a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.687927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.688662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.691547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.691547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.691547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.692628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.710339 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1082/2174] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:57 2022] POST /identity/v3/users => generated 304 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:57.711289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.723627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532aba-e474-4562-b626-49e990fce4cb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.729596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.730276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.730634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.730905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.731725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.733827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.743849 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1093/2175] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:57 2022] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:55:57.749332 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1083/2176] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:57.750015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.750319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.761092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07065c-97cf-499c-a082-e2197c518fe5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.845915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.846844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.847128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.847400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] PATH_INFO: `/v3/projects/c219d726df4e48a4891f2c7bfa54554b/users/c02f41e6e4574b93903dcae78000de65/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.872865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fd759-bc07-40f2-83cd-838d6fc76a98 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.878250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:57.878944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:57.879490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:57.879490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:57.880190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.882179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.886296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c219d726df4e48a4891f2c7bfa54554b, user_id=c02f41e6e4574b93903dcae78000de65, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:57.894569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:57.915938 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1094/2177] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:55:57 2022] POST /identity/v3/users => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:55:57.919030 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1084/2178] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:57 2022] PUT /identity/v3/projects/c219d726df4e48a4891f2c7bfa54554b/users/c02f41e6e4574b93903dcae78000de65/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:57.919930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.920437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:57.930364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62d763-0c40-4e61-8e1d-014140864317 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:57.998476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac332655-6268-4088-a099-9d7e6d4ca4db admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.004122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.004449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.005057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.005253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.005536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.005651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.005988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.006103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.007868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.007998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.009486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.009926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.022720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1095/2179] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:55:58.030531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.054884 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1085/2180] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:58.058573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.073178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89be6-142f-429c-b3d3-328d540a6358 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.074500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983396fc-d290-4ac8-a7aa-8a0288168610 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.079323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb11cc-561a-4eed-ac9f-5b7aa1a53404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.080579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb11cc-561a-4eed-ac9f-5b7aa1a53404 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.080891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb11cc-561a-4eed-ac9f-5b7aa1a53404 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.081366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb11cc-561a-4eed-ac9f-5b7aa1a53404 admin admin] PATH_INFO: `/v3/projects/c219d726df4e48a4891f2c7bfa54554b/users/c02f41e6e4574b93903dcae78000de65/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.081696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.082788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.083224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.083645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] PATH_INFO: `/v3/projects/d112051ef09c40bab5e48b1d25311053/users/96c5e3a35056462288d77b5b165b50b1/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.085023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb11cc-561a-4eed-ac9f-5b7aa1a53404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c219d726df4e48a4891f2c7bfa54554b, user_id=c02f41e6e4574b93903dcae78000de65, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.089124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb11cc-561a-4eed-ac9f-5b7aa1a53404 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.100357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d112051ef09c40bab5e48b1d25311053, user_id=96c5e3a35056462288d77b5b165b50b1, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.112686 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1086/2181] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:58 2022] PUT /identity/v3/projects/c219d726df4e48a4891f2c7bfa54554b/users/c02f41e6e4574b93903dcae78000de65/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:58.113187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.115217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.115720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.116083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.148685 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1096/2182] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:58 2022] PUT /identity/v3/projects/d112051ef09c40bab5e48b1d25311053/users/96c5e3a35056462288d77b5b165b50b1/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:58.151140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.174323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] MFA Rules not processed for user `c02f41e6e4574b93903dcae78000de65`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:58.177355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:58.250237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd383-ec03-4484-bac4-bb8f15b5fd8f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.255365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.256136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.256811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.257392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.258111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.259839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.279834 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1097/2183] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:55:58.285830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.310318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f99424-8b6f-401f-9489-805568ab6d5d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.321550 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1087/2184] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:58.326216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.327541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.327819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.328088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] PATH_INFO: `/v3/projects/d112051ef09c40bab5e48b1d25311053/users/96c5e3a35056462288d77b5b165b50b1/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.330222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d112051ef09c40bab5e48b1d25311053, user_id=96c5e3a35056462288d77b5b165b50b1, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.333659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.348737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.350806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:58.355510 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1098/2185] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:55:58 2022] PUT /identity/v3/projects/d112051ef09c40bab5e48b1d25311053/users/96c5e3a35056462288d77b5b165b50b1/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:58.356488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.358693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:58.379149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ed254-d7c8-4df2-bff3-4da6cf1e7db3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.498561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.500005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.501098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.501484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] PATH_INFO: `/v3/projects/0a58268cda414acd8a8d37632975bff4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.503017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a58268cda414acd8a8d37632975bff4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.505219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.518692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912fbf-1e0e-4d62-95b2-4a8a58785525 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.527601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.529606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.529894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.530172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.611068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a58268cda414acd8a8d37632975bff4', 'request_id': 'req-daefd626-678a-4345-b0dc-1644ccecb783'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.624899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a58268cda414acd8a8d37632975bff4', 'request_id': 'req-daefd626-678a-4345-b0dc-1644ccecb783'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.639354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a58268cda414acd8a8d37632975bff4', 'request_id': 'req-daefd626-678a-4345-b0dc-1644ccecb783'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.660903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] The token cache is being invalidate because project 0a58268cda414acd8a8d37632975bff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:58.661215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.663727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-daefd626-678a-4345-b0dc-1644ccecb783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.665615 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1088/2186] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:58 2022] DELETE /identity/v3/projects/0a58268cda414acd8a8d37632975bff4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:58.666437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.668789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.668928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.669531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.669669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.688193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1099/2187] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:58.704773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.736459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c11a3-6dc3-456b-b2d9-f6d5dbf351b3 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:58.763816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] MFA Rules not processed for user `96c5e3a35056462288d77b5b165b50b1`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:58.763816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:58.848516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:58.849853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:58.850231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:58.850597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] PATH_INFO: `/v3/users/4db7d1bbb21e4da2821e00dc63c7478e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:58.852010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db7d1bbb21e4da2821e00dc63c7478e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:58.854149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:58.925482 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1089/2188] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:58.939637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db7d1bbb21e4da2821e00dc63c7478e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.939826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:58.940699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db7d1bbb21e4da2821e00dc63c7478e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.941935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:58.948851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db7d1bbb21e4da2821e00dc63c7478e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.962955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db7d1bbb21e4da2821e00dc63c7478e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.965613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db7d1bbb21e4da2821e00dc63c7478e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:58.987772 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1100/2189] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:58 2022] DELETE /identity/v3/users/4db7d1bbb21e4da2821e00dc63c7478e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:59.108820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108c34-5d0f-42e0-8589-85c359356caa None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:59.228055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da644c7-cfbf-43a7-9e59-6df52ec6b911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:59.228725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da644c7-cfbf-43a7-9e59-6df52ec6b911 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:59.228999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da644c7-cfbf-43a7-9e59-6df52ec6b911 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:59.229299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da644c7-cfbf-43a7-9e59-6df52ec6b911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:59.231924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3da644c7-cfbf-43a7-9e59-6df52ec6b911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:59.350900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da644c7-cfbf-43a7-9e59-6df52ec6b911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:59.356509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da644c7-cfbf-43a7-9e59-6df52ec6b911 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:59.375249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:59.377278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:59.397245 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1090/2190] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:59.533568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f24f7-eddb-4fe0-a190-fd962f5c6f2e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:59.540718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:59.541447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:59.541821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:59.563398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] PATH_INFO: `/v3/projects/251c8c47f9614f20a302f5e5a6b79fa8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:59.568139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251c8c47f9614f20a302f5e5a6b79fa8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:59.570394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:59.681349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251c8c47f9614f20a302f5e5a6b79fa8', 'request_id': 'req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:59.689149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251c8c47f9614f20a302f5e5a6b79fa8', 'request_id': 'req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:59.700883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251c8c47f9614f20a302f5e5a6b79fa8', 'request_id': 'req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:59.718487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] The token cache is being invalidate because project 251c8c47f9614f20a302f5e5a6b79fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:55:59.718850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:59.720183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:55:59.726866 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1101/2191] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:55:59 2022] DELETE /identity/v3/projects/251c8c47f9614f20a302f5e5a6b79fa8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:55:59.728663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cdf4-865c-4249-8c7c-23ff9fbd78e0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:59.729018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cdf4-865c-4249-8c7c-23ff9fbd78e0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:59.729385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cdf4-865c-4249-8c7c-23ff9fbd78e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:59.754483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-adc1cdf4-865c-4249-8c7c-23ff9fbd78e0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:59.756612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-adc1cdf4-865c-4249-8c7c-23ff9fbd78e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:59.867461 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1091/2192] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:55:59.867653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:59.868521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:59.869504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d7f0-949f-4438-9d1c-1b92f4024780 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:59.870001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d7f0-949f-4438-9d1c-1b92f4024780 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:59.870440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d7f0-949f-4438-9d1c-1b92f4024780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:59.894416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3dd6d7f0-949f-4438-9d1c-1b92f4024780 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:55:59.896000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3dd6d7f0-949f-4438-9d1c-1b92f4024780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:59.922625 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1092/2193] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:55:59.923786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d7f0-949f-4438-9d1c-1b92f4024780 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:55:59.938537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d7f0-949f-4438-9d1c-1b92f4024780 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:59.948521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af9f1-f98f-44ad-ad69-d94223d3bde9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:55:59.953290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:59.954169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:59.954601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:59.955033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:59.955613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:55:59.955819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:55:59.956126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:55:59.956282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:55:59.956552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:55:59.956823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:55:59.957937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:55:59.958822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:55:59.987274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1093/2194] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:55:59.992330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.010900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ea24-52e4-4f44-a130-ffe3386a0405 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.022919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.024172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.024881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.025193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.025466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.025580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.026368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.028402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.038920 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1102/2195] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:55:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:00.055564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.057227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:00.079348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce58af-6807-4820-ab73-c203b4db523e service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.085392 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1094/2196] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:55:59 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:00.086433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.170293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.171280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.171617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.172023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] PATH_INFO: `/v3/users/867c29dbc88042afa976b753757e93a4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.173995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=867c29dbc88042afa976b753757e93a4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.177021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbcfd-bb9c-42f5-b429-19034a7847d3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.177475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.189770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.190467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.192782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.193081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.193787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.195776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.231663 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1095/2197] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:00 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:00.233417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.249881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867c29dbc88042afa976b753757e93a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.250701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867c29dbc88042afa976b753757e93a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.259625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867c29dbc88042afa976b753757e93a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.274681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867c29dbc88042afa976b753757e93a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.275639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867c29dbc88042afa976b753757e93a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.312961 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1103/2198] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:00 2022] DELETE /identity/v3/users/867c29dbc88042afa976b753757e93a4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:00.313782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.316524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:00.350179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcd4a2-f232-4828-9a51-aad3908d0324 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.412850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0d3f4-ec3e-4824-a18e-4e3a44b9b52c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.419946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.421849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.422358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.422833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] PATH_INFO: `/v3/users/1f2fded994f74df180787ca182d1db4d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.425000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2fded994f74df180787ca182d1db4d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.427279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.433623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b341-7613-44cf-be57-115be9ba23da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.434404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b341-7613-44cf-be57-115be9ba23da service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.434756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b341-7613-44cf-be57-115be9ba23da service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.435037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b341-7613-44cf-be57-115be9ba23da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.442111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3d92b341-7613-44cf-be57-115be9ba23da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:00.495085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2fded994f74df180787ca182d1db4d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.496097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2fded994f74df180787ca182d1db4d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.505204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2fded994f74df180787ca182d1db4d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.525569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2fded994f74df180787ca182d1db4d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.531120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2fded994f74df180787ca182d1db4d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:00.564616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b341-7613-44cf-be57-115be9ba23da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.571445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b341-7613-44cf-be57-115be9ba23da service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.578107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1104/2199] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:00 2022] DELETE /identity/v3/users/1f2fded994f74df180787ca182d1db4d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:00.579037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.582651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:00.605363 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1096/2200] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:00.607052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.607338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.607609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.648295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:00.652367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:00.717618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ab83b-9794-4db0-bef4-357b111fdadb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.723163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9626-c123-48af-9e97-b9048e1b5a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.724984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9626-c123-48af-9e97-b9048e1b5a6b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.724984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9626-c123-48af-9e97-b9048e1b5a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.724984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9626-c123-48af-9e97-b9048e1b5a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.725828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9626-c123-48af-9e97-b9048e1b5a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.728574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9626-c123-48af-9e97-b9048e1b5a6b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.743099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1105/2201] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:00.744889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb9262-a6cf-4d6c-80ec-dcc21e16bf78 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.745693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb9262-a6cf-4d6c-80ec-dcc21e16bf78 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.745881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb9262-a6cf-4d6c-80ec-dcc21e16bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.771041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-65fb9262-a6cf-4d6c-80ec-dcc21e16bf78 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:00.772741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-65fb9262-a6cf-4d6c-80ec-dcc21e16bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:00.787400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1106/2202] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:00.788421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb9262-a6cf-4d6c-80ec-dcc21e16bf78 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.803074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb9262-a6cf-4d6c-80ec-dcc21e16bf78 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.814055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.814790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.815817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.816117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.816869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.821795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.847925 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1097/2203] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:00.852597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.856988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:00.866513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1107/2204] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:00.867819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:00.890967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10989854-6914-4848-b710-1a2b89ceb6e9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:00.915103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:00.916206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:00.916583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:00.919160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] PATH_INFO: `/v3/projects/76b53d8bf2b6473bbff55e2aa932a898/users/b0e47ff2de7a47fea56890f7b4f08432/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:00.957993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b53d8bf2b6473bbff55e2aa932a898, user_id=b0e47ff2de7a47fea56890f7b4f08432, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:00.961535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:00.994275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bcc6b-cbf2-4901-9489-95bcc5d79201 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:01.004884 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1108/2205] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:00 2022] PUT /identity/v3/projects/76b53d8bf2b6473bbff55e2aa932a898/users/b0e47ff2de7a47fea56890f7b4f08432/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:01.004884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:01.093769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55002-fc4e-4727-8e07-150b64b9ec1d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:01.099257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:01.100670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:01.101220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:01.101803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:01.104001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6588e13-2c08-4e5d-b69a-ecd70b2e8c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:01.105384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588e13-2c08-4e5d-b69a-ecd70b2e8c5e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:01.106806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588e13-2c08-4e5d-b69a-ecd70b2e8c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:01.106806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588e13-2c08-4e5d-b69a-ecd70b2e8c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:01.238596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6588e13-2c08-4e5d-b69a-ecd70b2e8c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:01.240157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6588e13-2c08-4e5d-b69a-ecd70b2e8c5e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:01.251259 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1098/2206] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:01.252851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3810-3d51-4ac4-bc8c-94ca297a5d4a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:01.253193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3810-3d51-4ac4-bc8c-94ca297a5d4a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:01.253656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3810-3d51-4ac4-bc8c-94ca297a5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:01.283417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-dc1b3810-3d51-4ac4-bc8c-94ca297a5d4a None None] MFA Rules not processed for user `b0e47ff2de7a47fea56890f7b4f08432`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:01.284285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dc1b3810-3d51-4ac4-bc8c-94ca297a5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:01.289302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:01.292914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:01.316966 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1109/2207] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:01.392798 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1099/2208] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:01.397787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:01.411085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa471-f6da-494c-b84a-5a348de6ef4d service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:01.424111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:01.424865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:01.425305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:01.425582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:01.426605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:01.428894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:01.492775 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1110/2209] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:01 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:01.497621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b3810-3d51-4ac4-bc8c-94ca297a5d4a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:01.522095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b3810-3d51-4ac4-bc8c-94ca297a5d4a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:01.635354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:01.636041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:01.636319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:01.636594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:01.637343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:01.639673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:01.680270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1100/2210] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:01 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:01.684038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:01.698379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b846a8-191f-4960-becf-194e99bd3c7d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:01.708069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:01.709710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:01.710203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:01.710765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:01.711714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:01.714295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:01.749891 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1111/2211] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:01.753969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:01.767029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb6860-6670-46a4-9045-c2bfa9da3dbb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:01.773327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:01.773999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:01.774274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:01.774543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] PATH_INFO: `/v3/projects/636a2d8743a0425794b24083625b37dc/users/f82522b0dd5b41a7a0658f3b4fd812ae/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:01.808317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636a2d8743a0425794b24083625b37dc, user_id=f82522b0dd5b41a7a0658f3b4fd812ae, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:01.815491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:01.845938 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1101/2212] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:01 2022] PUT /identity/v3/projects/636a2d8743a0425794b24083625b37dc/users/f82522b0dd5b41a7a0658f3b4fd812ae/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:01.850218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:01.872284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02100f-94f4-4aa9-882c-802bfcc845a2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:02.009222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d87ee7-9f93-46d5-9506-4b71e1a34798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:02.010017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87ee7-9f93-46d5-9506-4b71e1a34798 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:02.010396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87ee7-9f93-46d5-9506-4b71e1a34798 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:02.010763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87ee7-9f93-46d5-9506-4b71e1a34798 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:02.011740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d87ee7-9f93-46d5-9506-4b71e1a34798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:02.013572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d87ee7-9f93-46d5-9506-4b71e1a34798 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:02.028663 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1112/2213] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:02.034351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:02.059104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903392-423a-43e5-8212-a025969591b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:02.072478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:02.073475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:02.073754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:02.074024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] PATH_INFO: `/v3/projects/636a2d8743a0425794b24083625b37dc/users/f82522b0dd5b41a7a0658f3b4fd812ae/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:02.082753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636a2d8743a0425794b24083625b37dc, user_id=f82522b0dd5b41a7a0658f3b4fd812ae, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:02.085606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:02.101948 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1102/2214] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:02 2022] PUT /identity/v3/projects/636a2d8743a0425794b24083625b37dc/users/f82522b0dd5b41a7a0658f3b4fd812ae/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:02.115012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dce6-018a-4f89-b370-751845d9d8e2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:02.115500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dce6-018a-4f89-b370-751845d9d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:02.115967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dce6-018a-4f89-b370-751845d9d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:02.152035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7005dce6-018a-4f89-b370-751845d9d8e2 None None] MFA Rules not processed for user `f82522b0dd5b41a7a0658f3b4fd812ae`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:02.152035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7005dce6-018a-4f89-b370-751845d9d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:02.347044 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1113/2215] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:02.359469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:02.361944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:02.469971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f278cd-f914-4968-952b-faad23da6e60 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:02.477561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:02.478631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:02.479463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:02.479463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:02.490260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:02.491722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:02.505593 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1103/2216] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:02.602695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005dce6-018a-4f89-b370-751845d9d8e2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:02.626316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005dce6-018a-4f89-b370-751845d9d8e2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:02.629157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:02.630912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:02.636516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:02.637326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:02.637692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:02.638075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:02.712834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:02.715255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:02.750822 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1114/2217] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:02.752804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:02.760893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:02.783401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360e828-f691-492f-b8be-5e39c95d5590 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:02.792852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae772a-1c80-4ebd-bde4-0c2232445067 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:02.809008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:02.810333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:02.810995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:02.811552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] PATH_INFO: `/v3/projects/ccc0c2bb67804b5683c3ad270d4d6811` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:02.814348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc0c2bb67804b5683c3ad270d4d6811)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:02.821803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:02.832200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:02.834833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:02.837153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:02.837533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] PATH_INFO: `/v3/projects/bb969b79526b4634bdbe1741fd142178` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:02.842041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb969b79526b4634bdbe1741fd142178)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:02.844638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:02.930418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc0c2bb67804b5683c3ad270d4d6811', 'request_id': 'req-e66704c7-483a-4e57-ae7e-86bda035d226'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:02.949987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc0c2bb67804b5683c3ad270d4d6811', 'request_id': 'req-e66704c7-483a-4e57-ae7e-86bda035d226'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:02.954796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb969b79526b4634bdbe1741fd142178', 'request_id': 'req-1177af54-b392-4d03-84c3-84aca5d433e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:02.966525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb969b79526b4634bdbe1741fd142178', 'request_id': 'req-1177af54-b392-4d03-84c3-84aca5d433e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:02.967909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc0c2bb67804b5683c3ad270d4d6811', 'request_id': 'req-e66704c7-483a-4e57-ae7e-86bda035d226'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:02.982318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb969b79526b4634bdbe1741fd142178', 'request_id': 'req-1177af54-b392-4d03-84c3-84aca5d433e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:02.994226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] The token cache is being invalidate because project ccc0c2bb67804b5683c3ad270d4d6811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:02.994520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:02.995191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.009489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] The token cache is being invalidate because project bb969b79526b4634bdbe1741fd142178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:03.009933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.017153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.022581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1104/2218] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:02 2022] DELETE /identity/v3/projects/bb969b79526b4634bdbe1741fd142178 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:03.026724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:03.028765 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1115/2219] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:02 2022] DELETE /identity/v3/projects/ccc0c2bb67804b5683c3ad270d4d6811 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:03.029211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:03.032630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:03.033969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:03.171594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177af54-b392-4d03-84c3-84aca5d433e6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:03.184569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66704c7-483a-4e57-ae7e-86bda035d226 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:03.188311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:03.189649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:03.190178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:03.190656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] PATH_INFO: `/v3/users/96c5e3a35056462288d77b5b165b50b1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:03.193578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c5e3a35056462288d77b5b165b50b1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:03.195855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:03.200931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:03.201894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:03.202169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:03.202438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] PATH_INFO: `/v3/users/c02f41e6e4574b93903dcae78000de65` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:03.209259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02f41e6e4574b93903dcae78000de65)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:03.211484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:03.298248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c5e3a35056462288d77b5b165b50b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.299169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c5e3a35056462288d77b5b165b50b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.309415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c5e3a35056462288d77b5b165b50b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.310535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c5e3a35056462288d77b5b165b50b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.315805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02f41e6e4574b93903dcae78000de65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.316636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02f41e6e4574b93903dcae78000de65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.323766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c5e3a35056462288d77b5b165b50b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.332222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02f41e6e4574b93903dcae78000de65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.354133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02f41e6e4574b93903dcae78000de65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.358411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02f41e6e4574b93903dcae78000de65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.358608 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1105/2220] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:03 2022] DELETE /identity/v3/users/96c5e3a35056462288d77b5b165b50b1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:03.383976 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1116/2221] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:03 2022] DELETE /identity/v3/users/c02f41e6e4574b93903dcae78000de65 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:03.517211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:03.519567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:03.642924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb57f84-25f0-4340-8053-c71e7e2f2ef6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:03.668067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:03.669682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:03.765511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537ae25-286f-4a4a-b026-ce2d0cd71a9f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:03.772003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:03.772941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:03.773462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:03.773999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] PATH_INFO: `/v3/users/b0e47ff2de7a47fea56890f7b4f08432` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:03.775515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e47ff2de7a47fea56890f7b4f08432)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:03.777806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:03.786860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:03.787778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:03.788060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:03.789300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] PATH_INFO: `/v3/users/08df9efeeca2495c89f5187218f68fcb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:03.793533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08df9efeeca2495c89f5187218f68fcb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:03.799404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:03.875025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e47ff2de7a47fea56890f7b4f08432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.875965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e47ff2de7a47fea56890f7b4f08432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.886142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e47ff2de7a47fea56890f7b4f08432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.903669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08df9efeeca2495c89f5187218f68fcb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.904389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08df9efeeca2495c89f5187218f68fcb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.906896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e47ff2de7a47fea56890f7b4f08432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.907810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f400b908-adff-44b8-b5b8-c3e831a7856d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e47ff2de7a47fea56890f7b4f08432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.923576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08df9efeeca2495c89f5187218f68fcb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.925416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08df9efeeca2495c89f5187218f68fcb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.939683 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1117/2222] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:03 2022] DELETE /identity/v3/users/b0e47ff2de7a47fea56890f7b4f08432 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:03.940789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05135e64-5614-4401-9283-a2ad5cbfe01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08df9efeeca2495c89f5187218f68fcb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:03.944465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:03.944666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:03.944940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:03.968162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:03.969851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:03.972711 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1106/2223] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:03 2022] DELETE /identity/v3/users/08df9efeeca2495c89f5187218f68fcb => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:03.977603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:03.977603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:03.977913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:03.999086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:04.000244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.060360 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1118/2224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:04.093101 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1107/2225] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:04.104366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.106733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.114049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.116513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.173906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7cf69-f731-4cd6-95fe-ddcf7ad20fad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.177420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.177572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb854-aaaa-44f6-b9d3-08fa601dfa89 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.178437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.178437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.178775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.182022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.182678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.183476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.183476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.193315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.193822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.195492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.196422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.208555 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1108/2226] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:04.210993 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1119/2227] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:04.319669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.321520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.334775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61f18-9025-4d94-85ba-4c482ca6a039 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.341071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.342569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.342569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.342569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] PATH_INFO: `/v3/projects/c219d726df4e48a4891f2c7bfa54554b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.343595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c219d726df4e48a4891f2c7bfa54554b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.345671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.422055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c219d726df4e48a4891f2c7bfa54554b', 'request_id': 'req-c2d8945b-4166-4627-965a-3e5072e1d79e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.430163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c219d726df4e48a4891f2c7bfa54554b', 'request_id': 'req-c2d8945b-4166-4627-965a-3e5072e1d79e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.431108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.432596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.443412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c219d726df4e48a4891f2c7bfa54554b', 'request_id': 'req-c2d8945b-4166-4627-965a-3e5072e1d79e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.470936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] The token cache is being invalidate because project c219d726df4e48a4891f2c7bfa54554b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:04.471235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.471932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c2d8945b-4166-4627-965a-3e5072e1d79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.474012 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1109/2228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:04 2022] DELETE /identity/v3/projects/c219d726df4e48a4891f2c7bfa54554b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:04.474780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8995-1333-41d1-bee8-7ec2774e635b service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.480755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f1492-58f9-4010-a33a-77f04531ea0c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.481081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f1492-58f9-4010-a33a-77f04531ea0c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.481487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f1492-58f9-4010-a33a-77f04531ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.506832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c67f1492-58f9-4010-a33a-77f04531ea0c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:04.508075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c67f1492-58f9-4010-a33a-77f04531ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.567087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.567992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.568273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.568546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] PATH_INFO: `/v3/projects/d112051ef09c40bab5e48b1d25311053` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.569747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d112051ef09c40bab5e48b1d25311053)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.571934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.580226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1110/2229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:04.589106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fbb0e-45a4-41b6-bfbd-a18194608fc2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.589393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fbb0e-45a4-41b6-bfbd-a18194608fc2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.589968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fbb0e-45a4-41b6-bfbd-a18194608fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.607952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e72fbb0e-45a4-41b6-bfbd-a18194608fc2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:04.609550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e72fbb0e-45a4-41b6-bfbd-a18194608fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.618026 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1111/2230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:04.623064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fbb0e-45a4-41b6-bfbd-a18194608fc2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.634114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fbb0e-45a4-41b6-bfbd-a18194608fc2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.635986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd112051ef09c40bab5e48b1d25311053', 'request_id': 'req-40eb4f26-0794-45cc-8a5d-5672d59fad7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.643284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd112051ef09c40bab5e48b1d25311053', 'request_id': 'req-40eb4f26-0794-45cc-8a5d-5672d59fad7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.652633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd112051ef09c40bab5e48b1d25311053', 'request_id': 'req-40eb4f26-0794-45cc-8a5d-5672d59fad7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.666142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] The token cache is being invalidate because project d112051ef09c40bab5e48b1d25311053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:04.666514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.667200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-40eb4f26-0794-45cc-8a5d-5672d59fad7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.668973 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1120/2231] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:04 2022] DELETE /identity/v3/projects/d112051ef09c40bab5e48b1d25311053 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:04.673854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8230b90-efa8-4039-a41d-9b7391548968 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.674259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8230b90-efa8-4039-a41d-9b7391548968 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.674628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8230b90-efa8-4039-a41d-9b7391548968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.694200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e8230b90-efa8-4039-a41d-9b7391548968 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:04.695543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8230b90-efa8-4039-a41d-9b7391548968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.696776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.697499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.697783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.698062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.698953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:04.699333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.701392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.706671 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1121/2232] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:04.715745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628211-b440-4989-95f7-a07a8356c799 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.716033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628211-b440-4989-95f7-a07a8356c799 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.716316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628211-b440-4989-95f7-a07a8356c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.722547 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1112/2233] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:04.723416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.725249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.734953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5d628211-b440-4989-95f7-a07a8356c799 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:04.736142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5d628211-b440-4989-95f7-a07a8356c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.741809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35975235-0bd7-4b62-b77d-7cb50445edee admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.744715 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1122/2234] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:04.750555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628211-b440-4989-95f7-a07a8356c799 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.751370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.752056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.752338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.752612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.753354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.755301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.760802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628211-b440-4989-95f7-a07a8356c799 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.766311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.766992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.767268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.767536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.769617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:04.769921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.771748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.784772 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1123/2235] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:04.785683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.789417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.797708 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1113/2236] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:04 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:04.797708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.800380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.806540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c54e9-cd2a-4296-8be6-0603e24254ed admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.865895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.866789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.867568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.867568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] PATH_INFO: `/v3/projects/38e5a75a3193410580f61e9ef6b03a22` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.869291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e5a75a3193410580f61e9ef6b03a22)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.870853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19032-a2e7-4392-a884-81c551b734ab admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:04.871303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.875684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:04.876557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:04.876836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:04.877140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] PATH_INFO: `/v3/projects/76b53d8bf2b6473bbff55e2aa932a898` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:04.878356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b53d8bf2b6473bbff55e2aa932a898)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:04.880298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:04.922140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e5a75a3193410580f61e9ef6b03a22', 'request_id': 'req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.928214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e5a75a3193410580f61e9ef6b03a22', 'request_id': 'req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.932045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b53d8bf2b6473bbff55e2aa932a898', 'request_id': 'req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.938734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e5a75a3193410580f61e9ef6b03a22', 'request_id': 'req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.943251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b53d8bf2b6473bbff55e2aa932a898', 'request_id': 'req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.952200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] The token cache is being invalidate because project 38e5a75a3193410580f61e9ef6b03a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:04.952421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b53d8bf2b6473bbff55e2aa932a898', 'request_id': 'req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.952771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.953626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.958215 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1124/2237] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:04 2022] DELETE /identity/v3/projects/38e5a75a3193410580f61e9ef6b03a22 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:04.958215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.959228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:04.968024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] The token cache is being invalidate because project 76b53d8bf2b6473bbff55e2aa932a898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:04.968391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.969785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:04.971426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1114/2238] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:04 2022] DELETE /identity/v3/projects/76b53d8bf2b6473bbff55e2aa932a898 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:04.975066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:04.976451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.030622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfb9f6-8060-4ea6-8e79-4a42ec8aaccb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.045238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4b5f1-6763-4bd1-9b2f-d75a4b7a208f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.050060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.050737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.051008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.054055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.054785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.056759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.081386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1115/2239] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:04 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:05.081386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.081386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.084703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.085441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.085749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.086012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.086695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.088610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.094427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f6d7-c8e8-4639-8f5d-b91460b0ac71 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.099660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.100544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.100825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.101136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] PATH_INFO: `/v3/users/71224d7fb595446797054a3818555e1a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.102558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71224d7fb595446797054a3818555e1a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.104788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.118544 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1125/2240] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:04 2022] POST /identity/v3/projects => generated 399 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:05.118544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.118544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.152217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71224d7fb595446797054a3818555e1a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.152869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71224d7fb595446797054a3818555e1a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.159446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71224d7fb595446797054a3818555e1a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.160162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71224d7fb595446797054a3818555e1a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.168545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71224d7fb595446797054a3818555e1a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.182266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89593ed-a17f-42a9-987d-1490af60f5da admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.187388 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1116/2241] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:05 2022] DELETE /identity/v3/users/71224d7fb595446797054a3818555e1a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:05.187644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.188296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.188923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.189395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.189760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] PATH_INFO: `/v3/users/f82522b0dd5b41a7a0658f3b4fd812ae` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.189885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.191173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82522b0dd5b41a7a0658f3b4fd812ae)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.193191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.253269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82522b0dd5b41a7a0658f3b4fd812ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.254063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82522b0dd5b41a7a0658f3b4fd812ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.257992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9e5cd-c3d0-4564-b21f-a3c84bf836d0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.262933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82522b0dd5b41a7a0658f3b4fd812ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.263434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.263852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.264136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.264423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.267133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.268777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.279996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82522b0dd5b41a7a0658f3b4fd812ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.280615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82522b0dd5b41a7a0658f3b4fd812ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.282596 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1117/2242] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:05.283720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.285680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.299396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05987de6-4557-4cff-ac68-c1d981aefbd6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.305307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.306668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.306957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.307285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.307996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.309545 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1126/2243] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:05 2022] DELETE /identity/v3/users/f82522b0dd5b41a7a0658f3b4fd812ae => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:05.310169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.310753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.312528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.339767 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1118/2244] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:05 2022] POST /identity/v3/users => generated 300 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:05.346528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.360245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c707ae-421f-4ccb-8252-9b1b62e8d38a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.423901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bf600-d6db-4f1e-ac03-b6b46efe7053 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.430445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.431437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.431959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.432437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.433599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.442111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.443098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.444041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.444366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.445321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.452409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.454497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.464132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1119/2245] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:05.469643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.470120 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1127/2246] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:05.471135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.481749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b1d1a-46cc-41d1-a25e-33bf948d503c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.484984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ecc7-ea1a-456d-9a87-d4dc76a3fa4c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.497211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.497211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.497211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.497211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.497554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.497554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.501574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ef0d6-169e-42c9-afd5-62ca11bd23c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.502824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef0d6-169e-42c9-afd5-62ca11bd23c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.503012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef0d6-169e-42c9-afd5-62ca11bd23c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.503464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef0d6-169e-42c9-afd5-62ca11bd23c4 admin admin] PATH_INFO: `/v3/projects/847209629f944fd98aec4c4bbe9a2bd8/users/ae8571042b5f47eea035c6f126d4e641/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.504660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1120/2247] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:05.509211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.520167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e91a-4dae-4a56-a67d-6d0a9a47d04d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.520372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ef0d6-169e-42c9-afd5-62ca11bd23c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847209629f944fd98aec4c4bbe9a2bd8, user_id=ae8571042b5f47eea035c6f126d4e641, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.523019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ef0d6-169e-42c9-afd5-62ca11bd23c4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.525726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0433d10-473d-4d79-840c-cbdc83d491f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.527314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0433d10-473d-4d79-840c-cbdc83d491f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.527314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0433d10-473d-4d79-840c-cbdc83d491f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.527314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0433d10-473d-4d79-840c-cbdc83d491f6 admin admin] PATH_INFO: `/v3/projects/9b52aef2f7124bfa8343992aa5f1101b/users/4373f108fb0b46b0b66e010d5396a17e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.539719 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1128/2248] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:05 2022] PUT /identity/v3/projects/847209629f944fd98aec4c4bbe9a2bd8/users/ae8571042b5f47eea035c6f126d4e641/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:05.544357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0433d10-473d-4d79-840c-cbdc83d491f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b52aef2f7124bfa8343992aa5f1101b, user_id=4373f108fb0b46b0b66e010d5396a17e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.544989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.545428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.545862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.547586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0433d10-473d-4d79-840c-cbdc83d491f6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.562802 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1121/2249] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:05 2022] PUT /identity/v3/projects/9b52aef2f7124bfa8343992aa5f1101b/users/4373f108fb0b46b0b66e010d5396a17e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:05.573082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.573082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.573345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.578866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:05.581856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.637703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] MFA Rules not processed for user `4373f108fb0b46b0b66e010d5396a17e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:05.638942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.671981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1129/2250] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:05.673152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.675653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.691337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6454-e357-41c3-b9af-a971d6937c00 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.697594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.698829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.699381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.699805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] PATH_INFO: `/v3/projects/04aca5fe4e5b411785c7ffec3290f757` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.702437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04aca5fe4e5b411785c7ffec3290f757)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.704827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.725390 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1122/2251] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:05.726530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.728667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.763844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04aca5fe4e5b411785c7ffec3290f757', 'request_id': 'req-7ea99100-e5ce-4649-9326-9d774423845c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.772445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04aca5fe4e5b411785c7ffec3290f757', 'request_id': 'req-7ea99100-e5ce-4649-9326-9d774423845c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.783879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04aca5fe4e5b411785c7ffec3290f757', 'request_id': 'req-7ea99100-e5ce-4649-9326-9d774423845c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.788001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9787c-042f-454c-bd68-bd73686d9f0e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.806397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] The token cache is being invalidate because project 04aca5fe4e5b411785c7ffec3290f757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:05.806967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.807778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:05.813600 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1130/2252] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:05 2022] DELETE /identity/v3/projects/04aca5fe4e5b411785c7ffec3290f757 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:05.814495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.817081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.851818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571e044-8534-45a9-a54e-a25e0c2da882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.852478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e044-8534-45a9-a54e-a25e0c2da882 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.852771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e044-8534-45a9-a54e-a25e0c2da882 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.853050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e044-8534-45a9-a54e-a25e0c2da882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.854988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9571e044-8534-45a9-a54e-a25e0c2da882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.887793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99100-e5ce-4649-9326-9d774423845c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.892454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:05.893155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.893437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.893736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.894439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.896409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.916959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571e044-8534-45a9-a54e-a25e0c2da882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:05.918604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571e044-8534-45a9-a54e-a25e0c2da882 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:05.922324 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1131/2253] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:05 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:05.922984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:05.924521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.928385 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1123/2254] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:05.929697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c634ce-525f-4d01-9f19-d0c734b71695 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:05.929988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c634ce-525f-4d01-9f19-d0c734b71695 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:05.930267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c634ce-525f-4d01-9f19-d0c734b71695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:05.947993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-10c634ce-525f-4d01-9f19-d0c734b71695 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:05.949242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-10c634ce-525f-4d01-9f19-d0c734b71695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:05.994249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c50e26-d46d-4676-ae0b-089c6cc89046 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:05.999636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.000726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.001007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.001315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] PATH_INFO: `/v3/projects/636a2d8743a0425794b24083625b37dc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.002610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636a2d8743a0425794b24083625b37dc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.004704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.033413 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1124/2255] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:06.034343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c634ce-525f-4d01-9f19-d0c734b71695 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.049904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c634ce-525f-4d01-9f19-d0c734b71695 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.057267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef41679-60a5-4714-b4a0-2f57b02c33b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.057885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef41679-60a5-4714-b4a0-2f57b02c33b4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.058214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef41679-60a5-4714-b4a0-2f57b02c33b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.058490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef41679-60a5-4714-b4a0-2f57b02c33b4 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.060001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef41679-60a5-4714-b4a0-2f57b02c33b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.062272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef41679-60a5-4714-b4a0-2f57b02c33b4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.077796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636a2d8743a0425794b24083625b37dc', 'request_id': 'req-a68f8237-ed61-4078-b55e-ebbbf62f6918'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:06.085021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636a2d8743a0425794b24083625b37dc', 'request_id': 'req-a68f8237-ed61-4078-b55e-ebbbf62f6918'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:06.090960 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1125/2256] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/users => generated 306 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:06.092466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277617-d676-47e0-99ad-bcd508d443bb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.092751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277617-d676-47e0-99ad-bcd508d443bb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.093124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277617-d676-47e0-99ad-bcd508d443bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.097363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636a2d8743a0425794b24083625b37dc', 'request_id': 'req-a68f8237-ed61-4078-b55e-ebbbf62f6918'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:06.117593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] The token cache is being invalidate because project 636a2d8743a0425794b24083625b37dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:06.117895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:06.118980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:06.120470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-df277617-d676-47e0-99ad-bcd508d443bb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:06.122687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df277617-d676-47e0-99ad-bcd508d443bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:06.124355 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1132/2257] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:05 2022] DELETE /identity/v3/projects/636a2d8743a0425794b24083625b37dc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:06.125322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.126838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:06.202210 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1126/2258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:06.206903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555cc55-b7dc-4618-afea-4c657391ad1a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.207263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555cc55-b7dc-4618-afea-4c657391ad1a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.207813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555cc55-b7dc-4618-afea-4c657391ad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.208388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f8237-ed61-4078-b55e-ebbbf62f6918 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.216292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.216473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.216608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.216858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.217794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.219646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.227651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8555cc55-b7dc-4618-afea-4c657391ad1a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:06.228863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8555cc55-b7dc-4618-afea-4c657391ad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:06.232206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1133/2259] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:06.232937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.237886 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1127/2260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:06.239160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555cc55-b7dc-4618-afea-4c657391ad1a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.243456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418d59-bb7e-4c55-9945-75c86d652359 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.248234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036667c-fd4f-4836-acd2-95abd90de5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.248702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555cc55-b7dc-4618-afea-4c657391ad1a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.249517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036667c-fd4f-4836-acd2-95abd90de5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.249517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036667c-fd4f-4836-acd2-95abd90de5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.249740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036667c-fd4f-4836-acd2-95abd90de5a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.250458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036667c-fd4f-4836-acd2-95abd90de5a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:06.250824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036667c-fd4f-4836-acd2-95abd90de5a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.252465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036667c-fd4f-4836-acd2-95abd90de5a9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.253839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.254732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.255011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.255281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] PATH_INFO: `/v3/projects/ed2bd6e2dd824b0192c7be1055577cd9/users/4e706de8cdb4421cb38c052ef51e7a77/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.266353 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1134/2261] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:06.267875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855502c-fbcf-4b65-b510-fc8d838ee79d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.268310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855502c-fbcf-4b65-b510-fc8d838ee79d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.268707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855502c-fbcf-4b65-b510-fc8d838ee79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.271379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2bd6e2dd824b0192c7be1055577cd9, user_id=4e706de8cdb4421cb38c052ef51e7a77, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.274952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.294532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1128/2262] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:06 2022] PUT /identity/v3/projects/ed2bd6e2dd824b0192c7be1055577cd9/users/4e706de8cdb4421cb38c052ef51e7a77/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:06.295914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e855502c-fbcf-4b65-b510-fc8d838ee79d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:06.296554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.297244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e855502c-fbcf-4b65-b510-fc8d838ee79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:06.379972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93b926-f20e-4e6c-ba48-a17fe16b715a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.385425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.386426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.386712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.386989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.387823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.398031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.411156 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1135/2263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:06.412129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855502c-fbcf-4b65-b510-fc8d838ee79d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.423012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855502c-fbcf-4b65-b510-fc8d838ee79d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.429845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.430605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.430887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.431163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.432058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.434646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.441275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1129/2264] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:06.442997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.459174 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1136/2265] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:06.460113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.473384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc01a9-bf02-4579-8def-84e201d5d2ca admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.531280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f1b2-141c-46e0-87a6-91e7ef415db5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.536463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.536781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.537019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.537329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.538068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:06.538377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.540019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.552441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1130/2266] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:06.553307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.560926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a234f-a213-46bf-a504-b9af8f362f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.562258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a234f-a213-46bf-a504-b9af8f362f55 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.562697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a234f-a213-46bf-a504-b9af8f362f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.563024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a234f-a213-46bf-a504-b9af8f362f55 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.563867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a234f-a213-46bf-a504-b9af8f362f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.566284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ae40d-ced2-48cb-9f96-ba247ab38a04 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.566420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a234f-a213-46bf-a504-b9af8f362f55 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.572053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.573119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.573522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.573901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] PATH_INFO: `/v3/projects/ed2bd6e2dd824b0192c7be1055577cd9/users/4e706de8cdb4421cb38c052ef51e7a77/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.576119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2bd6e2dd824b0192c7be1055577cd9, user_id=4e706de8cdb4421cb38c052ef51e7a77, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.579366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.594378 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1131/2267] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:06 2022] PUT /identity/v3/projects/ed2bd6e2dd824b0192c7be1055577cd9/users/4e706de8cdb4421cb38c052ef51e7a77/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:06.595424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.605075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1137/2268] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:06.609877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d8753-3d30-4fb0-9b7b-490b30a187a1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.610381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d8753-3d30-4fb0-9b7b-490b30a187a1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.612042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d8753-3d30-4fb0-9b7b-490b30a187a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.653398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-790d8753-3d30-4fb0-9b7b-490b30a187a1 None None] MFA Rules not processed for user `4e706de8cdb4421cb38c052ef51e7a77`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:06.655233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-790d8753-3d30-4fb0-9b7b-490b30a187a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:06.693848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f75155-8b70-4ab9-b53b-dcea385ad133 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.710183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.710889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.711173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.712134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.713081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.714882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.753975 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1132/2269] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:06.754721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.772521 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1138/2270] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:06.773554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d8753-3d30-4fb0-9b7b-490b30a187a1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.793068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d8753-3d30-4fb0-9b7b-490b30a187a1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.847210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6a367-60c2-431d-a12f-f3a62d8de4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.847908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a367-60c2-431d-a12f-f3a62d8de4ce admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.848137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a367-60c2-431d-a12f-f3a62d8de4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.849106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a367-60c2-431d-a12f-f3a62d8de4ce admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.849863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6a367-60c2-431d-a12f-f3a62d8de4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.851583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07169ee7-27be-4484-a900-76f6862d547e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.853640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6a367-60c2-431d-a12f-f3a62d8de4ce admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.857800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.858644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.859440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.859860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.860737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:06.864106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:06.875339 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1133/2271] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:06.876591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:06.880426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:06.887008 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1139/2272] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:06.889182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb724c1-8bb9-4169-802f-4f1fa6900082 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.890438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb724c1-8bb9-4169-802f-4f1fa6900082 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.890727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb724c1-8bb9-4169-802f-4f1fa6900082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.927763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-adb724c1-8bb9-4169-802f-4f1fa6900082 None None] MFA Rules not processed for user `ae8571042b5f47eea035c6f126d4e641`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:06.929252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-adb724c1-8bb9-4169-802f-4f1fa6900082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:06.973930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54617b2b-9937-430b-925b-d7223e8c5899 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:06.979930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:06.981252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:06.981252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:06.981528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:06.984213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.014841 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1140/2273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:07.015789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb724c1-8bb9-4169-802f-4f1fa6900082 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.031141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb724c1-8bb9-4169-802f-4f1fa6900082 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.049216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.049216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.049216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.049216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.049553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.049553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.053130 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1141/2274] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:07.053982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.059913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.061639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.063536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882372e9-0707-4a0d-b711-67797096609f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.068128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.068799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.069109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.069385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.070107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.070655 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1134/2275] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:07.071430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.071781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.072718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.083439 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1142/2276] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:07.084285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.090143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c95e0e-39de-4631-8b6f-9a42b1108514 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.095331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.095997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.096120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b420684-caec-4bf4-a2ec-cf6f04d04e62 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.096294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.096846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.101273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.101668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.102575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.102855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.103115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] PATH_INFO: `/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4/users/abed55159a524b32b283c47764e9f5cc/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.103214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.120511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8327eac92d4e15ba65e4b37d8b39d4, user_id=abed55159a524b32b283c47764e9f5cc, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.123268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.135935 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1135/2277] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:07.135935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.139305 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1143/2278] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:07 2022] PUT /identity/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4/users/abed55159a524b32b283c47764e9f5cc/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:07.140321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.141937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.194001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1579a-b11a-45d1-954f-bdec4b71ddd8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.198817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.199493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.199765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.200079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.200820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.202513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.213247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6f1e8-e015-4d57-8206-3efd8ac1911e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.214364 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1136/2279] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:07.215329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.227311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63f46-b6b7-4325-9a2b-b98da68579a4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.232355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860bca5-ad92-41d6-ae2d-ce068a927428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.233025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860bca5-ad92-41d6-ae2d-ce068a927428 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.233350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860bca5-ad92-41d6-ae2d-ce068a927428 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.233626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860bca5-ad92-41d6-ae2d-ce068a927428 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.234676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860bca5-ad92-41d6-ae2d-ce068a927428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.236783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860bca5-ad92-41d6-ae2d-ce068a927428 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.260435 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1137/2280] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/users => generated 299 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:07.262132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120a72-3f82-4808-9978-cf287c451a52 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.262422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120a72-3f82-4808-9978-cf287c451a52 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.262732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120a72-3f82-4808-9978-cf287c451a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.287684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.288491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.289121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.289254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.290417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-58120a72-3f82-4808-9978-cf287c451a52 None None] MFA Rules not processed for user `abed55159a524b32b283c47764e9f5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:07.291713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-58120a72-3f82-4808-9978-cf287c451a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.363580 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1138/2281] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:07.364662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120a72-3f82-4808-9978-cf287c451a52 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.370412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.372978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.375926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120a72-3f82-4808-9978-cf287c451a52 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.388245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.389286 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1144/2282] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:07.389400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.390401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.390678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] PATH_INFO: `/v3/projects/3e33d678ddb34b3d9e415454098fe4c1/users/e6e7caaaf2794b3f88d1dbcd35eabdfd/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.391268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.408937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988994b-1d4c-463b-a23f-d8505adc5fdd service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.410877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e33d678ddb34b3d9e415454098fe4c1, user_id=e6e7caaaf2794b3f88d1dbcd35eabdfd, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.413679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.414660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.416033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.416416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.416832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.418100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.420184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.432211 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1145/2284] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:07.440418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.440634 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1139/2284] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:07 2022] PUT /identity/v3/projects/3e33d678ddb34b3d9e415454098fe4c1/users/e6e7caaaf2794b3f88d1dbcd35eabdfd/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:07.440634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.448662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05d25a-8240-4a29-a39f-3c65aa3477a4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.520355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94e95e-d128-48ff-b0a1-b415bdacc53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.521133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e95e-d128-48ff-b0a1-b415bdacc53b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.521406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e95e-d128-48ff-b0a1-b415bdacc53b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.521728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e95e-d128-48ff-b0a1-b415bdacc53b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.522872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94e95e-d128-48ff-b0a1-b415bdacc53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.525242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94e95e-d128-48ff-b0a1-b415bdacc53b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.534271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf277-e26c-4031-b1d6-d4a3aeaecc02 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.539735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.540745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.540946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.541265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] PATH_INFO: `/v3/projects/5e298331a0b24825a6cbe40cd5bae09d/users/9ce9a5de45c2441381e3a2329b438b56/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.566048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e298331a0b24825a6cbe40cd5bae09d, user_id=9ce9a5de45c2441381e3a2329b438b56, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.568841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.573531 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1146/2285] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:07.575276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66177f8-79de-4ea0-8093-e7ef47e5827a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.575597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66177f8-79de-4ea0-8093-e7ef47e5827a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.575961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66177f8-79de-4ea0-8093-e7ef47e5827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.593498 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1140/2286] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:07 2022] PUT /identity/v3/projects/5e298331a0b24825a6cbe40cd5bae09d/users/9ce9a5de45c2441381e3a2329b438b56/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:07.594670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.606764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f66177f8-79de-4ea0-8093-e7ef47e5827a None None] MFA Rules not processed for user `e6e7caaaf2794b3f88d1dbcd35eabdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:07.608132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f66177f8-79de-4ea0-8093-e7ef47e5827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.661404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767b9b-6379-40e1-9c8c-30a5115c294d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.665999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.666897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.667170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.667436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] PATH_INFO: `/v3/users/4373f108fb0b46b0b66e010d5396a17e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.668768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4373f108fb0b46b0b66e010d5396a17e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.670773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.686980 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1147/2287] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:07.688117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66177f8-79de-4ea0-8093-e7ef47e5827a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.700135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66177f8-79de-4ea0-8093-e7ef47e5827a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.706461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.707525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.707967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.708344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.709335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.711706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.726586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4373f108fb0b46b0b66e010d5396a17e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:07.727351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4373f108fb0b46b0b66e010d5396a17e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:07.734467 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1148/2288] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:07.736661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4373f108fb0b46b0b66e010d5396a17e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:07.737533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4373f108fb0b46b0b66e010d5396a17e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:07.739854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.741578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.746417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4373f108fb0b46b0b66e010d5396a17e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:07.753840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a515c7-039b-4040-9c0f-94ca403c42a3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.759245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.759922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.760204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.760484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.761248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.762957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.769614 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1141/2289] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:07 2022] DELETE /identity/v3/users/4373f108fb0b46b0b66e010d5396a17e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:07.770446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.771879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.773612 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1149/2290] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:07.774755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.776272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.789632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a0083-b0bc-4144-a7f9-9670d753b400 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.848080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84faa8-109b-4f38-bd80-61b5a47a3940 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.849201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303d7b7-8877-4317-8b3d-bdc38b4f8879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.850215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303d7b7-8877-4317-8b3d-bdc38b4f8879 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.850506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303d7b7-8877-4317-8b3d-bdc38b4f8879 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.853355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303d7b7-8877-4317-8b3d-bdc38b4f8879 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.854558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.855242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.855357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303d7b7-8877-4317-8b3d-bdc38b4f8879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.855523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.855797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.856542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.858502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.866793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303d7b7-8877-4317-8b3d-bdc38b4f8879 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.887055 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1150/2291] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:07.889594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866408aa-c39f-4ab0-9f9c-348b42b30618 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.890024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866408aa-c39f-4ab0-9f9c-348b42b30618 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.893285 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1142/2292] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:07.893430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866408aa-c39f-4ab0-9f9c-348b42b30618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.893544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.909584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-866408aa-c39f-4ab0-9f9c-348b42b30618 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:07.910933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-866408aa-c39f-4ab0-9f9c-348b42b30618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:07.965826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ea213-dd8d-40f5-ac62-eb314177c86b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:07.972544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:07.973492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:07.973770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:07.974026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] PATH_INFO: `/v3/projects/5e298331a0b24825a6cbe40cd5bae09d/users/9ce9a5de45c2441381e3a2329b438b56/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:07.977200 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1151/2293] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:07.978068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866408aa-c39f-4ab0-9f9c-348b42b30618 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:07.982780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e298331a0b24825a6cbe40cd5bae09d, user_id=9ce9a5de45c2441381e3a2329b438b56, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:07.987330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:07.993456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866408aa-c39f-4ab0-9f9c-348b42b30618 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.002897 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1143/2294] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:07 2022] PUT /identity/v3/projects/5e298331a0b24825a6cbe40cd5bae09d/users/9ce9a5de45c2441381e3a2329b438b56/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:08.002897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.062257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.063426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.063867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.064138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] PATH_INFO: `/v3/projects/cb34669e812d4235b1103ece8979d581/users/3a7d52c9af6a47c88e6ccb614125eae6/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.072840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b747d-15a1-470f-81f4-d01739af496f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.078621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.079567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.079690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.080131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.080869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.082654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb34669e812d4235b1103ece8979d581, user_id=3a7d52c9af6a47c88e6ccb614125eae6, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.083624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.085847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.105503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1152/2295] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:07 2022] PUT /identity/v3/projects/cb34669e812d4235b1103ece8979d581/users/3a7d52c9af6a47c88e6ccb614125eae6/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:08.106464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.108661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:08.113142 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1144/2296] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:07 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:08.114267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.135959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9992-a8a5-40b6-a2b9-6821edb2f882 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.186342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f2e9b-035b-4b95-b11f-4b2e638dbb22 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.191321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.192262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.192688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.193157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.222142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.223083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.223614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.223883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.226343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.227303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.244088 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1145/2297] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:08.245195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.263551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea354e-ff63-498a-a7e2-f566b18a8cde admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.270494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.271399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.272195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.272615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.273494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.276639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.289684 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1146/2298] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:08.290657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.298300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.300025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.311953 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1153/2299] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:08.312847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.314717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80ee2-7197-4393-a48d-ab1c68c9b816 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.321660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beed34-71b2-49c2-86a5-4fd0116ecf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.322731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beed34-71b2-49c2-86a5-4fd0116ecf16 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.323118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beed34-71b2-49c2-86a5-4fd0116ecf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.323522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beed34-71b2-49c2-86a5-4fd0116ecf16 admin admin] PATH_INFO: `/v3/projects/cb34669e812d4235b1103ece8979d581/users/3a7d52c9af6a47c88e6ccb614125eae6/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.324139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1791f-6ee3-470a-a229-1941d62baa1d service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.326179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beed34-71b2-49c2-86a5-4fd0116ecf16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb34669e812d4235b1103ece8979d581, user_id=3a7d52c9af6a47c88e6ccb614125eae6, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.329613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beed34-71b2-49c2-86a5-4fd0116ecf16 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.332556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.333489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.334279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.334568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] PATH_INFO: `/v3/projects/def29972cc8b489795636fb0a5a3cfc1/users/83fca75b918f4213a4d86a63a7399ea8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.347767 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1147/2300] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:08 2022] PUT /identity/v3/projects/cb34669e812d4235b1103ece8979d581/users/3a7d52c9af6a47c88e6ccb614125eae6/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:08.355657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=def29972cc8b489795636fb0a5a3cfc1, user_id=83fca75b918f4213a4d86a63a7399ea8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.358357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2e995-6b87-439b-8e34-b77b9227366f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.358700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.358805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2e995-6b87-439b-8e34-b77b9227366f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.359882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2e995-6b87-439b-8e34-b77b9227366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.379783 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1154/2301] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:08 2022] PUT /identity/v3/projects/def29972cc8b489795636fb0a5a3cfc1/users/83fca75b918f4213a4d86a63a7399ea8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:08.405771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.407991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5bb2e995-6b87-439b-8e34-b77b9227366f None None] MFA Rules not processed for user `3a7d52c9af6a47c88e6ccb614125eae6`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:08.411782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5bb2e995-6b87-439b-8e34-b77b9227366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:08.492549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2443-cca2-4148-a3ec-40b7c053d5fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.503694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.504745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.506389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.506809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.509083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.510104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1148/2302] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:08.512165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.520241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2e995-6b87-439b-8e34-b77b9227366f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.531446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2e995-6b87-439b-8e34-b77b9227366f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.535231 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1155/2303] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:08.539382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.540562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.541348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.541639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.541914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.542657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:08.543077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.545110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.553634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39be97-a24b-4e00-a7bc-6d617a599f3a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.560278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fb31b-b0cd-4888-b09b-a34c080df3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.561177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb31b-b0cd-4888-b09b-a34c080df3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.561903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb31b-b0cd-4888-b09b-a34c080df3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.561903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb31b-b0cd-4888-b09b-a34c080df3fb admin admin] PATH_INFO: `/v3/projects/def29972cc8b489795636fb0a5a3cfc1/users/83fca75b918f4213a4d86a63a7399ea8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.564041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fb31b-b0cd-4888-b09b-a34c080df3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=def29972cc8b489795636fb0a5a3cfc1, user_id=83fca75b918f4213a4d86a63a7399ea8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.567235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fb31b-b0cd-4888-b09b-a34c080df3fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.577591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1149/2304] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:08.581435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.590241 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1156/2305] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:08 2022] PUT /identity/v3/projects/def29972cc8b489795636fb0a5a3cfc1/users/83fca75b918f4213a4d86a63a7399ea8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:08.592066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450bef0-b490-4800-a1d9-c9b01c07a04b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.600998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.601663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.601663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.639995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] MFA Rules not processed for user `83fca75b918f4213a4d86a63a7399ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:08.645740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:08.681140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.682087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.682447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.682797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.683752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.686487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.722976 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1150/2306] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:08 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:08.727165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.745755 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1157/2307] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:08.770614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.772169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:08.822395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ac49-402c-4b60-af84-7d16280289a1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.837849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.839099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.839447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.839956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.849077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:08.849498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.851732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:08.872877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cf005-26dd-430e-91ff-ed11347c0932 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.880627 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1151/2308] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:08.881435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:08.886582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:08.971764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.972100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed022915-7e82-4802-8802-003a2c112420 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:08.972887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.973616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.973616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.980433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:08.981618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:08.982070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:08.982350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] PATH_INFO: `/v3/projects/9b52aef2f7124bfa8343992aa5f1101b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:08.983673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b52aef2f7124bfa8343992aa5f1101b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:08.988173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:09.080904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:09.085437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:09.101345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b52aef2f7124bfa8343992aa5f1101b', 'request_id': 'req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.107577 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1158/2309] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:09.113922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:09.116060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.124224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b52aef2f7124bfa8343992aa5f1101b', 'request_id': 'req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.141763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b52aef2f7124bfa8343992aa5f1101b', 'request_id': 'req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.145643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbe0f9-6772-41c9-9640-4bf782039eee service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:09.167490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] The token cache is being invalidate because project 9b52aef2f7124bfa8343992aa5f1101b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:09.168253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.170489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6ad2fcfc-e860-42b1-b4b2-e57814ab6b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.173665 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1152/2310] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:08 2022] DELETE /identity/v3/projects/9b52aef2f7124bfa8343992aa5f1101b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:09.178182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.178601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.178975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.241446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] MFA Rules not processed for user `9ce9a5de45c2441381e3a2329b438b56`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:09.245231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.314654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8639b-a78f-417c-8e34-6d67b3d2a617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:09.315434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8639b-a78f-417c-8e34-6d67b3d2a617 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.315794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8639b-a78f-417c-8e34-6d67b3d2a617 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.316204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8639b-a78f-417c-8e34-6d67b3d2a617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.323243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-26c8639b-a78f-417c-8e34-6d67b3d2a617 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.361209 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1153/2311] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:09.362481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:09.364510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.441163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8639b-a78f-417c-8e34-6d67b3d2a617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:09.443689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8639b-a78f-417c-8e34-6d67b3d2a617 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:09.457850 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1159/2312] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:09.459520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a915c79-ccec-4e47-aee1-7badadb7eff9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.459859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a915c79-ccec-4e47-aee1-7badadb7eff9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.460306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a915c79-ccec-4e47-aee1-7badadb7eff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.486497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8a915c79-ccec-4e47-aee1-7badadb7eff9 None None] MFA Rules not processed for user `ae8571042b5f47eea035c6f126d4e641`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:09.487963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a915c79-ccec-4e47-aee1-7badadb7eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.493649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de3ad-1a92-40fc-aaf5-78522c3e6525 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:09.518023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:09.520684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.528003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.528479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] PATH_INFO: `/v3/users/4e706de8cdb4421cb38c052ef51e7a77` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.530766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e706de8cdb4421cb38c052ef51e7a77)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:09.536069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:09.563533 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1160/2313] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:09.565535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066978a-a17b-4806-ab79-f77aede75b2f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.565824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066978a-a17b-4806-ab79-f77aede75b2f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.566103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066978a-a17b-4806-ab79-f77aede75b2f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.571906 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1161/2314] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:09.572775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066978a-a17b-4806-ab79-f77aede75b2f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:09.575002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b066978a-a17b-4806-ab79-f77aede75b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.595550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066978a-a17b-4806-ab79-f77aede75b2f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:09.605387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:09.606580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.606847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.607095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] PATH_INFO: `/v3/users/e6e7caaaf2794b3f88d1dbcd35eabdfd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.609224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e7caaaf2794b3f88d1dbcd35eabdfd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:09.616542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:09.631663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e706de8cdb4421cb38c052ef51e7a77'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.632363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e706de8cdb4421cb38c052ef51e7a77'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.643805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e706de8cdb4421cb38c052ef51e7a77'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.644534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e706de8cdb4421cb38c052ef51e7a77'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.658482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e706de8cdb4421cb38c052ef51e7a77'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.686330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e7caaaf2794b3f88d1dbcd35eabdfd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.686998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e7caaaf2794b3f88d1dbcd35eabdfd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.696658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e7caaaf2794b3f88d1dbcd35eabdfd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.698374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1154/2315] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:09 2022] DELETE /identity/v3/users/4e706de8cdb4421cb38c052ef51e7a77 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:09.699332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:09.710134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.721907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e7caaaf2794b3f88d1dbcd35eabdfd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.722986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ef1b5068-fcb4-46ad-b5fc-84d539c601bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e7caaaf2794b3f88d1dbcd35eabdfd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:09.761113 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1162/2316] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:09 2022] DELETE /identity/v3/users/e6e7caaaf2794b3f88d1dbcd35eabdfd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:09.764818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.766615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.766615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.795156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:09.797146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.864423 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1163/2317] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:09.865613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:09.867040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.868862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:09.870972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:09.944778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45c571-6158-43b5-b8d3-90361e093680 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:09.950602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664afbf0-2652-4b94-8522-92e90b4aad3e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:09.951279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9361f3c-84e3-407c-aa79-955dd8bbb4e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:09.952301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9361f3c-84e3-407c-aa79-955dd8bbb4e4 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:09.952723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9361f3c-84e3-407c-aa79-955dd8bbb4e4 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:09.953257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9361f3c-84e3-407c-aa79-955dd8bbb4e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:09.955273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f9361f3c-84e3-407c-aa79-955dd8bbb4e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:10.018898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9361f3c-84e3-407c-aa79-955dd8bbb4e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:10.020776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9361f3c-84e3-407c-aa79-955dd8bbb4e4 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:10.026311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:10.027371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:10.027661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:10.027936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/fcfa475ab3b948348477ccb0a44ea049` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:10.029360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=fcfa475ab3b948348477ccb0a44ea049)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:10.031565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:10.041560 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1155/2318] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:09 2022] GET /identity/v3/projects/fcfa475ab3b948348477ccb0a44ea049 => generated 369 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:10.042587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:10.047213 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1164/2319] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:10.050805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:10.143674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b2293-792d-4870-92d9-5d25304ae40c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:10.147792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:10.148445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:10.148737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:10.149003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:10.159303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:10.161553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:10.171587 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1156/2320] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:10.703011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98541-44d8-4147-9b03-63e47dfa87c4 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:10.703430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98541-44d8-4147-9b03-63e47dfa87c4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:10.703718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98541-44d8-4147-9b03-63e47dfa87c4 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:10.705114 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1165/2321] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:10.710164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:10.711754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:10.727966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:10.729580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:10.744775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca98541-44d8-4147-9b03-63e47dfa87c4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:10.744962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9c44-6721-44bb-bab0-05511add9ed3 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:10.746911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cca98541-44d8-4147-9b03-63e47dfa87c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:10.750402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acdb2d-b329-4cff-a670-53caa4230b15 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:10.751314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acdb2d-b329-4cff-a670-53caa4230b15 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:10.751586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acdb2d-b329-4cff-a670-53caa4230b15 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:10.751854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acdb2d-b329-4cff-a670-53caa4230b15 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/fcfa475ab3b948348477ccb0a44ea049` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:10.753156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acdb2d-b329-4cff-a670-53caa4230b15 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=fcfa475ab3b948348477ccb0a44ea049)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:10.755402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acdb2d-b329-4cff-a670-53caa4230b15 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:10.757302 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1157/2322] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:10 2022] GET /identity/v3/projects/fcfa475ab3b948348477ccb0a44ea049 => generated 369 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:10.767431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca98541-44d8-4147-9b03-63e47dfa87c4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:10.774080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:10.775083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:10.775377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:10.776351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] PATH_INFO: `/v3/projects/ed2bd6e2dd824b0192c7be1055577cd9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:10.776959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2bd6e2dd824b0192c7be1055577cd9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:10.779101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:10.838284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2bd6e2dd824b0192c7be1055577cd9', 'request_id': 'req-c53305c3-7dbe-4917-a744-0f58e9396020'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:10.843249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2bd6e2dd824b0192c7be1055577cd9', 'request_id': 'req-c53305c3-7dbe-4917-a744-0f58e9396020'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:10.853541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2bd6e2dd824b0192c7be1055577cd9', 'request_id': 'req-c53305c3-7dbe-4917-a744-0f58e9396020'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:10.867677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] The token cache is being invalidate because project ed2bd6e2dd824b0192c7be1055577cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:10.868149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:10.869023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c53305c3-7dbe-4917-a744-0f58e9396020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:10.871243 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1166/2323] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:10 2022] DELETE /identity/v3/projects/ed2bd6e2dd824b0192c7be1055577cd9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:10.876156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:10.877519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:10.877973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:10.899835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:10.901137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.000202 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1158/2324] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:11.007724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569b1c4-ecbb-4a6f-a632-ba19d0a355ac None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.008241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569b1c4-ecbb-4a6f-a632-ba19d0a355ac None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.008241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569b1c4-ecbb-4a6f-a632-ba19d0a355ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.051510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5569b1c4-ecbb-4a6f-a632-ba19d0a355ac None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:11.053340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5569b1c4-ecbb-4a6f-a632-ba19d0a355ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.089479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.089479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.090299 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1167/2325] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:11.091567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569b1c4-ecbb-4a6f-a632-ba19d0a355ac None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.105400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569b1c4-ecbb-4a6f-a632-ba19d0a355ac None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.113483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.114452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.115382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.115800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.116679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:11.117386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.119799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.127068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9e132-4c6e-4147-a0b0-4351098c2611 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.140352 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1168/2326] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:11.141793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.145978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.150935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.151222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.151502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] PATH_INFO: `/v3/projects/3e33d678ddb34b3d9e415454098fe4c1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.153216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e33d678ddb34b3d9e415454098fe4c1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.155257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.155937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3515a5-7033-41ef-a79c-290bc070b833 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.181809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.183055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.183714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.183989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.185155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.193776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.231445 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1169/2327] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:11 2022] POST /identity/v3/projects => generated 403 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:11.235577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.239413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e33d678ddb34b3d9e415454098fe4c1', 'request_id': 'req-46deb0a9-a334-4b97-8a26-75e012cddfc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.249699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e33d678ddb34b3d9e415454098fe4c1', 'request_id': 'req-46deb0a9-a334-4b97-8a26-75e012cddfc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.261934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e33d678ddb34b3d9e415454098fe4c1', 'request_id': 'req-46deb0a9-a334-4b97-8a26-75e012cddfc3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.279165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] The token cache is being invalidate because project 3e33d678ddb34b3d9e415454098fe4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:11.279811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.280618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.283514 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1159/2328] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:11 2022] DELETE /identity/v3/projects/3e33d678ddb34b3d9e415454098fe4c1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:11.287851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.290418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.400549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01177-1f00-48b3-af7b-c53ad787a386 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.410351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb0a9-a334-4b97-8a26-75e012cddfc3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.414285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.414631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.415216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.415490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.423092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.423092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.423348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.423348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.423348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.423348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] PATH_INFO: `/v3/users/83fca75b918f4213a4d86a63a7399ea8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.425944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fca75b918f4213a4d86a63a7399ea8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.430164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.485374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1170/2329] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:11 2022] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:11.496047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.502842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.547100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf7c52-6814-48b4-ab2e-508a060d7973 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.573592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b33872-f3bf-45ee-85c1-356c8b1dc853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.584959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b33872-f3bf-45ee-85c1-356c8b1dc853 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.586124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b33872-f3bf-45ee-85c1-356c8b1dc853 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.586538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b33872-f3bf-45ee-85c1-356c8b1dc853 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.588092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b33872-f3bf-45ee-85c1-356c8b1dc853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.592890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b33872-f3bf-45ee-85c1-356c8b1dc853 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.604735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fca75b918f4213a4d86a63a7399ea8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.605681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fca75b918f4213a4d86a63a7399ea8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.618134 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1171/2330] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:11.619543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3a27a-c686-4fb0-8630-5910679ea378 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.619829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3a27a-c686-4fb0-8630-5910679ea378 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.620448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3a27a-c686-4fb0-8630-5910679ea378 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.625497 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1172/2331] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:11.628203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3a27a-c686-4fb0-8630-5910679ea378 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.636586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fca75b918f4213a4d86a63a7399ea8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.638262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fca75b918f4213a4d86a63a7399ea8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.657618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fca75b918f4213a4d86a63a7399ea8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:11.658506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3a27a-c686-4fb0-8630-5910679ea378 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.670379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.672241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.675674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.675674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.677066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.680198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.694471 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1173/2332] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:11.695452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:11.697907 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1160/2333] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:11 2022] DELETE /identity/v3/users/83fca75b918f4213a4d86a63a7399ea8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:11.699747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.702009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.702612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.811029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305a2d-85b7-49bc-a8e7-83ec95ec9972 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.815972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e807b5-6237-4842-bdb7-cd2b2b651b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:11.816291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:11.817107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e807b5-6237-4842-bdb7-cd2b2b651b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.817559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e807b5-6237-4842-bdb7-cd2b2b651b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.817706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:11.817880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e807b5-6237-4842-bdb7-cd2b2b651b77 admin admin] PATH_INFO: `/v3/projects/ea880def78db4f858cb4b6fe9d11e181/users/e04919de69a4459084a415279e11985a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.842155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e807b5-6237-4842-bdb7-cd2b2b651b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea880def78db4f858cb4b6fe9d11e181, user_id=e04919de69a4459084a415279e11985a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:11.847125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e807b5-6237-4842-bdb7-cd2b2b651b77 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:11.878449 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1161/2334] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:11 2022] PUT /identity/v3/projects/ea880def78db4f858cb4b6fe9d11e181/users/e04919de69a4459084a415279e11985a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:11.882929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759f55-7692-4908-9840-e994980bbd67 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:11.884902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759f55-7692-4908-9840-e994980bbd67 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:11.885666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759f55-7692-4908-9840-e994980bbd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:11.904127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c6e60-a33c-434f-9a70-145a731cbbc9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:11.934491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f4759f55-7692-4908-9840-e994980bbd67 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:11.935561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f4759f55-7692-4908-9840-e994980bbd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.003212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8978d8b-b9fe-4b93-a922-18645357aaf9 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.004230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8978d8b-b9fe-4b93-a922-18645357aaf9 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.004518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8978d8b-b9fe-4b93-a922-18645357aaf9 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.004788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8978d8b-b9fe-4b93-a922-18645357aaf9 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/fcfa475ab3b948348477ccb0a44ea049` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.006057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8978d8b-b9fe-4b93-a922-18645357aaf9 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=fcfa475ab3b948348477ccb0a44ea049)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.009077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8978d8b-b9fe-4b93-a922-18645357aaf9 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.011020 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1174/2335] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:11 2022] GET /identity/v3/projects/fcfa475ab3b948348477ccb0a44ea049 => generated 369 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:12.012545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.012823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.013117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.038270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] MFA Rules not processed for user `9c775742dfc04cec8559f9e4d13239b0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:12.039563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.093831 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1162/2336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:12.093831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759f55-7692-4908-9840-e994980bbd67 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.105783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759f55-7692-4908-9840-e994980bbd67 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:12.112934 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1175/2337] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:12.112934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.113200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.113298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.113372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.113637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.113847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/fcfa475ab3b948348477ccb0a44ea049` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.115201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fcfa475ab3b948348477ccb0a44ea049)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.117903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.208703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcfa475ab3b948348477ccb0a44ea049', 'request_id': 'req-0463e648-d457-4473-88a5-4c3410c21399'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.217604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcfa475ab3b948348477ccb0a44ea049', 'request_id': 'req-0463e648-d457-4473-88a5-4c3410c21399'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.233060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcfa475ab3b948348477ccb0a44ea049', 'request_id': 'req-0463e648-d457-4473-88a5-4c3410c21399'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.244187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c7f97-0342-4b14-874b-57db01ff0f21 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:12.254894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] The token cache is being invalidate because project fcfa475ab3b948348477ccb0a44ea049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:12.255248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.258214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0463e648-d457-4473-88a5-4c3410c21399 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.261871 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1163/2338] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:12 2022] DELETE /identity/v3/projects/fcfa475ab3b948348477ccb0a44ea049 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:12.296221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.296553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.296789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.299135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1164/2339] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:56:12.305777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:12.309292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.328779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.329785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.330207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.331006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.333426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.428434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.429955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.430613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.432231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.442592 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1176/2340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:12.443700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.445009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.460829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9815b-18b8-4575-9d21-904e54f0e414 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:12.470431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.471763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.472039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.472312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] PATH_INFO: `/v3/projects/def29972cc8b489795636fb0a5a3cfc1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.474644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def29972cc8b489795636fb0a5a3cfc1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.477644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.525583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730575c-e2e5-427f-ac7b-776fee9f2efd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:12.537449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def29972cc8b489795636fb0a5a3cfc1', 'request_id': 'req-a78cd8f2-52c6-4596-a8cf-291078ad4279'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.546892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def29972cc8b489795636fb0a5a3cfc1', 'request_id': 'req-a78cd8f2-52c6-4596-a8cf-291078ad4279'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.560226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def29972cc8b489795636fb0a5a3cfc1', 'request_id': 'req-a78cd8f2-52c6-4596-a8cf-291078ad4279'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.594910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] The token cache is being invalidate because project def29972cc8b489795636fb0a5a3cfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:12.595298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.596663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a78cd8f2-52c6-4596-a8cf-291078ad4279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:12.598521 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1177/2341] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:12 2022] DELETE /identity/v3/projects/def29972cc8b489795636fb0a5a3cfc1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:12.604400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac9dd-884f-4999-b597-3ece6c133564 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.604716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac9dd-884f-4999-b597-3ece6c133564 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.604959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac9dd-884f-4999-b597-3ece6c133564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.622270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.623470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.624486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.625142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.627339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=7d8327eac92d4e15ba65e4b37d8b39d4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.630319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.631118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-806ac9dd-884f-4999-b597-3ece6c133564 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:12.632346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-806ac9dd-884f-4999-b597-3ece6c133564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.632757 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1165/2342] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:12 2022] GET /identity/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4 => generated 375 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:12.653672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.656080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.690459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146678-c0c1-49cd-a235-48c6f24149de tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:12.697155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.697997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.698496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.698891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.700320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:12.700770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.702778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.718926 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1178/2343] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:12.726820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62770d6-bc5d-4e24-ade6-50aa5c0f8022 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.727119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62770d6-bc5d-4e24-ade6-50aa5c0f8022 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.727586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62770d6-bc5d-4e24-ade6-50aa5c0f8022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.729000 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1166/2344] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:12.732829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.754899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a62770d6-bc5d-4e24-ade6-50aa5c0f8022 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:12.756139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a62770d6-bc5d-4e24-ade6-50aa5c0f8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:12.763163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd1d0-adc8-45dd-aa04-b81f2952cca5 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:12.765567 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1179/2345] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:12.770826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62770d6-bc5d-4e24-ade6-50aa5c0f8022 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.782675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.783562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.784248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.784550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.785523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.790283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.794975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62770d6-bc5d-4e24-ade6-50aa5c0f8022 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:12.808406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:12.809269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:12.809560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:12.812492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:12.812965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:12.815830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:12.817315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:12.854506 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1180/2346] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:12.864887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.868175 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1167/2347] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:12 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:12.877826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:12.889137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a5e0-3a7e-40b1-be4b-9258cd4644ef admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.009161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.009925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.010210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.010527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.011236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.013496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.052272 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1181/2348] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:12 2022] POST /identity/v3/projects => generated 409 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:13.057129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5bf52-3e78-4671-9af3-a55552144785 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.057660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.208721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1558d9-7952-48a6-b250-7e43553092f3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.219090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b42a72-11a8-4e49-b936-4a5fd66a855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.222435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b42a72-11a8-4e49-b936-4a5fd66a855a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.222770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b42a72-11a8-4e49-b936-4a5fd66a855a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.223057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b42a72-11a8-4e49-b936-4a5fd66a855a admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.223794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b42a72-11a8-4e49-b936-4a5fd66a855a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.225860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b42a72-11a8-4e49-b936-4a5fd66a855a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.234403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.235590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.235880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.236556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.237608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:13.237920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.239721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.261211 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1168/2349] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:13.269152 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1182/2350] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:13 2022] POST /identity/v3/users => generated 305 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:13.273454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.287005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6d6b-85a0-4339-94f8-b87f631cd95f tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.291530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a66e-eaaa-41f3-b7ff-a2d030c9b3b5 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.291897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a66e-eaaa-41f3-b7ff-a2d030c9b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.292300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a66e-eaaa-41f3-b7ff-a2d030c9b3b5 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.294547 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1183/2351] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:13.299906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.300740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.301243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.301589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.302506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.304726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72a66e-eaaa-41f3-b7ff-a2d030c9b3b5 None None] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:13.306253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.308380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aa72a66e-eaaa-41f3-b7ff-a2d030c9b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:13.337588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1169/2352] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:13.340022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.359254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de72a8-be46-4808-a488-1abc9fc5552b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.372980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.374003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.374372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.374737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.375566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.377929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.397182 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1170/2353] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:13.403430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.426012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ff71-a235-41f0-b3a0-cd58b8002158 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.439999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dad048-0c41-4331-a90f-b5c9069b7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.441138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dad048-0c41-4331-a90f-b5c9069b7fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.441531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dad048-0c41-4331-a90f-b5c9069b7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.441895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dad048-0c41-4331-a90f-b5c9069b7fd1 admin admin] PATH_INFO: `/v3/projects/eda79d5ce0bc4d7d8c01457fe5872545/users/f18e2c79b059495c9b530a096f6f4b0d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.458775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72a66e-eaaa-41f3-b7ff-a2d030c9b3b5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.468432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dad048-0c41-4331-a90f-b5c9069b7fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda79d5ce0bc4d7d8c01457fe5872545, user_id=f18e2c79b059495c9b530a096f6f4b0d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.470969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72a66e-eaaa-41f3-b7ff-a2d030c9b3b5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.473724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dad048-0c41-4331-a90f-b5c9069b7fd1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.485335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbeb1e-4e7b-4dbd-8a5e-69b612432d57 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.486486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbeb1e-4e7b-4dbd-8a5e-69b612432d57 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.486748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbeb1e-4e7b-4dbd-8a5e-69b612432d57 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.487075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbeb1e-4e7b-4dbd-8a5e-69b612432d57 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/15bf4b994960491bbd8b8e0341131e68` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.488856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbeb1e-4e7b-4dbd-8a5e-69b612432d57 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=15bf4b994960491bbd8b8e0341131e68)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.491972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbeb1e-4e7b-4dbd-8a5e-69b612432d57 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.493818 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1184/2354] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:13 2022] GET /identity/v3/projects/15bf4b994960491bbd8b8e0341131e68 => generated 371 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:13.503084 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1171/2355] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:13 2022] PUT /identity/v3/projects/eda79d5ce0bc4d7d8c01457fe5872545/users/f18e2c79b059495c9b530a096f6f4b0d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:13.513537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346437d3-cc93-45be-a0d4-17e70e6f273f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.513973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346437d3-cc93-45be-a0d4-17e70e6f273f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.514360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346437d3-cc93-45be-a0d4-17e70e6f273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.552379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-346437d3-cc93-45be-a0d4-17e70e6f273f None None] MFA Rules not processed for user `f18e2c79b059495c9b530a096f6f4b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:13.553876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-346437d3-cc93-45be-a0d4-17e70e6f273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:13.611785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d938d8-5997-49f8-b1d3-98f5b5236428 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.612169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d938d8-5997-49f8-b1d3-98f5b5236428 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.612503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d938d8-5997-49f8-b1d3-98f5b5236428 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.614773 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1172/2356] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:56:13.624058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d938d8-5997-49f8-b1d3-98f5b5236428 None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:13.685720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1185/2357] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:13.689603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346437d3-cc93-45be-a0d4-17e70e6f273f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.732381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d938d8-5997-49f8-b1d3-98f5b5236428 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.779272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346437d3-cc93-45be-a0d4-17e70e6f273f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.791307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.791590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.791964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.792365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.793200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.800849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.827030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d938d8-5997-49f8-b1d3-98f5b5236428 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.832547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.833582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.833868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.834222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/15bf4b994960491bbd8b8e0341131e68` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.835491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=15bf4b994960491bbd8b8e0341131e68)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.836374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1186/2358] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:13 2022] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:13.838511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.840523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1173/2359] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:13 2022] GET /identity/v3/projects/15bf4b994960491bbd8b8e0341131e68 => generated 371 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:13.841335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.889599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:13.901519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc547b2-6617-472b-9a44-c23bc68d8bcd tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.924456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3ec29-7857-4eae-bb85-c1790de04447 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:13.931722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:13.932943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:13.933546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:13.933973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:13.935043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:13.937485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:13.985579 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1187/2360] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:13 2022] POST /identity/v3/users => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:13.987197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.001928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab50535-9f14-41d4-92b3-5a04a35af1de admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.014275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.015023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c356-7e2c-4fa7-9bea-de3f6b97d94c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.016043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c356-7e2c-4fa7-9bea-de3f6b97d94c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.016180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c356-7e2c-4fa7-9bea-de3f6b97d94c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.016406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c356-7e2c-4fa7-9bea-de3f6b97d94c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.017188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c356-7e2c-4fa7-9bea-de3f6b97d94c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:14.017441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.017560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c356-7e2c-4fa7-9bea-de3f6b97d94c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.018022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.018497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.019193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c356-7e2c-4fa7-9bea-de3f6b97d94c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.019786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.023872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.034619 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1174/2361] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:14.037883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6aeb8-9555-4533-9687-b504c9038913 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.038169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6aeb8-9555-4533-9687-b504c9038913 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.038447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6aeb8-9555-4533-9687-b504c9038913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.064901 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1188/2362] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:14.065776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.076731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d7d6aeb8-9555-4533-9687-b504c9038913 None None] MFA Rules not processed for user `e04919de69a4459084a415279e11985a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:14.078030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d7d6aeb8-9555-4533-9687-b504c9038913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:14.086821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b19b-722f-4ad0-be44-d09c2f8afed2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.093960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.094840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.094999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.095190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.095950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.098003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.126907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1189/2363] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:14 2022] POST /identity/v3/users => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:14.127820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.146287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d121dce-6f3c-4ed8-9848-9daa69d476e1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.163775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.165400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.165985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.166368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] PATH_INFO: `/v3/projects/646dccefefc642ed845c34dd7e2df5d7/users/67a5434de6984081b1172ab7b3c70769/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.183738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646dccefefc642ed845c34dd7e2df5d7, user_id=67a5434de6984081b1172ab7b3c70769, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.186805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.201632 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1175/2364] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:14.206192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6aeb8-9555-4533-9687-b504c9038913 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.208683 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1190/2365] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:14 2022] PUT /identity/v3/projects/646dccefefc642ed845c34dd7e2df5d7/users/67a5434de6984081b1172ab7b3c70769/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:14.209932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.214727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:14.243642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6aeb8-9555-4533-9687-b504c9038913 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.341431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.342130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.342415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.342689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.343423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:14.343730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.346238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.353228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98175-cbea-477e-a3c7-a8779f7ac4d3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.360940 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1176/2366] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:14.361847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.372924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.373599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.373867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a3b66-a959-46be-8ca5-20709a578609 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.374422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.374959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.375765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.379158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.395832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.397228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.397509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.397794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.398547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.403431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.417495 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1177/2367] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:14.422294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.443900 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1191/2368] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:14 2022] POST /identity/v3/projects => generated 403 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:14.447621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.454168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e664-6ce1-4bf4-b376-b9f6793fdaf5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.569442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfef802-b3c4-4fce-92b2-d772cdabfc12 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.575812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9d5e4-1c4d-46f3-870a-156184a7f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.576635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d5e4-1c4d-46f3-870a-156184a7f6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.577156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d5e4-1c4d-46f3-870a-156184a7f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.578324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d5e4-1c4d-46f3-870a-156184a7f6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.579507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9d5e4-1c4d-46f3-870a-156184a7f6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.580679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.581772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.583288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.583719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] PATH_INFO: `/v3/projects/646dccefefc642ed845c34dd7e2df5d7/users/67a5434de6984081b1172ab7b3c70769/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.584203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9d5e4-1c4d-46f3-870a-156184a7f6f7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.591214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646dccefefc642ed845c34dd7e2df5d7, user_id=67a5434de6984081b1172ab7b3c70769, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.596024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.619574 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1192/2369] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:14 2022] POST /identity/v3/users => generated 308 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:14.624156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706226d-30e7-4043-b53f-6448045179a6 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.624442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706226d-30e7-4043-b53f-6448045179a6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.624719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706226d-30e7-4043-b53f-6448045179a6 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.633080 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1178/2371] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:14 2022] PUT /identity/v3/projects/646dccefefc642ed845c34dd7e2df5d7/users/67a5434de6984081b1172ab7b3c70769/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:14.633080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.633384 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1193/2371] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:14.635691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706226d-30e7-4043-b53f-6448045179a6 None None] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:14.726268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1414-910a-46f8-9b2e-220a942738c8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.742628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ddaef-4bd8-479a-b520-0264ff74a0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.743378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ddaef-4bd8-479a-b520-0264ff74a0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.744344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ddaef-4bd8-479a-b520-0264ff74a0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.744344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ddaef-4bd8-479a-b520-0264ff74a0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.745112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ddaef-4bd8-479a-b520-0264ff74a0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.747598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ddaef-4bd8-479a-b520-0264ff74a0f7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.753789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706226d-30e7-4043-b53f-6448045179a6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.772542 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1179/2372] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:14.774095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.774481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.775003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.805022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] MFA Rules not processed for user `67a5434de6984081b1172ab7b3c70769`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:14.806749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:14.869347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706226d-30e7-4043-b53f-6448045179a6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.874999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.875898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.876177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.876445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/15bf4b994960491bbd8b8e0341131e68` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.877672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=15bf4b994960491bbd8b8e0341131e68)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.879797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.881614 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1194/2373] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:14 2022] GET /identity/v3/projects/15bf4b994960491bbd8b8e0341131e68 => generated 371 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:14.882373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.893338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065cb8-77ac-4a56-bc19-2b5930359f2e tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.898901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1180/2374] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:14.902335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.903353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.903628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.904098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] PATH_INFO: `/v3/projects/6e0bb7d7d0b7431fab0479c7a1d489e9/users/3e6c562e31e447d2a615fcc52716d2b4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.910315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:14.912240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:14.932580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17e9b-6551-4d09-8351-c6b673e0d979 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:14.940998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:14.942117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:14.942443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:14.942877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:14.948117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0bb7d7d0b7431fab0479c7a1d489e9, user_id=3e6c562e31e447d2a615fcc52716d2b4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.951482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.957737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:14.959738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:14.972078 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1195/2375] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:14 2022] PUT /identity/v3/projects/6e0bb7d7d0b7431fab0479c7a1d489e9/users/3e6c562e31e447d2a615fcc52716d2b4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:14.976499 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1181/2376] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:14.982789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.040041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.056830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fc1b-664a-4edb-acf0-170596de5321 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:15.093880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a908d-1a7f-4a27-bbcf-1ccfbd80b33a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:15.099852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0762d65-0760-4191-afa2-918150cd2ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:15.101912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0762d65-0760-4191-afa2-918150cd2ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.102197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0762d65-0760-4191-afa2-918150cd2ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.102715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0762d65-0760-4191-afa2-918150cd2ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.103462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0762d65-0760-4191-afa2-918150cd2ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:15.106234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0762d65-0760-4191-afa2-918150cd2ba9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:15.120742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1196/2377] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:15.122057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566bcd-d4b5-4fcf-88b0-56563a88f456 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.122358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566bcd-d4b5-4fcf-88b0-56563a88f456 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.122623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566bcd-d4b5-4fcf-88b0-56563a88f456 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.124357 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1197/2378] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:15.126278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b566bcd-d4b5-4fcf-88b0-56563a88f456 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.144745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b566bcd-d4b5-4fcf-88b0-56563a88f456 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:15.149631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:15.151174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.151174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.151174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] PATH_INFO: `/v3/projects/6e0bb7d7d0b7431fab0479c7a1d489e9/users/3e6c562e31e447d2a615fcc52716d2b4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.153263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0bb7d7d0b7431fab0479c7a1d489e9, user_id=3e6c562e31e447d2a615fcc52716d2b4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:15.156264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:15.167216 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1198/2379] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:15 2022] PUT /identity/v3/projects/6e0bb7d7d0b7431fab0479c7a1d489e9/users/3e6c562e31e447d2a615fcc52716d2b4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:15.167864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:15.174171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:15.174938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.175344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.175792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.243999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:15.246101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:15.261172 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1182/2380] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:15.270877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.359432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579eb4f-806a-4f67-ae08-a783b40180d4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:15.365547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:15.366576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.367092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.367261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/15bf4b994960491bbd8b8e0341131e68` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.374000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=15bf4b994960491bbd8b8e0341131e68)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:15.374000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:15.374000 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1199/2381] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:15 2022] GET /identity/v3/projects/15bf4b994960491bbd8b8e0341131e68 => generated 371 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:15.440657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.445555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.459321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683351bd-05c7-4c1c-9b84-84742be23670 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:15.459957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccdc76-8e68-4367-b246-bdb8d76953d0 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:15.464874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:15.465963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.466255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.466812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/users/af6d82e9148a46379ed5fd54103884db` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.494596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:delete_user(user_id=af6d82e9148a46379ed5fd54103884db)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:15.498218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:15.560827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:15.563924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.564237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.564509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] PATH_INFO: `/v3/users/f18e2c79b059495c9b530a096f6f4b0d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.566778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18e2c79b059495c9b530a096f6f4b0d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:15.570153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6d82e9148a46379ed5fd54103884db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.570317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:15.570958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6d82e9148a46379ed5fd54103884db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.580343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6d82e9148a46379ed5fd54103884db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.594175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6d82e9148a46379ed5fd54103884db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.595021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6d82e9148a46379ed5fd54103884db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.623167 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1200/2382] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:15 2022] DELETE /identity/v3/users/af6d82e9148a46379ed5fd54103884db => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:15.628040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.632334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:15.660055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18e2c79b059495c9b530a096f6f4b0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.660806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18e2c79b059495c9b530a096f6f4b0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.668937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18e2c79b059495c9b530a096f6f4b0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.670516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18e2c79b059495c9b530a096f6f4b0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.683190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca280d-2523-4895-96ed-a4764c200cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18e2c79b059495c9b530a096f6f4b0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.721859 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1183/2383] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:15 2022] DELETE /identity/v3/users/f18e2c79b059495c9b530a096f6f4b0d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:15.723663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.724108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.724539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.768427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec9db-7a2f-4200-a7bc-82324b92b2c1 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:15.781411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:15.782658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:15.884088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:15.884088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:15.884088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:15.884487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/15bf4b994960491bbd8b8e0341131e68` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:15.884487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:delete_project(project_id=15bf4b994960491bbd8b8e0341131e68)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:15.884487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:15.898030 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1184/2384] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:15.945312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15bf4b994960491bbd8b8e0341131e68', 'request_id': 'req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.953610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15bf4b994960491bbd8b8e0341131e68', 'request_id': 'req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.967983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:15.968644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15bf4b994960491bbd8b8e0341131e68', 'request_id': 'req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.969651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:15.980549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] The token cache is being invalidate because project 15bf4b994960491bbd8b8e0341131e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:15.980869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.981691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0193d359-0d67-4a15-a8da-dd5ffccbe4ff tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:15.989390 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1201/2385] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:15 2022] DELETE /identity/v3/projects/15bf4b994960491bbd8b8e0341131e68 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:16.051493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:16.051776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:16.052089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:16.054654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1202/2386] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:56:16.060380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:16.062537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:16.065235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93c8f9-604d-443e-a284-5379de7c97ab None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:16.137745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9e95-e14d-40b1-9bb4-d83a6c450f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:16.142172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9e95-e14d-40b1-9bb4-d83a6c450f8d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:16.142525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9e95-e14d-40b1-9bb4-d83a6c450f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:16.143234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9e95-e14d-40b1-9bb4-d83a6c450f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:16.151953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5b5c9e95-e14d-40b1-9bb4-d83a6c450f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:16.176726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:16.180411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:16.266209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c9e95-e14d-40b1-9bb4-d83a6c450f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:16.267939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c9e95-e14d-40b1-9bb4-d83a6c450f8d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:16.274551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e1ef-7d88-4249-9a67-d0c90f9a2c85 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:16.280882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:16.281785 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1185/2387] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:16.282257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:16.283162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:16.283162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:16.283986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=7d8327eac92d4e15ba65e4b37d8b39d4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:16.286377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:16.288438 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1203/2388] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:16 2022] GET /identity/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4 => generated 375 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:16.420842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22db2c-71c7-40d6-9dee-753a2f16d22f None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:16.421346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22db2c-71c7-40d6-9dee-753a2f16d22f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:16.421689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22db2c-71c7-40d6-9dee-753a2f16d22f None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:16.423150 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1186/2389] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:16.428349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:16.430464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:16.448572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:16.458968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b963-c271-4520-8f83-46625242109c tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:16.466554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:16.467480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:16.467760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:16.468034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:16.469824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=7d8327eac92d4e15ba65e4b37d8b39d4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:16.474058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:16.476472 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1204/2390] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:16 2022] GET /identity/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4 => generated 375 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:16.744493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d85d-0467-4f83-92a0-6c152bcb6453 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:16.744850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d85d-0467-4f83-92a0-6c152bcb6453 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:16.745214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d85d-0467-4f83-92a0-6c152bcb6453 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:16.747511 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1187/2391] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:16.752258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:16.767772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:16.784368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2fd7-290c-407d-bf41-0bf1870e4ada tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:16.789763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7d52c9af6a47c88e6ccb614125eae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb34669e812d4235b1103ece8979d581', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:16.790733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:16.791907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:16.791907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] PATH_INFO: `/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:16.793831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorizing `identity:get_project(project_id=7d8327eac92d4e15ba65e4b37d8b39d4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:16.796198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:16.798786 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1205/2392] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:16 2022] GET /identity/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4 => generated 375 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:17.096312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:17.096601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:17.096897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:17.155271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] MFA Rules not processed for user `3e6c562e31e447d2a615fcc52716d2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:17.156467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:17.292015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:17.293879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:17.298746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1188/2393] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:17.315254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19841f4e-61fb-49b9-b852-aea5ad8961b4 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:17.325728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:17.326989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:17.327636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:17.328099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] PATH_INFO: `/v3/users/abed55159a524b32b283c47764e9f5cc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:17.329918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abed55159a524b32b283c47764e9f5cc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:17.332943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:17.349738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:17.351796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:17.379286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9fc6a-6be4-4c90-8ca5-241c420afc27 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:17.388688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:17.389959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:17.390082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:17.390271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] PATH_INFO: `/v3/projects/eda79d5ce0bc4d7d8c01457fe5872545` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:17.391664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda79d5ce0bc4d7d8c01457fe5872545)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:17.393900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:17.426213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abed55159a524b32b283c47764e9f5cc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.427049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abed55159a524b32b283c47764e9f5cc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.435994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abed55159a524b32b283c47764e9f5cc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.451668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abed55159a524b32b283c47764e9f5cc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.453500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a17195c5-e42c-4e00-92e1-3e1b88cc6be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abed55159a524b32b283c47764e9f5cc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.460536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda79d5ce0bc4d7d8c01457fe5872545', 'request_id': 'req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.466388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda79d5ce0bc4d7d8c01457fe5872545', 'request_id': 'req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.475885 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1206/2394] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:17 2022] DELETE /identity/v3/users/abed55159a524b32b283c47764e9f5cc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:17.480473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda79d5ce0bc4d7d8c01457fe5872545', 'request_id': 'req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.480651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:17.481169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:17.481508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:17.493178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] The token cache is being invalidate because project eda79d5ce0bc4d7d8c01457fe5872545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:17.493539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.494258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.497075 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1189/2395] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:17 2022] DELETE /identity/v3/projects/eda79d5ce0bc4d7d8c01457fe5872545 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:17.499818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:17.502307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:17.505925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:17.507395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:17.597055 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1207/2396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:17.602453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bc6bc-e115-4114-a4df-6ca6560f18ce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:17.607249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:17.608276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:17.609347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:17.609347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] PATH_INFO: `/v3/users/67a5434de6984081b1172ab7b3c70769` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:17.610482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a5434de6984081b1172ab7b3c70769)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:17.612073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:17.612667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:17.614181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:17.690169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a5434de6984081b1172ab7b3c70769'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.690414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2967a8-99b6-42a2-9a48-3b50e7cd375f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:17.690953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a5434de6984081b1172ab7b3c70769'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.695043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:17.695711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:17.695988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:17.696260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:17.703346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a5434de6984081b1172ab7b3c70769'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.707288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a5434de6984081b1172ab7b3c70769'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.708507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:17.710386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:17.721519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ddf9937a-2bc1-423f-a674-a7f2c61d3276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a5434de6984081b1172ab7b3c70769'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:17.723881 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1208/2397] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:17.743008 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1190/2398] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:17 2022] DELETE /identity/v3/users/67a5434de6984081b1172ab7b3c70769 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:18.258278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:18.269639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10399409-05d2-4901-b6dd-56cc20296f71 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:18.350803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:18.351643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:18.351917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:18.352187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] PATH_INFO: `/v3/projects/646dccefefc642ed845c34dd7e2df5d7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:18.353450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=646dccefefc642ed845c34dd7e2df5d7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:18.355401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:18.469079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646dccefefc642ed845c34dd7e2df5d7', 'request_id': 'req-037062fc-39f3-4acf-ba5e-c70d70164acf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.477968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646dccefefc642ed845c34dd7e2df5d7', 'request_id': 'req-037062fc-39f3-4acf-ba5e-c70d70164acf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.505400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646dccefefc642ed845c34dd7e2df5d7', 'request_id': 'req-037062fc-39f3-4acf-ba5e-c70d70164acf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.526367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] The token cache is being invalidate because project 646dccefefc642ed845c34dd7e2df5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:18.526659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.527480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-037062fc-39f3-4acf-ba5e-c70d70164acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.529894 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1209/2399] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:18 2022] DELETE /identity/v3/projects/646dccefefc642ed845c34dd7e2df5d7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:18.536144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ab83e-14b2-41b0-b022-917a851797ab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:18.536720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ab83e-14b2-41b0-b022-917a851797ab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:18.536720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ab83e-14b2-41b0-b022-917a851797ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:18.563363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1e8ab83e-14b2-41b0-b022-917a851797ab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:18.564510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1e8ab83e-14b2-41b0-b022-917a851797ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:18.635321 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1191/2400] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:18.644019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0843c5e-8899-48d0-b094-706937b7c1fb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:18.644383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0843c5e-8899-48d0-b094-706937b7c1fb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:18.644580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0843c5e-8899-48d0-b094-706937b7c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:18.667374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c0843c5e-8899-48d0-b094-706937b7c1fb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:18.668735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c0843c5e-8899-48d0-b094-706937b7c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:18.682628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1210/2401] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:18.683211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ab83e-14b2-41b0-b022-917a851797ab None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:18.695846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ab83e-14b2-41b0-b022-917a851797ab None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:18.708534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:18.709637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:18.709927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:18.710231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:18.710995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:18.711288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:18.717519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:18.751539 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1192/2402] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:18.751905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0843c5e-8899-48d0-b094-706937b7c1fb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:18.762711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0843c5e-8899-48d0-b094-706937b7c1fb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:18.780162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:18.780162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:18.780162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:18.780162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:18.781978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:18.784690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:18.786298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:18.790401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:18.802354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6dd00-b856-4aa3-ba8f-51cadf26928c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:18.808592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:18.809593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:18.809891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:18.810174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] PATH_INFO: `/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:18.811577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8327eac92d4e15ba65e4b37d8b39d4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:18.815299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:18.873777 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1211/2403] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:18 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:18.879890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:18.897258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8327eac92d4e15ba65e4b37d8b39d4', 'request_id': 'req-d421c321-90e3-43d5-a487-a7da09e19614'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.907206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8327eac92d4e15ba65e4b37d8b39d4', 'request_id': 'req-d421c321-90e3-43d5-a487-a7da09e19614'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.922637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8327eac92d4e15ba65e4b37d8b39d4', 'request_id': 'req-d421c321-90e3-43d5-a487-a7da09e19614'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.944201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] The token cache is being invalidate because project 7d8327eac92d4e15ba65e4b37d8b39d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:18.946486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.947648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:18.950045 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1193/2404] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:18 2022] DELETE /identity/v3/projects/7d8327eac92d4e15ba65e4b37d8b39d4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:18.954131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:18.956870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:18.965496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dac1d-d354-46d4-b6d6-d3715e0344bf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:18.971134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:18.971849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:18.972130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:18.972408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:18.973221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:18.975211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.005443 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1212/2405] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:18 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:19.008870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.012962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:19.028751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8b76f-8aeb-465e-9d0d-43bd9c86f4d5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.035220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.036038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.036363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.036643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.037454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.039292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.066724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c321-90e3-43d5-a487-a7da09e19614 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.075704 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1213/2406] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:19.076950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.078845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.080845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.081242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.081590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] PATH_INFO: `/v3/users/3a7d52c9af6a47c88e6ccb614125eae6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.082934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7d52c9af6a47c88e6ccb614125eae6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.085391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.105380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001dd54-249c-4325-8e84-37955b24291b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.116212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.116908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.117691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.117691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.118414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.120192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.138298 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1214/2407] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:19.139377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.150484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9dbe-3d52-4a7c-a4af-bf2f9b443dd0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.154943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7d52c9af6a47c88e6ccb614125eae6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.155937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7d52c9af6a47c88e6ccb614125eae6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.157841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cebfc-00b9-4ae1-83b4-0146100b02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.159274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cebfc-00b9-4ae1-83b4-0146100b02d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.159618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cebfc-00b9-4ae1-83b4-0146100b02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.159985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cebfc-00b9-4ae1-83b4-0146100b02d7 admin admin] PATH_INFO: `/v3/projects/ed3969bc7fa747a99d06d87702bbb3eb/users/725920d013a74f9c80e0c1398964d248/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.167202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7d52c9af6a47c88e6ccb614125eae6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.168314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7d52c9af6a47c88e6ccb614125eae6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.180924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f068313-b900-4a92-b71b-e7f25df7f9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7d52c9af6a47c88e6ccb614125eae6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.182772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cebfc-00b9-4ae1-83b4-0146100b02d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3969bc7fa747a99d06d87702bbb3eb, user_id=725920d013a74f9c80e0c1398964d248, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.186637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cebfc-00b9-4ae1-83b4-0146100b02d7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.222736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1215/2408] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:19 2022] PUT /identity/v3/projects/ed3969bc7fa747a99d06d87702bbb3eb/users/725920d013a74f9c80e0c1398964d248/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:19.230893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.231234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.231478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.253941 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1194/2409] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:18 2022] DELETE /identity/v3/users/3a7d52c9af6a47c88e6ccb614125eae6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:19.280443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] MFA Rules not processed for user `725920d013a74f9c80e0c1398964d248`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:19.282046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:19.315391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e60bc-a391-4f6e-87fa-3d84d7fb7c72 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.315697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e60bc-a391-4f6e-87fa-3d84d7fb7c72 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.315946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e60bc-a391-4f6e-87fa-3d84d7fb7c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.336191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c95e60bc-a391-4f6e-87fa-3d84d7fb7c72 None None] MFA Rules not processed for user `0bcc50583d0c4b9aa9d9c9b7ad87a576`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:19.337547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c95e60bc-a391-4f6e-87fa-3d84d7fb7c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:19.378634 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1216/2410] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:19.379716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.382286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:19.413837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1195/2411] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:19.478942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036839c2-dfdc-4588-9bba-956aa4e20e23 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.484526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.485237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.485599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.485785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.486464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.488555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.523287 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1217/2412] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:19 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:19.525070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e60bc-a391-4f6e-87fa-3d84d7fb7c72 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.537779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e60bc-a391-4f6e-87fa-3d84d7fb7c72 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.601655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.602804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.603594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.603594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.604344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.606503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.641809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1196/2413] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:19 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:19.643403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.663163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.667279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:19.672478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cc231-0dcd-41c3-bbb6-cdf6f74bfaca admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.681090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.681783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.682058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.682327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.683240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.686518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.695313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaf0f1-0995-46b6-a85c-602a494b5608 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.709751 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1218/2414] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:19.714541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:19.715760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.716682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.716959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.717251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] PATH_INFO: `/v3/users/e04919de69a4459084a415279e11985a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.720753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04919de69a4459084a415279e11985a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:19.723526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:19.753059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550fb7-5f13-45b6-b923-c7682b487dfc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:19.762911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:19.764584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:19.765294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:19.765760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] PATH_INFO: `/v3/projects/1eabd8a6f93e416b9084ba5979bcb069/users/0d951617d369462aa17e9b118747131d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:19.825831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04919de69a4459084a415279e11985a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.827750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04919de69a4459084a415279e11985a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.838028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04919de69a4459084a415279e11985a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.838855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04919de69a4459084a415279e11985a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.854906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04919de69a4459084a415279e11985a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:19.916190 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1197/2415] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:19 2022] DELETE /identity/v3/users/e04919de69a4459084a415279e11985a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:20.000816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eabd8a6f93e416b9084ba5979bcb069, user_id=0d951617d369462aa17e9b118747131d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:20.003605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:20.045564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:20.050636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.065845 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1219/2416] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:19 2022] PUT /identity/v3/projects/1eabd8a6f93e416b9084ba5979bcb069/users/0d951617d369462aa17e9b118747131d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:20.212148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73225b52-ae24-41ef-b7ed-8d77f8cfeae5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:20.276764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:20.278803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.338555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:20.339514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.340129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.340543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.341462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:20.343272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:20.361400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1198/2417] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:20.362585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:20.377476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5f48-393b-4f05-aaa9-579636fe16ee admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:20.386656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311bd02-a909-43cf-8c96-bab35c00671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:20.389347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311bd02-a909-43cf-8c96-bab35c00671a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.390263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311bd02-a909-43cf-8c96-bab35c00671a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.390688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311bd02-a909-43cf-8c96-bab35c00671a admin admin] PATH_INFO: `/v3/projects/1eabd8a6f93e416b9084ba5979bcb069/users/0d951617d369462aa17e9b118747131d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.394217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311bd02-a909-43cf-8c96-bab35c00671a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eabd8a6f93e416b9084ba5979bcb069, user_id=0d951617d369462aa17e9b118747131d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:20.397516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311bd02-a909-43cf-8c96-bab35c00671a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:20.412995 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1199/2418] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:20 2022] PUT /identity/v3/projects/1eabd8a6f93e416b9084ba5979bcb069/users/0d951617d369462aa17e9b118747131d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:20.424122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.424631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.425066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.435288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc990-34e8-4850-a834-cdce1554efa0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:20.466986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] MFA Rules not processed for user `0d951617d369462aa17e9b118747131d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:20.468321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.534473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:20.536061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.536656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.536965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] PATH_INFO: `/v3/projects/cb34669e812d4235b1103ece8979d581` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.549874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb34669e812d4235b1103ece8979d581)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:20.549874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:20.575796 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1200/2419] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:20.575796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:20.575796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.589584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858163e-b4d9-4def-9f7f-04652b07e3ac None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:20.594768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:20.595689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.595965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.596240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] PATH_INFO: `/v3/projects/ea880def78db4f858cb4b6fe9d11e181` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.597999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea880def78db4f858cb4b6fe9d11e181)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:20.599890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:20.633214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb34669e812d4235b1103ece8979d581', 'request_id': 'req-1445bd6e-870c-48a3-9c5d-0378e9d696bd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.641449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb34669e812d4235b1103ece8979d581', 'request_id': 'req-1445bd6e-870c-48a3-9c5d-0378e9d696bd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.654052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb34669e812d4235b1103ece8979d581', 'request_id': 'req-1445bd6e-870c-48a3-9c5d-0378e9d696bd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.677351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea880def78db4f858cb4b6fe9d11e181', 'request_id': 'req-6cfd4d95-c3c8-406a-8495-f4c073b42353'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.679345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] The token cache is being invalidate because project cb34669e812d4235b1103ece8979d581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:20.679661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.680593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1445bd6e-870c-48a3-9c5d-0378e9d696bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.688293 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1220/2420] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:20 2022] DELETE /identity/v3/projects/cb34669e812d4235b1103ece8979d581 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:20.688293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995914f8-21ef-41d8-9c3c-c386176a8775 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.688293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995914f8-21ef-41d8-9c3c-c386176a8775 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.688293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995914f8-21ef-41d8-9c3c-c386176a8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.696994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea880def78db4f858cb4b6fe9d11e181', 'request_id': 'req-6cfd4d95-c3c8-406a-8495-f4c073b42353'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.718049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea880def78db4f858cb4b6fe9d11e181', 'request_id': 'req-6cfd4d95-c3c8-406a-8495-f4c073b42353'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.721964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-995914f8-21ef-41d8-9c3c-c386176a8775 None None] MFA Rules not processed for user `2d51c9bfc0124777b559e1d2cd1e2d50`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:20.723217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-995914f8-21ef-41d8-9c3c-c386176a8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.734513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] The token cache is being invalidate because project ea880def78db4f858cb4b6fe9d11e181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:20.734818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.736377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:20.741101 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1201/2421] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:20 2022] DELETE /identity/v3/projects/ea880def78db4f858cb4b6fe9d11e181 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:20.741101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:20.742666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.843855 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1221/2422] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:20.845508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.845894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.846260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.866955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:20.868304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.898277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd4d95-c3c8-406a-8495-f4c073b42353 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:20.911201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d20f0-ef07-4334-9ac3-73f2d932e3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:20.911863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d20f0-ef07-4334-9ac3-73f2d932e3ac service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.913464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d20f0-ef07-4334-9ac3-73f2d932e3ac service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.913971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d20f0-ef07-4334-9ac3-73f2d932e3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.916462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-301d20f0-ef07-4334-9ac3-73f2d932e3ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.957200 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1222/2423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:20.958813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:20.960541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:20.977509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aae1e0-4aac-4920-bcff-b3c8ca9e3cf8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:20.982750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:20.984024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:20.984303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:20.984574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] PATH_INFO: `/v3/users/3e6c562e31e447d2a615fcc52716d2b4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:20.985968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6c562e31e447d2a615fcc52716d2b4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:20.987918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.010599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d20f0-ef07-4334-9ac3-73f2d932e3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.012807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d20f0-ef07-4334-9ac3-73f2d932e3ac service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.026431 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1202/2424] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:21.028166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f278-1f9e-483a-95d8-8520803f0e24 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.028637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f278-1f9e-483a-95d8-8520803f0e24 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.029127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f278-1f9e-483a-95d8-8520803f0e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.047524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6c562e31e447d2a615fcc52716d2b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.048432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6c562e31e447d2a615fcc52716d2b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.050371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-20d8f278-1f9e-483a-95d8-8520803f0e24 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:21.052030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-20d8f278-1f9e-483a-95d8-8520803f0e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:21.059110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6c562e31e447d2a615fcc52716d2b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.066845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1203/2425] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:21.067988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f278-1f9e-483a-95d8-8520803f0e24 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.072212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6c562e31e447d2a615fcc52716d2b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.073831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6c562e31e447d2a615fcc52716d2b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.079713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f278-1f9e-483a-95d8-8520803f0e24 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.086772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.086772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.086772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.086772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.087516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:21.087826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.089727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.110179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1204/2426] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:21.111189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.113103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:21.117754 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1223/2427] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:20 2022] DELETE /identity/v3/users/3e6c562e31e447d2a615fcc52716d2b4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:21.130221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070980-1eca-4ff3-adbc-1c816eb173d9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.216570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.223119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.223764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.224197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.225006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.227093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.269525 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1205/2428] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:21.273548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.284491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd380-ed40-42f1-9c40-b651b020674b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.372881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.373960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.374433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.374847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.376279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.378607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.390682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.392478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:21.416867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f13-caa6-40dc-93c6-fd347f8687a6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.424150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.425284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.425577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.427518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] PATH_INFO: `/v3/projects/6e0bb7d7d0b7431fab0479c7a1d489e9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.431096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0bb7d7d0b7431fab0479c7a1d489e9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.443576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.465585 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1224/2429] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:21.466549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.481685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1abe5-62eb-4dfd-81b2-820ef618aa07 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.494487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.495320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.495540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.495816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.496642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.498320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.512250 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1225/2430] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:21.518389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.539781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60cf0e-0f0d-4943-b1d6-78e3771fb2e0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.547189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0bb7d7d0b7431fab0479c7a1d489e9', 'request_id': 'req-6efcc189-9bdb-47fc-8bff-121c122e78d0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.559873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0bb7d7d0b7431fab0479c7a1d489e9', 'request_id': 'req-6efcc189-9bdb-47fc-8bff-121c122e78d0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.574410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0bb7d7d0b7431fab0479c7a1d489e9', 'request_id': 'req-6efcc189-9bdb-47fc-8bff-121c122e78d0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.591238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] The token cache is being invalidate because project 6e0bb7d7d0b7431fab0479c7a1d489e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:21.591816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.592438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6efcc189-9bdb-47fc-8bff-121c122e78d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:21.598075 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1206/2431] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:21 2022] DELETE /identity/v3/projects/6e0bb7d7d0b7431fab0479c7a1d489e9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:21.601691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba79c-885e-466c-b550-e634106c818b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.602884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba79c-885e-466c-b550-e634106c818b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.603173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba79c-885e-466c-b550-e634106c818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.628141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-13bba79c-885e-466c-b550-e634106c818b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:21.629405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-13bba79c-885e-466c-b550-e634106c818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:21.669765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.670870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.670994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.671344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.672139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.674002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.686098 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1226/2432] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:21.691142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.693762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:21.713678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9620cf-0663-4168-ac17-58d972f96a42 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.714581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1207/2433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:21.722099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40b3b-a55b-4463-bdb9-daa4bb0752f6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.722383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40b3b-a55b-4463-bdb9-daa4bb0752f6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.722770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40b3b-a55b-4463-bdb9-daa4bb0752f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.729185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd564b4e-f0fb-40ed-b81b-a1f222e0cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.731058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564b4e-f0fb-40ed-b81b-a1f222e0cbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.731337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564b4e-f0fb-40ed-b81b-a1f222e0cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.731614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564b4e-f0fb-40ed-b81b-a1f222e0cbcf admin admin] PATH_INFO: `/v3/projects/8c38f8a248e8481383ac5e5e24fe8af7/users/334378c07a54471a92821460690e9321/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.743404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d3b40b3b-a55b-4463-bdb9-daa4bb0752f6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:21.744759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3b40b3b-a55b-4463-bdb9-daa4bb0752f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:21.749864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd564b4e-f0fb-40ed-b81b-a1f222e0cbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c38f8a248e8481383ac5e5e24fe8af7, user_id=334378c07a54471a92821460690e9321, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.752611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd564b4e-f0fb-40ed-b81b-a1f222e0cbcf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.754883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1208/2434] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:21.759036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40b3b-a55b-4463-bdb9-daa4bb0752f6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.770086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40b3b-a55b-4463-bdb9-daa4bb0752f6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.771417 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1227/2435] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:21 2022] PUT /identity/v3/projects/8c38f8a248e8481383ac5e5e24fe8af7/users/334378c07a54471a92821460690e9321/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:21.785612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a046fc-4e67-4b24-af27-53e09429ce32 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.786846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a046fc-4e67-4b24-af27-53e09429ce32 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.787381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a046fc-4e67-4b24-af27-53e09429ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.831613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-84a046fc-4e67-4b24-af27-53e09429ce32 None None] MFA Rules not processed for user `334378c07a54471a92821460690e9321`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:21.832847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-84a046fc-4e67-4b24-af27-53e09429ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:21.858337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.859836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.859836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.860024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.860866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:21.861274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.862971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.879103 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1209/2436] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:21.891674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:21.907072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a0e4-b327-44db-adaf-1b8e4a9628db admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:21.913824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:21.914560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:21.914842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:21.915115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:21.915847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:21.918826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:21.946889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1228/2437] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:21.988300 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1210/2438] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:21.991781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a046fc-4e67-4b24-af27-53e09429ce32 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:22.015608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a046fc-4e67-4b24-af27-53e09429ce32 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:22.145961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:22.146767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:22.147225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:22.147567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:22.148896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:22.151588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:22.187545 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1229/2439] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:21 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:22.188626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:22.211070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049896b-6e18-46cc-853e-018a2811956d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:22.216382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:22.217293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:22.217851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:22.217851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:22.218801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:22.220517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:22.248088 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1211/2440] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:22.250697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:22.275020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1d3a-1473-42ff-9e6b-d8ee1735905a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:22.302977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c1f77-1d48-4d75-bf97-9ab805b13b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:22.303692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c1f77-1d48-4d75-bf97-9ab805b13b9b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:22.303986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c1f77-1d48-4d75-bf97-9ab805b13b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:22.304236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c1f77-1d48-4d75-bf97-9ab805b13b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:22.309240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c1f77-1d48-4d75-bf97-9ab805b13b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:22.312737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c1f77-1d48-4d75-bf97-9ab805b13b9b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:22.333944 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1230/2441] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:22.335682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:22.353125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8fbb-3cde-4afc-82ad-078f4ab7f30a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:22.367214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:22.368185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:22.368466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:22.369379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] PATH_INFO: `/v3/projects/90e2231e14d64602b3029e86206ba7c0/users/0489625154e743068e43054185fec76c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:22.395101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e2231e14d64602b3029e86206ba7c0, user_id=0489625154e743068e43054185fec76c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:22.399611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:22.422028 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1212/2442] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:22 2022] PUT /identity/v3/projects/90e2231e14d64602b3029e86206ba7c0/users/0489625154e743068e43054185fec76c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:22.432586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4068-e451-4487-8331-798e43fb07d5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:22.432871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4068-e451-4487-8331-798e43fb07d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:22.433230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4068-e451-4487-8331-798e43fb07d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:22.514209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fe9a4068-e451-4487-8331-798e43fb07d5 None None] MFA Rules not processed for user `0489625154e743068e43054185fec76c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:22.521880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fe9a4068-e451-4487-8331-798e43fb07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:22.523624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:22.530620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:22.637832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaabe87-933d-4502-9ca2-f23a27fc7371 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:22.647305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:22.648858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:22.649234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:22.654308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:22.709935 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1231/2443] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:22.714045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a4068-e451-4487-8331-798e43fb07d5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:22.796257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:22.798766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:22.812637 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1213/2444] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:22.833029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a4068-e451-4487-8331-798e43fb07d5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:22.849011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:22.849750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:22.850047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:22.850681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:22.851450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:22.853937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:22.892154 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1232/2445] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:22 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:22.896293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:22.918791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250794-6bae-4f74-8682-b8efd74da24b service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.083854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.084725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.085163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.085577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.086708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.088983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.124687 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1214/2446] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:22 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:23.126402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.145581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59718a27-3096-40f8-8c60-42f6517f75d6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.163216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.166660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.168085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.168585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.169298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:23.172500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.174014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.180990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.196785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e54a6-35d7-49d9-885f-0d471fe1695a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.205719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.206751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.207048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.207328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] PATH_INFO: `/v3/users/111ebd03dde445c99b447894d3ad03e7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.209648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111ebd03dde445c99b447894d3ad03e7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.215781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.221050 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1233/2447] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:23.226032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.251525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0deda-ac7d-4802-9b33-b5d9928bccf0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.266348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.267477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.268650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.269005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] PATH_INFO: `/v3/projects/1d9eadda2f6a48b2bd6b0c6e3a46ee01/users/095e87e431d2413ba8c048b61905e56d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.301420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9eadda2f6a48b2bd6b0c6e3a46ee01, user_id=095e87e431d2413ba8c048b61905e56d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.307253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.333945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111ebd03dde445c99b447894d3ad03e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:23.336183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111ebd03dde445c99b447894d3ad03e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:23.344356 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1234/2448] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:23 2022] PUT /identity/v3/projects/1d9eadda2f6a48b2bd6b0c6e3a46ee01/users/095e87e431d2413ba8c048b61905e56d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:23.345921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.353593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111ebd03dde445c99b447894d3ad03e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:23.357065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111ebd03dde445c99b447894d3ad03e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:23.372337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ea672c6-ccb3-4fb2-b046-09afb941a451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111ebd03dde445c99b447894d3ad03e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:23.400751 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1215/2449] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:23 2022] DELETE /identity/v3/users/111ebd03dde445c99b447894d3ad03e7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:23.406855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.408099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.408606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.428818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44621167-2e6d-4187-8775-79fe5bcff484 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.472368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:23.476284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:23.499905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.500672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.500879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.501217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.502792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.504682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.520674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1235/2450] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:23.524517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.529663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:23.567409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce08ad-0fbb-44bb-85b7-4368180f1fc3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.576537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e891f-1786-47a1-a014-b60462cf0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.577518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e891f-1786-47a1-a014-b60462cf0459 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.577798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e891f-1786-47a1-a014-b60462cf0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.578071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e891f-1786-47a1-a014-b60462cf0459 admin admin] PATH_INFO: `/v3/projects/1d9eadda2f6a48b2bd6b0c6e3a46ee01/users/095e87e431d2413ba8c048b61905e56d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.580291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e891f-1786-47a1-a014-b60462cf0459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9eadda2f6a48b2bd6b0c6e3a46ee01, user_id=095e87e431d2413ba8c048b61905e56d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.583319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e891f-1786-47a1-a014-b60462cf0459 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.598229 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1236/2451] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:23 2022] PUT /identity/v3/projects/1d9eadda2f6a48b2bd6b0c6e3a46ee01/users/095e87e431d2413ba8c048b61905e56d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:23.606599 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1216/2452] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:23.610354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d44da-2ad4-4e81-bfc3-01da312eea4e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.610942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d44da-2ad4-4e81-bfc3-01da312eea4e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.611401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d44da-2ad4-4e81-bfc3-01da312eea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.646086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.649197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:23.670196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c35d44da-2ad4-4e81-bfc3-01da312eea4e None None] MFA Rules not processed for user `095e87e431d2413ba8c048b61905e56d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:23.671468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c35d44da-2ad4-4e81-bfc3-01da312eea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:23.750158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9ef1-8071-40a5-84c1-c1b420a49428 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.769416 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1237/2453] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:23.770700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d44da-2ad4-4e81-bfc3-01da312eea4e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.782004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d44da-2ad4-4e81-bfc3-01da312eea4e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.788777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.789597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.789881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.790534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.791269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:23.791572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.793306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.807649 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1238/2454] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:23.813586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.827784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5165-486e-4bc3-b1d7-13ae44281b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.831411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.832096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.832398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.833343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.836164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.837162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.837510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.838118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.838890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.841496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.883069 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1239/2455] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:23 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:23.884611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:23.904598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.906103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.917097 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1217/2456] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:23.960766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975808a8-9506-49ff-b7db-33714c4cc5d1 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:23.965950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a9c6-9da6-4100-8759-84a00f303bb8 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:23.966674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a9c6-9da6-4100-8759-84a00f303bb8 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:23.966988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a9c6-9da6-4100-8759-84a00f303bb8 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:23.967295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a9c6-9da6-4100-8759-84a00f303bb8 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:23.968042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660a9c6-9da6-4100-8759-84a00f303bb8 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:23.968350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660a9c6-9da6-4100-8759-84a00f303bb8 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:23.970081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660a9c6-9da6-4100-8759-84a00f303bb8 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:23.985214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1240/2457] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:24.192781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:24.194411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:24.404430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549abad-82c0-4d40-9b9d-4215d78882e6 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:24.536984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:24.537738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:24.538077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:24.538505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:24.549806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:24.553773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:24.568176 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1218/2458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:24.586770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293dba-98ec-4200-b7c4-27229bf9a46b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:24.588222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293dba-98ec-4200-b7c4-27229bf9a46b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:24.588694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293dba-98ec-4200-b7c4-27229bf9a46b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:24.590760 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1241/2459] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:24.601861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:24.625010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:24.651642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b90480-5076-4aa4-a35a-2c0afb5dde4d service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:24.665998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:24.666889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:24.667169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:24.667438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/projects/2bc34e0d748942959fc0484c9e0535b2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:24.668708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:get_project(project_id=2bc34e0d748942959fc0484c9e0535b2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:24.671017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:24.676945 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1219/2460] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:24 2022] GET /identity/v3/projects/2bc34e0d748942959fc0484c9e0535b2 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:24.938250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:24.939095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f43f9-7095-4e4c-b716-fba636a238b9 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:24.939380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f43f9-7095-4e4c-b716-fba636a238b9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:24.939646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f43f9-7095-4e4c-b716-fba636a238b9 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:24.941883 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1242/2461] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:24.942609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:24.953082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f43f9-7095-4e4c-b716-fba636a238b9 None None] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:24.955833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6a2f43f9-7095-4e4c-b716-fba636a238b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.016701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f43f9-7095-4e4c-b716-fba636a238b9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.040904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f43f9-7095-4e4c-b716-fba636a238b9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.063732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.063900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.064180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.064447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/projects/2bc34e0d748942959fc0484c9e0535b2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.066824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:get_project(project_id=2bc34e0d748942959fc0484c9e0535b2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.068642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.076202 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1243/2462] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:24 2022] GET /identity/v3/projects/2bc34e0d748942959fc0484c9e0535b2 => generated 371 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:56:25.077102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.088805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.144021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0f14c-929b-4a83-bfdd-98b9f096dccd tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.169081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.169996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.170265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.170532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] PATH_INFO: `/v3/users/334378c07a54471a92821460690e9321` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.172134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=334378c07a54471a92821460690e9321)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.174273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.292014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143b17-a62d-4874-8e21-586b8b6367f5 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.297548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.298793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.299296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.299409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334378c07a54471a92821460690e9321'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.299829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] PATH_INFO: `/v3/users/725920d013a74f9c80e0c1398964d248` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.300246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334378c07a54471a92821460690e9321'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.302120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725920d013a74f9c80e0c1398964d248)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.304743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.308501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334378c07a54471a92821460690e9321'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.309503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334378c07a54471a92821460690e9321'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.319520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334378c07a54471a92821460690e9321'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.342588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1220/2463] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:24 2022] DELETE /identity/v3/users/334378c07a54471a92821460690e9321 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:25.346429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.348390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.377717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725920d013a74f9c80e0c1398964d248'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.379793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725920d013a74f9c80e0c1398964d248'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.401784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725920d013a74f9c80e0c1398964d248'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.422993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725920d013a74f9c80e0c1398964d248'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.424076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d43cec9-5a7e-431a-a5c7-8e5bebaecb09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725920d013a74f9c80e0c1398964d248'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.459863 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1244/2464] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:25 2022] DELETE /identity/v3/users/725920d013a74f9c80e0c1398964d248 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:25.461265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7fd2d-f0e0-43c3-944d-7cc18a15cd21 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.461548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7fd2d-f0e0-43c3-944d-7cc18a15cd21 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.462896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7fd2d-f0e0-43c3-944d-7cc18a15cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.500081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a9e7fd2d-f0e0-43c3-944d-7cc18a15cd21 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:25.501734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a9e7fd2d-f0e0-43c3-944d-7cc18a15cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.508717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5965-66a7-4e9f-9695-bc381418ba73 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.585165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1245/2465] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:25.587474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.588909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.597981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.606637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.610804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.610804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.611234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.612485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:25.612485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.615426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.630948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:25.634534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.638600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1221/2466] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:25.639678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.641471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.658018 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1246/2467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:25.660725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.666940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.682216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd112a-16fc-41e0-b4fc-f9ce484b0c66 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.688034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.689183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.689585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.690236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.691138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.693876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.719479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dd34a-bff3-4a70-be04-89ee0f0f807e tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.724223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.724895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.725355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.725653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.740545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.742318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.751135 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1247/2468] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:25 2022] POST /identity/v3/users => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:25.755392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.757571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1222/2469] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:25.758726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.760853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:25.776994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8669-1347-4de4-bfc5-fcf4e37f897b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.796173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.799549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.800010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.800428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] PATH_INFO: `/v3/projects/10c5c17262b94d898c4aaa03102b4dd8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.807669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848a161-083f-4419-9b4f-c32142cc5b6d tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.814632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c5c17262b94d898c4aaa03102b4dd8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.818761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.819536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.819770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.820043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.824332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.844598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.846736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.877237 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1248/2470] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:25.878430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:25.907124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b0dee-8207-4566-bee0-f781d66bba09 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:25.920675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:25.921590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:25.921590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:25.922006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:25.922580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:25.922888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:25.924579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:25.940858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c5c17262b94d898c4aaa03102b4dd8', 'request_id': 'req-e6956f4e-34b7-46ba-bb32-9a1369880f6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.947891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c5c17262b94d898c4aaa03102b4dd8', 'request_id': 'req-e6956f4e-34b7-46ba-bb32-9a1369880f6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:25.958365 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1249/2471] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:25.962964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c5c17262b94d898c4aaa03102b4dd8', 'request_id': 'req-e6956f4e-34b7-46ba-bb32-9a1369880f6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.010346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] The token cache is being invalidate because project 10c5c17262b94d898c4aaa03102b4dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:26.010819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.011591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6956f4e-34b7-46ba-bb32-9a1369880f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.015889 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1223/2472] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:25 2022] DELETE /identity/v3/projects/10c5c17262b94d898c4aaa03102b4dd8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:26.019790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:26.022423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:26.044639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0541a-c84d-484b-9d51-28bd6fa35d75 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:26.161468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:26.162610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:26.162934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:26.163211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] PATH_INFO: `/v3/users/705c703f699a4b0cb5b74e2c55ea56c1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:26.164640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705c703f699a4b0cb5b74e2c55ea56c1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:26.167929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:26.280374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705c703f699a4b0cb5b74e2c55ea56c1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.281143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705c703f699a4b0cb5b74e2c55ea56c1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.299260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705c703f699a4b0cb5b74e2c55ea56c1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.299823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:26.300232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:26.300604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:26.302861 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1224/2473] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 20:56:26.315689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:26.316630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705c703f699a4b0cb5b74e2c55ea56c1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.317459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fbb7dd19-57f7-48a4-bd03-b6d6c299eff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705c703f699a4b0cb5b74e2c55ea56c1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:26.327136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:26.377258 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1250/2474] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:26 2022] DELETE /identity/v3/users/705c703f699a4b0cb5b74e2c55ea56c1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:26.583997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:26.586635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:26.726546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a45f-74bf-4a5d-981d-50f3b577e6a0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:26.843204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:26.843783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:26.844060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:26.844330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/projects/2bc34e0d748942959fc0484c9e0535b2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:26.845729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:get_project(project_id=2bc34e0d748942959fc0484c9e0535b2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:26.847826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:26.852167 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1225/2475] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:26 2022] GET /identity/v3/projects/2bc34e0d748942959fc0484c9e0535b2 => generated 371 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:27.590970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229fd8-48c1-4a42-add1-8439def879fb None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:27.591537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229fd8-48c1-4a42-add1-8439def879fb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:27.591537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229fd8-48c1-4a42-add1-8439def879fb None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:27.600014 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1251/2476] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:27.604106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:27.606374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:27.767946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229fd8-48c1-4a42-add1-8439def879fb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:27.770805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f4229fd8-48c1-4a42-add1-8439def879fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:27.778291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:27.783515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:27.811482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c066489-f090-42ee-9ff8-fb50b1a048ad tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:27.825287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:27.827322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:27.827779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:27.828351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/projects/2bc34e0d748942959fc0484c9e0535b2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:27.830083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:get_project(project_id=2bc34e0d748942959fc0484c9e0535b2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:27.835475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:27.854815 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1226/2477] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:27 2022] GET /identity/v3/projects/2bc34e0d748942959fc0484c9e0535b2 => generated 371 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:27.889537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:27.908872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0454efe-cba7-42a2-8057-147158f1b407 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:27.927320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:27.928597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:27.944730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:27.945960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/users/29a45f77c3ed4ea694ee16f6f60b3fc7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:27.960461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229fd8-48c1-4a42-add1-8439def879fb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:27.977694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:27.978608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:27.978884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:27.979156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] PATH_INFO: `/v3/projects/8c38f8a248e8481383ac5e5e24fe8af7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:27.983813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c38f8a248e8481383ac5e5e24fe8af7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:27.985316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:delete_user(user_id=29a45f77c3ed4ea694ee16f6f60b3fc7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:27.986236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:27.987785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:28.060167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a45f77c3ed4ea694ee16f6f60b3fc7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.061325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a45f77c3ed4ea694ee16f6f60b3fc7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.071342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a45f77c3ed4ea694ee16f6f60b3fc7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.074012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a45f77c3ed4ea694ee16f6f60b3fc7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.093069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a45f77c3ed4ea694ee16f6f60b3fc7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.140276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c38f8a248e8481383ac5e5e24fe8af7', 'request_id': 'req-39cb2346-f168-48ce-973f-2eca6a799f08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.156398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c38f8a248e8481383ac5e5e24fe8af7', 'request_id': 'req-39cb2346-f168-48ce-973f-2eca6a799f08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.157276 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1227/2478] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:27 2022] DELETE /identity/v3/users/29a45f77c3ed4ea694ee16f6f60b3fc7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:28.159589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:28.162034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:28.175352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c38f8a248e8481383ac5e5e24fe8af7', 'request_id': 'req-39cb2346-f168-48ce-973f-2eca6a799f08'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.202410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] The token cache is being invalidate because project 8c38f8a248e8481383ac5e5e24fe8af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:28.203701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.206398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39cb2346-f168-48ce-973f-2eca6a799f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.213565 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1252/2479] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:27 2022] DELETE /identity/v3/projects/8c38f8a248e8481383ac5e5e24fe8af7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:28.218781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71523f77-b5ff-4ed6-8af8-8e87108ca701 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:28.219117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71523f77-b5ff-4ed6-8af8-8e87108ca701 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:28.219913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71523f77-b5ff-4ed6-8af8-8e87108ca701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:28.280358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-71523f77-b5ff-4ed6-8af8-8e87108ca701 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:28.283912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-71523f77-b5ff-4ed6-8af8-8e87108ca701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:28.352895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6ea4a-aa52-4126-b4ce-f171415e8253 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:28.361170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e87e431d2413ba8c048b61905e56d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:28.362674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:28.363956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:28.364463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] PATH_INFO: `/v3/projects/2bc34e0d748942959fc0484c9e0535b2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:28.367666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2bc34e0d748942959fc0484c9e0535b2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:28.374322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:28.466928 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1253/2480] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:28.471825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:28.473714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:28.474100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:28.534670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc34e0d748942959fc0484c9e0535b2', 'request_id': 'req-87671b69-be0e-4178-89d4-15334d249f48'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.544108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:28.563268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:28.580306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc34e0d748942959fc0484c9e0535b2', 'request_id': 'req-87671b69-be0e-4178-89d4-15334d249f48'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.610725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc34e0d748942959fc0484c9e0535b2', 'request_id': 'req-87671b69-be0e-4178-89d4-15334d249f48'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.637994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] The token cache is being invalidate because project 2bc34e0d748942959fc0484c9e0535b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:28.639077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.641511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.647296 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1228/2481] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:28 2022] DELETE /identity/v3/projects/2bc34e0d748942959fc0484c9e0535b2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:28.649315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:28.653472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:28.764807 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1254/2482] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:28.766187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:28.769580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:28.807052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b006808-6e53-455e-b74d-44fb384007f1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:28.817690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:28.818611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:28.819070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:28.820721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] PATH_INFO: `/v3/users/0489625154e743068e43054185fec76c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:28.822141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0489625154e743068e43054185fec76c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:28.824178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:28.845938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87671b69-be0e-4178-89d4-15334d249f48 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:28.853252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:28.854342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:28.854726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:28.855104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] PATH_INFO: `/v3/projects/ed3969bc7fa747a99d06d87702bbb3eb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:28.859452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3969bc7fa747a99d06d87702bbb3eb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:28.862622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:28.923559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0489625154e743068e43054185fec76c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.925327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0489625154e743068e43054185fec76c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.944231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0489625154e743068e43054185fec76c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.945115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3969bc7fa747a99d06d87702bbb3eb', 'request_id': 'req-4152ff23-dd02-4814-aefb-cabbfa3c75e0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.959020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3969bc7fa747a99d06d87702bbb3eb', 'request_id': 'req-4152ff23-dd02-4814-aefb-cabbfa3c75e0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.962854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0489625154e743068e43054185fec76c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.965338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0489625154e743068e43054185fec76c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:28.982937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3969bc7fa747a99d06d87702bbb3eb', 'request_id': 'req-4152ff23-dd02-4814-aefb-cabbfa3c75e0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.005552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] The token cache is being invalidate because project ed3969bc7fa747a99d06d87702bbb3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:29.007564 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1255/2483] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:28 2022] DELETE /identity/v3/users/0489625154e743068e43054185fec76c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:29.007981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.009300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.011059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4152ff23-dd02-4814-aefb-cabbfa3c75e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.011979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:29.013568 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1229/2484] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:28 2022] DELETE /identity/v3/projects/ed3969bc7fa747a99d06d87702bbb3eb => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:29.016708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.017544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.017948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.051161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:29.052747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:29.144887 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1230/2485] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:29.145930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.148931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:29.150002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d937a75-be02-446f-a63a-b953c28b7b3f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.156164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.156878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.157199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.157731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.158480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:29.159658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.161583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.164410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35595f5f-ed72-45a5-969c-3d3294034974 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.170704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.172278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.172667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.173142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] PATH_INFO: `/v3/users/0d951617d369462aa17e9b118747131d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.174583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d951617d369462aa17e9b118747131d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.176989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.177939 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1256/2486] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:29.178888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.185174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:29.246562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d951617d369462aa17e9b118747131d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.248111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d951617d369462aa17e9b118747131d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.271128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ea137-0725-45dd-a10c-44d6bfffa218 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.274069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d951617d369462aa17e9b118747131d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.275354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.276018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.276297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.276666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.277293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d951617d369462aa17e9b118747131d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.278684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:29.290297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d951617d369462aa17e9b118747131d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.304869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.306561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.323883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1231/2487] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:29 2022] DELETE /identity/v3/users/0d951617d369462aa17e9b118747131d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:29.325021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.326590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:29.331585 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1257/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:29.409745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2bf0-8cac-4867-8685-1f9ea15cd6cd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.431833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.433174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.435341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.436146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.439048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.444143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.483920 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1232/2489] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:29 2022] POST /identity/v3/projects => generated 399 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:29.487735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.521279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b7e6-ef36-4b50-8e0b-d2a59d523fbc service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.650392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.651000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.652230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.652230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.653140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.655313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.684580 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1258/2490] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:29 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:29.688853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.701868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17f10-c964-4b40-9f90-084ff7141515 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.707223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.708096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.708518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.708929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.709933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.712000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.727167 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1233/2491] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:29.731403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.750097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209076c-82fb-4d19-aa2b-b8e736d49694 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.756694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.758037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.758970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.759223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.760215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.763418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.782276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.784755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:29.784923 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1259/2492] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:29.785899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:29.800480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af487e1-23de-470f-9d6f-74d465b25720 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.809904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af52b-20d4-4efb-b47f-eb66b6e8cf24 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:29.818630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313c79-d20e-477a-a5ef-5bc610d0985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.819653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313c79-d20e-477a-a5ef-5bc610d0985e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.819935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313c79-d20e-477a-a5ef-5bc610d0985e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.820205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313c79-d20e-477a-a5ef-5bc610d0985e admin admin] PATH_INFO: `/v3/projects/3d826770f9644d5bae08457c5527cad5/users/f34bcdf16d64463cb4f0d13c0a1adae2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.821686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:29.822651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.823019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.823360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] PATH_INFO: `/v3/projects/5ff28b9e122a4051be554e19bdf4d2c9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.826140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff28b9e122a4051be554e19bdf4d2c9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.828354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.841062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313c79-d20e-477a-a5ef-5bc610d0985e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d826770f9644d5bae08457c5527cad5, user_id=f34bcdf16d64463cb4f0d13c0a1adae2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:29.845796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313c79-d20e-477a-a5ef-5bc610d0985e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:29.924674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1260/2493] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:29 2022] PUT /identity/v3/projects/3d826770f9644d5bae08457c5527cad5/users/f34bcdf16d64463cb4f0d13c0a1adae2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:29.928015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136e57-9e7a-4e62-86b1-498492147699 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:29.928276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136e57-9e7a-4e62-86b1-498492147699 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:29.928554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136e57-9e7a-4e62-86b1-498492147699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:29.941247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff28b9e122a4051be554e19bdf4d2c9', 'request_id': 'req-f02d6838-5464-4887-8cb0-995e870953f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.950377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff28b9e122a4051be554e19bdf4d2c9', 'request_id': 'req-f02d6838-5464-4887-8cb0-995e870953f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.973447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff28b9e122a4051be554e19bdf4d2c9', 'request_id': 'req-f02d6838-5464-4887-8cb0-995e870953f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:29.998682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] The token cache is being invalidate because project 5ff28b9e122a4051be554e19bdf4d2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:29.998915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:30.002439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f02d6838-5464-4887-8cb0-995e870953f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:30.012946 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1234/2494] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:29 2022] DELETE /identity/v3/projects/5ff28b9e122a4051be554e19bdf4d2c9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:30.017723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d85bb-f328-4667-b763-c22d1ba64651 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.018016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d85bb-f328-4667-b763-c22d1ba64651 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.018298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d85bb-f328-4667-b763-c22d1ba64651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.022557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b9136e57-9e7a-4e62-86b1-498492147699 None None] MFA Rules not processed for user `f34bcdf16d64463cb4f0d13c0a1adae2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:30.024321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b9136e57-9e7a-4e62-86b1-498492147699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:30.089472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9f6d85bb-f328-4667-b763-c22d1ba64651 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:30.090989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9f6d85bb-f328-4667-b763-c22d1ba64651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:30.142874 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1261/2495] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:30.216389 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1235/2496] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:30.222957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.223563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.223952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.256357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:30.258948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:30.276864 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1262/2497] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:30.278241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d85bb-f328-4667-b763-c22d1ba64651 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:30.290502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d85bb-f328-4667-b763-c22d1ba64651 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:30.301988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:30.302872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.303223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.305077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.307810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:30.308150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:30.313960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:30.317377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:30.318812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:30.342117 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1236/2498] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:30.346008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:30.367063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c1226-3d30-4bae-8d7d-ad4fa106e856 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:30.374964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:30.375497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.375887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.376256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.377118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:30.379211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:30.437317 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1237/2499] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:30 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:30.439867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:30.520516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87678da6-1196-4f53-bef3-b6c11f1f2229 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:30.581522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca811fbb-707e-4349-9a97-63279794c90c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:30.589029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:30.590135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.590416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.590760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.591511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:30.593894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:30.630991 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1238/2500] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:30 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:30.630991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:30.634560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:30.672552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dfb1e-114b-47c9-a03d-e1bf624635f9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:30.675629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:30.676409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.676694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.676972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.682772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:30.683808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.686555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.686876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] PATH_INFO: `/v3/projects/90e2231e14d64602b3029e86206ba7c0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.690543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e2231e14d64602b3029e86206ba7c0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:30.693451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:30.796509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:30.798213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:30.816086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e2231e14d64602b3029e86206ba7c0', 'request_id': 'req-11e2c4d6-5800-4433-b57f-0312b6dd6d20'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:30.816511 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1263/2501] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:30.817394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:30.829358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334986-4874-4a34-b971-cacce9f3604f service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:30.854070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e2231e14d64602b3029e86206ba7c0', 'request_id': 'req-11e2c4d6-5800-4433-b57f-0312b6dd6d20'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:30.869888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e2231e14d64602b3029e86206ba7c0', 'request_id': 'req-11e2c4d6-5800-4433-b57f-0312b6dd6d20'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:30.916394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] The token cache is being invalidate because project 90e2231e14d64602b3029e86206ba7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:30.917353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:30.919510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:30.926604 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1239/2502] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:30 2022] DELETE /identity/v3/projects/90e2231e14d64602b3029e86206ba7c0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:30.930042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:30.934184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:30.982046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:30.983869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:30.984222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:30.984566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:30.985530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:30.987537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:31.026572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c4d6-5800-4433-b57f-0312b6dd6d20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:31.044416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:31.045361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.045651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.047323 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1264/2503] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:31.047688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] PATH_INFO: `/v3/users/f34bcdf16d64463cb4f0d13c0a1adae2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.048731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:31.051197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34bcdf16d64463cb4f0d13c0a1adae2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:31.053195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:31.058588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:31.095540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d536b43-6f60-4d7e-91ba-a0efc1883890 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:31.115858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:31.116946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.117356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.117728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] PATH_INFO: `/v3/users/095e87e431d2413ba8c048b61905e56d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.119090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] RBAC: Authorizing `identity:delete_user(user_id=095e87e431d2413ba8c048b61905e56d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:31.121470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:31.232361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34bcdf16d64463cb4f0d13c0a1adae2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.236495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34bcdf16d64463cb4f0d13c0a1adae2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.241241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095e87e431d2413ba8c048b61905e56d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.242617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095e87e431d2413ba8c048b61905e56d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.261754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095e87e431d2413ba8c048b61905e56d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.271369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34bcdf16d64463cb4f0d13c0a1adae2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.272399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34bcdf16d64463cb4f0d13c0a1adae2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.276670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095e87e431d2413ba8c048b61905e56d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.277531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095e87e431d2413ba8c048b61905e56d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.298925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34bcdf16d64463cb4f0d13c0a1adae2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.315690 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1265/2504] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:31 2022] DELETE /identity/v3/users/095e87e431d2413ba8c048b61905e56d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:31.316411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:31.325821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:31.332185 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1240/2505] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:30 2022] DELETE /identity/v3/users/f34bcdf16d64463cb4f0d13c0a1adae2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:31.333237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:31.335034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:31.450905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c483c-8044-4e56-92a9-93be41c79069 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:31.454150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a7db1-f3b4-4cfc-a7db-90e9dcd8932e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:31.459882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:31.460348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09cc4d-2b12-4a62-acf9-40cb071960f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:31.461089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09cc4d-2b12-4a62-acf9-40cb071960f7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.461338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09cc4d-2b12-4a62-acf9-40cb071960f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.461607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09cc4d-2b12-4a62-acf9-40cb071960f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.462397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09cc4d-2b12-4a62-acf9-40cb071960f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:31.462558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.463441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.463878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] PATH_INFO: `/v3/projects/1eabd8a6f93e416b9084ba5979bcb069` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.463997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09cc4d-2b12-4a62-acf9-40cb071960f7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:31.466635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eabd8a6f93e416b9084ba5979bcb069)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:31.474466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:31.482155 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1266/2506] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:31.487956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2a7a-bb54-4008-a393-1c6e01fe00a3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.488251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2a7a-bb54-4008-a393-1c6e01fe00a3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.490749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2a7a-bb54-4008-a393-1c6e01fe00a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.545188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-075a2a7a-bb54-4008-a393-1c6e01fe00a3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:31.548231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-075a2a7a-bb54-4008-a393-1c6e01fe00a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:31.567126 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1267/2507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:31.568232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a2a7a-bb54-4008-a393-1c6e01fe00a3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:31.590734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a2a7a-bb54-4008-a393-1c6e01fe00a3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:31.602722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:31.603818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.603957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.604232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] PATH_INFO: `/v3/projects/a232c53c55c148cd8a689714077f5b97/users/1fa4f2d4a3e04883ae75a1a88f3755fe/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.637389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a232c53c55c148cd8a689714077f5b97, user_id=1fa4f2d4a3e04883ae75a1a88f3755fe, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:31.640322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:31.677287 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1268/2508] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:31 2022] PUT /identity/v3/projects/a232c53c55c148cd8a689714077f5b97/users/1fa4f2d4a3e04883ae75a1a88f3755fe/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:31.680741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:31.684461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:31.686023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eabd8a6f93e416b9084ba5979bcb069', 'request_id': 'req-3f84a48a-2f25-4bce-848f-68880a5eaa8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.701300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eabd8a6f93e416b9084ba5979bcb069', 'request_id': 'req-3f84a48a-2f25-4bce-848f-68880a5eaa8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.725552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eabd8a6f93e416b9084ba5979bcb069', 'request_id': 'req-3f84a48a-2f25-4bce-848f-68880a5eaa8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.775711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] The token cache is being invalidate because project 1eabd8a6f93e416b9084ba5979bcb069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:31.776366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.779588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f84a48a-2f25-4bce-848f-68880a5eaa8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:31.789974 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1241/2509] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:31 2022] DELETE /identity/v3/projects/1eabd8a6f93e416b9084ba5979bcb069 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:31.794823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.795858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.799413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.857670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f1ec4-c561-40da-9b1b-a65dfb9f3eb6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:31.874721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab553c-d5f8-4c7e-971f-0021cb2c6534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:31.875628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab553c-d5f8-4c7e-971f-0021cb2c6534 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.876066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab553c-d5f8-4c7e-971f-0021cb2c6534 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.876647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab553c-d5f8-4c7e-971f-0021cb2c6534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:31.877798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] MFA Rules not processed for user `1fa4f2d4a3e04883ae75a1a88f3755fe`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:31.878993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7fab553c-d5f8-4c7e-971f-0021cb2c6534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:31.880301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:31.962928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab553c-d5f8-4c7e-971f-0021cb2c6534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:31.966371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab553c-d5f8-4c7e-971f-0021cb2c6534 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:31.981807 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1269/2510] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:31.983312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52a33-60cc-4f01-9d57-ac1076d0c148 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:31.984156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52a33-60cc-4f01-9d57-ac1076d0c148 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:31.984569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52a33-60cc-4f01-9d57-ac1076d0c148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.005547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-10c52a33-60cc-4f01-9d57-ac1076d0c148 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:32.007205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-10c52a33-60cc-4f01-9d57-ac1076d0c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:32.023906 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1270/2511] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:32.027278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50798d-7a7b-4c6e-995a-ab1f59a61610 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.027933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50798d-7a7b-4c6e-995a-ab1f59a61610 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.028372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50798d-7a7b-4c6e-995a-ab1f59a61610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.098831 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1242/2512] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:32.103444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.112160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-de50798d-7a7b-4c6e-995a-ab1f59a61610 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:32.114127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:32.117604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de50798d-7a7b-4c6e-995a-ab1f59a61610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:32.183588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12205045-b750-4ab1-9d48-b453d90553cd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.187121 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1271/2513] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:32.188166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50798d-7a7b-4c6e-995a-ab1f59a61610 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.216715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.219700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.220174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.220712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.221747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.224860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.228691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50798d-7a7b-4c6e-995a-ab1f59a61610 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.258020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.260015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.260298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.260572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.262393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:32.262735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.265018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.288239 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1243/2514] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:32 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:32.292398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.318425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1272/2515] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:32.325297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.364829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8258e-cdda-48e9-912e-5347c9f2dbe1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.470956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48b3e-9d86-451f-b78d-6a6316327118 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.485185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.485910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.486178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.486445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.487157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.496108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.526965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.530229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.532470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.532937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.534313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.537257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.551117 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1244/2516] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:32 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:32.554940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.567627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248ad5-03dd-423f-b716-bbbf4981abe3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.577571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.578489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.578876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.579512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.580438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.582927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.598979 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1273/2517] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:32 2022] POST /identity/v3/projects => generated 371 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:32.603416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.623170 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1245/2518] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:32.624373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.635915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6128e4-1892-4088-83d2-f1a27aef9c96 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.713540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c2fa-68af-41fd-9396-1159c61c2766 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.719175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.720563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.721194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.721788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.722950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.726135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.726477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.727967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.728253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.728559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] PATH_INFO: `/v3/projects/3a0463b5365742ada5d5aa50da954704/users/3a939a1a7bd840108882d8b0fd18fb88/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.758915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0463b5365742ada5d5aa50da954704, user_id=3a939a1a7bd840108882d8b0fd18fb88, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.760687 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1274/2519] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:32 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:32.764250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.769097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.792815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea8d06-3110-4365-b61a-cc8fb95886c8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.800736 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1246/2520] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:32 2022] PUT /identity/v3/projects/3a0463b5365742ada5d5aa50da954704/users/3a939a1a7bd840108882d8b0fd18fb88/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:32.801768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.896241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.897380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.898309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.898678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.899515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.901686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.922098 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1275/2521] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:32.934131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.952507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ce50-c208-4bb4-a2a7-b4dc5efd1984 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.959975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.960675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.960956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.961259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.962485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.963926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:32.964644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c724-34e1-480d-a8f3-19cac7e6b93d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:32.980910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:32.985254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:32.985877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:32.987324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:32.989179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1247/2522] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:32.994379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:32.995262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:32.999911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.012789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d489-6ed9-4570-987b-a127bc7e77bd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.028246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7dece-d66a-4d87-8a3a-a5925b26a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.029418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7dece-d66a-4d87-8a3a-a5925b26a008 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.029798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7dece-d66a-4d87-8a3a-a5925b26a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.030679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7dece-d66a-4d87-8a3a-a5925b26a008 admin admin] PATH_INFO: `/v3/projects/3a0463b5365742ada5d5aa50da954704/users/3a939a1a7bd840108882d8b0fd18fb88/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.033594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7dece-d66a-4d87-8a3a-a5925b26a008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0463b5365742ada5d5aa50da954704, user_id=3a939a1a7bd840108882d8b0fd18fb88, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.034509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1276/2523] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:33.039685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.040028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7dece-d66a-4d87-8a3a-a5925b26a008 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.073563 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1248/2524] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:32 2022] PUT /identity/v3/projects/3a0463b5365742ada5d5aa50da954704/users/3a939a1a7bd840108882d8b0fd18fb88/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:33.078037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.078463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.078862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.088504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c163-6de8-4dc1-958d-9166d889f2e1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.130406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] MFA Rules not processed for user `3a939a1a7bd840108882d8b0fd18fb88`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:33.134462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.200578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.201743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.202017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.202301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] PATH_INFO: `/v3/projects/352d269ab35841c397ca9168792c1ec4/users/ceba42e80d7746e4897669084c078c09/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.239193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352d269ab35841c397ca9168792c1ec4, user_id=ceba42e80d7746e4897669084c078c09, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.247486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.266638 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1249/2525] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:33.267561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.268898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.286532 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1277/2526] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:33 2022] PUT /identity/v3/projects/352d269ab35841c397ca9168792c1ec4/users/ceba42e80d7746e4897669084c078c09/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:33.287400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.294483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.301634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c5957-cbf6-4a2d-90ba-dfd5761f8821 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.398464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.399645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.400060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.400395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] PATH_INFO: `/v3/projects/1d9eadda2f6a48b2bd6b0c6e3a46ee01` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.401888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9eadda2f6a48b2bd6b0c6e3a46ee01)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.404094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.404798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb6c2-f46b-440a-a15b-fd94e9824730 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.414047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58281149-f9d1-43a5-b8dd-c02e7c00e773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.415010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281149-f9d1-43a5-b8dd-c02e7c00e773 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.415291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281149-f9d1-43a5-b8dd-c02e7c00e773 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.415563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281149-f9d1-43a5-b8dd-c02e7c00e773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.472758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'request_id': 'req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.478938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'request_id': 'req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.491587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9eadda2f6a48b2bd6b0c6e3a46ee01', 'request_id': 'req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.506613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58281149-f9d1-43a5-b8dd-c02e7c00e773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.510393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58281149-f9d1-43a5-b8dd-c02e7c00e773 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.512241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] The token cache is being invalidate because project 1d9eadda2f6a48b2bd6b0c6e3a46ee01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:33.512638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.514666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-11bd6ab3-8d49-4dd9-b313-0d529b1174c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.518709 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1250/2527] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:33 2022] DELETE /identity/v3/projects/1d9eadda2f6a48b2bd6b0c6e3a46ee01 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:33.519928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b886c7-bbeb-4516-a9fe-ce776ed9ddfc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.526789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b886c7-bbeb-4516-a9fe-ce776ed9ddfc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.527482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b886c7-bbeb-4516-a9fe-ce776ed9ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.540988 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1278/2528] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:33.542816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d67ce-0d8e-4f62-b8a0-898ebb02dc50 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.545534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d67ce-0d8e-4f62-b8a0-898ebb02dc50 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.546512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d67ce-0d8e-4f62-b8a0-898ebb02dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.557193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-45b886c7-bbeb-4516-a9fe-ce776ed9ddfc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:33.558834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-45b886c7-bbeb-4516-a9fe-ce776ed9ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.606076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-658d67ce-0d8e-4f62-b8a0-898ebb02dc50 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:33.607842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-658d67ce-0d8e-4f62-b8a0-898ebb02dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.673401 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1279/2529] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:33.674830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507880c-a270-4fe5-a3cb-6b9ee7e3ab17 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.675183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507880c-a270-4fe5-a3cb-6b9ee7e3ab17 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.675524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507880c-a270-4fe5-a3cb-6b9ee7e3ab17 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.677122 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1280/2530] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:33.677895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507880c-a270-4fe5-a3cb-6b9ee7e3ab17 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.679546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c507880c-a270-4fe5-a3cb-6b9ee7e3ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.681187 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1251/2531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:33.682766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.683056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.683400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.696401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507880c-a270-4fe5-a3cb-6b9ee7e3ab17 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.702114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.703107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.703518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.703866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] PATH_INFO: `/v3/projects/3d826770f9644d5bae08457c5527cad5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.705351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d826770f9644d5bae08457c5527cad5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.706618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:33.707449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.707852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.716084 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1252/2532] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:33.717126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:33.721845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.763666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d826770f9644d5bae08457c5527cad5', 'request_id': 'req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.770051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d826770f9644d5bae08457c5527cad5', 'request_id': 'req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.779818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d826770f9644d5bae08457c5527cad5', 'request_id': 'req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.791585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] The token cache is being invalidate because project 3d826770f9644d5bae08457c5527cad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:33.791935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.792916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:33.794898 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1281/2533] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:33 2022] DELETE /identity/v3/projects/3d826770f9644d5bae08457c5527cad5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:33.797579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.798054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.799157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.799871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.865175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2384-e552-436d-8ea7-25a8e3efa606 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.867947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725c5e3-9ecf-4d69-86f5-f54b51fb0e95 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.871644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091523c7-066a-4c81-8500-3fce7c7a1ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.872312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091523c7-066a-4c81-8500-3fce7c7a1ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.872590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091523c7-066a-4c81-8500-3fce7c7a1ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.872885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091523c7-066a-4c81-8500-3fce7c7a1ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.875275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-091523c7-066a-4c81-8500-3fce7c7a1ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.919171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a939a1a7bd840108882d8b0fd18fb88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0463b5365742ada5d5aa50da954704', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.920107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.920391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.920664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] PATH_INFO: `/v3/projects/a232c53c55c148cd8a689714077f5b97` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.921899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] RBAC: Authorizing `identity:get_project(project_id=a232c53c55c148cd8a689714077f5b97)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.923985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.925820 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1253/2534] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:33 2022] GET /identity/v3/projects/a232c53c55c148cd8a689714077f5b97 => generated 379 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:33.926595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.928486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.944448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091523c7-066a-4c81-8500-3fce7c7a1ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.946108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091523c7-066a-4c81-8500-3fce7c7a1ed9 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.951212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5352d-e3f5-4c00-9f87-38fd6f91a104 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:33.959795 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1282/2535] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:33.961366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e48e7-1ed0-43fc-b606-79f92796cbbe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.961777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e48e7-1ed0-43fc-b606-79f92796cbbe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.962054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e48e7-1ed0-43fc-b606-79f92796cbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.962163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:33.962992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:33.963370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:33.963858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:33.964941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:33.965433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:33.967580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:33.981632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ab6e48e7-1ed0-43fc-b606-79f92796cbbe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:33.983014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ab6e48e7-1ed0-43fc-b606-79f92796cbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:33.988836 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1254/2536] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:33.988836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:33.990620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:34.001844 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1283/2537] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:34.001844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e48e7-1ed0-43fc-b606-79f92796cbbe None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.012482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e48e7-1ed0-43fc-b606-79f92796cbbe None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.020007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c5c24-2e68-4805-98e1-2ea4671697c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.020615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c5c24-2e68-4805-98e1-2ea4671697c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.020893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c5c24-2e68-4805-98e1-2ea4671697c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.021208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c5c24-2e68-4805-98e1-2ea4671697c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.022002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c5c24-2e68-4805-98e1-2ea4671697c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.023952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c5c24-2e68-4805-98e1-2ea4671697c2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.060206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1284/2538] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:33 2022] POST /identity/v3/projects => generated 411 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:34.062739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe4d78-ae26-4a95-aa7d-c607fb33db71 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.063268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe4d78-ae26-4a95-aa7d-c607fb33db71 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.063688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe4d78-ae26-4a95-aa7d-c607fb33db71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.090027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2cfe4d78-ae26-4a95-aa7d-c607fb33db71 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:34.091726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2cfe4d78-ae26-4a95-aa7d-c607fb33db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:34.107735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9cac-9015-4f8a-940f-6df68cc74843 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.169385 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1285/2539] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:34.169385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe4d78-ae26-4a95-aa7d-c607fb33db71 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.182474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe4d78-ae26-4a95-aa7d-c607fb33db71 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.187275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.188092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.188469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.188592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.188925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.189202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.189479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.189842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.190502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.191372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:34.192493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.225429 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1286/2540] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:34 2022] POST /identity/v3/users => generated 306 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:34.225429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.241840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc878e-ff9a-4801-9cec-2033390a4b0e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.253681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.254908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.255487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.255865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.256696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:34.257154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.258877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.290552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.292324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.297195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1287/2541] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:34.299705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.310133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1255/2542] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:34.311432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.323059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580dc80-94a8-4290-be8b-50e4617096b7 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.325571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad3a3a-3365-49ed-8767-bfa77c233ce9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.328177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.328904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.329208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.329526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.330336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.333255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.337590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.347452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.347732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.348004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.348780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.350600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.374894 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1256/2543] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:34 2022] POST /identity/v3/projects => generated 397 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:34.378688 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1288/2544] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:34.382528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.382752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.400173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bd4ae-efd2-4ce5-90b6-1ca8bbed2e1a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.493671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78195-5049-4e1c-8d21-92e87e9e53b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.498956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da94d8-4fd7-401e-8108-28827d9733ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.500059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da94d8-4fd7-401e-8108-28827d9733ea admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.500500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da94d8-4fd7-401e-8108-28827d9733ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.500936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.501095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da94d8-4fd7-401e-8108-28827d9733ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.501648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.501929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.502201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.502606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da94d8-4fd7-401e-8108-28827d9733ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.502894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.505099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da94d8-4fd7-401e-8108-28827d9733ea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.505349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.519681 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1289/2545] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:34.522360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565b61-4f16-4b2c-8645-00c1ac3af47b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.522924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565b61-4f16-4b2c-8645-00c1ac3af47b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.523651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565b61-4f16-4b2c-8645-00c1ac3af47b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.526133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1290/2546] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:56:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:34.527720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565b61-4f16-4b2c-8645-00c1ac3af47b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.540133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1257/2547] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:34 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:34.545406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 20:56:34.549850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565b61-4f16-4b2c-8645-00c1ac3af47b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.557573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.558291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.558626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.558964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] PATH_INFO: `/v3/projects/66f36ce90faf42d0b8a5ab4024bd3db8/users/d415747d240d49d89c65e45cc3fc810b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.579125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f36ce90faf42d0b8a5ab4024bd3db8, user_id=d415747d240d49d89c65e45cc3fc810b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.582001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.617358 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1291/2548] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:34 2022] PUT /identity/v3/projects/66f36ce90faf42d0b8a5ab4024bd3db8/users/d415747d240d49d89c65e45cc3fc810b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:34.617358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.655449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.657184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:34.744489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329bf4-0b03-4206-b5e3-14318e52c0bc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.746318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670069-1d2e-4d36-9412-9cf630e9b34c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.752736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66832c-e33f-4d07-b9eb-de2992b705bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.753914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66832c-e33f-4d07-b9eb-de2992b705bd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.754372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66832c-e33f-4d07-b9eb-de2992b705bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.754802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66832c-e33f-4d07-b9eb-de2992b705bd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.755929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66832c-e33f-4d07-b9eb-de2992b705bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.758078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66832c-e33f-4d07-b9eb-de2992b705bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.773461 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1292/2549] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:34.775446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65167c-b677-4545-bbb4-fa4b58c7ff8a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.775884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65167c-b677-4545-bbb4-fa4b58c7ff8a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.776467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65167c-b677-4545-bbb4-fa4b58c7ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.800484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bb65167c-b677-4545-bbb4-fa4b58c7ff8a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:34.802627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bb65167c-b677-4545-bbb4-fa4b58c7ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:34.813823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a939a1a7bd840108882d8b0fd18fb88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0463b5365742ada5d5aa50da954704', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.817908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.817908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.817908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] PATH_INFO: `/v3/projects/a232c53c55c148cd8a689714077f5b97` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.818230 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1293/2550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:34.818869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65167c-b677-4545-bbb4-fa4b58c7ff8a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.819651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] RBAC: Authorizing `identity:get_project(project_id=a232c53c55c148cd8a689714077f5b97)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.827047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.830264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65167c-b677-4545-bbb4-fa4b58c7ff8a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.831230 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1258/2551] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 20:56:34 2022] GET /identity/v3/projects/a232c53c55c148cd8a689714077f5b97 => generated 379 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:34.835783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.837344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.838039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.838316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.838585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.839311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.844451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.866411 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1294/2552] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:34.875269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:34.888165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582671a-fb64-4d4c-ad4c-90d1115a8532 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.894489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadcaf3-558a-48a2-b4ce-c259838d3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.895652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadcaf3-558a-48a2-b4ce-c259838d3786 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.896000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadcaf3-558a-48a2-b4ce-c259838d3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.896356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadcaf3-558a-48a2-b4ce-c259838d3786 admin admin] PATH_INFO: `/v3/projects/3d162dcd707c4c628b142d66e3c9f504/users/82dec50db2944543a56546bb406345e7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.908919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ebe8b-64db-4ab8-a52a-907d1ee20d84 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:34.913641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:34.914435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.914715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.915389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.916141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadcaf3-558a-48a2-b4ce-c259838d3786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d162dcd707c4c628b142d66e3c9f504, user_id=82dec50db2944543a56546bb406345e7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.920048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadcaf3-558a-48a2-b4ce-c259838d3786 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.927032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:34.928579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:34.943535 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1295/2553] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:34 2022] PUT /identity/v3/projects/3d162dcd707c4c628b142d66e3c9f504/users/82dec50db2944543a56546bb406345e7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:34.949398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df15e1-07b7-4f98-bda6-7c9b28ebfa66 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:34.950171 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1259/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:34.950560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df15e1-07b7-4f98-bda6-7c9b28ebfa66 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:34.950785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df15e1-07b7-4f98-bda6-7c9b28ebfa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:34.978030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d8df15e1-07b7-4f98-bda6-7c9b28ebfa66 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:34.979260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d8df15e1-07b7-4f98-bda6-7c9b28ebfa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.112396 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1296/2555] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:35.127246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:35.129291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.153450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb547a2-0660-42ca-910a-e6eaa5cfd572 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.153880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb547a2-0660-42ca-910a-e6eaa5cfd572 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.154340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb547a2-0660-42ca-910a-e6eaa5cfd572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.155913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6e718-3fd9-4515-855f-7272609b08dd service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:35.235519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1cb547a2-0660-42ca-910a-e6eaa5cfd572 None None] MFA Rules not processed for user `ceba42e80d7746e4897669084c078c09`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:35.236772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1cb547a2-0660-42ca-910a-e6eaa5cfd572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.389182 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1297/2556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:35.391343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51a85-ff77-4b14-8337-2394898c6044 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.391784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51a85-ff77-4b14-8337-2394898c6044 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.392186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51a85-ff77-4b14-8337-2394898c6044 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.395319 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1298/2557] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:56:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:56:35.397431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51a85-ff77-4b14-8337-2394898c6044 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:35.401931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-34a51a85-ff77-4b14-8337-2394898c6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.452096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e8942-4c6a-4390-9ed7-e734182c3024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:35.452737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8942-4c6a-4390-9ed7-e734182c3024 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.452992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8942-4c6a-4390-9ed7-e734182c3024 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.455752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8942-4c6a-4390-9ed7-e734182c3024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.465789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51a85-ff77-4b14-8337-2394898c6044 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:35.466555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e8942-4c6a-4390-9ed7-e734182c3024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:35.468168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e8942-4c6a-4390-9ed7-e734182c3024 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:35.481269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:35.481989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.482268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.482537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.483229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:35.485609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:35.486581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1260/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:35.487905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496becca-3b9b-49e0-9e86-5765365a3838 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.488370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496becca-3b9b-49e0-9e86-5765365a3838 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.488653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496becca-3b9b-49e0-9e86-5765365a3838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.514411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-496becca-3b9b-49e0-9e86-5765365a3838 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:35.515752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-496becca-3b9b-49e0-9e86-5765365a3838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.534227 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1299/2559] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:35 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:35.536240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:35.538577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.630661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71f61-f9f3-431f-8f62-71d65a942089 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:35.637149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:35.638214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.638548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.638871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] PATH_INFO: `/v3/users/1fa4f2d4a3e04883ae75a1a88f3755fe` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.640681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa4f2d4a3e04883ae75a1a88f3755fe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:35.642976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:35.648344 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1261/2560] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:35.650217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496becca-3b9b-49e0-9e86-5765365a3838 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:35.666066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496becca-3b9b-49e0-9e86-5765365a3838 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:35.671777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:35.672686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.673153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.673715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.674597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:35.680186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:35.725445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa4f2d4a3e04883ae75a1a88f3755fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:35.726185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa4f2d4a3e04883ae75a1a88f3755fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:35.730634 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1262/2561] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:35 2022] POST /identity/v3/users => generated 292 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:35.731718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:35.735051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.743576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa4f2d4a3e04883ae75a1a88f3755fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:35.756305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa4f2d4a3e04883ae75a1a88f3755fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:35.757082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa4f2d4a3e04883ae75a1a88f3755fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:35.789711 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1300/2562] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:35 2022] DELETE /identity/v3/users/1fa4f2d4a3e04883ae75a1a88f3755fe => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:35.790976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:35.793059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.817843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3b0d-0409-4f08-90c5-dfd2215b60c0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:35.890721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f8e58-8178-4cac-a247-3b86a25d91e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:35.891706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f8e58-8178-4cac-a247-3b86a25d91e7 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.892289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f8e58-8178-4cac-a247-3b86a25d91e7 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.892767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f8e58-8178-4cac-a247-3b86a25d91e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.895266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-524f8e58-8178-4cac-a247-3b86a25d91e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.904074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cad99-caca-408f-8bb5-75782d2bfb29 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:35.908227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f8e58-8178-4cac-a247-3b86a25d91e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:35.910908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:35.911219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f8e58-8178-4cac-a247-3b86a25d91e7 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:35.912689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.912893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.913153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.914093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:35.916625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:35.923835 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1263/2563] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:35.925332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.925861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.926196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.957331 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1301/2564] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:35.958326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:35.967036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:35.969081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:35.978817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91028f-46cd-4a3a-9a61-f8c40d1116ed admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:35.985027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:35.986122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:35.986287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:35.986561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] PATH_INFO: `/v3/projects/fbdc275749894f1380ebab29d71ae52f/users/08e4a286faa04d65bc28e426e9dd97af/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:35.987414 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1264/2565] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:36.007878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:36.009781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:36.025731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdc275749894f1380ebab29d71ae52f, user_id=08e4a286faa04d65bc28e426e9dd97af, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:36.033585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:36.067933 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1302/2566] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:35 2022] PUT /identity/v3/projects/fbdc275749894f1380ebab29d71ae52f/users/08e4a286faa04d65bc28e426e9dd97af/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:36.072659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:36.098941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee793cb-e3b2-467d-80c5-6ec70878fecd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:36.164654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:36.165456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:36.166280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:36.166850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:36.171422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfea6-60a3-4af2-aad7-c449901ba500 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:36.177416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:36.179041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:36.182572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:36.183549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:36.183932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:36.184311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:36.185760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:36.188703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:36.190185 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1265/2567] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:36.208463 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1303/2568] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:36.211900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:36.225770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653d2e-0d8c-45aa-8ca6-e4a8251b7233 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:36.233681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2106e31-d9e1-46fb-a953-2af7a7add7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:36.234797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2106e31-d9e1-46fb-a953-2af7a7add7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:36.235356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2106e31-d9e1-46fb-a953-2af7a7add7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:36.235727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2106e31-d9e1-46fb-a953-2af7a7add7e0 admin admin] PATH_INFO: `/v3/projects/fbdc275749894f1380ebab29d71ae52f/users/08e4a286faa04d65bc28e426e9dd97af/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:36.238643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2106e31-d9e1-46fb-a953-2af7a7add7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdc275749894f1380ebab29d71ae52f, user_id=08e4a286faa04d65bc28e426e9dd97af, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:36.241927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2106e31-d9e1-46fb-a953-2af7a7add7e0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:36.255785 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1266/2569] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:36 2022] PUT /identity/v3/projects/fbdc275749894f1380ebab29d71ae52f/users/08e4a286faa04d65bc28e426e9dd97af/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:36.821071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:36.827175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:36.878508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f74a6-fa99-4fec-98b9-fc414dac0a52 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:36.897174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915177b-2a8e-46bf-b58e-883cc0892f00 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:36.897775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915177b-2a8e-46bf-b58e-883cc0892f00 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:36.897775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915177b-2a8e-46bf-b58e-883cc0892f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:36.974075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c915177b-2a8e-46bf-b58e-883cc0892f00 None None] MFA Rules not processed for user `82dec50db2944543a56546bb406345e7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:36.975339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c915177b-2a8e-46bf-b58e-883cc0892f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:37.030087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:37.031608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:37.032136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:37.032983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] PATH_INFO: `/v3/projects/a232c53c55c148cd8a689714077f5b97` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:37.036072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a232c53c55c148cd8a689714077f5b97)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:37.040874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:37.096515 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1267/2570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:37.121215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a232c53c55c148cd8a689714077f5b97', 'request_id': 'req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.127071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a232c53c55c148cd8a689714077f5b97', 'request_id': 'req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.137554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a232c53c55c148cd8a689714077f5b97', 'request_id': 'req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.153945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] The token cache is being invalidate because project a232c53c55c148cd8a689714077f5b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:37.154337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.155091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.156985 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1304/2571] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:36 2022] DELETE /identity/v3/projects/a232c53c55c148cd8a689714077f5b97 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:37.160796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915177b-2a8e-46bf-b58e-883cc0892f00 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:37.175542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915177b-2a8e-46bf-b58e-883cc0892f00 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:37.252757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:37.253682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:37.253954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:37.254418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] PATH_INFO: `/v3/users/3a939a1a7bd840108882d8b0fd18fb88` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:37.255616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a939a1a7bd840108882d8b0fd18fb88)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:37.257818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:37.310468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a939a1a7bd840108882d8b0fd18fb88'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.311475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a939a1a7bd840108882d8b0fd18fb88'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.319347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a939a1a7bd840108882d8b0fd18fb88'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.320142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a939a1a7bd840108882d8b0fd18fb88'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.331196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a939a1a7bd840108882d8b0fd18fb88'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.350522 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1268/2572] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:37 2022] DELETE /identity/v3/users/3a939a1a7bd840108882d8b0fd18fb88 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:37.642811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:37.644929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:37.810887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97c5a-23bb-41ff-b0c5-da0c6069fee0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:37.829440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:37.831438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:37.909537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff184-714c-4a3d-8b22-e9cf40f24366 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:37.915044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:37.916567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:37.917109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:37.917759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] PATH_INFO: `/v3/projects/3a0463b5365742ada5d5aa50da954704` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:37.919520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0463b5365742ada5d5aa50da954704)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:37.922254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:37.947547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d5622-ee15-4c66-b73c-1beb0f9ad0d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:37.948223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5622-ee15-4c66-b73c-1beb0f9ad0d6 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:37.948500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5622-ee15-4c66-b73c-1beb0f9ad0d6 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:37.948805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5622-ee15-4c66-b73c-1beb0f9ad0d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:37.957928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a93d5622-ee15-4c66-b73c-1beb0f9ad0d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:37.987835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0463b5365742ada5d5aa50da954704', 'request_id': 'req-f6daae06-86fa-4eff-b299-4f1654c2ee63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:37.995779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0463b5365742ada5d5aa50da954704', 'request_id': 'req-f6daae06-86fa-4eff-b299-4f1654c2ee63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:38.017219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0463b5365742ada5d5aa50da954704', 'request_id': 'req-f6daae06-86fa-4eff-b299-4f1654c2ee63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:38.048827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] The token cache is being invalidate because project 3a0463b5365742ada5d5aa50da954704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:38.053990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:38.057562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f6daae06-86fa-4eff-b299-4f1654c2ee63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:38.064012 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1269/2573] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:37 2022] DELETE /identity/v3/projects/3a0463b5365742ada5d5aa50da954704 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:38.070630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5bb1-db89-4265-9792-418903d58eb4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.071231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5bb1-db89-4265-9792-418903d58eb4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.071695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5bb1-db89-4265-9792-418903d58eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.121074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1b0e5bb1-db89-4265-9792-418903d58eb4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:38.122902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1b0e5bb1-db89-4265-9792-418903d58eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:38.149587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d5622-ee15-4c66-b73c-1beb0f9ad0d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:38.153733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d5622-ee15-4c66-b73c-1beb0f9ad0d6 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:38.188878 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1305/2574] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:38.192080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785ac7-d08e-4ae2-be6f-793a86f4acb2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.192390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785ac7-d08e-4ae2-be6f-793a86f4acb2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.192775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785ac7-d08e-4ae2-be6f-793a86f4acb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.212588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1270/2575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:38.221052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ee8f-aaa2-48fc-a8c2-822d4d6d9758 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.221529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ee8f-aaa2-48fc-a8c2-822d4d6d9758 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.221877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ee8f-aaa2-48fc-a8c2-822d4d6d9758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.234906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6f785ac7-d08e-4ae2-be6f-793a86f4acb2 None None] MFA Rules not processed for user `08e4a286faa04d65bc28e426e9dd97af`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:38.236473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6f785ac7-d08e-4ae2-be6f-793a86f4acb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:38.245795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a5e5ee8f-aaa2-48fc-a8c2-822d4d6d9758 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:38.247326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a5e5ee8f-aaa2-48fc-a8c2-822d4d6d9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:38.265674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1271/2576] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:38.267161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ee8f-aaa2-48fc-a8c2-822d4d6d9758 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.285599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ee8f-aaa2-48fc-a8c2-822d4d6d9758 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:38.290780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:38.291615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.291991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.292378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.293302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:38.293714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:38.295504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:38.316797 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1272/2577] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:38.318370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.340957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c207c-7a21-4581-b62e-a756dd1ab14f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:38.351381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:38.352382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.352821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.353279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.354135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:38.362032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:38.366837 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1306/2578] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:38.369403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5666-154b-49d5-86af-76de81104282 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.371636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5666-154b-49d5-86af-76de81104282 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.371963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5666-154b-49d5-86af-76de81104282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.421722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-03fe5666-154b-49d5-86af-76de81104282 None None] MFA Rules not processed for user `ceba42e80d7746e4897669084c078c09`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:38.423195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-03fe5666-154b-49d5-86af-76de81104282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:38.447752 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1273/2579] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:38.452200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.520715 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1307/2580] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:38.572897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9e848-eb63-4a44-8df2-d632365ff875 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:38.578527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:38.579799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.580193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.580564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.581514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:38.583570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:38.611109 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1274/2581] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:38.615462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5666-154b-49d5-86af-76de81104282 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.628803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5666-154b-49d5-86af-76de81104282 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:38.634219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:38.635535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.637970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.638272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.639202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:38.640899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:38.652992 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1308/2582] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:38.657484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.668550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151081-9b0a-4eb0-bb40-7084cc9e2dfd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:38.676032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:38.677396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.677744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.678078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.678897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:38.680638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:38.701144 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1275/2583] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:38.704780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.729198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7735-6f4f-42d5-a740-761dcb559493 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:38.735926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ef47a-0094-4af6-a5eb-0c0ddc1658c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:38.737615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef47a-0094-4af6-a5eb-0c0ddc1658c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.737978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef47a-0094-4af6-a5eb-0c0ddc1658c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.738515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef47a-0094-4af6-a5eb-0c0ddc1658c9 admin admin] PATH_INFO: `/v3/projects/800fb4997def400e84cb7dda9b1f468f/users/8b4d0a5869e34008a279fe6379c12947/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.738885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.740981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:38.760415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ef47a-0094-4af6-a5eb-0c0ddc1658c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800fb4997def400e84cb7dda9b1f468f, user_id=8b4d0a5869e34008a279fe6379c12947, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:38.765517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ef47a-0094-4af6-a5eb-0c0ddc1658c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:38.793436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1309/2584] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:38 2022] PUT /identity/v3/projects/800fb4997def400e84cb7dda9b1f468f/users/8b4d0a5869e34008a279fe6379c12947/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:38.804301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4aa52-15bb-4221-8868-ca903fb01790 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.804595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4aa52-15bb-4221-8868-ca903fb01790 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.804846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4aa52-15bb-4221-8868-ca903fb01790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.837842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-46d4aa52-15bb-4221-8868-ca903fb01790 None None] MFA Rules not processed for user `8b4d0a5869e34008a279fe6379c12947`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:38.840894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46d4aa52-15bb-4221-8868-ca903fb01790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:38.844195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcb79b-426c-4162-86af-371bc2d1f650 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:38.925151 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1310/2585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:38.927463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4aa52-15bb-4221-8868-ca903fb01790 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:38.933121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:38.934339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:38.934339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:38.934514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:38.936747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:39.023896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4aa52-15bb-4221-8868-ca903fb01790 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:39.034040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:39.034741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.035017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.035289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.035983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.040536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.043556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.045692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.059540 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1276/2586] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:39.101189 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1311/2587] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:38 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:39.104112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:39.117025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a22b3-a93f-4304-bc9d-bc4c4a297789 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:39.227273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:39.228061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.228470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.228834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.229692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.232009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.259913 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1277/2588] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:39 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:39.261391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:39.275428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad3409-564f-40c1-8ecf-bc872dfe3799 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:39.283750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:39.284463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.284745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.285145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.286034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.287642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.309536 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1312/2589] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:39.310042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:39.321511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ac13-6034-4c36-b93f-537cf0cf7f7d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:39.329401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:39.330423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.330783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.331343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] PATH_INFO: `/v3/projects/fe477629adce4bd984629006e0ed840e/users/aa440be23fbc4390b5ecdf2ca430f6db/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.354716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe477629adce4bd984629006e0ed840e, user_id=aa440be23fbc4390b5ecdf2ca430f6db, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.354716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.389843 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1278/2590] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:39 2022] PUT /identity/v3/projects/fe477629adce4bd984629006e0ed840e/users/aa440be23fbc4390b5ecdf2ca430f6db/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:39.393913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:39.445198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab870c-69c7-4858-8b5f-d72b94078b9b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:39.544950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:39.583712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:39.584677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.584781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.587555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.590932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.593259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.642070 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1313/2591] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:39.646958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:39.675981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a90a0-5b36-4f9e-82db-4f3958cdc145 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:39.686634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b631124-cabb-4a89-abcb-19dd1fbbc31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:39.690236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25132d-b907-458f-a87b-6cf8e4cf6317 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:39.693028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631124-cabb-4a89-abcb-19dd1fbbc31b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.693337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631124-cabb-4a89-abcb-19dd1fbbc31b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.693671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631124-cabb-4a89-abcb-19dd1fbbc31b admin admin] PATH_INFO: `/v3/projects/fe477629adce4bd984629006e0ed840e/users/aa440be23fbc4390b5ecdf2ca430f6db/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.699693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b631124-cabb-4a89-abcb-19dd1fbbc31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe477629adce4bd984629006e0ed840e, user_id=aa440be23fbc4390b5ecdf2ca430f6db, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.701316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:39.701992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.702271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.702542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.702943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b631124-cabb-4a89-abcb-19dd1fbbc31b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.707180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:39.733590 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1314/2592] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:39 2022] PUT /identity/v3/projects/fe477629adce4bd984629006e0ed840e/users/aa440be23fbc4390b5ecdf2ca430f6db/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:39.739989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aba6f-fa6b-41fc-9bdc-5632301e4fb1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:39.740319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aba6f-fa6b-41fc-9bdc-5632301e4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:39.740543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aba6f-fa6b-41fc-9bdc-5632301e4fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:39.786443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a06aba6f-fa6b-41fc-9bdc-5632301e4fb1 None None] MFA Rules not processed for user `aa440be23fbc4390b5ecdf2ca430f6db`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:39.788536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a06aba6f-fa6b-41fc-9bdc-5632301e4fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:39.883044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:39.889305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:39.916932 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1279/2593] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:56:39.947176 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1315/2594] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:42.298225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:42.315075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1baad-d787-4ce2-b2cf-97672f9b81dc service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:42.411482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:42.412682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:42.412861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:42.413245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:42.424917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:42.426736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:42.438986 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1280/2595] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:43.018363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aba6f-fa6b-41fc-9bdc-5632301e4fb1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:43.035386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aba6f-fa6b-41fc-9bdc-5632301e4fb1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:43.042433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8702b-cb3d-4d35-b4bf-3f399faab7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:43.043264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8702b-cb3d-4d35-b4bf-3f399faab7fe service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:43.044215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8702b-cb3d-4d35-b4bf-3f399faab7fe service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:43.044580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8702b-cb3d-4d35-b4bf-3f399faab7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:43.116084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8702b-cb3d-4d35-b4bf-3f399faab7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:43.117854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8702b-cb3d-4d35-b4bf-3f399faab7fe service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:43.137338 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1316/2596] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:44.688350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:44.831861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fead3e6-5181-4613-9d9d-ed03901be581 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:44.845968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:44.863289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:44.864352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:44.864858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] PATH_INFO: `/v3/users/8b4d0a5869e34008a279fe6379c12947` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:44.870350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4d0a5869e34008a279fe6379c12947)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:44.874465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:44.980265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4d0a5869e34008a279fe6379c12947'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:44.981934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4d0a5869e34008a279fe6379c12947'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.007599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4d0a5869e34008a279fe6379c12947'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.008658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4d0a5869e34008a279fe6379c12947'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.021163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4d0a5869e34008a279fe6379c12947'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.051513 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1281/2597] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:44 2022] DELETE /identity/v3/users/8b4d0a5869e34008a279fe6379c12947 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:45.057449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:45.058271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:45.058621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:45.090403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:45.092298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:45.175721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1317/2598] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:45.212382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:45.216953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:45.291459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8600a6c-b43c-419d-8f12-5082a76648d7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:45.297733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcaa9d-ca0f-4ced-9e5b-d5dbc982b3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:45.298726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcaa9d-ca0f-4ced-9e5b-d5dbc982b3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:45.299123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcaa9d-ca0f-4ced-9e5b-d5dbc982b3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:45.299500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcaa9d-ca0f-4ced-9e5b-d5dbc982b3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:45.313869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcaa9d-ca0f-4ced-9e5b-d5dbc982b3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:45.330043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcaa9d-ca0f-4ced-9e5b-d5dbc982b3e6 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:45.370414 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1282/2599] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:45.481230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:45.486158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:45.492885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:45.493611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:45.494007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:45.507903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f0241-519e-43ba-8b36-62badd0fdded None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:45.522265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:45.523506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:45.525160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:45.526271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] PATH_INFO: `/v3/users/82dec50db2944543a56546bb406345e7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:45.531189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82dec50db2944543a56546bb406345e7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:45.533386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:45.595077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] MFA Rules not processed for user `d415747d240d49d89c65e45cc3fc810b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:45.599584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:45.660039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82dec50db2944543a56546bb406345e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.660725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82dec50db2944543a56546bb406345e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.669973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82dec50db2944543a56546bb406345e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.687938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82dec50db2944543a56546bb406345e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.688722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8c73fcb6-b30d-4f67-b457-61a952bd8693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82dec50db2944543a56546bb406345e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:45.727608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1318/2600] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:45 2022] DELETE /identity/v3/users/82dec50db2944543a56546bb406345e7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:45.768271 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1283/2601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:45.780385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:45.780962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:45.781401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:45.811602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] MFA Rules not processed for user `d415747d240d49d89c65e45cc3fc810b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:45.813026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:45.887856 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1319/2602] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:45.937832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:45.939659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:46.025702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efdf-49f5-4efa-9b3a-2da3956cb597 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:46.145804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:46.148146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.148425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.148790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.157022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:46.164689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:46.172672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:46.174339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:46.191040 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1284/2603] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:46.247824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:46.249650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:46.336947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463033c-b7cb-4d56-ad29-4cd3a8e02092 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:46.354387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:46.362151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.362474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.362797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] PATH_INFO: `/v3/projects/800fb4997def400e84cb7dda9b1f468f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.367647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] RBAC: Authorizing `identity:delete_project(project_id=800fb4997def400e84cb7dda9b1f468f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:46.374905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:46.380121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88af77-5c8d-4010-a8ff-3f9d9a85f2c8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:46.402390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:46.405917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.406197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.406470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] PATH_INFO: `/v3/projects/3d162dcd707c4c628b142d66e3c9f504` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.408799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d162dcd707c4c628b142d66e3c9f504)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:46.413716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:46.497636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800fb4997def400e84cb7dda9b1f468f', 'request_id': 'req-500b83d0-b0b7-4c6b-9386-e17185a8824d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.509431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800fb4997def400e84cb7dda9b1f468f', 'request_id': 'req-500b83d0-b0b7-4c6b-9386-e17185a8824d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.521230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d162dcd707c4c628b142d66e3c9f504', 'request_id': 'req-e16c67dd-ab56-4ce5-af1b-12250c3d111e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.537864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800fb4997def400e84cb7dda9b1f468f', 'request_id': 'req-500b83d0-b0b7-4c6b-9386-e17185a8824d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.538828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d162dcd707c4c628b142d66e3c9f504', 'request_id': 'req-e16c67dd-ab56-4ce5-af1b-12250c3d111e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.555903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] The token cache is being invalidate because project 800fb4997def400e84cb7dda9b1f468f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:46.556347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.556838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.557474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d162dcd707c4c628b142d66e3c9f504', 'request_id': 'req-e16c67dd-ab56-4ce5-af1b-12250c3d111e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.564017 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1285/2604] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:46 2022] DELETE /identity/v3/projects/800fb4997def400e84cb7dda9b1f468f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:46.565020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:46.567457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:46.579238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] The token cache is being invalidate because project 3d162dcd707c4c628b142d66e3c9f504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:46.579533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.580694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e16c67dd-ab56-4ce5-af1b-12250c3d111e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.584163 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1320/2605] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:46 2022] DELETE /identity/v3/projects/3d162dcd707c4c628b142d66e3c9f504 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:46.591065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166b4be-81a8-40e0-82b3-4b794f7466bc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.591523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166b4be-81a8-40e0-82b3-4b794f7466bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.592191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166b4be-81a8-40e0-82b3-4b794f7466bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.626276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7166b4be-81a8-40e0-82b3-4b794f7466bc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:46.627503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7166b4be-81a8-40e0-82b3-4b794f7466bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:46.729938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b83d0-b0b7-4c6b-9386-e17185a8824d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:46.787462 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1321/2606] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:46.797122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a047d9-24db-403c-a19e-6eef43e3a8c0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.797525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a047d9-24db-403c-a19e-6eef43e3a8c0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.797783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a047d9-24db-403c-a19e-6eef43e3a8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.802714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:46.803831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.804162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.804430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] PATH_INFO: `/v3/users/aa440be23fbc4390b5ecdf2ca430f6db` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.806377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa440be23fbc4390b5ecdf2ca430f6db)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:46.809757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:46.825803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b9a047d9-24db-403c-a19e-6eef43e3a8c0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:46.831009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b9a047d9-24db-403c-a19e-6eef43e3a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:46.846710 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1322/2607] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:46.853797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a047d9-24db-403c-a19e-6eef43e3a8c0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:46.880948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a047d9-24db-403c-a19e-6eef43e3a8c0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:46.897266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:46.897961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.898243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.898517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.899257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:46.899562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:46.901415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:46.910546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa440be23fbc4390b5ecdf2ca430f6db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.912306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa440be23fbc4390b5ecdf2ca430f6db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.935400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1323/2608] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:46.938642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:46.951909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa440be23fbc4390b5ecdf2ca430f6db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.954336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa440be23fbc4390b5ecdf2ca430f6db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.976292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135d46-1068-4fa9-85fc-7c8cb4400ddc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:46.981969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa440be23fbc4390b5ecdf2ca430f6db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:46.995973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:46.997028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:46.997028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:46.997319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:46.997980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:47.004473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:47.022031 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1286/2609] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:46 2022] DELETE /identity/v3/users/aa440be23fbc4390b5ecdf2ca430f6db => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:47.062955 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1324/2610] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:46 2022] POST /identity/v3/projects => generated 361 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:47.067005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:47.068543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:47.175201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c3721-acb4-4b93-90d0-5d7f14f277a6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:47.342337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:47.344875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:47.347405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:47.349411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:47.353071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:47.361862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:47.418061 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1287/2611] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:47 2022] POST /identity/v3/users => generated 281 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:47.422897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:47.442650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d41f8a-ce1f-4031-873f-9b0720edb81b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:47.454890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:47.455933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:47.456398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:47.456901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:47.457835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:47.459986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:47.482977 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1325/2612] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:47.488335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:47.502195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951ddc-4f5d-4c3b-83c9-db65db87267e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:47.508446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffbd5b-97fd-4ed0-947c-7960657cd885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:47.509240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffbd5b-97fd-4ed0-947c-7960657cd885 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:47.509506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffbd5b-97fd-4ed0-947c-7960657cd885 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:47.510072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffbd5b-97fd-4ed0-947c-7960657cd885 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:47.511551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffbd5b-97fd-4ed0-947c-7960657cd885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:47.520648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffbd5b-97fd-4ed0-947c-7960657cd885 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:47.554433 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1288/2613] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:47.558141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:47.568402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596c517-0b89-4ab4-a3d0-8b60b794c323 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:47.583414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:47.584559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:47.585098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:47.585584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] PATH_INFO: `/v3/projects/4ddbac8e604343e39fc034af7fc4ab3f/users/d1ef2a9d1dbc4bb68dae8c33c2de91fc/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:47.620885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddbac8e604343e39fc034af7fc4ab3f, user_id=d1ef2a9d1dbc4bb68dae8c33c2de91fc, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:47.636198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:47.663998 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1326/2614] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:47 2022] PUT /identity/v3/projects/4ddbac8e604343e39fc034af7fc4ab3f/users/d1ef2a9d1dbc4bb68dae8c33c2de91fc/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:47.674258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:47.674808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:47.675411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:47.763173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] MFA Rules not processed for user `d1ef2a9d1dbc4bb68dae8c33c2de91fc`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:47.764196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:48.023673 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1289/2615] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:48.325990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:48.331027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:48.437365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:48.439022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:48.578212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9588495-d6a7-4571-bc93-47b3aa3b41a8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:48.588052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:48.589768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:48.590286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:48.590701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] PATH_INFO: `/v3/projects/fe477629adce4bd984629006e0ed840e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:48.593499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe477629adce4bd984629006e0ed840e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:48.609750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:48.619190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4005bb-287b-4e42-b84e-1094c2a79d97 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:48.645305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:48.646000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:48.646276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:48.646547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:48.666272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:48.667926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:48.699382 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1290/2616] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:48.728559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe477629adce4bd984629006e0ed840e', 'request_id': 'req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:48.735827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe477629adce4bd984629006e0ed840e', 'request_id': 'req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:48.750151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe477629adce4bd984629006e0ed840e', 'request_id': 'req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:48.759745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:48.776835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e546b-b84a-4800-8ff1-6a18199f3f27 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:48.786014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] The token cache is being invalidate because project fe477629adce4bd984629006e0ed840e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:48.786303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:48.790019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-203655e5-6257-4e87-ab96-bd4d0cfc6dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:48.795519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1327/2617] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:48 2022] DELETE /identity/v3/projects/fe477629adce4bd984629006e0ed840e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:48.800278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b77ca-31bd-4d01-92b9-502bad490d31 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:48.800566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b77ca-31bd-4d01-92b9-502bad490d31 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:48.801008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b77ca-31bd-4d01-92b9-502bad490d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:48.855815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a94b77ca-31bd-4d01-92b9-502bad490d31 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:48.864838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a94b77ca-31bd-4d01-92b9-502bad490d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:48.894630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:48.900933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:48.901251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:48.905498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] PATH_INFO: `/v3/users/d1ef2a9d1dbc4bb68dae8c33c2de91fc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:48.912446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ef2a9d1dbc4bb68dae8c33c2de91fc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:48.916713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.030941 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1328/2618] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:49.039840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2e92a-1b62-4b05-95dc-1b063e5057bc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.040459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2e92a-1b62-4b05-95dc-1b063e5057bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.040942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2e92a-1b62-4b05-95dc-1b063e5057bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.045260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ef2a9d1dbc4bb68dae8c33c2de91fc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:49.046513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ef2a9d1dbc4bb68dae8c33c2de91fc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:49.055955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ef2a9d1dbc4bb68dae8c33c2de91fc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:49.061122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ef2a9d1dbc4bb68dae8c33c2de91fc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:49.071537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4fd2e92a-1b62-4b05-95dc-1b063e5057bc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:49.074700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4fd2e92a-1b62-4b05-95dc-1b063e5057bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:49.082511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551e11e9-3636-48a9-b11d-9ec61a53b51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ef2a9d1dbc4bb68dae8c33c2de91fc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:49.093777 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1329/2619] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:49.101422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2e92a-1b62-4b05-95dc-1b063e5057bc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.112808 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1291/2620] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:56:48 2022] DELETE /identity/v3/users/d1ef2a9d1dbc4bb68dae8c33c2de91fc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:49.117099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2e92a-1b62-4b05-95dc-1b063e5057bc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:49.119087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.119380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.119651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.138611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:49.139951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:49.245967 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1292/2621] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:49.249569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:49.251454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.255041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.255873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.257001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:49.258297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.260473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:49.261405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:49.265453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.292192 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1330/2622] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:49.293799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.314117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a93cc-88ba-48f0-84e9-b57d938eb77f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:49.319767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:49.320449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.320728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.321001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.321759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:49.323786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.333227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2ed17-94b9-447d-8111-c65182c21a6d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:49.340202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:49.340959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.341378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.341742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.357384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:49.361117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.363724 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1331/2623] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:49 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:49.370167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.375748 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1293/2624] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:49.473743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c67aff-078f-49c6-af19-51b518c8baa1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:49.489516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:49.490508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.491085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.491523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.492388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:49.494621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.547004 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1332/2625] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:49 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:49.552271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.563944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e497-4d2b-4972-8d0a-858814d204a4 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:49.574626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:49.575537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.576081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.576493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.577806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:49.580250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.600170 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1294/2626] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:49.601077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.616300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd6f8-d057-4c61-856b-62520e64e07a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:49.633815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109ee4-1b00-456c-8d9e-823fdd66678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:49.634563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109ee4-1b00-456c-8d9e-823fdd66678a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.634881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109ee4-1b00-456c-8d9e-823fdd66678a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.635116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109ee4-1b00-456c-8d9e-823fdd66678a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.635931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109ee4-1b00-456c-8d9e-823fdd66678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:49.640197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109ee4-1b00-456c-8d9e-823fdd66678a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.658981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1333/2627] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:56:49.660198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.675219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5628d62-7dee-4965-9a5f-fd75c6d38a95 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:49.691467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:49.692407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.692684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.692967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] PATH_INFO: `/v3/projects/e77d97d277f245d4822a646af7d5f50d/users/5ab294d1890047aababb87b3a865a14c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.727359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77d97d277f245d4822a646af7d5f50d, user_id=5ab294d1890047aababb87b3a865a14c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:49.731289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:49.772041 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1295/2628] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:49 2022] PUT /identity/v3/projects/e77d97d277f245d4822a646af7d5f50d/users/5ab294d1890047aababb87b3a865a14c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:49.774763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2784-a56d-4591-83e0-5c82bd4992ae None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:49.775248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2784-a56d-4591-83e0-5c82bd4992ae None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:49.775395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2784-a56d-4591-83e0-5c82bd4992ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:49.820237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f42b2784-a56d-4591-83e0-5c82bd4992ae None None] MFA Rules not processed for user `5ab294d1890047aababb87b3a865a14c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:49.821866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f42b2784-a56d-4591-83e0-5c82bd4992ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:49.846637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:49.852247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:49.928854 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1334/2629] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:49.930110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2784-a56d-4591-83e0-5c82bd4992ae None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.004612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65fe12-25e1-476e-9905-90adf14cab20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.011651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.014036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.014520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.014995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] PATH_INFO: `/v3/projects/4ddbac8e604343e39fc034af7fc4ab3f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.017546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddbac8e604343e39fc034af7fc4ab3f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.019681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.055540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2784-a56d-4591-83e0-5c82bd4992ae None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.062063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.062762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.063031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.063302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.064418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.066684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.127311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddbac8e604343e39fc034af7fc4ab3f', 'request_id': 'req-76dc1707-2c01-4297-9d23-925ae8af2527'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:50.132145 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1335/2630] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:49 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:50.136359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddbac8e604343e39fc034af7fc4ab3f', 'request_id': 'req-76dc1707-2c01-4297-9d23-925ae8af2527'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:50.137833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.155848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddbac8e604343e39fc034af7fc4ab3f', 'request_id': 'req-76dc1707-2c01-4297-9d23-925ae8af2527'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:50.181996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] The token cache is being invalidate because project 4ddbac8e604343e39fc034af7fc4ab3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:56:50.182308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:50.183113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76dc1707-2c01-4297-9d23-925ae8af2527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:56:50.188310 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1296/2631] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:49 2022] DELETE /identity/v3/projects/4ddbac8e604343e39fc034af7fc4ab3f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:56:50.191127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21373e4-b995-4481-9ff0-dfbda4e16076 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.191420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21373e4-b995-4481-9ff0-dfbda4e16076 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.191697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21373e4-b995-4481-9ff0-dfbda4e16076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.216083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae81e5a-2360-403d-8727-19433f87a256 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.217901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d21373e4-b995-4481-9ff0-dfbda4e16076 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:50.219463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d21373e4-b995-4481-9ff0-dfbda4e16076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:50.221416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.224191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.224191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.224191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.224191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.225753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.240857 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1297/2632] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:50.242943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40d7d-6946-4b13-9106-bba21aba5ae0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.243230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40d7d-6946-4b13-9106-bba21aba5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.243498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40d7d-6946-4b13-9106-bba21aba5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.261917 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1336/2633] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:50.262897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.264614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:50.276675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c3c40d7d-6946-4b13-9106-bba21aba5ae0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:50.278900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c3c40d7d-6946-4b13-9106-bba21aba5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:50.281452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45ad32-1e9a-4160-8776-9a32c261a2a7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.291854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.292838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.292838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.294085 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1298/2634] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:50.294401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.295157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.297929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c40d7d-6946-4b13-9106-bba21aba5ae0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.301670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.323571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c40d7d-6946-4b13-9106-bba21aba5ae0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.323856 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1337/2635] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:50.324156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.329972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.332906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.333465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.335464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.335597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641f0f-2dc4-488a-b65c-cba50ced30d3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.336789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:56:50.338110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.343991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b025211-59aa-4e50-8d70-d71ba9b8927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.344909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b025211-59aa-4e50-8d70-d71ba9b8927a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.345240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b025211-59aa-4e50-8d70-d71ba9b8927a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.345515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b025211-59aa-4e50-8d70-d71ba9b8927a admin admin] PATH_INFO: `/v3/projects/dc2f1362b9454910aca78105376f906b/users/0997b8a27edd4cc88479af11c71e53e6/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.347540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.365252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b025211-59aa-4e50-8d70-d71ba9b8927a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2f1362b9454910aca78105376f906b, user_id=0997b8a27edd4cc88479af11c71e53e6, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.368171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b025211-59aa-4e50-8d70-d71ba9b8927a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.395849 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1338/2636] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:50 2022] PUT /identity/v3/projects/dc2f1362b9454910aca78105376f906b/users/0997b8a27edd4cc88479af11c71e53e6/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:50.398126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d1e6d-d38e-49f3-8f74-a3e3c7922766 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.398598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d1e6d-d38e-49f3-8f74-a3e3c7922766 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.399018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d1e6d-d38e-49f3-8f74-a3e3c7922766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.400694 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1299/2637] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:56:50.403678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.431389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09211-4791-4152-a988-73e6d95f148a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.437377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-496d1e6d-d38e-49f3-8f74-a3e3c7922766 None None] MFA Rules not processed for user `0bcc50583d0c4b9aa9d9c9b7ad87a576`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:50.438859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-496d1e6d-d38e-49f3-8f74-a3e3c7922766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:50.532555 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1339/2638] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:50.534758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d1e6d-d38e-49f3-8f74-a3e3c7922766 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.536559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.537354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.537697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.538038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.538841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.540539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.552963 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1300/2639] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:50.556821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.558310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d1e6d-d38e-49f3-8f74-a3e3c7922766 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.563145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251e6c9-21e6-4a15-adf1-804037eba2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.563883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e6c9-21e6-4a15-adf1-804037eba2fa admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.564231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e6c9-21e6-4a15-adf1-804037eba2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.564982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e6c9-21e6-4a15-adf1-804037eba2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.565454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251e6c9-21e6-4a15-adf1-804037eba2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.568120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251e6c9-21e6-4a15-adf1-804037eba2fa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.568948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b02aa-5e32-4099-9bee-6301825a5272 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.582205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.583252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.583781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.584063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] PATH_INFO: `/v3/projects/dc2f1362b9454910aca78105376f906b/users/0997b8a27edd4cc88479af11c71e53e6/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.586345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2f1362b9454910aca78105376f906b, user_id=0997b8a27edd4cc88479af11c71e53e6, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.589872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.610028 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1301/2640] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:50 2022] PUT /identity/v3/projects/dc2f1362b9454910aca78105376f906b/users/0997b8a27edd4cc88479af11c71e53e6/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:50.612271 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1340/2641] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:56:50.618228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.621872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc59d7-d42f-4e0a-8c6b-991e020a790d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.622154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc59d7-d42f-4e0a-8c6b-991e020a790d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.622426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc59d7-d42f-4e0a-8c6b-991e020a790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.660224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b8dc59d7-d42f-4e0a-8c6b-991e020a790d None None] MFA Rules not processed for user `0997b8a27edd4cc88479af11c71e53e6`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:50.661828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b8dc59d7-d42f-4e0a-8c6b-991e020a790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:50.720578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7ab8-d4f2-4a04-8b9d-511cd6b521f7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.769776 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1341/2642] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:56:50.781226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a844-7b84-4adf-ac28-2d346dca2771 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.781507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a844-7b84-4adf-ac28-2d346dca2771 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.781697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a844-7b84-4adf-ac28-2d346dca2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.789776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.790472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.790750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.791022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.791724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.793926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.799331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7294a844-7b84-4adf-ac28-2d346dca2771 None None] MFA Rules not processed for user `5ab294d1890047aababb87b3a865a14c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:50.800551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7294a844-7b84-4adf-ac28-2d346dca2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:50.819214 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1302/2643] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:56:50.822778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.833736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856eb56-fcda-463c-97fe-2dd2b459187b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.840236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.840913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.841313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.841588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.842320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.843931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.855201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1303/2644] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:50.859369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.865071 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1342/2645] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:50.870272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf883-b2fb-408e-aab2-5986417a65a8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.874786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0acbd1-0706-49f1-b18a-995fa5f33f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.875451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0acbd1-0706-49f1-b18a-995fa5f33f41 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.875728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0acbd1-0706-49f1-b18a-995fa5f33f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.876022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0acbd1-0706-49f1-b18a-995fa5f33f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.876744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0acbd1-0706-49f1-b18a-995fa5f33f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.878372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0acbd1-0706-49f1-b18a-995fa5f33f41 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.889814 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1304/2646] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:56:50.893870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a844-7b84-4adf-ac28-2d346dca2771 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:50.904328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a844-7b84-4adf-ac28-2d346dca2771 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:50.909587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:50.910486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.910758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.911021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] PATH_INFO: `/v3/projects/bf4fe086a6e94378997756b1fc02a6c7/users/730fd7f2ff9e4e96be5e412ad86bb0d8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.926655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4fe086a6e94378997756b1fc02a6c7, user_id=730fd7f2ff9e4e96be5e412ad86bb0d8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:50.929825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:50.948883 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1343/2647] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:56:50 2022] PUT /identity/v3/projects/bf4fe086a6e94378997756b1fc02a6c7/users/730fd7f2ff9e4e96be5e412ad86bb0d8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:56:50.952462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:50.952753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:50.953021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:50.970462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:56:50.972156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:51.028556 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1305/2648] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:56:51.039573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:51.041532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:51.104246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524320-ec3f-45d3-b2fd-23a116f9e926 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:51.110067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:51.110938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:51.111370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:51.111936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:51.124067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:51.125738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:51.137374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1344/2649] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:51.177026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:56:51.179284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:51.281941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0a17a-0234-463e-b972-2eb509e48e8c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:56:51.290184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:56:51.290949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:56:51.291324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:56:51.291689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:56:51.293743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:56:51.369203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:56:51.371673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:56:51.385277 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1306/2650] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:56:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:00.011537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:00.013144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:00.033378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf2613-5bfe-4a37-8b47-aac6d67e46c3 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:00.039318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:00.040488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:00.041183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:00.041519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] PATH_INFO: `/v3/users/ae8571042b5f47eea035c6f126d4e641` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:00.042913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8571042b5f47eea035c6f126d4e641)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:00.045067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:00.118062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8571042b5f47eea035c6f126d4e641'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:00.119450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8571042b5f47eea035c6f126d4e641'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:00.151603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8571042b5f47eea035c6f126d4e641'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:00.165353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:00.177434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8571042b5f47eea035c6f126d4e641'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:00.179878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8571042b5f47eea035c6f126d4e641'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:00.188373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139658f7-b42f-4a77-983b-f5176244b869 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:00.204308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:00.206387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:00.207193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:00.209581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:00.213950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:00.222206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1345/2651] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:57:00 2022] DELETE /identity/v3/users/ae8571042b5f47eea035c6f126d4e641 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:00.317318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:00.318939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:00.348638 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1307/2652] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:00.970603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:00.972478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:01.065943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c28f9a-5218-49cb-a39b-80536d938c86 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:01.081842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:01.082764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:01.083035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:01.083306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] PATH_INFO: `/v3/projects/847209629f944fd98aec4c4bbe9a2bd8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:01.084597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] RBAC: Authorizing `identity:delete_project(project_id=847209629f944fd98aec4c4bbe9a2bd8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:01.086574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:01.174209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847209629f944fd98aec4c4bbe9a2bd8', 'request_id': 'req-5cdd15ae-7b73-42c1-8830-554f5c8a349c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.182957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847209629f944fd98aec4c4bbe9a2bd8', 'request_id': 'req-5cdd15ae-7b73-42c1-8830-554f5c8a349c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.204339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847209629f944fd98aec4c4bbe9a2bd8', 'request_id': 'req-5cdd15ae-7b73-42c1-8830-554f5c8a349c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.224772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] The token cache is being invalidate because project 847209629f944fd98aec4c4bbe9a2bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:57:01.225156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.226458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5cdd15ae-7b73-42c1-8830-554f5c8a349c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.236265 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1346/2653] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:57:00 2022] DELETE /identity/v3/projects/847209629f944fd98aec4c4bbe9a2bd8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:01.246976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:01.281183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46fb2e-916b-488c-8cfb-00dbcdf01dbf service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:01.404867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:01.406142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:01.406582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:01.407009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] PATH_INFO: `/v3/users/9ce9a5de45c2441381e3a2329b438b56` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:01.408455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce9a5de45c2441381e3a2329b438b56)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:01.411266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:01.497566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce9a5de45c2441381e3a2329b438b56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.498584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce9a5de45c2441381e3a2329b438b56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.516353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce9a5de45c2441381e3a2329b438b56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.517559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce9a5de45c2441381e3a2329b438b56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.541676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6c98f3e8-f1cc-42f0-ae04-4672ed357fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce9a5de45c2441381e3a2329b438b56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:01.592686 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1308/2654] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:57:01 2022] DELETE /identity/v3/users/9ce9a5de45c2441381e3a2329b438b56 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:02.365502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39c90-f1ea-4555-ab30-706b71dfb83a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:02.366559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39c90-f1ea-4555-ab30-706b71dfb83a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:02.366979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39c90-f1ea-4555-ab30-706b71dfb83a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:02.368592 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1347/2655] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:57:02.375275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:02.376156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:02.376742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:02.413049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:02.414560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:02.537935 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1309/2656] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:02.562801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39c90-f1ea-4555-ab30-706b71dfb83a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:02.569152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2da39c90-f1ea-4555-ab30-706b71dfb83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:02.590184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39c90-f1ea-4555-ab30-706b71dfb83a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:02.598089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5baedc-a4d7-438d-997e-8f963a4b76fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:02.599113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5baedc-a4d7-438d-997e-8f963a4b76fc service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:02.599557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5baedc-a4d7-438d-997e-8f963a4b76fc service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:02.600018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5baedc-a4d7-438d-997e-8f963a4b76fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:02.619743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5baedc-a4d7-438d-997e-8f963a4b76fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:02.621970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5baedc-a4d7-438d-997e-8f963a4b76fc service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:02.649236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1348/2657] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:02.779758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:02.781214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:02.902053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351e9db-9ed4-4476-b4e3-d308e5308f6d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:02.906857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:02.907868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:02.908136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:02.908408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] PATH_INFO: `/v3/projects/5e298331a0b24825a6cbe40cd5bae09d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:02.910343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e298331a0b24825a6cbe40cd5bae09d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:02.911836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:02.982304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e298331a0b24825a6cbe40cd5bae09d', 'request_id': 'req-ebd3b22b-cfe4-4719-a766-32763c600cf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:02.988788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e298331a0b24825a6cbe40cd5bae09d', 'request_id': 'req-ebd3b22b-cfe4-4719-a766-32763c600cf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:03.033262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e298331a0b24825a6cbe40cd5bae09d', 'request_id': 'req-ebd3b22b-cfe4-4719-a766-32763c600cf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:03.051516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] The token cache is being invalidate because project 5e298331a0b24825a6cbe40cd5bae09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:57:03.051824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:03.053932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ebd3b22b-cfe4-4719-a766-32763c600cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:03.063717 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1310/2658] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:57:02 2022] DELETE /identity/v3/projects/5e298331a0b24825a6cbe40cd5bae09d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:03.065974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf43c1-c3ae-4129-806f-8ddb7395250d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.066532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf43c1-c3ae-4129-806f-8ddb7395250d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.067049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf43c1-c3ae-4129-806f-8ddb7395250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.100681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b6cf43c1-c3ae-4129-806f-8ddb7395250d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:03.102366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6cf43c1-c3ae-4129-806f-8ddb7395250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:03.201706 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1349/2659] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:03.209446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cea4-89e4-4157-bf9c-f1f96fbf052d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.209730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cea4-89e4-4157-bf9c-f1f96fbf052d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.210012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cea4-89e4-4157-bf9c-f1f96fbf052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.250685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a426cea4-89e4-4157-bf9c-f1f96fbf052d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:03.251965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a426cea4-89e4-4157-bf9c-f1f96fbf052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:03.283478 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1311/2660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:03.284838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf43c1-c3ae-4129-806f-8ddb7395250d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:03.306806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf43c1-c3ae-4129-806f-8ddb7395250d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:03.317177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:03.317897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.318246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.318584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.319410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:57:03.324007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:03.325837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:03.355502 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1350/2661] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:57:03.360795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cea4-89e4-4157-bf9c-f1f96fbf052d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:03.379055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cea4-89e4-4157-bf9c-f1f96fbf052d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:03.398105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67585607-cac4-449a-8edd-35fdee621b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:03.398797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585607-cac4-449a-8edd-35fdee621b42 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.399073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585607-cac4-449a-8edd-35fdee621b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.399343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585607-cac4-449a-8edd-35fdee621b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.404736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67585607-cac4-449a-8edd-35fdee621b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:03.406919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67585607-cac4-449a-8edd-35fdee621b42 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:03.469451 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1312/2662] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:57:03 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:57:03.470068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:03.487421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f2316-1b0b-434e-9527-e82091428109 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:03.510301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4782c3-067e-49ff-9473-f3dc65fe5670 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.510576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4782c3-067e-49ff-9473-f3dc65fe5670 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.510855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4782c3-067e-49ff-9473-f3dc65fe5670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.562251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cb4782c3-067e-49ff-9473-f3dc65fe5670 None None] MFA Rules not processed for user `730fd7f2ff9e4e96be5e412ad86bb0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:03.563600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb4782c3-067e-49ff-9473-f3dc65fe5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:03.583267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:03.584304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.584675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.584882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.585776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:03.587896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:03.615936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1351/2663] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:57:03 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:57:03.620024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:03.630473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f157d-6f71-4cef-aed2-6b8bba7f48c2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:03.637451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:03.638465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.639422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.639886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.641510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:03.643495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:03.657182 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1313/2664] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:03.662290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1352/2665] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:57:03.666815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4782c3-067e-49ff-9473-f3dc65fe5670 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:03.671157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:03.678110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:03.682726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4782c3-067e-49ff-9473-f3dc65fe5670 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:03.689582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:03.690793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.691243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.691848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.693458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:03.695708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:03.710492 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1314/2666] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:57:03.716515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:03.733498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0580-943e-4003-b4fb-baa72df74d90 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:03.739195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e266726-6233-4d3e-92f9-82bd6947f46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:03.740730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e266726-6233-4d3e-92f9-82bd6947f46f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.741274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e266726-6233-4d3e-92f9-82bd6947f46f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.742164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e266726-6233-4d3e-92f9-82bd6947f46f admin admin] PATH_INFO: `/v3/projects/187ddc30032e4562988928849adc2ca4/users/74dbaf8dda7641669d57b71c83ca2197/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.758488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b234f-a0bc-4f91-b0ba-0642885a44b7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:03.760491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e266726-6233-4d3e-92f9-82bd6947f46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=187ddc30032e4562988928849adc2ca4, user_id=74dbaf8dda7641669d57b71c83ca2197, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:03.763258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a9954-2fff-4fc9-8061-6d970c23bb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:03.763987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9954-2fff-4fc9-8061-6d970c23bb75 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.764493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e266726-6233-4d3e-92f9-82bd6947f46f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:03.764873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9954-2fff-4fc9-8061-6d970c23bb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.765293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9954-2fff-4fc9-8061-6d970c23bb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.783686 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1315/2667] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:57:03 2022] PUT /identity/v3/projects/187ddc30032e4562988928849adc2ca4/users/74dbaf8dda7641669d57b71c83ca2197/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:03.794474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b1b3-3dbc-4a55-97f7-1439eab1cb60 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.794945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b1b3-3dbc-4a55-97f7-1439eab1cb60 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.795145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b1b3-3dbc-4a55-97f7-1439eab1cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.798624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a9954-2fff-4fc9-8061-6d970c23bb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:03.800573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a9954-2fff-4fc9-8061-6d970c23bb75 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:03.826106 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1353/2668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:03.827671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe7c6f-e45e-4ab3-818b-14a5aa2af8cf None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.828031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe7c6f-e45e-4ab3-818b-14a5aa2af8cf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.828505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe7c6f-e45e-4ab3-818b-14a5aa2af8cf None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.829909 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1354/2669] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:57:03.840464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440682-1716-4a27-b662-b2b3c6cc56b7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:03.841586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440682-1716-4a27-b662-b2b3c6cc56b7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:03.842092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440682-1716-4a27-b662-b2b3c6cc56b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:03.858558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2c06b1b3-3dbc-4a55-97f7-1439eab1cb60 None None] MFA Rules not processed for user `74dbaf8dda7641669d57b71c83ca2197`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:03.859822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2c06b1b3-3dbc-4a55-97f7-1439eab1cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:03.868168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-06440682-1716-4a27-b662-b2b3c6cc56b7 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:03.870639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-06440682-1716-4a27-b662-b2b3c6cc56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:03.981226 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1355/2670] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:03.998244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440682-1716-4a27-b662-b2b3c6cc56b7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:04.001139 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1316/2671] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:04.075208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440682-1716-4a27-b662-b2b3c6cc56b7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:04.094115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:04.098570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:04.098936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:04.099234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:04.128146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:04.132241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:04.148106 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1356/2672] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:04.274507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:04.274797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:04.275158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:04.300662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:04.303497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:04.315844 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1317/2673] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:04.337436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:04.350888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19e5b-e5d1-47ed-ad42-df083a2a9cfe service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:04.356436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aeb21-81b1-47f8-8389-3272537f2c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:04.358199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aeb21-81b1-47f8-8389-3272537f2c60 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:04.358853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aeb21-81b1-47f8-8389-3272537f2c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:04.359336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aeb21-81b1-47f8-8389-3272537f2c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:04.373005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aeb21-81b1-47f8-8389-3272537f2c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:04.375384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aeb21-81b1-47f8-8389-3272537f2c60 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:04.386913 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1357/2674] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:04.631992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:04.633637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:04.659084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916c086-8dee-4e5d-be55-08784020be7b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:04.666830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:04.667590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:04.667938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:04.668221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:04.677126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:04.679432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:04.694893 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1318/2675] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:04.934505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96bcd6-80ce-48f2-b3cb-ae35b5ec2e5c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:04.937435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96bcd6-80ce-48f2-b3cb-ae35b5ec2e5c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:04.938100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96bcd6-80ce-48f2-b3cb-ae35b5ec2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:05.019431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dc96bcd6-80ce-48f2-b3cb-ae35b5ec2e5c None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:05.022511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dc96bcd6-80ce-48f2-b3cb-ae35b5ec2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:05.162645 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1358/2676] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:05.222250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:05.224031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:05.368532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b01e7-dcbc-4328-8a01-f5bfa3862f26 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:05.374586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ccfbd-5cde-48be-bb8f-65cb8137521d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:05.375347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ccfbd-5cde-48be-bb8f-65cb8137521d service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:05.375723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ccfbd-5cde-48be-bb8f-65cb8137521d service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:05.376070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ccfbd-5cde-48be-bb8f-65cb8137521d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:05.386529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ccfbd-5cde-48be-bb8f-65cb8137521d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:05.388435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ccfbd-5cde-48be-bb8f-65cb8137521d service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:05.401534 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1319/2677] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 20:57:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 20:57:05.576637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0751014-e48a-4009-afe9-fa193c64c0d7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:05.577058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0751014-e48a-4009-afe9-fa193c64c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:05.577547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0751014-e48a-4009-afe9-fa193c64c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:05.598658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f0751014-e48a-4009-afe9-fa193c64c0d7 None None] MFA Rules not processed for user `74dbaf8dda7641669d57b71c83ca2197`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:05.608172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0751014-e48a-4009-afe9-fa193c64c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:05.629274 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1359/2678] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:06.231345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff5ab-e03e-47fe-ba8e-49f274bb7ad2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:06.232203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff5ab-e03e-47fe-ba8e-49f274bb7ad2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:06.233010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff5ab-e03e-47fe-ba8e-49f274bb7ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:06.255315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5bfff5ab-e03e-47fe-ba8e-49f274bb7ad2 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:06.257398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5bfff5ab-e03e-47fe-ba8e-49f274bb7ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:06.280668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0751014-e48a-4009-afe9-fa193c64c0d7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:06.281681 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1320/2679] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:06.296784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0751014-e48a-4009-afe9-fa193c64c0d7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:06.304446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897051f1-a8e1-4454-a787-aef716829fae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:06.305561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897051f1-a8e1-4454-a787-aef716829fae service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:06.305992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897051f1-a8e1-4454-a787-aef716829fae service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:06.306413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897051f1-a8e1-4454-a787-aef716829fae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:06.317200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897051f1-a8e1-4454-a787-aef716829fae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:06.319099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897051f1-a8e1-4454-a787-aef716829fae service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:06.340360 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1360/2680] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 20:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 20:57:06.377010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a27a-7306-464e-a2f0-aa572bd11c3e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:06.377809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a27a-7306-464e-a2f0-aa572bd11c3e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:06.378303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a27a-7306-464e-a2f0-aa572bd11c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:06.401311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c819a27a-7306-464e-a2f0-aa572bd11c3e None None] MFA Rules not processed for user `730fd7f2ff9e4e96be5e412ad86bb0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:06.403499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c819a27a-7306-464e-a2f0-aa572bd11c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:06.478890 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1321/2681] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:06.619253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cc9e9-c17a-41c4-b9ae-65fb9fb91fbb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:06.619648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cc9e9-c17a-41c4-b9ae-65fb9fb91fbb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:06.619992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cc9e9-c17a-41c4-b9ae-65fb9fb91fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:06.648409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a27a-7306-464e-a2f0-aa572bd11c3e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:06.648640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-068cc9e9-c17a-41c4-b9ae-65fb9fb91fbb None None] MFA Rules not processed for user `9c775742dfc04cec8559f9e4d13239b0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:06.650004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-068cc9e9-c17a-41c4-b9ae-65fb9fb91fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:06.746384 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1361/2682] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:06.770526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a27a-7306-464e-a2f0-aa572bd11c3e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:06.777391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:06.779329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:06.779844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:06.780296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] PATH_INFO: `/v3/users/74dbaf8dda7641669d57b71c83ca2197` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:06.781926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74dbaf8dda7641669d57b71c83ca2197)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:06.784535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:06.898694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74dbaf8dda7641669d57b71c83ca2197'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:06.900380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74dbaf8dda7641669d57b71c83ca2197'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:06.914620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74dbaf8dda7641669d57b71c83ca2197'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:06.916327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74dbaf8dda7641669d57b71c83ca2197'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:06.930043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74dbaf8dda7641669d57b71c83ca2197'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:06.985405 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1322/2683] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:57:06 2022] DELETE /identity/v3/users/74dbaf8dda7641669d57b71c83ca2197 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:06.988252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:06.988252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:06.988252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:07.005492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:07.006745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:07.071486 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1362/2684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:07.083198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:07.085384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:07.154870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162f51-30e8-4cea-a71d-aa563c0dcd86 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:07.158891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b5f63-2436-4d6e-9325-6a66bb7669d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:07.159658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5f63-2436-4d6e-9325-6a66bb7669d3 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:07.159995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5f63-2436-4d6e-9325-6a66bb7669d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:07.160438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5f63-2436-4d6e-9325-6a66bb7669d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:07.170886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5f63-2436-4d6e-9325-6a66bb7669d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:07.172315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5f63-2436-4d6e-9325-6a66bb7669d3 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:07.183180 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1323/2685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:07.940566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:07.942154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:07.956316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906110aa-d3e0-4c84-8845-dbf2c14c9cd5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:07.963526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:07.965599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:07.965599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:07.965599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] PATH_INFO: `/v3/projects/187ddc30032e4562988928849adc2ca4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:07.967068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187ddc30032e4562988928849adc2ca4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:07.969847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:08.054380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187ddc30032e4562988928849adc2ca4', 'request_id': 'req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:08.059960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187ddc30032e4562988928849adc2ca4', 'request_id': 'req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:08.073579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187ddc30032e4562988928849adc2ca4', 'request_id': 'req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:08.087025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] The token cache is being invalidate because project 187ddc30032e4562988928849adc2ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:57:08.087669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:08.088581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf440c3d-5218-4d9a-9f31-2d6ae0807da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:08.091341 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1363/2686] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:57:07 2022] DELETE /identity/v3/projects/187ddc30032e4562988928849adc2ca4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:08.096988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e66e6e-2425-43f8-b4cb-668d879756da None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.097901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e66e6e-2425-43f8-b4cb-668d879756da None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.098347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e66e6e-2425-43f8-b4cb-668d879756da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.121342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f4e66e6e-2425-43f8-b4cb-668d879756da None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:08.123919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f4e66e6e-2425-43f8-b4cb-668d879756da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:08.219106 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1324/2687] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:08.224188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0d0b-f2e4-443e-a8db-b540b38859d2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.224906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0d0b-f2e4-443e-a8db-b540b38859d2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.225420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0d0b-f2e4-443e-a8db-b540b38859d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.296468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-345b0d0b-f2e4-443e-a8db-b540b38859d2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:08.299649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-345b0d0b-f2e4-443e-a8db-b540b38859d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:08.309992 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1364/2688] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:08.314284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e66e6e-2425-43f8-b4cb-668d879756da None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:08.382197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e66e6e-2425-43f8-b4cb-668d879756da None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:08.410779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:08.411550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.411814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.412270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.413251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:57:08.414346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:08.416985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:08.440412 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1325/2689] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:57:08.441393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b0d0b-f2e4-443e-a8db-b540b38859d2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:08.465754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b0d0b-f2e4-443e-a8db-b540b38859d2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:08.472591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:08.473657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.474084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.474519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.483961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:08.486950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:08.538092 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1365/2690] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:57:08 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:57:08.545462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:08.579241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715cdd4-0ff0-4d5a-acd9-8ddbfc7c43f0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:08.688346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:08.689695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.690151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.690565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.691543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:08.693812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:08.725669 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1326/2691] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:57:08 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:57:08.730036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:08.743128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4660ea-7043-4cef-bd7a-5e9065e9ee08 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:08.753407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:08.754569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.755332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.755773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.757412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:08.759799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:08.780104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1366/2692] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:57:08.785145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:08.796174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbba58-9e2d-4564-9761-cdcb371a9a31 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:08.801161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1af31b-abc6-41d6-9a32-2ce70dbf2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:08.801961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af31b-abc6-41d6-9a32-2ce70dbf2202 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.803015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af31b-abc6-41d6-9a32-2ce70dbf2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.803264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af31b-abc6-41d6-9a32-2ce70dbf2202 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.804103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1af31b-abc6-41d6-9a32-2ce70dbf2202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:08.805940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1af31b-abc6-41d6-9a32-2ce70dbf2202 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:08.822818 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1327/2693] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:57:08.825145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:08.841934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec431362-f36c-4192-9d5c-4c17d79e7ca3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:08.847831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:08.851984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.852376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.853776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] PATH_INFO: `/v3/projects/333402ee57fb405f856c323a638d2b7c/users/33746e27054c4f1db976d4a4ae44e073/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.882096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=333402ee57fb405f856c323a638d2b7c, user_id=33746e27054c4f1db976d4a4ae44e073, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:08.885791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:08.909091 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1367/2694] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:57:08 2022] PUT /identity/v3/projects/333402ee57fb405f856c323a638d2b7c/users/33746e27054c4f1db976d4a4ae44e073/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:08.911281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a6a9-f2c3-4efe-a2f1-45ed230b6b8b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:08.911667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a6a9-f2c3-4efe-a2f1-45ed230b6b8b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:08.912032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a6a9-f2c3-4efe-a2f1-45ed230b6b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:08.945397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f596a6a9-f2c3-4efe-a2f1-45ed230b6b8b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:08.947018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f596a6a9-f2c3-4efe-a2f1-45ed230b6b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:09.100179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1328/2695] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:09.110712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:09.117744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:09.305826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ba940-8c30-4cfa-8216-04362dfb8c2d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:09.313326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbf0ba-8ca4-47eb-ae2e-c580fabc6bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:09.315442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf0ba-8ca4-47eb-ae2e-c580fabc6bae service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:09.316248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf0ba-8ca4-47eb-ae2e-c580fabc6bae service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:09.319457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf0ba-8ca4-47eb-ae2e-c580fabc6bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:09.344961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbf0ba-8ca4-47eb-ae2e-c580fabc6bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:09.346573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbf0ba-8ca4-47eb-ae2e-c580fabc6bae service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:09.360596 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1368/2696] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:11.233230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:11.233771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:11.233771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:11.273961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] MFA Rules not processed for user `33746e27054c4f1db976d4a4ae44e073`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:11.275129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:11.375441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1329/2697] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:11.386339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d88173-634d-47b8-b6f7-1b9c0444a21a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:11.386933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d88173-634d-47b8-b6f7-1b9c0444a21a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:11.387090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d88173-634d-47b8-b6f7-1b9c0444a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:11.419154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c3d88173-634d-47b8-b6f7-1b9c0444a21a None None] MFA Rules not processed for user `33746e27054c4f1db976d4a4ae44e073`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:11.421092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c3d88173-634d-47b8-b6f7-1b9c0444a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:11.430908 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1369/2698] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:11.837281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:11.839072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:11.962259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0007f-14b0-4c91-8752-3529c0771d86 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:11.968075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc6bae-50d6-4179-924e-e5284c8c1e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:11.968756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6bae-50d6-4179-924e-e5284c8c1e42 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:11.969057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6bae-50d6-4179-924e-e5284c8c1e42 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:11.969363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6bae-50d6-4179-924e-e5284c8c1e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:11.980598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc6bae-50d6-4179-924e-e5284c8c1e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:11.983688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc6bae-50d6-4179-924e-e5284c8c1e42 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:11.997358 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1330/2699] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:18.934925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d88173-634d-47b8-b6f7-1b9c0444a21a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:18.955389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d88173-634d-47b8-b6f7-1b9c0444a21a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:18.963696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02507d-6ef1-44d0-a0ee-a4ebfe2c03f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:18.964647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02507d-6ef1-44d0-a0ee-a4ebfe2c03f6 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:18.965251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02507d-6ef1-44d0-a0ee-a4ebfe2c03f6 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:18.965769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02507d-6ef1-44d0-a0ee-a4ebfe2c03f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:18.967895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ed02507d-6ef1-44d0-a0ee-a4ebfe2c03f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:19.116108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02507d-6ef1-44d0-a0ee-a4ebfe2c03f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:19.117864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02507d-6ef1-44d0-a0ee-a4ebfe2c03f6 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:19.143711 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1370/2700] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:22.828300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430175-6451-4bbf-9cfc-38cdd18d1b47 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:22.828805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430175-6451-4bbf-9cfc-38cdd18d1b47 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:22.829465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430175-6451-4bbf-9cfc-38cdd18d1b47 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:22.832155 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1331/2701] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 20:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:57:22.845334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b6d05-849c-4514-bbd9-57fdb74d92bc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:22.845900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b6d05-849c-4514-bbd9-57fdb74d92bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:22.845900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b6d05-849c-4514-bbd9-57fdb74d92bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:22.869519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5e1b6d05-849c-4514-bbd9-57fdb74d92bc None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:22.870786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5e1b6d05-849c-4514-bbd9-57fdb74d92bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:22.944626 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1371/2702] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:22.969877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a430175-6451-4bbf-9cfc-38cdd18d1b47 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:22.971580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6a430175-6451-4bbf-9cfc-38cdd18d1b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:22.988452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a430175-6451-4bbf-9cfc-38cdd18d1b47 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:22.993880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771ad5c-c9da-4a8b-9bc1-4b759aed6471 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:22.994535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ad5c-c9da-4a8b-9bc1-4b759aed6471 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:22.994815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ad5c-c9da-4a8b-9bc1-4b759aed6471 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:22.995123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ad5c-c9da-4a8b-9bc1-4b759aed6471 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:23.004118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771ad5c-c9da-4a8b-9bc1-4b759aed6471 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:23.005890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771ad5c-c9da-4a8b-9bc1-4b759aed6471 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:23.016411 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1332/2703] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:23.316782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7731329-03c4-4590-ba96-0d8bdc26fdaf None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:23.317219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7731329-03c4-4590-ba96-0d8bdc26fdaf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:23.317499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7731329-03c4-4590-ba96-0d8bdc26fdaf None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:23.318888 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1372/2704] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:57:23.324017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f19af6-6784-46f2-9036-bdecc7194520 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:23.324319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f19af6-6784-46f2-9036-bdecc7194520 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:23.324593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f19af6-6784-46f2-9036-bdecc7194520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:23.343167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a0f19af6-6784-46f2-9036-bdecc7194520 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:23.344443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a0f19af6-6784-46f2-9036-bdecc7194520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:23.354061 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1333/2705] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:23.376242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7731329-03c4-4590-ba96-0d8bdc26fdaf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:23.395411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7731329-03c4-4590-ba96-0d8bdc26fdaf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:23.400898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe2ad1-19e8-4c79-aec5-fc320d521e61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:23.401555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2ad1-19e8-4c79-aec5-fc320d521e61 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:23.401895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2ad1-19e8-4c79-aec5-fc320d521e61 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:23.402226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2ad1-19e8-4c79-aec5-fc320d521e61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:23.423737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2ad1-19e8-4c79-aec5-fc320d521e61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:23.423737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2ad1-19e8-4c79-aec5-fc320d521e61 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:23.441127 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1373/2706] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:23.622382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bd0d2-73b8-452f-a804-8d93a49729cd None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:23.622692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bd0d2-73b8-452f-a804-8d93a49729cd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:23.622979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bd0d2-73b8-452f-a804-8d93a49729cd None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:23.624357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1334/2707] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:57:23.630661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:23.631046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:23.631400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:23.650444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:23.651761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:23.661029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1374/2708] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:23.671732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bd0d2-73b8-452f-a804-8d93a49729cd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:23.682676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bd0d2-73b8-452f-a804-8d93a49729cd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:23.686202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339bef-70e1-4705-8d8e-6577723d98da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:23.686840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339bef-70e1-4705-8d8e-6577723d98da service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:23.687116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339bef-70e1-4705-8d8e-6577723d98da service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:23.687386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339bef-70e1-4705-8d8e-6577723d98da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:23.698156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339bef-70e1-4705-8d8e-6577723d98da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:23.699882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339bef-70e1-4705-8d8e-6577723d98da service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:23.713934 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1335/2709] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:35.250363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:35.251848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:35.270718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935fe44-1c06-4838-877b-b87fe8eaeb5f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:35.276224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48178c-7de7-4c4c-ad6a-2befdb5dd974 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:35.277179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48178c-7de7-4c4c-ad6a-2befdb5dd974 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:35.277431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48178c-7de7-4c4c-ad6a-2befdb5dd974 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:35.277712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48178c-7de7-4c4c-ad6a-2befdb5dd974 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:35.279594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5b48178c-7de7-4c4c-ad6a-2befdb5dd974 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:35.295306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48178c-7de7-4c4c-ad6a-2befdb5dd974 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:35.296950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48178c-7de7-4c4c-ad6a-2befdb5dd974 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:35.311479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1375/2710] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:36.661008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204ab2-9a74-4c76-9f2b-95fcc31a5be9 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:36.661625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204ab2-9a74-4c76-9f2b-95fcc31a5be9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:36.661625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204ab2-9a74-4c76-9f2b-95fcc31a5be9 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:36.663185 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1336/2711] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:57:36.668875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:36.669423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:36.669423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:36.689091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:36.690321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:36.699118 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1376/2712] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:36.719911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204ab2-9a74-4c76-9f2b-95fcc31a5be9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:36.745939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204ab2-9a74-4c76-9f2b-95fcc31a5be9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:36.758450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:36.759306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:36.759651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:36.759995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:36.769062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:36.770743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:36.781359 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1337/2713] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:42.161574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:42.163145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:42.177604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082898e7-734d-43dd-8077-a6a6a243273f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:42.183404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:42.184309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:42.184565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:42.185068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] PATH_INFO: `/v3/users/d415747d240d49d89c65e45cc3fc810b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:42.186364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d415747d240d49d89c65e45cc3fc810b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:42.188542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:42.253711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd415747d240d49d89c65e45cc3fc810b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.254589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd415747d240d49d89c65e45cc3fc810b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.263078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd415747d240d49d89c65e45cc3fc810b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.272243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd415747d240d49d89c65e45cc3fc810b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.272874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5273b71e-4041-449f-9151-c0ea68024856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd415747d240d49d89c65e45cc3fc810b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.297979 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1377/2714] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:57:42 2022] DELETE /identity/v3/users/d415747d240d49d89c65e45cc3fc810b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:42.511891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:42.527477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442c2f-230a-477b-a31c-10dcc3107fe0 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:42.596716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:42.597906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:42.598183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:42.598451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] PATH_INFO: `/v3/projects/66f36ce90faf42d0b8a5ab4024bd3db8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:42.599627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f36ce90faf42d0b8a5ab4024bd3db8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:42.601546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:42.658924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f36ce90faf42d0b8a5ab4024bd3db8', 'request_id': 'req-dd8ce884-7c22-432a-93b1-b90863417374'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.664207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f36ce90faf42d0b8a5ab4024bd3db8', 'request_id': 'req-dd8ce884-7c22-432a-93b1-b90863417374'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.672589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f36ce90faf42d0b8a5ab4024bd3db8', 'request_id': 'req-dd8ce884-7c22-432a-93b1-b90863417374'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.684341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] The token cache is being invalidate because project 66f36ce90faf42d0b8a5ab4024bd3db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:57:42.684628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.685321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd8ce884-7c22-432a-93b1-b90863417374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:57:42.686918 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1338/2715] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:57:42 2022] DELETE /identity/v3/projects/66f36ce90faf42d0b8a5ab4024bd3db8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:42.692182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff2059-db5b-4088-856e-9d865f599d60 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:42.692460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff2059-db5b-4088-856e-9d865f599d60 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:42.692749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff2059-db5b-4088-856e-9d865f599d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:42.710791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-98ff2059-db5b-4088-856e-9d865f599d60 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:42.712022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98ff2059-db5b-4088-856e-9d865f599d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:42.772199 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1378/2716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:42.779888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000438-abb3-4277-9686-113dfb2e4a4d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:42.780172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000438-abb3-4277-9686-113dfb2e4a4d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:42.780442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000438-abb3-4277-9686-113dfb2e4a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:42.798421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-31000438-abb3-4277-9686-113dfb2e4a4d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:42.799688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-31000438-abb3-4277-9686-113dfb2e4a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:42.807502 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1339/2717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:42.811597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff2059-db5b-4088-856e-9d865f599d60 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:42.821513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff2059-db5b-4088-856e-9d865f599d60 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:42.826440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:42.827099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:42.827375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:42.827647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:42.828367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:57:42.828671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:42.830323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:42.843329 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1379/2718] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 20:57:42.849145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000438-abb3-4277-9686-113dfb2e4a4d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:42.860614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000438-abb3-4277-9686-113dfb2e4a4d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:42.865854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:42.866497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:42.866774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:42.867046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:42.867772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:42.869730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:42.903816 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1340/2719] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:57:42 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:57:42.910052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:42.922057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d95e8-b6cc-40b2-926d-933f9d5db320 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:42.980090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:42.981161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:42.981438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:42.982026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:42.982739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:42.984667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:43.007384 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1380/2720] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:57:42 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:57:43.011522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:43.022421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec3753-08d6-4299-bccc-6f483c5af291 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:43.027325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:43.027991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:43.028304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:43.028576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:43.029468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:43.031064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:43.042097 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1341/2721] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:57:43.046216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:43.057599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518296-9174-470d-8384-bd1ec1bd0342 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:43.064419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46e57-491f-4e12-8c97-426cf9d84c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:43.065334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46e57-491f-4e12-8c97-426cf9d84c3d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:43.065790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46e57-491f-4e12-8c97-426cf9d84c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:43.066141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46e57-491f-4e12-8c97-426cf9d84c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:43.066927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46e57-491f-4e12-8c97-426cf9d84c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:43.068893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46e57-491f-4e12-8c97-426cf9d84c3d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:43.079529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1381/2722] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:57:43.083870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:43.094035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864b20-934f-4e3c-b48d-187f2677bf86 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:43.098682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:43.099644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:43.099978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:43.100330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] PATH_INFO: `/v3/projects/7f7a5ffec4e047688285e72ae5c4d9dd/users/957f4920b90e4be0ae61ceb0ef0be4de/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:43.116241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7a5ffec4e047688285e72ae5c4d9dd, user_id=957f4920b90e4be0ae61ceb0ef0be4de, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:43.118965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:43.132955 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1342/2723] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:57:43 2022] PUT /identity/v3/projects/7f7a5ffec4e047688285e72ae5c4d9dd/users/957f4920b90e4be0ae61ceb0ef0be4de/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:57:43.138142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:43.138429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:43.138730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:43.156237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:43.157474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:43.217744 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1382/2724] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:57:43.227782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:43.229686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:43.288567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd0ef9-9c4f-44d0-92fe-2b1d6e7290f1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:43.292567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30a3c5-2308-441f-b890-158b8672b002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:43.293250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30a3c5-2308-441f-b890-158b8672b002 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:43.293535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30a3c5-2308-441f-b890-158b8672b002 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:43.293815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30a3c5-2308-441f-b890-158b8672b002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:43.303628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30a3c5-2308-441f-b890-158b8672b002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:43.305159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30a3c5-2308-441f-b890-158b8672b002 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:43.314626 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1343/2725] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:43.688174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:43.689820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:43.771497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b677ed3-dff8-4918-b48e-d67b499ceb44 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:43.780206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f311e9-9eaf-434e-aa49-2e8cafe5236e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:43.780870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f311e9-9eaf-434e-aa49-2e8cafe5236e service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:43.781182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f311e9-9eaf-434e-aa49-2e8cafe5236e service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:43.781607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f311e9-9eaf-434e-aa49-2e8cafe5236e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:43.784689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-80f311e9-9eaf-434e-aa49-2e8cafe5236e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:43.799183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f311e9-9eaf-434e-aa49-2e8cafe5236e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:43.801063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f311e9-9eaf-434e-aa49-2e8cafe5236e service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:43.816641 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1383/2726] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:47.966022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:47.966492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:47.966571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:47.990188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] MFA Rules not processed for user `ceba42e80d7746e4897669084c078c09`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:47.991816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:48.071496 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1344/2727] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:52.160270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fcc33-14c2-4a3b-982e-69eb111f2398 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:52.160905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fcc33-14c2-4a3b-982e-69eb111f2398 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:52.160905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fcc33-14c2-4a3b-982e-69eb111f2398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:52.191854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-454fcc33-14c2-4a3b-982e-69eb111f2398 None None] MFA Rules not processed for user `957f4920b90e4be0ae61ceb0ef0be4de`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:52.193108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-454fcc33-14c2-4a3b-982e-69eb111f2398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:52.276075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1384/2728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:57:52.463875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:57:52.465673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:52.564906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b24d-ed47-486b-8e3f-e16f09f76fb0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:57:52.572892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591258b-6127-43f9-88a7-1126697fef4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:57:52.578028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591258b-6127-43f9-88a7-1126697fef4e service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:52.578028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591258b-6127-43f9-88a7-1126697fef4e service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:52.578028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591258b-6127-43f9-88a7-1126697fef4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:52.590677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591258b-6127-43f9-88a7-1126697fef4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:57:52.592587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591258b-6127-43f9-88a7-1126697fef4e service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:57:52.604778 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1345/2729] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:57:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:53.790479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4c1b-1f03-4cc3-8aaf-e8a8ffefe006 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:57:53.790994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4c1b-1f03-4cc3-8aaf-e8a8ffefe006 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:57:53.790994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4c1b-1f03-4cc3-8aaf-e8a8ffefe006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:57:53.813498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-16fe4c1b-1f03-4cc3-8aaf-e8a8ffefe006 None None] MFA Rules not processed for user `730fd7f2ff9e4e96be5e412ad86bb0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:57:53.814952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-16fe4c1b-1f03-4cc3-8aaf-e8a8ffefe006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:57:53.883027 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1385/2730] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:00.387290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc1af-5b99-4853-8d09-619a15614063 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:00.387924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc1af-5b99-4853-8d09-619a15614063 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:00.388267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc1af-5b99-4853-8d09-619a15614063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:00.412451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-252dc1af-5b99-4853-8d09-619a15614063 None None] MFA Rules not processed for user `5ab294d1890047aababb87b3a865a14c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:00.413962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-252dc1af-5b99-4853-8d09-619a15614063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:00.474356 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1346/2731] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:08.372446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c642-fb3f-48c7-9b62-0ff3b8303f0d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:08.373414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c642-fb3f-48c7-9b62-0ff3b8303f0d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:08.373866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c642-fb3f-48c7-9b62-0ff3b8303f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:08.393726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bcf9c642-fb3f-48c7-9b62-0ff3b8303f0d None None] MFA Rules not processed for user `0bcc50583d0c4b9aa9d9c9b7ad87a576`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:08.394458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bcf9c642-fb3f-48c7-9b62-0ff3b8303f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:08.452072 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1386/2732] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:14.172199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb62f-c271-4c32-bdb3-75b05969d42d None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:14.172792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb62f-c271-4c32-bdb3-75b05969d42d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:14.172792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb62f-c271-4c32-bdb3-75b05969d42d None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:14.174151 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1347/2733] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:58:14.179707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834719-6980-49f2-8bc0-a9d8d64455a6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:14.180173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834719-6980-49f2-8bc0-a9d8d64455a6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:14.180270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834719-6980-49f2-8bc0-a9d8d64455a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:14.198458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ee834719-6980-49f2-8bc0-a9d8d64455a6 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:14.199652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee834719-6980-49f2-8bc0-a9d8d64455a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:14.208482 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1387/2734] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:14.229634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fb62f-c271-4c32-bdb3-75b05969d42d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:14.231947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b88fb62f-c271-4c32-bdb3-75b05969d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:14.249669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fb62f-c271-4c32-bdb3-75b05969d42d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:14.255422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9fd95-973e-49d9-8747-7069067ff01f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:14.256066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9fd95-973e-49d9-8747-7069067ff01f service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:14.256345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9fd95-973e-49d9-8747-7069067ff01f service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:14.256639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9fd95-973e-49d9-8747-7069067ff01f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:14.266015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9fd95-973e-49d9-8747-7069067ff01f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:14.267816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9fd95-973e-49d9-8747-7069067ff01f service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:14.278267 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1348/2735] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:58:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:58:17.403636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d4043-c962-4d2f-b06e-aea0c06a0d5c None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:17.404709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d4043-c962-4d2f-b06e-aea0c06a0d5c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:17.405435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d4043-c962-4d2f-b06e-aea0c06a0d5c None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:17.407358 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1388/2736] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:58:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:58:17.413565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416fb6-0878-4a62-a822-66d9359b32ab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:17.414067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416fb6-0878-4a62-a822-66d9359b32ab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:17.414172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416fb6-0878-4a62-a822-66d9359b32ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:17.454876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-98416fb6-0878-4a62-a822-66d9359b32ab None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:17.456483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-98416fb6-0878-4a62-a822-66d9359b32ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:17.471459 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1349/2737] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:17.496786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d4043-c962-4d2f-b06e-aea0c06a0d5c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:17.512116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d4043-c962-4d2f-b06e-aea0c06a0d5c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:17.518616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e24c88-5a9c-4f6e-a907-9dcc6da87c8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:17.519667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e24c88-5a9c-4f6e-a907-9dcc6da87c8e service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:17.520274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e24c88-5a9c-4f6e-a907-9dcc6da87c8e service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:17.520706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e24c88-5a9c-4f6e-a907-9dcc6da87c8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:17.533959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e24c88-5a9c-4f6e-a907-9dcc6da87c8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:17.536762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e24c88-5a9c-4f6e-a907-9dcc6da87c8e service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:17.550750 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1389/2738] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:58:17.837120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec0551-1078-49db-a50d-1c9a08d1ba0d None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:17.837695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec0551-1078-49db-a50d-1c9a08d1ba0d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:17.838145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec0551-1078-49db-a50d-1c9a08d1ba0d None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:17.840203 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1350/2739] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:58:17.852907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570cbd7-0bce-4cb1-a6b6-c1d4a0a1788f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:17.853519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570cbd7-0bce-4cb1-a6b6-c1d4a0a1788f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:17.853974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570cbd7-0bce-4cb1-a6b6-c1d4a0a1788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:17.880494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e570cbd7-0bce-4cb1-a6b6-c1d4a0a1788f None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:17.882044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e570cbd7-0bce-4cb1-a6b6-c1d4a0a1788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:17.911448 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1390/2740] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:17.935933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec0551-1078-49db-a50d-1c9a08d1ba0d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:17.949168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec0551-1078-49db-a50d-1c9a08d1ba0d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:17.953394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:17.954354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:17.954809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:17.955229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:17.967749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:17.969725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:17.983423 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1351/2741] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:58:20.594474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570cbd7-0bce-4cb1-a6b6-c1d4a0a1788f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:20.606395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570cbd7-0bce-4cb1-a6b6-c1d4a0a1788f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:20.611570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:20.612472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:20.612750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:20.613222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] PATH_INFO: `/v3/users/957f4920b90e4be0ae61ceb0ef0be4de` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:20.614429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=957f4920b90e4be0ae61ceb0ef0be4de)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:20.616634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:20.714564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957f4920b90e4be0ae61ceb0ef0be4de'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:20.715539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957f4920b90e4be0ae61ceb0ef0be4de'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:20.725330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957f4920b90e4be0ae61ceb0ef0be4de'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:20.738742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957f4920b90e4be0ae61ceb0ef0be4de'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:20.739604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-26a14c76-3c46-46fd-9d9b-dce94a1d97dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957f4920b90e4be0ae61ceb0ef0be4de'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:20.772796 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1391/2742] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:58:20 2022] DELETE /identity/v3/users/957f4920b90e4be0ae61ceb0ef0be4de => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:58:20.977185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:20.991597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a212-af99-4681-8cdd-828f580a7eea service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.056916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.057841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.058114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.058380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] PATH_INFO: `/v3/projects/7f7a5ffec4e047688285e72ae5c4d9dd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.059568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7a5ffec4e047688285e72ae5c4d9dd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.061500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.112207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7a5ffec4e047688285e72ae5c4d9dd', 'request_id': 'req-1af16af2-f324-4e5f-9ac8-812de5bc52c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:21.117643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7a5ffec4e047688285e72ae5c4d9dd', 'request_id': 'req-1af16af2-f324-4e5f-9ac8-812de5bc52c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:21.126285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7a5ffec4e047688285e72ae5c4d9dd', 'request_id': 'req-1af16af2-f324-4e5f-9ac8-812de5bc52c6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:21.138855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] The token cache is being invalidate because project 7f7a5ffec4e047688285e72ae5c4d9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:58:21.139209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:21.139896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1af16af2-f324-4e5f-9ac8-812de5bc52c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:21.142132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1352/2743] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:20 2022] DELETE /identity/v3/projects/7f7a5ffec4e047688285e72ae5c4d9dd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:58:21.150057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3652c9-ac0a-4e21-bb2e-e9c2f0f97670 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.150351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3652c9-ac0a-4e21-bb2e-e9c2f0f97670 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.150632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3652c9-ac0a-4e21-bb2e-e9c2f0f97670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.168772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ad3652c9-ac0a-4e21-bb2e-e9c2f0f97670 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:21.170362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ad3652c9-ac0a-4e21-bb2e-e9c2f0f97670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:21.237300 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1392/2744] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:21.242864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fa397-97b3-4675-94a0-f87d96787a19 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.243316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fa397-97b3-4675-94a0-f87d96787a19 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.243679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fa397-97b3-4675-94a0-f87d96787a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.261886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-de2fa397-97b3-4675-94a0-f87d96787a19 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:21.263087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-de2fa397-97b3-4675-94a0-f87d96787a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:21.270994 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1353/2745] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:21.275211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3652c9-ac0a-4e21-bb2e-e9c2f0f97670 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:21.285208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3652c9-ac0a-4e21-bb2e-e9c2f0f97670 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.290546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.291527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.291801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.292065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.292789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:58:21.293389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.295014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.307573 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1393/2746] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:58:21.312019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fa397-97b3-4675-94a0-f87d96787a19 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:21.321741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fa397-97b3-4675-94a0-f87d96787a19 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.326846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.327563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.327922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.328293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.329020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.331006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.359048 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1354/2747] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:58:21 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:58:21.363269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:21.373763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64814417-04fc-44af-9ec4-cdfc6a316ad5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.435570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.436378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.436657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.436907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.437632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.439885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.465080 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1394/2748] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:58:21 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:58:21.466702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:21.479700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085220bd-572b-4f02-955b-c58537acd7af admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.484814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.485641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.486046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.486421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.487267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.488877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.501084 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1355/2749] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:58:21.504931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:21.515111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e25a86-4511-4090-a21f-7219fb7e5801 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.520261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45b64-6ff9-4917-95cf-546c133fb482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.521014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45b64-6ff9-4917-95cf-546c133fb482 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.521397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45b64-6ff9-4917-95cf-546c133fb482 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.521756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45b64-6ff9-4917-95cf-546c133fb482 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.522640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45b64-6ff9-4917-95cf-546c133fb482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.524468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45b64-6ff9-4917-95cf-546c133fb482 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.535291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1395/2750] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:58:21.539671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:21.550405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b3a0c-2105-467c-8443-fd7d3fe016fe admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.555582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.556615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.557244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.557533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] PATH_INFO: `/v3/projects/9dbc8f96549e4dfaaf941d571addb9c6/users/c3f004d8412d43d7a82f7daa56f47305/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.573409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbc8f96549e4dfaaf941d571addb9c6, user_id=c3f004d8412d43d7a82f7daa56f47305, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.576254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.592219 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1356/2751] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:58:21 2022] PUT /identity/v3/projects/9dbc8f96549e4dfaaf941d571addb9c6/users/c3f004d8412d43d7a82f7daa56f47305/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:58:21.597509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69825c-6318-445d-9cef-2ea4e206c52c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.597971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69825c-6318-445d-9cef-2ea4e206c52c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.598428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69825c-6318-445d-9cef-2ea4e206c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.625730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bc69825c-6318-445d-9cef-2ea4e206c52c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:21.625730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc69825c-6318-445d-9cef-2ea4e206c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:21.698685 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1396/2752] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:58:21.714187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:21.716095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:21.777467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570325-1e7a-48f7-ab51-07ca2f360065 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:21.781470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:21.782126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:21.782404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:21.782678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:21.792180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:21.793690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:21.803980 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1357/2753] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:58:28.328923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad0bcc-12d2-4b74-b19e-d3c31bbe87fb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:28.329433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad0bcc-12d2-4b74-b19e-d3c31bbe87fb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:28.329528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad0bcc-12d2-4b74-b19e-d3c31bbe87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:28.357918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8aad0bcc-12d2-4b74-b19e-d3c31bbe87fb None None] MFA Rules not processed for user `c3f004d8412d43d7a82f7daa56f47305`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:28.359162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8aad0bcc-12d2-4b74-b19e-d3c31bbe87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:28.475933 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1397/2754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:28.477982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:28.489077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d2196-dfde-4cd4-8678-d50807cb5765 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:28.495209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:28.496261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:28.500468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:28.500468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:28.500468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:28.502398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:28.541700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1358/2755] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:58:28 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:58:28.545588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad0bcc-12d2-4b74-b19e-d3c31bbe87fb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:28.557922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad0bcc-12d2-4b74-b19e-d3c31bbe87fb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:28.638508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:28.639236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:28.639513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:28.639784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:28.640605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:28.642610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:28.672522 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1398/2756] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:58:28 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:58:28.674934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:28.689861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae988aac-d3dc-4cda-b237-b96e461ca37c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:28.697104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:28.700036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:28.700036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:28.700036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:28.700036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:28.703207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:28.720890 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1359/2757] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:58:28.722208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:28.737068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d4e53-5125-4eb1-b8e8-f568b7503445 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:28.742439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:28.743623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:28.743899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:28.744313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] PATH_INFO: `/v3/projects/e2d0c5c00bd44d33a97c1057b4ab5f9c/users/5ed102e585f64369a331be11ab73dd34/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:28.762664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d0c5c00bd44d33a97c1057b4ab5f9c, user_id=5ed102e585f64369a331be11ab73dd34, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:28.765736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:28.796931 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1399/2758] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:58:28 2022] PUT /identity/v3/projects/e2d0c5c00bd44d33a97c1057b4ab5f9c/users/5ed102e585f64369a331be11ab73dd34/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:58:28.798088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:28.816839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6473b0-1925-4a01-a17b-37de692551f4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:28.930290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ea4bd-8c5e-41e5-bc82-4a149a5ba0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:28.931866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea4bd-8c5e-41e5-bc82-4a149a5ba0ae admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:28.933202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea4bd-8c5e-41e5-bc82-4a149a5ba0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:28.933520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea4bd-8c5e-41e5-bc82-4a149a5ba0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:28.934296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ea4bd-8c5e-41e5-bc82-4a149a5ba0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:28.936088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ea4bd-8c5e-41e5-bc82-4a149a5ba0ae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:28.950252 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1360/2759] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:58:28.954123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:28.968210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1a74-6361-4840-9b5b-edec1e7f62b8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:28.974080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:28.975175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:28.975328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:28.975571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] PATH_INFO: `/v3/projects/e2d0c5c00bd44d33a97c1057b4ab5f9c/users/5ed102e585f64369a331be11ab73dd34/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:28.977710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d0c5c00bd44d33a97c1057b4ab5f9c, user_id=5ed102e585f64369a331be11ab73dd34, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:28.980931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:28.997206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1400/2760] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:58:28 2022] PUT /identity/v3/projects/e2d0c5c00bd44d33a97c1057b4ab5f9c/users/5ed102e585f64369a331be11ab73dd34/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:58:35.466592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:35.467192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:35.467192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:35.513564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] MFA Rules not processed for user `5ed102e585f64369a331be11ab73dd34`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:35.515015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:35.632306 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1361/2761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:35.651381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:35.653747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:35.782900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1036f-fabf-4ca6-878f-681f81a33857 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:35.789571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:35.790381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:35.790754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:35.791103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:35.865811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:35.867638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:35.888026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1401/2762] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:58:43.980327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:43.982034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:44.072972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ab4b-ca53-4494-b7ad-80e75047b2df None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:44.084512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:44.085443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:44.085725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:44.085997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] PATH_INFO: `/v3/users/730fd7f2ff9e4e96be5e412ad86bb0d8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:44.087862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=730fd7f2ff9e4e96be5e412ad86bb0d8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:44.090589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:44.188748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730fd7f2ff9e4e96be5e412ad86bb0d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.192417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730fd7f2ff9e4e96be5e412ad86bb0d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.227131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730fd7f2ff9e4e96be5e412ad86bb0d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.229316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730fd7f2ff9e4e96be5e412ad86bb0d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.248170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8becb78-c685-4462-a063-f0a8c4d5b091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730fd7f2ff9e4e96be5e412ad86bb0d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.290134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1362/2763] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:58:43 2022] DELETE /identity/v3/users/730fd7f2ff9e4e96be5e412ad86bb0d8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:58:44.560140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:44.573632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8652-0655-4124-84e5-9e15e961ad2b service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:44.697789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:44.699471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:44.699912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:44.700326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] PATH_INFO: `/v3/projects/bf4fe086a6e94378997756b1fc02a6c7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:44.701884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4fe086a6e94378997756b1fc02a6c7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:44.713395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:44.819823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4fe086a6e94378997756b1fc02a6c7', 'request_id': 'req-4bbf36f3-cfe0-4d26-b756-7572257d5311'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.828191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4fe086a6e94378997756b1fc02a6c7', 'request_id': 'req-4bbf36f3-cfe0-4d26-b756-7572257d5311'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.841501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4fe086a6e94378997756b1fc02a6c7', 'request_id': 'req-4bbf36f3-cfe0-4d26-b756-7572257d5311'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.864289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] The token cache is being invalidate because project bf4fe086a6e94378997756b1fc02a6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:58:44.864644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.865341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbf36f3-cfe0-4d26-b756-7572257d5311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:58:44.867218 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1402/2764] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:44 2022] DELETE /identity/v3/projects/bf4fe086a6e94378997756b1fc02a6c7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:58:44.872501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718b98a-c3ba-4ad8-ac02-d29a1850fb5f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:44.873281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718b98a-c3ba-4ad8-ac02-d29a1850fb5f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:44.873728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718b98a-c3ba-4ad8-ac02-d29a1850fb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:44.903679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f718b98a-c3ba-4ad8-ac02-d29a1850fb5f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:44.909815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f718b98a-c3ba-4ad8-ac02-d29a1850fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:45.006888 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1363/2765] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:45.015784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fffcf3-b3ac-4576-9f63-477df05b966b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.016068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fffcf3-b3ac-4576-9f63-477df05b966b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.016334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fffcf3-b3ac-4576-9f63-477df05b966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.050553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f8fffcf3-b3ac-4576-9f63-477df05b966b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:45.051799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f8fffcf3-b3ac-4576-9f63-477df05b966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:45.065220 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1403/2766] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:45.069383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718b98a-c3ba-4ad8-ac02-d29a1850fb5f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:45.082285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718b98a-c3ba-4ad8-ac02-d29a1850fb5f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:45.088279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:45.089234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.089514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.089986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.090731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:58:45.091041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:45.092666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:45.106904 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1364/2767] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:58:45.111302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fffcf3-b3ac-4576-9f63-477df05b966b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:45.123495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fffcf3-b3ac-4576-9f63-477df05b966b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:45.133720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:45.134651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.134935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.135207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.135905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:45.138588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:45.189771 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1404/2768] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:58:45 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:58:45.191028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:45.205124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc4f7-cdd7-45d6-baa8-743fb0388ab2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:45.279505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:45.280411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.280765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.281168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.282129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:45.285025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:45.324620 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1365/2769] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:58:45 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:58:45.328482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:45.343659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb19b0-33e2-43c6-96f7-9efc8ec4f441 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:45.355318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:45.357557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.357892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.358174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.359635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:45.363041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:45.387953 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1405/2770] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:58:45.389266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:45.406104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21890-5f1c-4f46-a375-014bc3ec84e6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:45.418903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee47c8-8dce-4bdf-bdc7-9923fff75aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:45.419157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee47c8-8dce-4bdf-bdc7-9923fff75aed admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.419541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee47c8-8dce-4bdf-bdc7-9923fff75aed admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.420046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee47c8-8dce-4bdf-bdc7-9923fff75aed admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.422163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee47c8-8dce-4bdf-bdc7-9923fff75aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:45.424073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee47c8-8dce-4bdf-bdc7-9923fff75aed admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:45.447049 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1366/2771] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:58:45.449322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:45.464219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa64eb-a566-42b0-8401-cf7bb3657e39 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:45.470926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:45.482618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.482950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.485933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] PATH_INFO: `/v3/projects/b70c13d77d304aa69f4eeb95e037ea4b/users/d26f77ab87bf4c67ac3513a2f62056f4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.536729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70c13d77d304aa69f4eeb95e037ea4b, user_id=d26f77ab87bf4c67ac3513a2f62056f4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:45.547269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:45.590724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07473044-0f14-49df-9673-465f84faff3c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.591018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07473044-0f14-49df-9673-465f84faff3c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.591295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07473044-0f14-49df-9673-465f84faff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.596926 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1406/2772] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:58:45 2022] PUT /identity/v3/projects/b70c13d77d304aa69f4eeb95e037ea4b/users/d26f77ab87bf4c67ac3513a2f62056f4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:58:45.649791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-07473044-0f14-49df-9673-465f84faff3c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:45.650891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-07473044-0f14-49df-9673-465f84faff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:45.779933 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1367/2773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:45.806215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:45.808550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:45.898611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c77a9-90f7-41d0-8f02-8eb44d8333f0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:45.904022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f54aa-68b5-4ef7-a616-4c02e34090d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:45.904784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f54aa-68b5-4ef7-a616-4c02e34090d6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:45.905376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f54aa-68b5-4ef7-a616-4c02e34090d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:45.905731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f54aa-68b5-4ef7-a616-4c02e34090d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:45.924078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f54aa-68b5-4ef7-a616-4c02e34090d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:45.927517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f54aa-68b5-4ef7-a616-4c02e34090d6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:45.956085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1407/2774] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:58:47.623933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:47.624539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:47.624539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:47.653697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] MFA Rules not processed for user `d26f77ab87bf4c67ac3513a2f62056f4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:47.654933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:47.745327 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1368/2775] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:47.825638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc772df-1f5c-4e29-a071-b5b3d0d4cd9b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:47.826255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc772df-1f5c-4e29-a071-b5b3d0d4cd9b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:47.826362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc772df-1f5c-4e29-a071-b5b3d0d4cd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:47.855644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-adc772df-1f5c-4e29-a071-b5b3d0d4cd9b None None] MFA Rules not processed for user `d26f77ab87bf4c67ac3513a2f62056f4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:47.857415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-adc772df-1f5c-4e29-a071-b5b3d0d4cd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:47.867370 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1408/2776] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:48.084680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:48.086280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:48.177995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a0ec7-52f5-40c8-9810-bcf1fb3e8b34 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:48.192046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:48.192891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:48.193285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:48.193626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:48.206004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:48.207873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:48.237267 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1369/2777] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:58:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:58:56.904014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:56.904618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:56.904618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:56.937449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:58:56.938709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:57.081587 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1409/2778] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:58:57.130893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:58:57.132578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:58:57.281571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad174-c388-40b2-84dd-4b0c7e0e5bdb service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:58:57.290942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:58:57.291986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:58:57.292597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:58:57.292964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:58:57.313473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:58:57.313473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:58:57.329472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1370/2779] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 20:58:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 20:59:00.031026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:00.032603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:00.055748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937110b7-fff7-434e-8386-05957bf6f1aa None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:00.063346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:00.064886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:00.066446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:00.067154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] PATH_INFO: `/v3/users/2d51c9bfc0124777b559e1d2cd1e2d50` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:00.069341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d51c9bfc0124777b559e1d2cd1e2d50)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:00.072183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:00.152471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d51c9bfc0124777b559e1d2cd1e2d50'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:00.153663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d51c9bfc0124777b559e1d2cd1e2d50'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:00.167079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d51c9bfc0124777b559e1d2cd1e2d50'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:00.186603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d51c9bfc0124777b559e1d2cd1e2d50'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:00.198598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d51c9bfc0124777b559e1d2cd1e2d50'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:00.302101 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1410/2780] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:59:00 2022] DELETE /identity/v3/users/2d51c9bfc0124777b559e1d2cd1e2d50 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:00.760956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:00.776028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c1d6-1c09-4d7e-ae01-a8d19890acb2 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:00.963081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:00.964454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:00.964831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:00.979945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] PATH_INFO: `/v3/projects/430f19ffcb28429189b8c76282d2077b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:01.015095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430f19ffcb28429189b8c76282d2077b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:01.017257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:01.243199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430f19ffcb28429189b8c76282d2077b', 'request_id': 'req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.254199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430f19ffcb28429189b8c76282d2077b', 'request_id': 'req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.285818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430f19ffcb28429189b8c76282d2077b', 'request_id': 'req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.325302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] The token cache is being invalidate because project 430f19ffcb28429189b8c76282d2077b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:59:01.325645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.326315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6a2475d3-17bd-4fb8-82ba-c2538ce3eaa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.328621 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1371/2781] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:00 2022] DELETE /identity/v3/projects/430f19ffcb28429189b8c76282d2077b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:01.337365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:01.339691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:01.363367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a7068-599a-4ce5-b22f-49744a7480db admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:01.491463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:01.492872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:01.493439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:01.493885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] PATH_INFO: `/v3/users/f4225fb3976e48d79456a0a988a399cf` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:01.495358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4225fb3976e48d79456a0a988a399cf)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:01.497669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:01.595284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4225fb3976e48d79456a0a988a399cf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.596667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4225fb3976e48d79456a0a988a399cf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.606747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4225fb3976e48d79456a0a988a399cf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.619759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4225fb3976e48d79456a0a988a399cf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.620855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4225fb3976e48d79456a0a988a399cf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:01.649931 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1411/2782] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:59:01 2022] DELETE /identity/v3/users/f4225fb3976e48d79456a0a988a399cf => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:01.828658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0596-e6de-46f2-8cef-10e9f8c65b4a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:01.829288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0596-e6de-46f2-8cef-10e9f8c65b4a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:01.829414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0596-e6de-46f2-8cef-10e9f8c65b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:01.874131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-24eb0596-e6de-46f2-8cef-10e9f8c65b4a None None] MFA Rules not processed for user `5ab294d1890047aababb87b3a865a14c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:01.875848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24eb0596-e6de-46f2-8cef-10e9f8c65b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:01.996414 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1372/2783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:02.103005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:02.105298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:02.255329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198b348-bbe6-4fe5-9c27-58de3d09a0c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:02.260006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:02.260901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:02.261494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:02.262145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] PATH_INFO: `/v3/projects/587189385a484c4abec9ab7e2da31334` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:02.263361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=587189385a484c4abec9ab7e2da31334)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:02.265338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:02.395699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587189385a484c4abec9ab7e2da31334', 'request_id': 'req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:02.403684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587189385a484c4abec9ab7e2da31334', 'request_id': 'req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:02.441490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587189385a484c4abec9ab7e2da31334', 'request_id': 'req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:02.462758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] The token cache is being invalidate because project 587189385a484c4abec9ab7e2da31334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:59:02.463458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:02.465413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2f5b8c1-66d0-4641-94b7-422b57d7e8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:02.469116 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1412/2784] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:02 2022] DELETE /identity/v3/projects/587189385a484c4abec9ab7e2da31334 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:02.474404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa342b-bc97-48f4-bc75-22dba5a0caba None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:02.475441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa342b-bc97-48f4-bc75-22dba5a0caba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:02.475966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa342b-bc97-48f4-bc75-22dba5a0caba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:02.517297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e7fa342b-bc97-48f4-bc75-22dba5a0caba None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:02.519515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e7fa342b-bc97-48f4-bc75-22dba5a0caba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:02.603203 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1373/2785] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:02.611817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56fe1-d710-4d53-81a3-ef8c16fc28d0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:02.614160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56fe1-d710-4d53-81a3-ef8c16fc28d0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:02.614696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56fe1-d710-4d53-81a3-ef8c16fc28d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:02.641599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-97a56fe1-d710-4d53-81a3-ef8c16fc28d0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:02.643217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-97a56fe1-d710-4d53-81a3-ef8c16fc28d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:02.656082 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1413/2786] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:02.659997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa342b-bc97-48f4-bc75-22dba5a0caba None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:02.674109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa342b-bc97-48f4-bc75-22dba5a0caba None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:02.681712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:02.682677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:02.683041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:02.683408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:02.684360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:59:02.685745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:02.688130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:02.706022 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1374/2787] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:59:02.708997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56fe1-d710-4d53-81a3-ef8c16fc28d0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:02.737524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56fe1-d710-4d53-81a3-ef8c16fc28d0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:02.743134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:02.743965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:02.744437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:02.744720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:02.746612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:02.748802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:02.787849 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1414/2788] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:59:02 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:02.791941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:02.824886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562af0e6-9486-486a-9166-cb020bc298fa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:02.943516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:02.944293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:02.944516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:02.944790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:02.945578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:02.948225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:03.002530 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1375/2789] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:59:02 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:59:03.003968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:03.020261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eda70a-3d01-4707-b1ca-8adc0a44914d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:03.034887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:03.036513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:03.037021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:03.037567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:03.038887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:03.042338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:03.056628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1415/2790] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:03.060509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:03.075155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0cefc-e48e-453a-bb10-d9aa8518d735 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:03.081935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c765-29c9-41a7-ada1-403d7f408e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:03.081935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c765-29c9-41a7-ada1-403d7f408e5a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:03.081935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c765-29c9-41a7-ada1-403d7f408e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:03.082325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c765-29c9-41a7-ada1-403d7f408e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:03.083493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c765-29c9-41a7-ada1-403d7f408e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:03.086134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c765-29c9-41a7-ada1-403d7f408e5a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:03.102810 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1376/2791] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:03.107086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:03.120453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc7e68-7a36-4aee-83ca-32c98e065e03 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:03.129440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:03.131648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:03.131995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:03.132375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] PATH_INFO: `/v3/projects/ec2105ae605c434997f70f4a73db5a43/users/d031b85738c24fcdbfe3f4c8d8b11057/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:03.177751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2105ae605c434997f70f4a73db5a43, user_id=d031b85738c24fcdbfe3f4c8d8b11057, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:03.182446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:03.214513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1416/2792] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:03 2022] PUT /identity/v3/projects/ec2105ae605c434997f70f4a73db5a43/users/d031b85738c24fcdbfe3f4c8d8b11057/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:59:03.225381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c2e6-ff48-4ace-af67-433d732007f2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:03.225708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c2e6-ff48-4ace-af67-433d732007f2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:03.226270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c2e6-ff48-4ace-af67-433d732007f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:03.287273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4771c2e6-ff48-4ace-af67-433d732007f2 None None] MFA Rules not processed for user `d031b85738c24fcdbfe3f4c8d8b11057`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:03.288946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4771c2e6-ff48-4ace-af67-433d732007f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:03.472903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:03.480045 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1377/2793] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:03.626694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24d581-7537-443a-9676-391fb995dd0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:03.641963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:03.642680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:03.642984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:03.643261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:03.645003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:03.651025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:03.735829 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1417/2794] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:59:03 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:03.737680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c2e6-ff48-4ace-af67-433d732007f2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:03.751815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c2e6-ff48-4ace-af67-433d732007f2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:03.853243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:03.854087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:03.854796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:03.856499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:03.857356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:03.866696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:03.905807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1378/2795] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:59:03 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:59:03.910510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:03.936183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107929ad-cd41-4c2d-8d0d-f50896dcc096 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:03.954281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:03.957255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:03.959525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:03.960236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:03.961474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:03.974019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:03.987715 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1418/2796] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:03.992239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:04.018968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b568ea-5e8b-4f1e-8c1f-f94b8615e2e9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:04.053746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:04.054616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:04.055033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:04.055317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] PATH_INFO: `/v3/projects/2cc714aa4fc7490baf36f98b0400b076/users/329ba0731c8b44c1a5cb07b8834da499/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:04.105623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc714aa4fc7490baf36f98b0400b076, user_id=329ba0731c8b44c1a5cb07b8834da499, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:04.108520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:04.131341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1379/2797] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:03 2022] PUT /identity/v3/projects/2cc714aa4fc7490baf36f98b0400b076/users/329ba0731c8b44c1a5cb07b8834da499/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:04.138224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:04.153793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe0cf-e1c3-40bd-b162-77b031d73cf2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:04.266542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c780b-0a83-4e1f-81ef-9acd4854a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:04.267309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c780b-0a83-4e1f-81ef-9acd4854a56f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:04.267525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c780b-0a83-4e1f-81ef-9acd4854a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:04.267784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c780b-0a83-4e1f-81ef-9acd4854a56f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:04.268517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c780b-0a83-4e1f-81ef-9acd4854a56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:04.271013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c780b-0a83-4e1f-81ef-9acd4854a56f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:04.285530 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1419/2798] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:04.289075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:04.313993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43dc2a-2051-495e-b651-255e27a4c475 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:04.322585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:04.323991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:04.324456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:04.327876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] PATH_INFO: `/v3/projects/2cc714aa4fc7490baf36f98b0400b076/users/329ba0731c8b44c1a5cb07b8834da499/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:04.331056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc714aa4fc7490baf36f98b0400b076, user_id=329ba0731c8b44c1a5cb07b8834da499, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:04.339765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:04.354788 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1380/2799] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:04 2022] PUT /identity/v3/projects/2cc714aa4fc7490baf36f98b0400b076/users/329ba0731c8b44c1a5cb07b8834da499/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:59:04.369368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e69f-b034-4946-82b5-058410d1a340 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:04.369952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e69f-b034-4946-82b5-058410d1a340 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:04.370506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e69f-b034-4946-82b5-058410d1a340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:04.430404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-95c1e69f-b034-4946-82b5-058410d1a340 None None] MFA Rules not processed for user `329ba0731c8b44c1a5cb07b8834da499`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:04.432059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-95c1e69f-b034-4946-82b5-058410d1a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:04.670437 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1420/2800] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:04.676486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:04.678132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:04.882597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462c0a6-ae41-478f-b558-07c72c6caaca admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:04.989383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b42e04-89de-4451-9b6f-9f76b5f3f511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:04.990172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42e04-89de-4451-9b6f-9f76b5f3f511 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:04.991843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42e04-89de-4451-9b6f-9f76b5f3f511 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:04.991843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42e04-89de-4451-9b6f-9f76b5f3f511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:05.017565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b42e04-89de-4451-9b6f-9f76b5f3f511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:05.019978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b42e04-89de-4451-9b6f-9f76b5f3f511 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:05.046105 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1381/2801] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:05.126346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e69f-b034-4946-82b5-058410d1a340 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:05.146510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e69f-b034-4946-82b5-058410d1a340 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:05.153491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62849888-093a-4593-a12d-b3b042df89be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:05.153910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62849888-093a-4593-a12d-b3b042df89be service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:05.154187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62849888-093a-4593-a12d-b3b042df89be service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:05.154455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62849888-093a-4593-a12d-b3b042df89be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:05.251067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62849888-093a-4593-a12d-b3b042df89be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:05.252812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62849888-093a-4593-a12d-b3b042df89be service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:05.297018 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1421/2802] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:08.725272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719680e-d1aa-42f0-9a2f-c8eb2ad30883 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:08.726430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719680e-d1aa-42f0-9a2f-c8eb2ad30883 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:08.726430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719680e-d1aa-42f0-9a2f-c8eb2ad30883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:08.838548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c719680e-d1aa-42f0-9a2f-c8eb2ad30883 None None] MFA Rules not processed for user `0bcc50583d0c4b9aa9d9c9b7ad87a576`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:08.841016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c719680e-d1aa-42f0-9a2f-c8eb2ad30883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:08.900082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62849888-093a-4593-a12d-b3b042df89be service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:09.112778 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1382/2803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:09.127672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62849888-093a-4593-a12d-b3b042df89be service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:09.140314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:09.141695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:09.142212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:09.142705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] PATH_INFO: `/v3/users/d031b85738c24fcdbfe3f4c8d8b11057` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:09.150862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d031b85738c24fcdbfe3f4c8d8b11057)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:09.153393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:09.273710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd031b85738c24fcdbfe3f4c8d8b11057'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:09.278689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd031b85738c24fcdbfe3f4c8d8b11057'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:09.307780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd031b85738c24fcdbfe3f4c8d8b11057'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:09.501483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd031b85738c24fcdbfe3f4c8d8b11057'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:09.509935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd031b85738c24fcdbfe3f4c8d8b11057'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:09.586746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1422/2804] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:59:08 2022] DELETE /identity/v3/users/d031b85738c24fcdbfe3f4c8d8b11057 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:09.602606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:09.603229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:09.603662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:09.648297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:09.649833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:09.799511 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1383/2805] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:09.834577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:09.837962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:10.002614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b212852-2251-4c18-9179-ec93b1a39e21 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:10.016582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:10.017696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:10.018037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:10.018379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:10.042822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:10.044790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:10.072839 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1423/2806] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:11.871133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:11.872758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:11.940164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eea37b-b78d-4fd5-92b5-290055b76d3a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:11.961702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:11.962548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:11.963016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:11.963446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] PATH_INFO: `/v3/projects/ec2105ae605c434997f70f4a73db5a43` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:11.965324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2105ae605c434997f70f4a73db5a43)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:11.968399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:12.073251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2105ae605c434997f70f4a73db5a43', 'request_id': 'req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.080533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2105ae605c434997f70f4a73db5a43', 'request_id': 'req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.101010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2105ae605c434997f70f4a73db5a43', 'request_id': 'req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.129529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] The token cache is being invalidate because project ec2105ae605c434997f70f4a73db5a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:59:12.131446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.133124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.139319 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1384/2807] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:11 2022] DELETE /identity/v3/projects/ec2105ae605c434997f70f4a73db5a43 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:12.140530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:12.151784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e575-f403-419d-bcc2-02b1890449ae service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:12.218807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:12.219998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:12.220590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:12.221157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] PATH_INFO: `/v3/users/329ba0731c8b44c1a5cb07b8834da499` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:12.222656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] RBAC: Authorizing `identity:delete_user(user_id=329ba0731c8b44c1a5cb07b8834da499)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:12.225337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:12.286248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '329ba0731c8b44c1a5cb07b8834da499'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.287236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '329ba0731c8b44c1a5cb07b8834da499'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.294620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '329ba0731c8b44c1a5cb07b8834da499'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.307955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '329ba0731c8b44c1a5cb07b8834da499'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.308582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50760d4e-5e88-4fef-910b-b41359ac546b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '329ba0731c8b44c1a5cb07b8834da499'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:12.330356 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1424/2808] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:59:12 2022] DELETE /identity/v3/users/329ba0731c8b44c1a5cb07b8834da499 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:13.630176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:13.631725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:13.668568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c85b1b-bc6d-4e35-9d88-1b47d391e5e9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:13.878691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:13.881824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:13.882401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:13.884138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] PATH_INFO: `/v3/projects/2cc714aa4fc7490baf36f98b0400b076` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:13.886523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc714aa4fc7490baf36f98b0400b076)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:13.890504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:14.003377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc714aa4fc7490baf36f98b0400b076', 'request_id': 'req-b50b02ad-028f-4039-8d13-1bdf65468b22'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:14.017015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc714aa4fc7490baf36f98b0400b076', 'request_id': 'req-b50b02ad-028f-4039-8d13-1bdf65468b22'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:14.039390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc714aa4fc7490baf36f98b0400b076', 'request_id': 'req-b50b02ad-028f-4039-8d13-1bdf65468b22'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:14.056895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] The token cache is being invalidate because project 2cc714aa4fc7490baf36f98b0400b076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:59:14.059439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:14.061564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b50b02ad-028f-4039-8d13-1bdf65468b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:14.064643 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1385/2809] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:13 2022] DELETE /identity/v3/projects/2cc714aa4fc7490baf36f98b0400b076 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:14.070146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455089c4-1db7-40a6-9122-25ae4ed6c533 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.070641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455089c4-1db7-40a6-9122-25ae4ed6c533 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.070727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455089c4-1db7-40a6-9122-25ae4ed6c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.098089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-455089c4-1db7-40a6-9122-25ae4ed6c533 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:14.099636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-455089c4-1db7-40a6-9122-25ae4ed6c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:14.186480 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1425/2810] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:14.194257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c99e-88d9-4139-91e6-a25cf9e8dd3a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.194888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c99e-88d9-4139-91e6-a25cf9e8dd3a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.195392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c99e-88d9-4139-91e6-a25cf9e8dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.237065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fba3c99e-88d9-4139-91e6-a25cf9e8dd3a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:14.240514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fba3c99e-88d9-4139-91e6-a25cf9e8dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:14.263793 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1386/2811] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:14.268278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455089c4-1db7-40a6-9122-25ae4ed6c533 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:14.280421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455089c4-1db7-40a6-9122-25ae4ed6c533 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:14.298558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:14.299332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.299615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.300199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.301308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:59:14.301497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:14.304538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:14.346903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c99e-88d9-4139-91e6-a25cf9e8dd3a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:14.353600 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1426/2812] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:59:14.375406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c99e-88d9-4139-91e6-a25cf9e8dd3a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:14.393391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:14.394373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.395532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.396276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.397831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:14.400913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:14.486702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1387/2813] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:59:14 2022] POST /identity/v3/projects => generated 393 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:59:14.487060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:14.502169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995369f8-22cd-476b-bfd5-cc034849e7ce admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:14.658525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:14.659849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.661634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.664550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.665576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:14.669504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:14.745443 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1427/2814] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:59:14 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:59:14.748832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:14.762666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bee30-9901-4fd6-8f74-8d8a7119e2ed admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:14.768126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:14.770206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.771689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.772123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.773007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:14.775031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:14.792569 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1388/2815] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:14.797787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:14.810485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc7a53-5fa9-443b-9755-a4c611e7b599 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:14.816650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d00985-2d21-4e60-935f-7391ff32bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:14.817375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d00985-2d21-4e60-935f-7391ff32bf01 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.817741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d00985-2d21-4e60-935f-7391ff32bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.818132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d00985-2d21-4e60-935f-7391ff32bf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.818993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d00985-2d21-4e60-935f-7391ff32bf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:14.821354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d00985-2d21-4e60-935f-7391ff32bf01 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:14.839285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:14.845227 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1428/2816] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:14.856734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74762757-262c-4fd3-b0e3-98bd2d471671 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:14.862188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:14.864016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.864456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.864872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] PATH_INFO: `/v3/projects/c05d52bcf4484ee6a1c3c3ad530635cc/users/1fee7dfb8164467fb81140dd70b2ec8a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.907379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05d52bcf4484ee6a1c3c3ad530635cc, user_id=1fee7dfb8164467fb81140dd70b2ec8a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:14.910134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:14.931936 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1389/2817] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:14 2022] PUT /identity/v3/projects/c05d52bcf4484ee6a1c3c3ad530635cc/users/1fee7dfb8164467fb81140dd70b2ec8a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:14.947283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c6fe8-1fc7-42ca-b8bf-e3bcff62c13c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:14.947611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c6fe8-1fc7-42ca-b8bf-e3bcff62c13c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:14.948101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c6fe8-1fc7-42ca-b8bf-e3bcff62c13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:14.980250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4c5c6fe8-1fc7-42ca-b8bf-e3bcff62c13c None None] MFA Rules not processed for user `1fee7dfb8164467fb81140dd70b2ec8a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:14.982236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4c5c6fe8-1fc7-42ca-b8bf-e3bcff62c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:15.084195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1429/2818] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:15.091750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:15.256041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff31760-d739-407d-b5d9-b1a1583b845b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:15.263866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:15.264846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:15.265370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:15.265854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:15.267195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:15.270560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:15.349799 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1390/2819] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:59:15 2022] POST /identity/v3/projects => generated 393 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:15.354421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c6fe8-1fc7-42ca-b8bf-e3bcff62c13c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:15.389998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c6fe8-1fc7-42ca-b8bf-e3bcff62c13c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:15.516732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:15.517600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:15.517975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:15.518423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:15.519359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:15.521599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:15.558016 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1430/2820] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:59:15 2022] POST /identity/v3/users => generated 303 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:15.562274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:15.574518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee0237-38f6-465e-96f4-9977f06a7f77 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:15.591985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:15.593021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:15.595755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:15.597454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:15.599498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:15.604030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:15.643062 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1391/2821] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:15.645836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:15.666745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18471-0225-4aa9-b870-ed73c3796add admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:15.681213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:15.682807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:15.683592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:15.683896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] PATH_INFO: `/v3/projects/d42010e49ea745b3a8a1af5102b2c4ad/users/e8c30b3790df4df3bb2ec6cffff862fe/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:15.724974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42010e49ea745b3a8a1af5102b2c4ad, user_id=e8c30b3790df4df3bb2ec6cffff862fe, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:15.734419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:15.790048 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1431/2822] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:15 2022] PUT /identity/v3/projects/d42010e49ea745b3a8a1af5102b2c4ad/users/e8c30b3790df4df3bb2ec6cffff862fe/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:15.790646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:15.818684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a28b1-b3b2-486e-85e2-242547b56607 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:16.022762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d775bb-2040-470e-ba9a-aff2fb931bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:16.023466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d775bb-2040-470e-ba9a-aff2fb931bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:16.023751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d775bb-2040-470e-ba9a-aff2fb931bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:16.024027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d775bb-2040-470e-ba9a-aff2fb931bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:16.024768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d775bb-2040-470e-ba9a-aff2fb931bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:16.030671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d775bb-2040-470e-ba9a-aff2fb931bc7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:16.061874 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1392/2823] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:16.066285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:16.083562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61099af9-9e4c-47a2-8582-57eaa4bae3aa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:16.105232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:16.106979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:16.107553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:16.108031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] PATH_INFO: `/v3/projects/d42010e49ea745b3a8a1af5102b2c4ad/users/e8c30b3790df4df3bb2ec6cffff862fe/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:16.110363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42010e49ea745b3a8a1af5102b2c4ad, user_id=e8c30b3790df4df3bb2ec6cffff862fe, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:16.114013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:16.139272 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1432/2824] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:16 2022] PUT /identity/v3/projects/d42010e49ea745b3a8a1af5102b2c4ad/users/e8c30b3790df4df3bb2ec6cffff862fe/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:59:16.153993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd016b4-1fad-404d-ab7f-d3dde5562ca6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:16.154277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd016b4-1fad-404d-ab7f-d3dde5562ca6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:16.154722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd016b4-1fad-404d-ab7f-d3dde5562ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:16.216126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ddd016b4-1fad-404d-ab7f-d3dde5562ca6 None None] MFA Rules not processed for user `e8c30b3790df4df3bb2ec6cffff862fe`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:16.218949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ddd016b4-1fad-404d-ab7f-d3dde5562ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:16.462800 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1393/2825] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:16.971978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:16.974454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:17.095064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323459-296f-46ca-9edf-40b357ec72db admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:17.104392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4de1-e4b2-4c0e-ae95-5a848d956964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:17.105505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4de1-e4b2-4c0e-ae95-5a848d956964 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:17.106388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4de1-e4b2-4c0e-ae95-5a848d956964 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:17.107286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4de1-e4b2-4c0e-ae95-5a848d956964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:17.123566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4de1-e4b2-4c0e-ae95-5a848d956964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:17.125336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4de1-e4b2-4c0e-ae95-5a848d956964 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:17.150123 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1433/2826] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:17.612105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd016b4-1fad-404d-ab7f-d3dde5562ca6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:17.735373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd016b4-1fad-404d-ab7f-d3dde5562ca6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:17.744515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:17.746260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:17.747029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:17.747861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] PATH_INFO: `/v3/users/1fee7dfb8164467fb81140dd70b2ec8a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:17.752109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fee7dfb8164467fb81140dd70b2ec8a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:17.756293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:17.819140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fee7dfb8164467fb81140dd70b2ec8a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:17.819878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fee7dfb8164467fb81140dd70b2ec8a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:17.827259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fee7dfb8164467fb81140dd70b2ec8a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:17.827932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fee7dfb8164467fb81140dd70b2ec8a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:17.836968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fee7dfb8164467fb81140dd70b2ec8a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:17.854382 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1394/2827] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:59:17 2022] DELETE /identity/v3/users/1fee7dfb8164467fb81140dd70b2ec8a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:59:17.858954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc819c-938c-4b53-8a0f-5d5ac48f57db None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:17.859241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc819c-938c-4b53-8a0f-5d5ac48f57db None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:17.859516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc819c-938c-4b53-8a0f-5d5ac48f57db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:17.876939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-04bc819c-938c-4b53-8a0f-5d5ac48f57db None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:17.878346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-04bc819c-938c-4b53-8a0f-5d5ac48f57db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:17.952251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1434/2828] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:17.959395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:17.961215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:18.061281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff085bf-8b21-422c-aa9e-8c44b56bc0f6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:18.070286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:18.071961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:18.074649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:18.075159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:18.099064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:18.099475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:18.099841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:18.105929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:18.110330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:18.138711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:18.139318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1395/2829] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:59:18.141150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:18.250013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1435/2830] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:59:18.257349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:18.265312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:18.378460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09a94a-afe8-4cec-8a9f-fddd579feb9c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:18.385996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:18.387021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:18.387348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:18.387625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:18.398411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:18.400116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:18.409901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1396/2831] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 20:59:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 20:59:18.795794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:18.797360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:18.844097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75756a8-6173-4255-8ed5-262dd973736c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:18.875560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:18.876789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:18.878319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:18.880384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] PATH_INFO: `/v3/projects/c05d52bcf4484ee6a1c3c3ad530635cc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:18.883716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05d52bcf4484ee6a1c3c3ad530635cc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:18.887059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:19.017602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05d52bcf4484ee6a1c3c3ad530635cc', 'request_id': 'req-b1c924d0-9229-4c1f-8785-761e1528a586'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.028346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05d52bcf4484ee6a1c3c3ad530635cc', 'request_id': 'req-b1c924d0-9229-4c1f-8785-761e1528a586'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.043613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05d52bcf4484ee6a1c3c3ad530635cc', 'request_id': 'req-b1c924d0-9229-4c1f-8785-761e1528a586'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.067761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] The token cache is being invalidate because project c05d52bcf4484ee6a1c3c3ad530635cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:59:19.068139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.069144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1c924d0-9229-4c1f-8785-761e1528a586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.071421 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1436/2832] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:18 2022] DELETE /identity/v3/projects/c05d52bcf4484ee6a1c3c3ad530635cc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:19.075710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:19.100189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2295a7-a540-4dd8-b12d-16120d80a6b1 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:19.246303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:19.251742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:19.251963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:19.252211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] PATH_INFO: `/v3/users/e8c30b3790df4df3bb2ec6cffff862fe` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:19.274493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c30b3790df4df3bb2ec6cffff862fe)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:19.278435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:19.327169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd230f6-a924-49e3-a472-bc1c4087976f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:19.327649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd230f6-a924-49e3-a472-bc1c4087976f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:19.327854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd230f6-a924-49e3-a472-bc1c4087976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:19.356588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bfd230f6-a924-49e3-a472-bc1c4087976f None None] MFA Rules not processed for user `33746e27054c4f1db976d4a4ae44e073`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:19.358394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bfd230f6-a924-49e3-a472-bc1c4087976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:19.404466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c30b3790df4df3bb2ec6cffff862fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.407132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c30b3790df4df3bb2ec6cffff862fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.422247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c30b3790df4df3bb2ec6cffff862fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.424917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c30b3790df4df3bb2ec6cffff862fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.446671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c30b3790df4df3bb2ec6cffff862fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:19.489079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1397/2833] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:59:19 2022] DELETE /identity/v3/users/e8c30b3790df4df3bb2ec6cffff862fe => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:19.489270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1437/2834] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:59:20.248208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:20.249702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:20.365757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a926-e754-4ab5-be1f-6afadf6b419c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:20.372529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:20.373896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:20.374383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:20.375128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] PATH_INFO: `/v3/projects/d42010e49ea745b3a8a1af5102b2c4ad` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:20.377512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42010e49ea745b3a8a1af5102b2c4ad)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:20.380337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:20.469484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42010e49ea745b3a8a1af5102b2c4ad', 'request_id': 'req-5f564260-dcec-4623-b303-c33ae554cd9f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:20.487765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42010e49ea745b3a8a1af5102b2c4ad', 'request_id': 'req-5f564260-dcec-4623-b303-c33ae554cd9f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:20.505991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42010e49ea745b3a8a1af5102b2c4ad', 'request_id': 'req-5f564260-dcec-4623-b303-c33ae554cd9f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:20.525454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] The token cache is being invalidate because project d42010e49ea745b3a8a1af5102b2c4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:59:20.526276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:20.527158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f564260-dcec-4623-b303-c33ae554cd9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:20.530092 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1398/2835] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:20 2022] DELETE /identity/v3/projects/d42010e49ea745b3a8a1af5102b2c4ad => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:20.535293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542f28-9793-43d2-88f8-a2e90ae3b293 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:20.535793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542f28-9793-43d2-88f8-a2e90ae3b293 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:20.535894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542f28-9793-43d2-88f8-a2e90ae3b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:20.564431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-67542f28-9793-43d2-88f8-a2e90ae3b293 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:20.566260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-67542f28-9793-43d2-88f8-a2e90ae3b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:20.692813 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1438/2836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:20.701400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09a16a-09db-4a7c-91bf-1471a6095c99 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:20.701691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09a16a-09db-4a7c-91bf-1471a6095c99 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:20.701969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09a16a-09db-4a7c-91bf-1471a6095c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:20.734153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8a09a16a-09db-4a7c-91bf-1471a6095c99 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:20.735399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8a09a16a-09db-4a7c-91bf-1471a6095c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:20.759567 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1399/2837] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:20.763776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542f28-9793-43d2-88f8-a2e90ae3b293 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:20.782515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542f28-9793-43d2-88f8-a2e90ae3b293 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:20.800363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:20.802562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:20.804361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:20.804852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:20.806425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:59:20.808184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:20.810089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:20.844248 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1439/2838] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:59:20.850385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09a16a-09db-4a7c-91bf-1471a6095c99 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:20.876249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09a16a-09db-4a7c-91bf-1471a6095c99 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:20.894262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:20.895457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:20.895457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:20.895457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:20.896899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:20.909183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:20.982423 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1400/2839] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:59:20 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:20.987744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:21.017465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8c178-c7c7-4d77-b49f-b1b94e44de2e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:21.121181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:21.124271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:21.178326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:21.181734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.182024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.182300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.185237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:21.190966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:21.246258 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1440/2840] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:59:20 2022] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:21.247497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:21.259874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466a40-4058-4e5b-9635-787819d6dc6d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:21.268654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:21.270221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.270828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.271795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] PATH_INFO: `/v3/users/d26f77ab87bf4c67ac3513a2f62056f4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.272926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a9f5c-ca23-4192-ba00-d9d016700eaa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:21.273924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26f77ab87bf4c67ac3513a2f62056f4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:21.280337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:21.284937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:21.285696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.285932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.286260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.286999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:21.292863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:21.312081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1441/2841] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:21.314704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:21.329345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad112f-59af-430a-b7f4-d365044c2b7b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:21.340782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:21.341520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.341800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.342069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.347314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:21.350701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:21.380158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26f77ab87bf4c67ac3513a2f62056f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:21.380938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26f77ab87bf4c67ac3513a2f62056f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:21.391498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1442/2842] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:21.395733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:21.404040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26f77ab87bf4c67ac3513a2f62056f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:21.405239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26f77ab87bf4c67ac3513a2f62056f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:21.412990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5960bb0-7e0a-4aba-bb8c-83339eb024e9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:21.432068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:21.434535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.434798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.435145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] PATH_INFO: `/v3/projects/23df4eef46ae4894870e050990d597f0/users/16441a7999c149ff9dd66e0b3a3a95b4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.456474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd7222c8-978a-499a-a4f9-7126751db170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26f77ab87bf4c67ac3513a2f62056f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:21.495700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1401/2843] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:59:21 2022] DELETE /identity/v3/users/d26f77ab87bf4c67ac3513a2f62056f4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:59:21.501116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23df4eef46ae4894870e050990d597f0, user_id=16441a7999c149ff9dd66e0b3a3a95b4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:21.504749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:21.530936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1443/2844] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:21 2022] PUT /identity/v3/projects/23df4eef46ae4894870e050990d597f0/users/16441a7999c149ff9dd66e0b3a3a95b4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:21.543232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fafd7-e897-4cf4-a329-d390d585db93 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.543516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fafd7-e897-4cf4-a329-d390d585db93 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.545250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fafd7-e897-4cf4-a329-d390d585db93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.593884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d67fafd7-e897-4cf4-a329-d390d585db93 None None] MFA Rules not processed for user `16441a7999c149ff9dd66e0b3a3a95b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:21.595115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d67fafd7-e897-4cf4-a329-d390d585db93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:21.787326 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1402/2845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:59:21.791618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:21.793533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:21.800548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e845980-19be-4bc2-9254-892d0ff73d8f None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.800838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e845980-19be-4bc2-9254-892d0ff73d8f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.801205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e845980-19be-4bc2-9254-892d0ff73d8f None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.809171 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1403/2846] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 20:59:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 20:59:21.810796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.811228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.811673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.865104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:21.865104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:21.975517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc20cf-2fde-41c7-86b8-611f9ede3db2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:21.988169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:21.989379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:21.990044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:21.990539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:21.991453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:21.995281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.021756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1404/2847] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:22.048231 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1444/2848] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:59:21 2022] POST /identity/v3/projects => generated 391 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 20:59:22.051733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.052986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.053979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:22.073588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6909d-e78e-4db9-bfc8-6ca23dfd9c81 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:22.174798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80236e-e03d-4aba-bb5e-d86977a5fde9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:22.195702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:22.196852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.198240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.198677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.199560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:22.201820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.263878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:22.267437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.267920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.269288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.278421 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1445/2849] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:59:22 2022] POST /identity/v3/users => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:22.282263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.306143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:22.308493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.320879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944651e9-6011-4e89-8c2d-611b3ed466e3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:22.335243 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1405/2850] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:22.335463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:22.336038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.336713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.337179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.338229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:22.340028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.366681 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1446/2851] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:22.371606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.390996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ccc6a-e27e-485a-a557-dc9fe26ab712 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:22.423716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:22.424888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.425283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.425564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] PATH_INFO: `/v3/projects/a30c4ed592af4e4e96ec1d3ccb82fd3c/users/1f4e74efd1e94b9eacf48daa7540844e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.471860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.474251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:22.504911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30c4ed592af4e4e96ec1d3ccb82fd3c, user_id=1f4e74efd1e94b9eacf48daa7540844e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:22.520402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.525595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e7b69-cdbb-4092-aba9-cc27e0710a66 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:22.539810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:22.542136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.547205 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1406/2852] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:22 2022] PUT /identity/v3/projects/a30c4ed592af4e4e96ec1d3ccb82fd3c/users/1f4e74efd1e94b9eacf48daa7540844e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:59:22.552930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.553253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.553542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] PATH_INFO: `/v3/projects/b70c13d77d304aa69f4eeb95e037ea4b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.560692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70c13d77d304aa69f4eeb95e037ea4b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:22.570851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.712130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd66fe-5800-4f8c-a6ec-894beb9bb0a6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:22.749080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70c13d77d304aa69f4eeb95e037ea4b', 'request_id': 'req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:22.772657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70c13d77d304aa69f4eeb95e037ea4b', 'request_id': 'req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:22.795998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70c13d77d304aa69f4eeb95e037ea4b', 'request_id': 'req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:22.831967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] The token cache is being invalidate because project b70c13d77d304aa69f4eeb95e037ea4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 20:59:22.832258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:22.834283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8a56d4c-5ef4-4633-a38b-89c7c19b010f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 20:59:22.850735 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1447/2853] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:22 2022] DELETE /identity/v3/projects/b70c13d77d304aa69f4eeb95e037ea4b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:22.856909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0104d65-304d-4f75-87e9-7fee38a066d6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.858028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0104d65-304d-4f75-87e9-7fee38a066d6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.858462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0104d65-304d-4f75-87e9-7fee38a066d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.891652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f0104d65-304d-4f75-87e9-7fee38a066d6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:22.893213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0104d65-304d-4f75-87e9-7fee38a066d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:22.895891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:22.896600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.896872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.897162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.897894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:22.901455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.905661 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1448/2854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:22.913899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f284d4-e6ca-4943-b49a-04364848895b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.915318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f284d4-e6ca-4943-b49a-04364848895b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.915822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f284d4-e6ca-4943-b49a-04364848895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.928732 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1407/2855] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:22.931550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.943813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:22.951345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-54f284d4-e6ca-4943-b49a-04364848895b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:22.956580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-54f284d4-e6ca-4943-b49a-04364848895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:22.957583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8769db-d5b4-4a13-bac3-768f7c82488c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:22.967535 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1449/2856] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:22.972515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35bc6f-d148-4c8b-af60-4220524fd758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:22.974213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f284d4-e6ca-4943-b49a-04364848895b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:22.976233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bc6f-d148-4c8b-af60-4220524fd758 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:22.976735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bc6f-d148-4c8b-af60-4220524fd758 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:22.977233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bc6f-d148-4c8b-af60-4220524fd758 admin admin] PATH_INFO: `/v3/projects/a30c4ed592af4e4e96ec1d3ccb82fd3c/users/1f4e74efd1e94b9eacf48daa7540844e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:22.983066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35bc6f-d148-4c8b-af60-4220524fd758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30c4ed592af4e4e96ec1d3ccb82fd3c, user_id=1f4e74efd1e94b9eacf48daa7540844e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:22.992764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35bc6f-d148-4c8b-af60-4220524fd758 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:22.997632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f284d4-e6ca-4943-b49a-04364848895b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:23.010325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:23.016121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.016514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.017721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.019111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 20:59:23.019419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:23.025482 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1408/2857] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:22 2022] PUT /identity/v3/projects/a30c4ed592af4e4e96ec1d3ccb82fd3c/users/1f4e74efd1e94b9eacf48daa7540844e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 20:59:23.025761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:23.048370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4c22-0d98-4ec7-ace9-39946b39cdb7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.048666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4c22-0d98-4ec7-ace9-39946b39cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.048944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4c22-0d98-4ec7-ace9-39946b39cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.085028 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1450/2858] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 20:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 20:59:23.087793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:23.116956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0c2f-86ae-488c-b6fa-efd43dd88d90 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:23.131109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5ffd4c22-0d98-4ec7-ace9-39946b39cdb7 None None] MFA Rules not processed for user `1f4e74efd1e94b9eacf48daa7540844e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:23.134903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5ffd4c22-0d98-4ec7-ace9-39946b39cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:23.282493 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1409/2859] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:23.286302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454c77-0893-432c-87ec-aaa86024109d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.286591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454c77-0893-432c-87ec-aaa86024109d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.287431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454c77-0893-432c-87ec-aaa86024109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.322563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-06454c77-0893-432c-87ec-aaa86024109d None None] MFA Rules not processed for user `16441a7999c149ff9dd66e0b3a3a95b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:23.323727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-06454c77-0893-432c-87ec-aaa86024109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:23.327282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:23.328442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.329372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.330989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.331955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:23.341342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:23.416117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1451/2860] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 20:59:23 2022] POST /identity/v3/projects => generated 389 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:23.419923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:23.463617 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1410/2861] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:59:23.480206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454c77-0893-432c-87ec-aaa86024109d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:23.482630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-06454c77-0893-432c-87ec-aaa86024109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:23.518230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e28bd-0c8d-4976-a486-f03876c3d4c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:23.529174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:23.530105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.530391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.530662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.531365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:23.533436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:23.583223 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1452/2862] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 20:59:23 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 20:59:23.584480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:23.612167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d29c7-b801-4275-a30c-1c370b752b37 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:23.627393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:23.628187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.628474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.628742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.630461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:23.632064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:23.678526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454c77-0893-432c-87ec-aaa86024109d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:23.689836 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1453/2863] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 20:59:23.707768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:23.721876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eb2d8-e807-462b-83e1-8c378b4a614a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:23.729180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:23.730308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.730594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.730988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.731706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:23.749205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:23.783564 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1454/2864] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 20:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 20:59:23.785066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:23.809247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8db6-86eb-4bb5-80b7-f8c32014171f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:23.824537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6fc4b-7d6e-44fb-8203-48d78a65031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:23.825573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6fc4b-7d6e-44fb-8203-48d78a65031d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.825788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6fc4b-7d6e-44fb-8203-48d78a65031d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.826065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6fc4b-7d6e-44fb-8203-48d78a65031d admin admin] PATH_INFO: `/v3/projects/3389a4f6db1e4cd7b183da2c7e6a4850/users/570ad335e35d460fa3fa337374a5a431/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.854360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6fc4b-7d6e-44fb-8203-48d78a65031d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3389a4f6db1e4cd7b183da2c7e6a4850, user_id=570ad335e35d460fa3fa337374a5a431, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:23.857936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6fc4b-7d6e-44fb-8203-48d78a65031d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:23.893867 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1455/2865] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 20:59:23 2022] PUT /identity/v3/projects/3389a4f6db1e4cd7b183da2c7e6a4850/users/570ad335e35d460fa3fa337374a5a431/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 20:59:23.899106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.899407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.899686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.918818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d795-18c2-47e9-90d4-430569e4f9bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:23.919238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d795-18c2-47e9-90d4-430569e4f9bc service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:23.919632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d795-18c2-47e9-90d4-430569e4f9bc service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:23.920005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d795-18c2-47e9-90d4-430569e4f9bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:23.923431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:23.924789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:23.925880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c700d795-18c2-47e9-90d4-430569e4f9bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:23.999656 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1456/2866] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 20:59:24.032090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:24.042035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:24.093233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d795-18c2-47e9-90d4-430569e4f9bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:24.094898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d795-18c2-47e9-90d4-430569e4f9bc service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:24.132201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1411/2867] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:24.200503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c311-8452-4dd0-9611-6fe78cc9d049 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:24.204653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e476a03-1a72-419b-afc7-116d7352acb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:24.205793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e476a03-1a72-419b-afc7-116d7352acb6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:24.206099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e476a03-1a72-419b-afc7-116d7352acb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:24.206391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e476a03-1a72-419b-afc7-116d7352acb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:24.227932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e476a03-1a72-419b-afc7-116d7352acb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:24.230315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e476a03-1a72-419b-afc7-116d7352acb6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:24.244952 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1457/2868] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 20:59:26.229941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:26.230425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:26.230731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:26.290623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] MFA Rules not processed for user `570ad335e35d460fa3fa337374a5a431`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:26.292658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:26.416651 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1412/2869] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:26.427907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04290d-51e4-4b2d-926c-f2f74a2b2f21 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:26.428484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04290d-51e4-4b2d-926c-f2f74a2b2f21 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:26.428484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04290d-51e4-4b2d-926c-f2f74a2b2f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:26.446431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ba04290d-51e4-4b2d-926c-f2f74a2b2f21 None None] MFA Rules not processed for user `570ad335e35d460fa3fa337374a5a431`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:26.447857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ba04290d-51e4-4b2d-926c-f2f74a2b2f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:26.456862 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1458/2870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:26.468320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:26.469819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:26.580476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc718538-2267-471e-afbe-2ef3378fe361 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:26.604658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66384f30-2c52-442e-85c6-a29b3c301e95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:26.605615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66384f30-2c52-442e-85c6-a29b3c301e95 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:26.606150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66384f30-2c52-442e-85c6-a29b3c301e95 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:26.606516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66384f30-2c52-442e-85c6-a29b3c301e95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:26.616117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66384f30-2c52-442e-85c6-a29b3c301e95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:26.617884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66384f30-2c52-442e-85c6-a29b3c301e95 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:26.628562 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1413/2871] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:27.733517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c43ff-c219-4e8b-8e76-2e3fb2d587c4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:27.733986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c43ff-c219-4e8b-8e76-2e3fb2d587c4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:27.734221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c43ff-c219-4e8b-8e76-2e3fb2d587c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:27.754012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a91c43ff-c219-4e8b-8e76-2e3fb2d587c4 None None] MFA Rules not processed for user `c3f004d8412d43d7a82f7daa56f47305`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:27.755373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a91c43ff-c219-4e8b-8e76-2e3fb2d587c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:27.817103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1459/2872] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:27.822955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b21413-a6be-497b-8a2f-9f0adce85fe2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:27.823502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b21413-a6be-497b-8a2f-9f0adce85fe2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:27.823745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b21413-a6be-497b-8a2f-9f0adce85fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:27.841962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e6b21413-a6be-497b-8a2f-9f0adce85fe2 None None] MFA Rules not processed for user `c3f004d8412d43d7a82f7daa56f47305`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:27.843176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e6b21413-a6be-497b-8a2f-9f0adce85fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:27.850429 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1414/2873] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:42.125451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c43ff-c219-4e8b-8e76-2e3fb2d587c4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:42.138312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c43ff-c219-4e8b-8e76-2e3fb2d587c4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:42.143878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b68d5-a874-41ad-a53d-5ff7d4ed7a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:42.144650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b68d5-a874-41ad-a53d-5ff7d4ed7a06 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:42.144989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b68d5-a874-41ad-a53d-5ff7d4ed7a06 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:42.145362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b68d5-a874-41ad-a53d-5ff7d4ed7a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:42.208492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b68d5-a874-41ad-a53d-5ff7d4ed7a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:42.210623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b68d5-a874-41ad-a53d-5ff7d4ed7a06 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:42.224647 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1460/2874] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:42.257543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b669c0b-1b78-48d6-85e0-7c4c63ff3833 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:42.258405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b669c0b-1b78-48d6-85e0-7c4c63ff3833 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:42.258917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b669c0b-1b78-48d6-85e0-7c4c63ff3833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:42.285367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5b669c0b-1b78-48d6-85e0-7c4c63ff3833 None None] MFA Rules not processed for user `16441a7999c149ff9dd66e0b3a3a95b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:42.286811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5b669c0b-1b78-48d6-85e0-7c4c63ff3833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:42.402237 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1415/2875] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:46.000821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3ef2-e0cf-468b-827b-358e372e94d9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:46.001334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3ef2-e0cf-468b-827b-358e372e94d9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:46.001420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3ef2-e0cf-468b-827b-358e372e94d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:46.041371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7fbd3ef2-e0cf-468b-827b-358e372e94d9 None None] MFA Rules not processed for user `9c775742dfc04cec8559f9e4d13239b0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:46.042620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7fbd3ef2-e0cf-468b-827b-358e372e94d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:46.143519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1461/2876] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 20:59:58.410659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b669c0b-1b78-48d6-85e0-7c4c63ff3833 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 20:59:58.429092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b669c0b-1b78-48d6-85e0-7c4c63ff3833 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 20:59:58.433572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 20:59:58.434548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:58.441482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:58.441956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:58.444933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:58.467119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 20:59:58.468738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 20:59:58.485368 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1416/2877] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 20:59:59.567386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d46d-074b-417c-9684-585f69c64596 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 20:59:59.568384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d46d-074b-417c-9684-585f69c64596 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 20:59:59.569229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d46d-074b-417c-9684-585f69c64596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 20:59:59.610429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9461d46d-074b-417c-9684-585f69c64596 None None] MFA Rules not processed for user `ceba42e80d7746e4897669084c078c09`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 20:59:59.611965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9461d46d-074b-417c-9684-585f69c64596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 20:59:59.683673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1462/2878] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:04.171583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:04.189831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afe01d-f04a-4963-8f45-da9c19e8e0e7 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:04.197588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:04.201244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:04.202905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:04.204243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:04.217817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:04.239908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:04.242686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:04.265542 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1417/2879] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:14.789746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d46d-074b-417c-9684-585f69c64596 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:14.800761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d46d-074b-417c-9684-585f69c64596 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:14.804472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:14.805459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:14.805636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:14.806073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:14.808894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:14.825638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:14.827117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:14.835652 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1463/2880] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:16.732251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:16.750916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a0fbc-2e54-4bbc-85b0-a086be1a9060 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:16.756775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:16.757963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:16.758238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:16.758508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] PATH_INFO: `/v3/users/570ad335e35d460fa3fa337374a5a431` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:16.759759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=570ad335e35d460fa3fa337374a5a431)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:16.762316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:16.820261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570ad335e35d460fa3fa337374a5a431'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:16.821254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570ad335e35d460fa3fa337374a5a431'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:16.831484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570ad335e35d460fa3fa337374a5a431'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:16.832934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570ad335e35d460fa3fa337374a5a431'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:16.843173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23ac6b32-46b7-4e30-b330-f76705fa4570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570ad335e35d460fa3fa337374a5a431'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:16.870789 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1418/2881] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:00:16 2022] DELETE /identity/v3/users/570ad335e35d460fa3fa337374a5a431 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:17.120851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.140433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe19b2-e77c-4be1-a4e4-624796f2659b service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:17.208260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:17.209584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.209870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.210187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] PATH_INFO: `/v3/projects/3389a4f6db1e4cd7b183da2c7e6a4850` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.211907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3389a4f6db1e4cd7b183da2c7e6a4850)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:17.213990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:17.272612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3389a4f6db1e4cd7b183da2c7e6a4850', 'request_id': 'req-2ca4dab7-6d74-4060-876b-9917aaff02c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:17.278288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3389a4f6db1e4cd7b183da2c7e6a4850', 'request_id': 'req-2ca4dab7-6d74-4060-876b-9917aaff02c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:17.288491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3389a4f6db1e4cd7b183da2c7e6a4850', 'request_id': 'req-2ca4dab7-6d74-4060-876b-9917aaff02c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:17.302455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] The token cache is being invalidate because project 3389a4f6db1e4cd7b183da2c7e6a4850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:00:17.302759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:17.303390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ca4dab7-6d74-4060-876b-9917aaff02c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:17.305393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1464/2882] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:17 2022] DELETE /identity/v3/projects/3389a4f6db1e4cd7b183da2c7e6a4850 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:17.310461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5052-608b-42ab-9aee-1d00e0b19a66 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.310818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5052-608b-42ab-9aee-1d00e0b19a66 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.311305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5052-608b-42ab-9aee-1d00e0b19a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.330090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-49fd5052-608b-42ab-9aee-1d00e0b19a66 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:17.331547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-49fd5052-608b-42ab-9aee-1d00e0b19a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:17.388577 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1419/2883] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:00:17.396574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d619cb-ec90-4362-81bb-1f73cbb78a9e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.396894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d619cb-ec90-4362-81bb-1f73cbb78a9e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.397293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d619cb-ec90-4362-81bb-1f73cbb78a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.415731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e7d619cb-ec90-4362-81bb-1f73cbb78a9e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:17.416956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e7d619cb-ec90-4362-81bb-1f73cbb78a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:17.426138 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1465/2884] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:17.430728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd5052-608b-42ab-9aee-1d00e0b19a66 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.440681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd5052-608b-42ab-9aee-1d00e0b19a66 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:17.445690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:17.446366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.446646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.446907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.447649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:00:17.447956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:17.449612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:17.466064 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1420/2885] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:00:17.466453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d619cb-ec90-4362-81bb-1f73cbb78a9e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.496327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d619cb-ec90-4362-81bb-1f73cbb78a9e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:17.506662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:17.507355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.507634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.507905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.508600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:17.510601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:17.543659 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1466/2886] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:00:17 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:00:17.547385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.560337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20246-0d2d-4312-9005-a239a803e167 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:17.644790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:17.645598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.645945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.646699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.647208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:17.649404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:17.680124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1421/2887] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:00:17 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:00:17.681783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.693183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257632a-40b2-4a75-8e46-411f5ae7629e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:17.700388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:17.701360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.701830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.702290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.703683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:17.705797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:17.722054 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1467/2888] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:17.725834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.739298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab41721-b339-4f9c-bc5b-54e0c5f0b71a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:17.745471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd557f3-9ddb-4c5a-b302-d0c67d7f9c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:17.746558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd557f3-9ddb-4c5a-b302-d0c67d7f9c93 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.746839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd557f3-9ddb-4c5a-b302-d0c67d7f9c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.747109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd557f3-9ddb-4c5a-b302-d0c67d7f9c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.747838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd557f3-9ddb-4c5a-b302-d0c67d7f9c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:17.749477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd557f3-9ddb-4c5a-b302-d0c67d7f9c93 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:17.766002 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1422/2889] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:17.767025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.783431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529c80f-35a3-458a-ac0f-f3c1b2f08e48 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:17.789790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:17.790762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.791372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.792113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] PATH_INFO: `/v3/projects/8584541985ac44cc923c89a5a518ec32/users/08995e63d5ec446bbcf643822d5f37c7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.819091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8584541985ac44cc923c89a5a518ec32, user_id=08995e63d5ec446bbcf643822d5f37c7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:17.821999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:17.840506 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1468/2890] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:00:17 2022] PUT /identity/v3/projects/8584541985ac44cc923c89a5a518ec32/users/08995e63d5ec446bbcf643822d5f37c7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:17.846070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d7e1b-1468-47a3-8193-76c22a75b6c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:17.846382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d7e1b-1468-47a3-8193-76c22a75b6c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:17.846661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d7e1b-1468-47a3-8193-76c22a75b6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:17.866436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f69d7e1b-1468-47a3-8193-76c22a75b6c0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:17.867719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f69d7e1b-1468-47a3-8193-76c22a75b6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:17.945390 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1423/2891] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:17.959455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:17.962325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:18.023600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1cc72-21a2-4763-95b8-2471cd89b7c2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:18.035736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:18.036684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:18.037079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:18.037452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:18.041266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf0452-b41f-4683-be52-640f79a42a46 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:18.041563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf0452-b41f-4683-be52-640f79a42a46 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:18.041891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf0452-b41f-4683-be52-640f79a42a46 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:18.043355 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1424/2892] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:00:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:00:18.049104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bed11-901b-4c0a-b82c-cb4d5be8d6f4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:18.049250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:18.049380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bed11-901b-4c0a-b82c-cb4d5be8d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:18.049662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bed11-901b-4c0a-b82c-cb4d5be8d6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:18.051467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:18.062451 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1469/2893] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:00:18.069266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bf8bed11-901b-4c0a-b82c-cb4d5be8d6f4 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:18.070543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bf8bed11-901b-4c0a-b82c-cb4d5be8d6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:18.136120 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1425/2894] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:00:18.157673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:18.159219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:18.174640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4059-185d-4da9-acf1-02f12d9a3406 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:18.180041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:18.180784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:18.181098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:18.181375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:18.190303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:18.191914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:18.201874 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1470/2895] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:18.873955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:18.874446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:18.875261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:18.893837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:18.895701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:18.967441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1426/2896] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:19.029550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:19.030999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:19.109189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b893f-19a9-4d35-ad2a-e5ae95f034f4 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:19.115869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e313da7-5af3-4572-8fbe-9e59d0b9b3f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:19.116656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313da7-5af3-4572-8fbe-9e59d0b9b3f1 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:19.117010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313da7-5af3-4572-8fbe-9e59d0b9b3f1 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:19.117427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313da7-5af3-4572-8fbe-9e59d0b9b3f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:19.126565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e313da7-5af3-4572-8fbe-9e59d0b9b3f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:19.128764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e313da7-5af3-4572-8fbe-9e59d0b9b3f1 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:19.137682 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1471/2897] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:24.516776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:24.518854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:24.544888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243218d-114e-4847-8ac4-8c4663077a67 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:24.565168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:24.566409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:24.571968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:24.572436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] PATH_INFO: `/v3/users/16441a7999c149ff9dd66e0b3a3a95b4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:24.574279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16441a7999c149ff9dd66e0b3a3a95b4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:24.577231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:24.668547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71133-4e3d-4589-aacb-6cabdadf0e10 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:24.672738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71133-4e3d-4589-aacb-6cabdadf0e10 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:24.673763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71133-4e3d-4589-aacb-6cabdadf0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:24.722970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16441a7999c149ff9dd66e0b3a3a95b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:24.724154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16441a7999c149ff9dd66e0b3a3a95b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:24.736630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-13c71133-4e3d-4589-aacb-6cabdadf0e10 None None] MFA Rules not processed for user `5ab294d1890047aababb87b3a865a14c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:24.743552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-13c71133-4e3d-4589-aacb-6cabdadf0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:24.749650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16441a7999c149ff9dd66e0b3a3a95b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:24.752332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16441a7999c149ff9dd66e0b3a3a95b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:24.785230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16441a7999c149ff9dd66e0b3a3a95b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:24.818822 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1427/2898] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:00:24 2022] DELETE /identity/v3/users/16441a7999c149ff9dd66e0b3a3a95b4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:24.820156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:24.826288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:24.904575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1472/2899] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:24.907670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfade009-2642-4b77-a33f-97ef38428d74 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:24.908543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfade009-2642-4b77-a33f-97ef38428d74 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:24.908827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfade009-2642-4b77-a33f-97ef38428d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:24.995353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cfade009-2642-4b77-a33f-97ef38428d74 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:24.999871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cfade009-2642-4b77-a33f-97ef38428d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:25.058417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ba9bb-5404-4461-add6-ac047e93102a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:25.076949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:25.078275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:25.078660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:25.079057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] PATH_INFO: `/v3/users/0bcc50583d0c4b9aa9d9c9b7ad87a576` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:25.083354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bcc50583d0c4b9aa9d9c9b7ad87a576)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:25.087729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:25.172657 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1473/2900] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:25.200686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bcc50583d0c4b9aa9d9c9b7ad87a576'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:25.201800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bcc50583d0c4b9aa9d9c9b7ad87a576'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:25.211542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bcc50583d0c4b9aa9d9c9b7ad87a576'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:25.213212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bcc50583d0c4b9aa9d9c9b7ad87a576'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:25.236709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bcc50583d0c4b9aa9d9c9b7ad87a576'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:25.294562 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1428/2901] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:00:24 2022] DELETE /identity/v3/users/0bcc50583d0c4b9aa9d9c9b7ad87a576 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:25.299777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:25.300070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:25.300342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:25.323946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:25.325081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:25.326905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:25.328783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:25.412829 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1474/2902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:25.432792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:25.438426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:25.479528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01adc3e-a1df-44fc-bef1-4abe2f8608d8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:25.486722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:25.488065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:25.488575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:25.489021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:25.493576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:25.536252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:25.538690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:25.555044 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1429/2903] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:00:25.610402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a33b4-851d-4b09-a4b0-01dfa381e796 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:25.620424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:25.621718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:25.622001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:25.623187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:25.637765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:25.640322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:25.663082 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1475/2904] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:25.917665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:25.919940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:25.951605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188adb-4ed5-457d-94d1-f73888480b4d service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:25.964439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:25.968021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:25.968480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:25.968969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] PATH_INFO: `/v3/projects/b21b82d625c249269c02db9bbe700c7c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:25.972387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21b82d625c249269c02db9bbe700c7c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:25.978324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:26.092643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21b82d625c249269c02db9bbe700c7c', 'request_id': 'req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.099958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21b82d625c249269c02db9bbe700c7c', 'request_id': 'req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.115944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21b82d625c249269c02db9bbe700c7c', 'request_id': 'req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.145880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] The token cache is being invalidate because project b21b82d625c249269c02db9bbe700c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:00:26.145880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.147137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.152901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1430/2905] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:25 2022] DELETE /identity/v3/projects/b21b82d625c249269c02db9bbe700c7c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:26.154171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:26.170433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a020-2cf7-4306-84ae-0f752b6d6801 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:26.245858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:26.250409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:26.250988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:26.251627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] PATH_INFO: `/v3/users/0424b6c2d71a46b68f80812a75ac3efc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:26.254708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0424b6c2d71a46b68f80812a75ac3efc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:26.271368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:26.399807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0424b6c2d71a46b68f80812a75ac3efc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.402539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0424b6c2d71a46b68f80812a75ac3efc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.420957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0424b6c2d71a46b68f80812a75ac3efc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.438762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0424b6c2d71a46b68f80812a75ac3efc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.440128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0424b6c2d71a46b68f80812a75ac3efc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:26.466246 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1476/2906] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:00:26 2022] DELETE /identity/v3/users/0424b6c2d71a46b68f80812a75ac3efc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:26.610171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:26.612212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:26.814329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4306-f3b7-4cce-9570-b1a7f3fd7cc8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:26.998800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:27.002533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:27.005003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:27.005003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:27.019246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:27.036771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:27.042384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:27.058534 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1431/2907] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:27.162407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:27.163854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:27.364988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3badf3-45dd-4ba9-9cb4-ff877037bc4a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:27.385776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:27.389793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:27.390940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:27.392196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] PATH_INFO: `/v3/projects/23df4eef46ae4894870e050990d597f0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:27.396539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23df4eef46ae4894870e050990d597f0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:27.401615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:27.422935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:27.424692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:27.460652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4d1d3-5a51-4363-b524-0b7d622f1a09 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:27.477693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:27.479320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:27.479763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:27.480226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] PATH_INFO: `/v3/projects/92ecd38c1e92486fa25acf2c581b5315` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:27.481730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ecd38c1e92486fa25acf2c581b5315)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:27.488394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:27.588194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23df4eef46ae4894870e050990d597f0', 'request_id': 'req-6164be86-4294-4529-a5f3-4d2ba1b0f522'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.598110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ecd38c1e92486fa25acf2c581b5315', 'request_id': 'req-66ffc0cc-3331-4845-b912-f1faa96a66a9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.612477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ecd38c1e92486fa25acf2c581b5315', 'request_id': 'req-66ffc0cc-3331-4845-b912-f1faa96a66a9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.619261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23df4eef46ae4894870e050990d597f0', 'request_id': 'req-6164be86-4294-4529-a5f3-4d2ba1b0f522'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.629908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ecd38c1e92486fa25acf2c581b5315', 'request_id': 'req-66ffc0cc-3331-4845-b912-f1faa96a66a9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.646020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23df4eef46ae4894870e050990d597f0', 'request_id': 'req-6164be86-4294-4529-a5f3-4d2ba1b0f522'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.660965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] The token cache is being invalidate because project 92ecd38c1e92486fa25acf2c581b5315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:00:27.661281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.664974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66ffc0cc-3331-4845-b912-f1faa96a66a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.670608 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1432/2908] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:27 2022] DELETE /identity/v3/projects/92ecd38c1e92486fa25acf2c581b5315 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:00:27.675383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371c53-e1a7-4f2a-96f8-b379815e3f8a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:27.677263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371c53-e1a7-4f2a-96f8-b379815e3f8a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:27.677709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371c53-e1a7-4f2a-96f8-b379815e3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:27.700881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] The token cache is being invalidate because project 23df4eef46ae4894870e050990d597f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:00:27.702259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.705200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:27.715941 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1477/2909] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:27 2022] DELETE /identity/v3/projects/23df4eef46ae4894870e050990d597f0 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:27.722045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:27.722707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-59371c53-e1a7-4f2a-96f8-b379815e3f8a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:27.726374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-59371c53-e1a7-4f2a-96f8-b379815e3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:27.730048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:27.883809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1433/2910] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:27.902186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff5a1-fbe9-40ba-815a-42ea92bfa36e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:27.902974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff5a1-fbe9-40ba-815a-42ea92bfa36e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:27.903614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff5a1-fbe9-40ba-815a-42ea92bfa36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:27.946214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b3eff5a1-fbe9-40ba-815a-42ea92bfa36e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:27.947435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b3eff5a1-fbe9-40ba-815a-42ea92bfa36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:27.955253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164be86-4294-4529-a5f3-4d2ba1b0f522 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:27.990247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:27.991361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:27.991490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:27.991737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] PATH_INFO: `/v3/users/1f4e74efd1e94b9eacf48daa7540844e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:27.995478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4e74efd1e94b9eacf48daa7540844e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:27.997531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:28.000125 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1434/2911] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:28.004540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff5a1-fbe9-40ba-815a-42ea92bfa36e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:28.021323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff5a1-fbe9-40ba-815a-42ea92bfa36e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:28.045718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:28.054026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.055031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.055482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.056378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:00:28.059637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:28.061500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:28.117351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1435/2912] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:00:28.118762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:28.157561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4e74efd1e94b9eacf48daa7540844e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:28.159821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4e74efd1e94b9eacf48daa7540844e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:28.162201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0084ce-9f57-4d7b-9b04-c94f0c58bfd7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:28.183191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4e74efd1e94b9eacf48daa7540844e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:28.194899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:28.195902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.196358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.196800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.197928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:28.199998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4e74efd1e94b9eacf48daa7540844e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:28.200638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9558949-1fd2-41e4-90a4-fcd1ca8bade7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4e74efd1e94b9eacf48daa7540844e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:28.202912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:28.241142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1478/2913] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:00:27 2022] DELETE /identity/v3/users/1f4e74efd1e94b9eacf48daa7540844e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:28.243064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6c413-4ac0-4c71-8096-043076ad7796 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.243545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6c413-4ac0-4c71-8096-043076ad7796 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.243990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6c413-4ac0-4c71-8096-043076ad7796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.321556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fee6c413-4ac0-4c71-8096-043076ad7796 None None] MFA Rules not processed for user `08995e63d5ec446bbcf643822d5f37c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:28.323268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fee6c413-4ac0-4c71-8096-043076ad7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:28.328696 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1436/2914] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:00:28 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:00:28.333254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:28.339925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:28.489206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1479/2915] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:28.496867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1528-c2a6-4aee-be71-7bd0017afdf3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.497819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1528-c2a6-4aee-be71-7bd0017afdf3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.499314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1528-c2a6-4aee-be71-7bd0017afdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.510138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c4af-0646-4468-bb03-b1db07c5b4a9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:28.530715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:28.535409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.537658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.537956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-575e1528-c2a6-4aee-be71-7bd0017afdf3 None None] MFA Rules not processed for user `08995e63d5ec446bbcf643822d5f37c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:28.538933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.540307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-575e1528-c2a6-4aee-be71-7bd0017afdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:28.542830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:28.550029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:28.619738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1480/2916] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:00:28.635045 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1437/2917] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:00:28 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:00:28.641268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1528-c2a6-4aee-be71-7bd0017afdf3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:28.660935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1528-c2a6-4aee-be71-7bd0017afdf3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:28.669633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:28.670936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.671225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.672137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.672891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:28.676296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:28.720198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:28.720677 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1481/2918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:28.721794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:28.722917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:28.748953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77d725-d50a-4690-b21a-03466971fc26 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:28.765811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:28.768618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.770283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.770769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.771725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:28.795586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:28.845783 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1482/2919] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:28.846901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:28.856914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:28.896730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eddc0-6047-4d50-a3d7-76c712b9c641 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:28.910649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:28.911828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:28.912297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:28.912818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] PATH_INFO: `/v3/projects/a30c4ed592af4e4e96ec1d3ccb82fd3c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:28.914805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30c4ed592af4e4e96ec1d3ccb82fd3c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:28.920110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:29.074097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b610c7-de1d-4383-98e8-a86fd5445b35 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:29.093843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30c4ed592af4e4e96ec1d3ccb82fd3c', 'request_id': 'req-d821e8ea-20fd-4fa6-b283-106a99a8984f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:29.113396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30c4ed592af4e4e96ec1d3ccb82fd3c', 'request_id': 'req-d821e8ea-20fd-4fa6-b283-106a99a8984f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:29.144064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30c4ed592af4e4e96ec1d3ccb82fd3c', 'request_id': 'req-d821e8ea-20fd-4fa6-b283-106a99a8984f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:29.163340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] The token cache is being invalidate because project a30c4ed592af4e4e96ec1d3ccb82fd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:00:29.163788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:29.169461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:00:29.171734 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1483/2920] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:28 2022] DELETE /identity/v3/projects/a30c4ed592af4e4e96ec1d3ccb82fd3c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:29.173376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:29.176420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:29.252090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e8ea-20fd-4fa6-b283-106a99a8984f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:29.268573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c38a7-064a-4967-a8c6-4d7a3a6e865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:29.271851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c38a7-064a-4967-a8c6-4d7a3a6e865d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.272387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c38a7-064a-4967-a8c6-4d7a3a6e865d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.272956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c38a7-064a-4967-a8c6-4d7a3a6e865d admin admin] PATH_INFO: `/v3/projects/fb7b11a68b314c95b8ecc93cd51356b0/users/1ce74147326849bc8bf26bcfa9e30276/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.304734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daba64-a954-49d2-a944-45c476b16af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:29.305404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daba64-a954-49d2-a944-45c476b16af5 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.305687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daba64-a954-49d2-a944-45c476b16af5 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.305962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daba64-a954-49d2-a944-45c476b16af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.308436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a4daba64-a954-49d2-a944-45c476b16af5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:29.311859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c38a7-064a-4967-a8c6-4d7a3a6e865d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7b11a68b314c95b8ecc93cd51356b0, user_id=1ce74147326849bc8bf26bcfa9e30276, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:29.315064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c38a7-064a-4967-a8c6-4d7a3a6e865d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:29.359391 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1484/2921] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:00:29 2022] PUT /identity/v3/projects/fb7b11a68b314c95b8ecc93cd51356b0/users/1ce74147326849bc8bf26bcfa9e30276/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:29.361528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbda5cd-cc77-4329-ac82-b0e2ecfb061a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.361823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbda5cd-cc77-4329-ac82-b0e2ecfb061a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.362099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbda5cd-cc77-4329-ac82-b0e2ecfb061a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.363541 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1485/2922] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:00:29.364685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e821f9-ebb1-42b3-b032-18d95b371ffe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.365013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e821f9-ebb1-42b3-b032-18d95b371ffe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.365389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e821f9-ebb1-42b3-b032-18d95b371ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.396014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e8e821f9-ebb1-42b3-b032-18d95b371ffe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:29.397534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8e821f9-ebb1-42b3-b032-18d95b371ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:29.429024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daba64-a954-49d2-a944-45c476b16af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:29.432574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daba64-a954-49d2-a944-45c476b16af5 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:29.462405 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1438/2923] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:29.464075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f634ed-4027-4c46-aaab-93a8256e985f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.465499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f634ed-4027-4c46-aaab-93a8256e985f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.465938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f634ed-4027-4c46-aaab-93a8256e985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.515129 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1486/2924] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:29.518786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c11d-d132-44c8-bd31-404e28d1d281 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.519352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c11d-d132-44c8-bd31-404e28d1d281 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.520432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c11d-d132-44c8-bd31-404e28d1d281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.525615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b7f634ed-4027-4c46-aaab-93a8256e985f None None] MFA Rules not processed for user `1ce74147326849bc8bf26bcfa9e30276`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:29.526873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b7f634ed-4027-4c46-aaab-93a8256e985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:29.548512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e511c11d-d132-44c8-bd31-404e28d1d281 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:29.551024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e511c11d-d132-44c8-bd31-404e28d1d281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:29.645422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1487/2925] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:29.651201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1439/2926] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:29.653287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.654952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f634ed-4027-4c46-aaab-93a8256e985f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:29.662780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.663274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.682416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f634ed-4027-4c46-aaab-93a8256e985f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:29.688240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:29.689914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:29.690750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:29.691474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.691774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.692011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.692762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:29.694788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:29.706301 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1488/2927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:29.708719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:29.712430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:29.745019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed091-c04a-4315-a356-54d7ebce93d7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:29.760281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:29.762480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.763038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.763580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.768134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1440/2928] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:00:29 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:00:29.769488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:29.774719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:29.777378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:29.804024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1489/2929] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:29.804024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:29.829667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059923de-863e-49c1-8285-78e304ed8d69 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:29.905211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058baead-6797-4786-8e1c-88e88efec131 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:29.921726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:29.923540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.923718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.927802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.927802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:00:29.927802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:29.930252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:29.947349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:29.947854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:29.948227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:29.948575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:29.949769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:29.954531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:29.965102 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1441/2930] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:00:29.966462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:29.986535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f299ea8-9a2a-4dd4-9545-79f71b631639 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.015128 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1490/2931] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:00:29 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:00:30.017235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.017747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.018444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.021282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.023935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.025180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.032165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.047105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20926f30-f9bf-4d0a-ac7e-9db6d31d9133 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.064188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.068092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.068479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.068866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.069747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.074135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.102162 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1491/2932] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:30.108427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.132471 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1442/2933] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:00:29 2022] POST /identity/v3/projects => generated 391 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:00:30.136259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.139688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b405d6b-036a-4719-86fd-06c3cc761ae3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.247188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a47270-c1dd-44bd-add0-72429f78736d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.253953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.254836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.254996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.255665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.256383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.258942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.314168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.315140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.315428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.315701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] PATH_INFO: `/v3/projects/92744092049f4f54b8bddffe804ea888/users/2d304812a9e0425db038de42515493d7/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.319872 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1443/2934] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:00:30 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:00:30.323128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.354178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ce723-8b7e-4c54-b504-68ea94707852 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.357985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92744092049f4f54b8bddffe804ea888, user_id=2d304812a9e0425db038de42515493d7, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.366881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.370807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.371529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.372472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.375445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.376816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.378663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.400289 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1444/2935] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:30.401713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.417619 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1492/2936] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:00:30 2022] PUT /identity/v3/projects/92744092049f4f54b8bddffe804ea888/users/2d304812a9e0425db038de42515493d7/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:30.419007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.422849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80949-ddb7-4127-87e6-8c2b9f4b13ce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.563123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aafe79-abde-487a-9f80-e7218841320a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.565549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.566266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.566523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.566794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.571486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.572504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.572995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.573507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.575701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.577474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.586519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.588143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.602474 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1445/2937] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:30.606151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.627670 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1493/2938] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:00:30.628308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:30.652571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210564-fbca-4f63-a4b2-36b9a59e5ec6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.655318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57cf2-b88f-4a44-8f3f-0dd66c4fb1f1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:30.667396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013038-3907-41b9-a2f4-8948f30a646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.669138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013038-3907-41b9-a2f4-8948f30a646e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.669586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013038-3907-41b9-a2f4-8948f30a646e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.670057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013038-3907-41b9-a2f4-8948f30a646e admin admin] PATH_INFO: `/v3/projects/92744092049f4f54b8bddffe804ea888/users/2d304812a9e0425db038de42515493d7/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.683109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff013038-3907-41b9-a2f4-8948f30a646e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92744092049f4f54b8bddffe804ea888, user_id=2d304812a9e0425db038de42515493d7, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.686424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff013038-3907-41b9-a2f4-8948f30a646e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.699146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098bbce-9616-4615-aab0-a7570c7413c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:30.700079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098bbce-9616-4615-aab0-a7570c7413c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.700355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098bbce-9616-4615-aab0-a7570c7413c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.700630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098bbce-9616-4615-aab0-a7570c7413c7 admin admin] PATH_INFO: `/v3/projects/6e435caef3fb4a2d9ed2b29aaddcecb9/users/e22347dd5497448894f3c6d44c4bed7f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.717610 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1494/2939] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:00:30 2022] PUT /identity/v3/projects/92744092049f4f54b8bddffe804ea888/users/2d304812a9e0425db038de42515493d7/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:30.728918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9c416-7d04-4b69-ae4c-fbfd0c3b06a4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.729614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9c416-7d04-4b69-ae4c-fbfd0c3b06a4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.730106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9c416-7d04-4b69-ae4c-fbfd0c3b06a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.775255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098bbce-9616-4615-aab0-a7570c7413c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e435caef3fb4a2d9ed2b29aaddcecb9, user_id=e22347dd5497448894f3c6d44c4bed7f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:30.783289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098bbce-9616-4615-aab0-a7570c7413c7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:30.820378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fac9c416-7d04-4b69-ae4c-fbfd0c3b06a4 None None] MFA Rules not processed for user `2d304812a9e0425db038de42515493d7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:30.823959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fac9c416-7d04-4b69-ae4c-fbfd0c3b06a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:30.838351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1446/2940] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:00:30 2022] PUT /identity/v3/projects/6e435caef3fb4a2d9ed2b29aaddcecb9/users/e22347dd5497448894f3c6d44c4bed7f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:00:30.846497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:30.847108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:30.848849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:30.874394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:30.875802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:31.088905 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1447/2941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:31.101169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:31.103381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:31.208444 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1495/2942] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:00:31.213688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:31.213978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:31.214256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:31.275467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] MFA Rules not processed for user `1ce74147326849bc8bf26bcfa9e30276`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:31.276747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:31.287581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68db964-7d9b-48d1-a062-51e756911518 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:31.296632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:31.297350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:31.297616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:31.297889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:31.325844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:31.337291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:31.355295 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1448/2943] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:31.389935 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1496/2944] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:34.116213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:34.117759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:34.419737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5dc6e-6d26-4f85-b9b9-87b50612a7e1 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:34.466362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:34.467322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:34.467781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:34.468267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:34.482662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:34.486192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:34.509226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1449/2945] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:34.804311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:34.806864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:34.849616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a4066-2802-4539-a7a3-23986e562779 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:34.875099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:34.875831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:34.876073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:34.880805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:34.889324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:34.941639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:34.949195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:34.991811 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1497/2946] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:36.910700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:36.944026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820872fb-955b-4f6a-b546-bb229512e818 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:36.963631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:36.974141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:36.975637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:36.979539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:36.988455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:37.156038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:37.158738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:37.219801 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1450/2947] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:40.018295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:40.031910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dfbd9-0d7b-44f3-a1d8-89430320ce9d service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:40.048824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:40.049677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:40.050055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:40.050424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:40.057063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:40.079778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:40.085406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:40.108933 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1498/2948] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:40.153361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:40.179636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab51be2-e870-4d5d-a5d6-65b982576c7a service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:40.188857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f16fc-64b3-4594-91c4-4c6ba85279e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:40.190044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f16fc-64b3-4594-91c4-4c6ba85279e8 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:40.193477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f16fc-64b3-4594-91c4-4c6ba85279e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:40.194009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f16fc-64b3-4594-91c4-4c6ba85279e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:40.214520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f16fc-64b3-4594-91c4-4c6ba85279e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:40.215960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f16fc-64b3-4594-91c4-4c6ba85279e8 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:40.250325 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1451/2949] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:40.853961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:40.896666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b94af-a3b8-4c6a-b8d6-1cd5905e65ac service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:40.928184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:40.929215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:40.929654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:40.930083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:40.945070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:41.007715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:41.010712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:41.039119 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1499/2950] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:44.298996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bca40a-5711-49c6-9c15-4be4e069b350 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:44.299874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bca40a-5711-49c6-9c15-4be4e069b350 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:44.300312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bca40a-5711-49c6-9c15-4be4e069b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:44.320779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-37bca40a-5711-49c6-9c15-4be4e069b350 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:44.322130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37bca40a-5711-49c6-9c15-4be4e069b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:44.408651 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1452/2951] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:44.410179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:44.416426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:44.524484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7bdb8-642b-4764-8862-95ba67ca8268 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:44.532622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:44.534365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:44.534853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:44.535375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:44.547406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:44.551138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:44.569265 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1500/2952] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:00:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:46.194645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:46.195229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:46.195229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:46.226772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] MFA Rules not processed for user `33746e27054c4f1db976d4a4ae44e073`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:46.228353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:46.314859 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1453/2953] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:47.261730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:47.277889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d8236-1b69-41b0-9e29-d0d43bd5a0f1 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:47.283809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559765cd-b7ee-4869-973a-fb618a5a74fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:47.284746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559765cd-b7ee-4869-973a-fb618a5a74fb service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:47.285054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559765cd-b7ee-4869-973a-fb618a5a74fb service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:47.285345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559765cd-b7ee-4869-973a-fb618a5a74fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:47.287202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-559765cd-b7ee-4869-973a-fb618a5a74fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:47.300345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559765cd-b7ee-4869-973a-fb618a5a74fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:47.302474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559765cd-b7ee-4869-973a-fb618a5a74fb service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:47.314213 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1501/2954] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:00:48.120377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:48.122609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:48.143331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14ca1-afcb-4012-a5f1-511640a2003f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:48.149208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:48.149877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:48.150160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:48.150434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:48.152405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:48.163286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:48.164851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:48.174960 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1454/2955] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:00:49.402308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40df87-3c94-485d-bf9b-7367c513a6cc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:49.402850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40df87-3c94-485d-bf9b-7367c513a6cc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:49.405283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40df87-3c94-485d-bf9b-7367c513a6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:49.506036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-af40df87-3c94-485d-bf9b-7367c513a6cc None None] MFA Rules not processed for user `e22347dd5497448894f3c6d44c4bed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:49.507553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-af40df87-3c94-485d-bf9b-7367c513a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:49.687109 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1502/2956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:50.648583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:50.681129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d222da-f82d-4916-8014-39639f036275 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:50.732387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e5b3d-59ee-4988-a27a-cf2f16c1e87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:50.737678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e5b3d-59ee-4988-a27a-cf2f16c1e87a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:50.737965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e5b3d-59ee-4988-a27a-cf2f16c1e87a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:50.738242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e5b3d-59ee-4988-a27a-cf2f16c1e87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:50.762374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e5b3d-59ee-4988-a27a-cf2f16c1e87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:50.764587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e5b3d-59ee-4988-a27a-cf2f16c1e87a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:50.787229 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1455/2957] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:54.021471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1047f7-4b9d-447b-8545-5db03596aedc None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:54.022384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1047f7-4b9d-447b-8545-5db03596aedc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:54.022819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1047f7-4b9d-447b-8545-5db03596aedc None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:54.025201 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1503/2958] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:00:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:00:54.032197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a731a3-a42b-42eb-b960-dadd781edfea None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:54.033133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a731a3-a42b-42eb-b960-dadd781edfea None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:54.033577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a731a3-a42b-42eb-b960-dadd781edfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:54.069632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-36a731a3-a42b-42eb-b960-dadd781edfea None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:54.071014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36a731a3-a42b-42eb-b960-dadd781edfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:54.212050 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1456/2959] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:00:54.250532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1047f7-4b9d-447b-8545-5db03596aedc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:54.252857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dc1047f7-4b9d-447b-8545-5db03596aedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:54.280230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1047f7-4b9d-447b-8545-5db03596aedc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:54.287702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb917b-2e42-43d4-b76b-2d9585e02251 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:54.288696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb917b-2e42-43d4-b76b-2d9585e02251 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:54.289525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb917b-2e42-43d4-b76b-2d9585e02251 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:54.290133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb917b-2e42-43d4-b76b-2d9585e02251 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:54.306819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb917b-2e42-43d4-b76b-2d9585e02251 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:54.308990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb917b-2e42-43d4-b76b-2d9585e02251 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:54.339576 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1504/2960] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:54.746866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a731a3-a42b-42eb-b960-dadd781edfea None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:54.761168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a731a3-a42b-42eb-b960-dadd781edfea None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:54.768327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0566e-934c-4578-ab6d-65ee66ad34db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:54.769914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0566e-934c-4578-ab6d-65ee66ad34db service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:54.770670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0566e-934c-4578-ab6d-65ee66ad34db service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:54.771620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0566e-934c-4578-ab6d-65ee66ad34db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:54.773833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-13b0566e-934c-4578-ab6d-65ee66ad34db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:54.826515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0566e-934c-4578-ab6d-65ee66ad34db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:54.829774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0566e-934c-4578-ab6d-65ee66ad34db service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:54.860897 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1457/2961] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:00:55.072346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be214a-04b1-449f-b095-67be9c47b46b None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:55.072918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be214a-04b1-449f-b095-67be9c47b46b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:55.072918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be214a-04b1-449f-b095-67be9c47b46b None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:55.074458 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1505/2962] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:00:55.079941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded60b-9cbc-4733-a75b-f8f90da69374 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:55.080457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded60b-9cbc-4733-a75b-f8f90da69374 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:55.080457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded60b-9cbc-4733-a75b-f8f90da69374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:55.118376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4bded60b-9cbc-4733-a75b-f8f90da69374 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:00:55.119608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4bded60b-9cbc-4733-a75b-f8f90da69374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:00:55.146056 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1458/2963] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:00:55.170486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be214a-04b1-449f-b095-67be9c47b46b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:55.200902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be214a-04b1-449f-b095-67be9c47b46b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:55.212468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:55.213489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:55.213846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:55.214060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:55.235655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:55.249760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:55.266797 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1506/2964] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:00:59.921583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bded60b-9cbc-4733-a75b-f8f90da69374 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:00:59.939138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bded60b-9cbc-4733-a75b-f8f90da69374 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:00:59.945558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:00:59.946154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:00:59.946435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:00:59.946710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:00:59.955825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:00:59.957587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:00:59.967379 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1459/2965] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:00.141696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:00.159093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03434-f50d-4f82-a83b-e4933e667662 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:00.165657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:00.166659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:00.166939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:00.167213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] PATH_INFO: `/v3/users/e22347dd5497448894f3c6d44c4bed7f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:00.168456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22347dd5497448894f3c6d44c4bed7f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:00.170684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:00.231068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22347dd5497448894f3c6d44c4bed7f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.232059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22347dd5497448894f3c6d44c4bed7f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.240568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22347dd5497448894f3c6d44c4bed7f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.255469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22347dd5497448894f3c6d44c4bed7f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.256408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c2a50cfe-8a94-49e7-afe2-00a0e44c32d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22347dd5497448894f3c6d44c4bed7f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.281757 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1507/2966] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:01:00 2022] DELETE /identity/v3/users/e22347dd5497448894f3c6d44c4bed7f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:00.483907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:00.496632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedab62-3082-4903-9771-0cab63245f25 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:00.581509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:00.582383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:00.582841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:00.583110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] PATH_INFO: `/v3/projects/6e435caef3fb4a2d9ed2b29aaddcecb9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:00.585056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e435caef3fb4a2d9ed2b29aaddcecb9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:00.587036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:00.638782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e435caef3fb4a2d9ed2b29aaddcecb9', 'request_id': 'req-c01bf19c-bc9c-4003-b6f3-71c84526349e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.646278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e435caef3fb4a2d9ed2b29aaddcecb9', 'request_id': 'req-c01bf19c-bc9c-4003-b6f3-71c84526349e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.654546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e435caef3fb4a2d9ed2b29aaddcecb9', 'request_id': 'req-c01bf19c-bc9c-4003-b6f3-71c84526349e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.669772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] The token cache is being invalidate because project 6e435caef3fb4a2d9ed2b29aaddcecb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:01:00.670133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.670852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c01bf19c-bc9c-4003-b6f3-71c84526349e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:00.672473 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1460/2967] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:00 2022] DELETE /identity/v3/projects/6e435caef3fb4a2d9ed2b29aaddcecb9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:00.678967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d209-4193-4f8b-ae34-fda2f02b4689 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:00.679261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d209-4193-4f8b-ae34-fda2f02b4689 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:00.679540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d209-4193-4f8b-ae34-fda2f02b4689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:00.697539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2102d209-4193-4f8b-ae34-fda2f02b4689 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:00.698740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2102d209-4193-4f8b-ae34-fda2f02b4689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:00.758804 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1508/2968] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:01:00.767035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351bb4-3d64-4606-ac7e-28c816df5121 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:00.767325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351bb4-3d64-4606-ac7e-28c816df5121 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:00.767601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351bb4-3d64-4606-ac7e-28c816df5121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:00.787704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e9351bb4-3d64-4606-ac7e-28c816df5121 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:00.788939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e9351bb4-3d64-4606-ac7e-28c816df5121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:00.797394 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1461/2969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:00.802199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102d209-4193-4f8b-ae34-fda2f02b4689 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:00.812412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102d209-4193-4f8b-ae34-fda2f02b4689 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:00.820951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:00.821929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:00.822288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:00.822840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:00.823741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:01:00.824468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:00.826258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:00.838396 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1509/2970] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:01:00.843010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9351bb4-3d64-4606-ac7e-28c816df5121 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:00.852516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9351bb4-3d64-4606-ac7e-28c816df5121 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:00.857320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:00.857973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:00.858253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:00.858529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:00.859249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:00.861209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:00.890550 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1462/2971] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:01:00 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:00.894812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:00.906122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc07d3-940b-48ae-b554-bd0ea78bffd3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:00.961945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:00.963524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:00.963524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:00.963524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:00.963892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:00.965896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:00.987059 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1510/2972] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:01:00 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:00.991007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:01.001099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe9ec-ae30-43eb-8d8a-da02d31cd7ef admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:01.006146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:01.006778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:01.007055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:01.007326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:01.008045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:01.009730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:01.021460 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1463/2973] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:01.025836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:01.037838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b4e03-1c5a-4816-b4f1-09a866e44327 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:01.045922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd8252-04b3-48e6-9252-0b5af133f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:01.046789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd8252-04b3-48e6-9252-0b5af133f881 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:01.047077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd8252-04b3-48e6-9252-0b5af133f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:01.047357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd8252-04b3-48e6-9252-0b5af133f881 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:01.048104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd8252-04b3-48e6-9252-0b5af133f881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:01.049951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd8252-04b3-48e6-9252-0b5af133f881 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:01.060523 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1511/2974] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:01.064671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:01.074390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948051f-d04f-4dc1-a59d-3e8bf10ce114 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:01.079394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b188d11-d3ad-4fb3-9f35-f7f477c09d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:01.080387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188d11-d3ad-4fb3-9f35-f7f477c09d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:01.080736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188d11-d3ad-4fb3-9f35-f7f477c09d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:01.081120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188d11-d3ad-4fb3-9f35-f7f477c09d30 admin admin] PATH_INFO: `/v3/projects/34832c64cfe049768207fb5cb0dfc2a7/users/702df47948994dd085132f3264ff66f5/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:01.096035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b188d11-d3ad-4fb3-9f35-f7f477c09d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34832c64cfe049768207fb5cb0dfc2a7, user_id=702df47948994dd085132f3264ff66f5, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:01.098958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b188d11-d3ad-4fb3-9f35-f7f477c09d30 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:01.113576 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1464/2975] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:01 2022] PUT /identity/v3/projects/34832c64cfe049768207fb5cb0dfc2a7/users/702df47948994dd085132f3264ff66f5/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:01:01.124208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:01.124491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:01.124786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:01.151464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] MFA Rules not processed for user `702df47948994dd085132f3264ff66f5`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:01.152856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:01.222295 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1512/2976] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:01:01.234319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:01.234697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:01.235070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:01.266376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] MFA Rules not processed for user `702df47948994dd085132f3264ff66f5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:01.268024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:01.286011 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1465/2977] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:01.294979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:01.297161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:01.423310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84673c-ea68-496d-b28d-7a613eb353a3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:01.432113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7e40-9d6f-4d41-b038-a03463fa5326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:01.433380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7e40-9d6f-4d41-b038-a03463fa5326 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:01.434640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7e40-9d6f-4d41-b038-a03463fa5326 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:01.434640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7e40-9d6f-4d41-b038-a03463fa5326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:01.444540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7e40-9d6f-4d41-b038-a03463fa5326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:01.445520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7e40-9d6f-4d41-b038-a03463fa5326 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:01.456446 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1513/2978] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:06.485768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:06.487569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:06.565484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7d49-623f-47e2-a4bb-1b4689bc8cfe None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:06.575924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:06.576212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:06.576456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:06.576726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] PATH_INFO: `/v3/users/1ce74147326849bc8bf26bcfa9e30276` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:06.578424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce74147326849bc8bf26bcfa9e30276)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:06.580797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:06.638818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce74147326849bc8bf26bcfa9e30276'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:06.639702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce74147326849bc8bf26bcfa9e30276'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:06.647239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce74147326849bc8bf26bcfa9e30276'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:06.647926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce74147326849bc8bf26bcfa9e30276'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:06.657199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce74147326849bc8bf26bcfa9e30276'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:06.685894 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1466/2979] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:01:06 2022] DELETE /identity/v3/users/1ce74147326849bc8bf26bcfa9e30276 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:06.692853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:06.693438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:06.693438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:06.730235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:06.731719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:06.820211 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1514/2980] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:01:06.829730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:06.834582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:06.896629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1e76c-8dd5-4ef4-a662-aaf814b502fe admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:06.900439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:06.901124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:06.901435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:06.901709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:06.911466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:06.912936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:06.922664 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1467/2981] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:01:07.118642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:07.120260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:07.140397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e58d-28d4-422a-bc90-43bcb0018076 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:07.154312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:07.155237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:07.155729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:07.155968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] PATH_INFO: `/v3/projects/fb7b11a68b314c95b8ecc93cd51356b0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:07.157410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7b11a68b314c95b8ecc93cd51356b0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:07.159401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:07.245395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7b11a68b314c95b8ecc93cd51356b0', 'request_id': 'req-907955fa-3ecc-47d1-a4c0-1752097b0a17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.251935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7b11a68b314c95b8ecc93cd51356b0', 'request_id': 'req-907955fa-3ecc-47d1-a4c0-1752097b0a17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.263463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7b11a68b314c95b8ecc93cd51356b0', 'request_id': 'req-907955fa-3ecc-47d1-a4c0-1752097b0a17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.279043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] The token cache is being invalidate because project fb7b11a68b314c95b8ecc93cd51356b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:01:07.279516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.280271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.282310 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1515/2982] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:07 2022] DELETE /identity/v3/projects/fb7b11a68b314c95b8ecc93cd51356b0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:07.288365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:07.300069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3c4d0-bb9c-4631-9f9f-755321aaed99 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:07.381609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:07.382605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:07.382916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:07.383213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] PATH_INFO: `/v3/users/2d304812a9e0425db038de42515493d7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:07.384532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d304812a9e0425db038de42515493d7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:07.386838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:07.483351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d304812a9e0425db038de42515493d7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.484132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d304812a9e0425db038de42515493d7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.492585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d304812a9e0425db038de42515493d7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.493680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d304812a9e0425db038de42515493d7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.505247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2ba8f2cf-b5f1-4855-a18b-2700466395cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d304812a9e0425db038de42515493d7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:07.526039 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1468/2983] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:01:07 2022] DELETE /identity/v3/users/2d304812a9e0425db038de42515493d7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:07.930651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:07.932273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:07.952005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907955fa-3ecc-47d1-a4c0-1752097b0a17 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.040088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.040934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.041225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.041500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] PATH_INFO: `/v3/projects/92744092049f4f54b8bddffe804ea888` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.042865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=92744092049f4f54b8bddffe804ea888)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.045135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:08.091575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92744092049f4f54b8bddffe804ea888', 'request_id': 'req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:08.097188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92744092049f4f54b8bddffe804ea888', 'request_id': 'req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:08.106063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92744092049f4f54b8bddffe804ea888', 'request_id': 'req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:08.117671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] The token cache is being invalidate because project 92744092049f4f54b8bddffe804ea888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:01:08.117947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:08.118692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2ceb2b29-8249-418d-b4bf-895d4d6e7f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:08.120686 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1516/2984] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:07 2022] DELETE /identity/v3/projects/92744092049f4f54b8bddffe804ea888 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:08.127022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5d052-6dff-4621-8d7c-9fbfac436404 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.127312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5d052-6dff-4621-8d7c-9fbfac436404 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.127775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5d052-6dff-4621-8d7c-9fbfac436404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.155592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2bf5d052-6dff-4621-8d7c-9fbfac436404 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:08.156894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2bf5d052-6dff-4621-8d7c-9fbfac436404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:08.275121 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1469/2985] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:08.284490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2704f5-345b-4125-b429-a379508d75f1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.284748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2704f5-345b-4125-b429-a379508d75f1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.285108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2704f5-345b-4125-b429-a379508d75f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.304807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7b2704f5-345b-4125-b429-a379508d75f1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:08.306113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b2704f5-345b-4125-b429-a379508d75f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:08.315622 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1517/2986] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:08.319766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5d052-6dff-4621-8d7c-9fbfac436404 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:08.330997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5d052-6dff-4621-8d7c-9fbfac436404 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.335893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.336570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.336847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.337150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.337878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:01:08.338173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.339792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:08.352664 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1470/2987] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:01:08.357160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2704f5-345b-4125-b429-a379508d75f1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:08.367145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2704f5-345b-4125-b429-a379508d75f1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.372958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.373913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.374378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.375477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.376392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.378804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:08.414482 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1518/2988] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:01:08 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:08.415620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:08.426837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3792dab-114c-4151-85d1-ddf612b808f7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.489193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.490195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.490557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.490923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.491708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.493782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:08.514769 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1471/2989] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:01:08 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:01:08.519110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:08.532732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33eb87-4b11-487d-ba91-134cc4be8300 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.557840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.561529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.561895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.562225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.563970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.568646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:08.583698 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1519/2990] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:08.587808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:08.600976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1bf7-0c2c-4aff-9784-9ea8f42f5f99 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.606560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd0aa6-74a6-49e0-80e5-082651b8e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.607292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd0aa6-74a6-49e0-80e5-082651b8e44a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.607749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd0aa6-74a6-49e0-80e5-082651b8e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.608311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd0aa6-74a6-49e0-80e5-082651b8e44a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.609269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd0aa6-74a6-49e0-80e5-082651b8e44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.611108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd0aa6-74a6-49e0-80e5-082651b8e44a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:08.627201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1472/2991] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:08.628103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:08.638937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f204b6c-0f71-46cf-8574-2c0f7aa0509e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.644147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.645083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.645369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.645643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] PATH_INFO: `/v3/projects/5d288e617526417680b8d375cf87e380/users/dd753dc1202f4e138094f0f50b83b2f4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.661691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d288e617526417680b8d375cf87e380, user_id=dd753dc1202f4e138094f0f50b83b2f4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.664467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:08.683612 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1520/2992] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:08 2022] PUT /identity/v3/projects/5d288e617526417680b8d375cf87e380/users/dd753dc1202f4e138094f0f50b83b2f4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:08.688674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.688965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.689274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.712819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:08.714356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:08.801935 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1473/2993] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:08.876411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:08.878705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:08.957348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb97ef-2203-420b-8132-59dff10478b9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:08.968972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50055a-ce4b-42ad-a369-7274488d8f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:08.969781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50055a-ce4b-42ad-a369-7274488d8f58 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:08.970735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50055a-ce4b-42ad-a369-7274488d8f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:08.971830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50055a-ce4b-42ad-a369-7274488d8f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:08.989299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50055a-ce4b-42ad-a369-7274488d8f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:08.998399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50055a-ce4b-42ad-a369-7274488d8f58 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:09.019399 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1521/2994] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:10.236789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:10.238380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:10.278360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c85a6-d4a8-45e6-a5ff-f38cf6024638 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:10.299304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:10.300533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:10.300837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:10.301154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:10.303215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:10.348696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:10.350871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:10.377244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1474/2995] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:11.549023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4bdc-4cc8-49f3-8470-0178aff18c58 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:11.549676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4bdc-4cc8-49f3-8470-0178aff18c58 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:11.549866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4bdc-4cc8-49f3-8470-0178aff18c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:11.571342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2d6a4bdc-4cc8-49f3-8470-0178aff18c58 None None] MFA Rules not processed for user `ceba42e80d7746e4897669084c078c09`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:11.572792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2d6a4bdc-4cc8-49f3-8470-0178aff18c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:11.693564 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1522/2996] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:12.961540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:12.963106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:12.992445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a321-5953-4ce0-b551-0b2dd51121fb service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:13.010316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:13.011593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:13.012063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:13.012491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] PATH_INFO: `/v3/users/9c775742dfc04cec8559f9e4d13239b0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:13.014114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c775742dfc04cec8559f9e4d13239b0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:13.016261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:13.142839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c775742dfc04cec8559f9e4d13239b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.146128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c775742dfc04cec8559f9e4d13239b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.179147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c775742dfc04cec8559f9e4d13239b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.181532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c775742dfc04cec8559f9e4d13239b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.193059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c775742dfc04cec8559f9e4d13239b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.233629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1475/2997] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:01:12 2022] DELETE /identity/v3/users/9c775742dfc04cec8559f9e4d13239b0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:13.559822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a4bdc-4cc8-49f3-8470-0178aff18c58 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:13.574998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a4bdc-4cc8-49f3-8470-0178aff18c58 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:13.665538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:13.666793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:13.667080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:13.667354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] PATH_INFO: `/v3/projects/2c23a8d6534a4426b2ea106417c8b68a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:13.669710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c23a8d6534a4426b2ea106417c8b68a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:13.671810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:13.758616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c23a8d6534a4426b2ea106417c8b68a', 'request_id': 'req-4483d321-33ec-418a-8a16-09e29460ecf6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.766290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c23a8d6534a4426b2ea106417c8b68a', 'request_id': 'req-4483d321-33ec-418a-8a16-09e29460ecf6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.794911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c23a8d6534a4426b2ea106417c8b68a', 'request_id': 'req-4483d321-33ec-418a-8a16-09e29460ecf6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.812184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] The token cache is being invalidate because project 2c23a8d6534a4426b2ea106417c8b68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:01:13.812818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.813720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:13.816468 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1523/2998] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:13 2022] DELETE /identity/v3/projects/2c23a8d6534a4426b2ea106417c8b68a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:13.820892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:13.822702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:13.841753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af1af5-51d0-453d-b6eb-fa8ea83bad90 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:13.939430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:13.940803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:13.941776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:13.944013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] PATH_INFO: `/v3/users/9003c87ee6804a7a86aa2c1e6ec97124` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:13.950481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] RBAC: Authorizing `identity:delete_user(user_id=9003c87ee6804a7a86aa2c1e6ec97124)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:13.954280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:14.052220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9003c87ee6804a7a86aa2c1e6ec97124'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.053902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9003c87ee6804a7a86aa2c1e6ec97124'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.064107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9003c87ee6804a7a86aa2c1e6ec97124'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.066042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9003c87ee6804a7a86aa2c1e6ec97124'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.082196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8684b31b-04fa-4d81-a793-e29140d4edda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9003c87ee6804a7a86aa2c1e6ec97124'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.116171 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1476/2999] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:01:13 2022] DELETE /identity/v3/users/9003c87ee6804a7a86aa2c1e6ec97124 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:14.574787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:14.577470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:14.605479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483d321-33ec-418a-8a16-09e29460ecf6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:14.722474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:14.723374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:14.730727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:14.731072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] PATH_INFO: `/v3/projects/e5e32e456ce8498cba865bda8f8445f1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:14.732663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e32e456ce8498cba865bda8f8445f1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:14.734757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:14.902375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e32e456ce8498cba865bda8f8445f1', 'request_id': 'req-b450229f-984d-4c23-9ab6-cc141c15ee1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.918099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e32e456ce8498cba865bda8f8445f1', 'request_id': 'req-b450229f-984d-4c23-9ab6-cc141c15ee1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.948025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e32e456ce8498cba865bda8f8445f1', 'request_id': 'req-b450229f-984d-4c23-9ab6-cc141c15ee1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.976802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] The token cache is being invalidate because project e5e32e456ce8498cba865bda8f8445f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:01:14.977269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.978452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b450229f-984d-4c23-9ab6-cc141c15ee1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:14.986690 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1524/3000] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:14 2022] DELETE /identity/v3/projects/e5e32e456ce8498cba865bda8f8445f1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:14.987680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081e9a0-6781-4d51-a42c-0a9580c037e5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:14.987971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081e9a0-6781-4d51-a42c-0a9580c037e5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:14.988252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081e9a0-6781-4d51-a42c-0a9580c037e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.040107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c081e9a0-6781-4d51-a42c-0a9580c037e5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:15.043306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c081e9a0-6781-4d51-a42c-0a9580c037e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:15.162276 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1477/3001] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:01:15.170201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3ec9-505c-43bc-8d3a-7e604985a732 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.170913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3ec9-505c-43bc-8d3a-7e604985a732 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.171361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3ec9-505c-43bc-8d3a-7e604985a732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.210101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-43ef3ec9-505c-43bc-8d3a-7e604985a732 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:15.211328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-43ef3ec9-505c-43bc-8d3a-7e604985a732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:15.229149 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1525/3002] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:15.231642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081e9a0-6781-4d51-a42c-0a9580c037e5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:15.252509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081e9a0-6781-4d51-a42c-0a9580c037e5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:15.258510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:15.259245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.259525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.259866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.261008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:01:15.261785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:15.263735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:15.279681 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1478/3003] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:01:15.285026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef3ec9-505c-43bc-8d3a-7e604985a732 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:15.299701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef3ec9-505c-43bc-8d3a-7e604985a732 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:15.308376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:15.309630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.310173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.310697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.311665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:15.315575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:15.372628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1526/3004] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:01:15 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:15.374464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:15.392280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f442d-e090-42c8-94ba-bbda0b955939 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:15.532868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f514c-2703-4c0a-b77e-6e4c23c0c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:15.536670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f514c-2703-4c0a-b77e-6e4c23c0c75f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.537723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f514c-2703-4c0a-b77e-6e4c23c0c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.537723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f514c-2703-4c0a-b77e-6e4c23c0c75f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.538094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f514c-2703-4c0a-b77e-6e4c23c0c75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:15.540421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f514c-2703-4c0a-b77e-6e4c23c0c75f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:15.585380 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1479/3005] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:01:15 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:15.587372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:15.605708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e5707-aec2-4552-a22c-8efea6eb70df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:15.617016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:15.618934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.619509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.619995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.622536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:15.626196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:15.640539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9119-ae32-4ff4-b0ee-2e3282ada8f3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.641029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9119-ae32-4ff4-b0ee-2e3282ada8f3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.641336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9119-ae32-4ff4-b0ee-2e3282ada8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.671544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-059f9119-ae32-4ff4-b0ee-2e3282ada8f3 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:15.677781 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1527/3006] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:01:15.678989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-059f9119-ae32-4ff4-b0ee-2e3282ada8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:15.681339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:15.719187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0ceb-0bdb-49c7-89c6-a45bc2af5753 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:15.730679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c604f5b-8727-46e1-841a-b4914fafd6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:15.732044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604f5b-8727-46e1-841a-b4914fafd6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.732879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604f5b-8727-46e1-841a-b4914fafd6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.733407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604f5b-8727-46e1-841a-b4914fafd6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.734449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c604f5b-8727-46e1-841a-b4914fafd6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:15.742661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c604f5b-8727-46e1-841a-b4914fafd6b2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:15.773480 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1528/3007] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:15.775237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf246a-e27e-4f76-bf14-e39015bae8e8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.775833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf246a-e27e-4f76-bf14-e39015bae8e8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.777449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf246a-e27e-4f76-bf14-e39015bae8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.821284 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1480/3008] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:15.823437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9119-ae32-4ff4-b0ee-2e3282ada8f3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:15.839458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9119-ae32-4ff4-b0ee-2e3282ada8f3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:15.847187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:15.848913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.849412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.849873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] PATH_INFO: `/v3/projects/57f80885ae94461faac0058e9c3186b9/users/18829faf81144879b9a7713e52b36c23/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:15.854138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aebf246a-e27e-4f76-bf14-e39015bae8e8 None None] MFA Rules not processed for user `dd753dc1202f4e138094f0f50b83b2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:15.859565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aebf246a-e27e-4f76-bf14-e39015bae8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:15.873719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f80885ae94461faac0058e9c3186b9, user_id=18829faf81144879b9a7713e52b36c23, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:15.877513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:15.913909 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1481/3009] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:15 2022] PUT /identity/v3/projects/57f80885ae94461faac0058e9c3186b9/users/18829faf81144879b9a7713e52b36c23/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:15.916450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:15.922256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:15.982737 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1529/3010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:15.985252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:15.985525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:15.985959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.037081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] MFA Rules not processed for user `18829faf81144879b9a7713e52b36c23`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:16.038416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:16.047101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eef28-f077-4557-8ade-8fcc5c4a57a7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.054789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.057986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.058354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.058906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.171301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.173486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.181717 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1530/3011] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:16.182926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.184609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:16.197263 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1482/3012] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:16.198223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.290087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91625fea-e966-4533-afd3-71cee8cd56ad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.309025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.310659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.310887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.311104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.311825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.314966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.329811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a98b61-88cc-4fa6-9d94-de7c60fd249c service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.359890 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1531/3013] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:01:16 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:16.361336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.375614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.378640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.379672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.379981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.384712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.392336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.456550 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1483/3014] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:01:16 2022] POST /identity/v3/projects => generated 391 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:16.458018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.513479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0288-cf28-44b1-a7da-3589615d538b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.578312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51235-ec53-4ebe-832c-0beba3ccbd8f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.590463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.593202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.593609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.594446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.598298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.605067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.645315 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1484/3015] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:01:16 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:16.646732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.648106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.649432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.650086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.650655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.651843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.655200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.665753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cf598-6bdf-42dc-be48-43cd377c001f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.672902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.673721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.674068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.674164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.674915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.676566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.692673 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1485/3016] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:16.695546 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1532/3017] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:01:16 2022] POST /identity/v3/users => generated 299 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:16.704540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.707146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.719071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331dda3-b8dd-4ff5-aa3c-065dfe5dc3bb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.726341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.726528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0cb45-2dc5-4e12-a408-4c1a1f20dfd7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.727728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.728451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.729097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] PATH_INFO: `/v3/projects/9ebcd94e5a064d6b8e5d97935384808c/users/c90aee54ed3242de82488d7600df3819/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.738590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.739337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.739657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.739927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:16.745997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.749640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.774318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebcd94e5a064d6b8e5d97935384808c, user_id=c90aee54ed3242de82488d7600df3819, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:16.779000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:16.779701 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1533/3018] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:16.788505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.812895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be181be-5960-43cc-9fbb-3f8964c56fb2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:16.839490 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1486/3019] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:16 2022] PUT /identity/v3/projects/9ebcd94e5a064d6b8e5d97935384808c/users/c90aee54ed3242de82488d7600df3819/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:16.840544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:16.946022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:16.947696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:16.948355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:16.948857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] PATH_INFO: `/v3/projects/8bd15ebf647e4d1988c25cd83baa5de1/users/4006873e704042b6a4b62d643d4a4ddb/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:17.012289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd15ebf647e4d1988c25cd83baa5de1, user_id=4006873e704042b6a4b62d643d4a4ddb, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:17.021668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:17.064511 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1534/3020] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:16 2022] PUT /identity/v3/projects/8bd15ebf647e4d1988c25cd83baa5de1/users/4006873e704042b6a4b62d643d4a4ddb/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:17.069497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:17.091592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed600-606d-4d23-9ec0-f8004e46d0a3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:17.250930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:17.252027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:17.252140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:17.252498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:17.253331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:17.255094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:17.269154 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1487/3021] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:17.271518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:17.285484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd94d-13a2-4579-8385-6f27f6d73c88 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:17.288640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a34f6-d06a-4fa6-b60c-c1942a20b32b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:17.308210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:17.308210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:17.309135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3b78-418e-48bc-bf04-408a81453752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:17.310056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3b78-418e-48bc-bf04-408a81453752 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:17.310508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:17.312820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:17.313335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3b78-418e-48bc-bf04-408a81453752 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:17.314210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:17.314657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3b78-418e-48bc-bf04-408a81453752 admin admin] PATH_INFO: `/v3/projects/9ebcd94e5a064d6b8e5d97935384808c/users/c90aee54ed3242de82488d7600df3819/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:17.317186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:17.323875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3b78-418e-48bc-bf04-408a81453752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebcd94e5a064d6b8e5d97935384808c, user_id=c90aee54ed3242de82488d7600df3819, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:17.333557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3b78-418e-48bc-bf04-408a81453752 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:17.361857 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1535/3022] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:17.363893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:17.370451 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1488/3023] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:17 2022] PUT /identity/v3/projects/9ebcd94e5a064d6b8e5d97935384808c/users/c90aee54ed3242de82488d7600df3819/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:17.380676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:17.380971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:17.381479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:17.387983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d248b-0c77-4087-9a7d-3dace1761ef6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:17.481782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] MFA Rules not processed for user `c90aee54ed3242de82488d7600df3819`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:17.483111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:17.585808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:17.587608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:17.587915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:17.590895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] PATH_INFO: `/v3/projects/8bd15ebf647e4d1988c25cd83baa5de1/users/4006873e704042b6a4b62d643d4a4ddb/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:17.596291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd15ebf647e4d1988c25cd83baa5de1, user_id=4006873e704042b6a4b62d643d4a4ddb, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:17.604125 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1489/3024] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:01:17.611586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:17.639522 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1536/3025] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:17 2022] PUT /identity/v3/projects/8bd15ebf647e4d1988c25cd83baa5de1/users/4006873e704042b6a4b62d643d4a4ddb/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:17.654336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:17.655874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:17.836890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd44a-ba89-43f2-bf4e-2130831abd82 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:17.953702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:17.954381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:17.954660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:17.954928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:18.052990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:18.054764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:18.086211 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1490/3026] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:18.117978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:18.152618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1cf14-7a6f-421d-b769-eedfdb9c9a0c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:18.168493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da0bf8-11b6-40ae-998b-64ef8bbe669e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:18.169592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0bf8-11b6-40ae-998b-64ef8bbe669e service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:18.170024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0bf8-11b6-40ae-998b-64ef8bbe669e service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:18.171265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0bf8-11b6-40ae-998b-64ef8bbe669e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:18.331765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da0bf8-11b6-40ae-998b-64ef8bbe669e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:18.335888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da0bf8-11b6-40ae-998b-64ef8bbe669e service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:18.369048 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1537/3027] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:18.377055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:18.591746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68a319-eb94-434e-89c9-e1a46cb96a13 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:18.630871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:18.631788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:18.632061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:18.632337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] PATH_INFO: `/v3/users/18829faf81144879b9a7713e52b36c23` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:18.633605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18829faf81144879b9a7713e52b36c23)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:18.635530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:18.745831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18829faf81144879b9a7713e52b36c23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:18.746525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18829faf81144879b9a7713e52b36c23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:18.755579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18829faf81144879b9a7713e52b36c23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:18.756520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18829faf81144879b9a7713e52b36c23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:18.772775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18829faf81144879b9a7713e52b36c23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:18.819961 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1491/3028] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:01:18 2022] DELETE /identity/v3/users/18829faf81144879b9a7713e52b36c23 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:18.826108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfbbf1-0baa-49b3-b155-89c71dc8cec0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:18.826925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfbbf1-0baa-49b3-b155-89c71dc8cec0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:18.827298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfbbf1-0baa-49b3-b155-89c71dc8cec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:18.861987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-29bfbbf1-0baa-49b3-b155-89c71dc8cec0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:18.864426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-29bfbbf1-0baa-49b3-b155-89c71dc8cec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:19.030125 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1538/3029] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:19.050026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:19.052426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:19.210782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cc6ad-d3ca-4c8e-8e47-5564107509d4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:19.222552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:19.224009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:19.225680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:19.227677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:19.253389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:19.256373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:19.286736 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1492/3030] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:20.244616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:20.245693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:20.246239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:20.273316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:20.275091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:20.363166 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1539/3031] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:20.416651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:20.418782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:20.474431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:20.476215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:20.512903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e98e3-c085-4243-bd9a-678b8f127ca4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:20.530210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:20.531122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:20.532323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:20.534197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] PATH_INFO: `/v3/projects/57f80885ae94461faac0058e9c3186b9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:20.538392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f80885ae94461faac0058e9c3186b9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:20.540413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:20.575221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c723-e540-4df7-bb20-c64d844eea70 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:20.586717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:20.588580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:20.589130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:20.589754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:20.606565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:20.609251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:20.624473 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1493/3032] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:20.719333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f80885ae94461faac0058e9c3186b9', 'request_id': 'req-a0cee6ba-6c3c-418c-bc5e-be73e6311134'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:20.750780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f80885ae94461faac0058e9c3186b9', 'request_id': 'req-a0cee6ba-6c3c-418c-bc5e-be73e6311134'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:20.787485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f80885ae94461faac0058e9c3186b9', 'request_id': 'req-a0cee6ba-6c3c-418c-bc5e-be73e6311134'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:20.824381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] The token cache is being invalidate because project 57f80885ae94461faac0058e9c3186b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:01:20.825620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:20.828771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:20.835722 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1540/3033] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:20 2022] DELETE /identity/v3/projects/57f80885ae94461faac0058e9c3186b9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:01:20.839944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:20.860930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8852b-c71e-479b-ab6d-8e1fd4a6d809 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:21.089910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:21.091359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:21.091774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:21.092107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] PATH_INFO: `/v3/users/c90aee54ed3242de82488d7600df3819` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:21.101947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90aee54ed3242de82488d7600df3819)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:21.104342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:21.236130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90aee54ed3242de82488d7600df3819'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:21.237715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90aee54ed3242de82488d7600df3819'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:21.258692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90aee54ed3242de82488d7600df3819'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:21.259835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90aee54ed3242de82488d7600df3819'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:21.277804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e1f5619d-40ec-455a-81d2-7769cfa75dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90aee54ed3242de82488d7600df3819'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:21.310886 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1494/3034] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:01:20 2022] DELETE /identity/v3/users/c90aee54ed3242de82488d7600df3819 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:23.040018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:23.041954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:23.097674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee6ba-6c3c-418c-bc5e-be73e6311134 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:23.323454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:23.324373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:23.324930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:23.325343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] PATH_INFO: `/v3/projects/9ebcd94e5a064d6b8e5d97935384808c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:23.330885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebcd94e5a064d6b8e5d97935384808c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:23.333089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:23.541952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebcd94e5a064d6b8e5d97935384808c', 'request_id': 'req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:23.563607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebcd94e5a064d6b8e5d97935384808c', 'request_id': 'req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:23.584859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebcd94e5a064d6b8e5d97935384808c', 'request_id': 'req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:23.639582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] The token cache is being invalidate because project 9ebcd94e5a064d6b8e5d97935384808c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:01:23.639846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:23.646334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf5b48d4-a375-42c8-a90a-4c60d5badaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:01:23.651487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1541/3035] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:23 2022] DELETE /identity/v3/projects/9ebcd94e5a064d6b8e5d97935384808c => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:01:23.658156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6299-7b81-4173-8646-e755d3061fa0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:23.658746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6299-7b81-4173-8646-e755d3061fa0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:23.658746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6299-7b81-4173-8646-e755d3061fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:23.692242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-388d6299-7b81-4173-8646-e755d3061fa0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:23.694007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-388d6299-7b81-4173-8646-e755d3061fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:23.835972 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1495/3036] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:23.845718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ddffd-2ab7-4578-a681-6afb55e3fa59 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:23.846004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ddffd-2ab7-4578-a681-6afb55e3fa59 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:23.846285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ddffd-2ab7-4578-a681-6afb55e3fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:23.890681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0c9ddffd-2ab7-4578-a681-6afb55e3fa59 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:23.890681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c9ddffd-2ab7-4578-a681-6afb55e3fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:23.906830 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1542/3037] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:23.911996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6299-7b81-4173-8646-e755d3061fa0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:23.924013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6299-7b81-4173-8646-e755d3061fa0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:23.940001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:23.940699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:23.941630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:23.941919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:23.942664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:01:23.943027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:23.944684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:23.978570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1496/3038] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:01:23.984158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ddffd-2ab7-4578-a681-6afb55e3fa59 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:23.996179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ddffd-2ab7-4578-a681-6afb55e3fa59 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:24.013484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:24.014184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:24.014471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:24.014763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:24.015471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:24.021508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:24.085835 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1543/3039] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:01:23 2022] POST /identity/v3/projects => generated 395 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:01:24.090325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:24.107332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031254b-30b1-4137-8ea6-f1f2cc6f9174 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:24.321844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:24.323118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:24.323613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:24.324108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:24.326992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:24.332133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:24.424308 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1497/3040] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:01:24 2022] POST /identity/v3/users => generated 298 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:01:24.428908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:24.473536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e600f-7e88-43d7-83e1-a7fdbf222000 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:24.487161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:24.487889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:24.488178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:24.488462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:24.489318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:24.491092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:24.532372 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1544/3041] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:24.536614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:24.579522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c22191-8ce4-4d73-8ab6-cada7a26083c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:24.606045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf4622-35fd-40d9-aa80-6a9e4b67bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:24.606963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4622-35fd-40d9-aa80-6a9e4b67bec0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:24.607673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4622-35fd-40d9-aa80-6a9e4b67bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:24.608147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4622-35fd-40d9-aa80-6a9e4b67bec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:24.609097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf4622-35fd-40d9-aa80-6a9e4b67bec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:24.611225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf4622-35fd-40d9-aa80-6a9e4b67bec0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:24.636096 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1498/3042] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:01:24.640774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:24.680421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da04ab-2575-4b9f-bbd7-f3c3b4df5997 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:24.686807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:24.687744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:24.688089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:24.688364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] PATH_INFO: `/v3/projects/bd8c462cb0354f748ec4a7bfa561be3d/users/c89ddff4ad7c4ef1b382b760918d6054/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:24.723050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8c462cb0354f748ec4a7bfa561be3d, user_id=c89ddff4ad7c4ef1b382b760918d6054, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:24.729399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:24.754018 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1545/3043] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:01:24 2022] PUT /identity/v3/projects/bd8c462cb0354f748ec4a7bfa561be3d/users/c89ddff4ad7c4ef1b382b760918d6054/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:01:24.756320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aede0d-75c6-4499-8a95-082c362f1d08 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:24.756936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aede0d-75c6-4499-8a95-082c362f1d08 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:24.756936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aede0d-75c6-4499-8a95-082c362f1d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:24.831542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-56aede0d-75c6-4499-8a95-082c362f1d08 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:24.840365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-56aede0d-75c6-4499-8a95-082c362f1d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:25.254279 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1499/3044] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:25.255720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:25.264327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:25.397454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4e96-6cd5-4c0e-b1a7-5a0df48379f7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:25.406091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:25.407057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:25.407519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:25.407964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:25.469980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:25.472018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:25.494026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1546/3045] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:31.384773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53f60-2962-446d-b7c2-f4b18312f1c5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:31.385875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53f60-2962-446d-b7c2-f4b18312f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:31.386326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53f60-2962-446d-b7c2-f4b18312f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:31.499557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-74f53f60-2962-446d-b7c2-f4b18312f1c5 None None] MFA Rules not processed for user `4006873e704042b6a4b62d643d4a4ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:31.501261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74f53f60-2962-446d-b7c2-f4b18312f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:31.808823 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1500/3046] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:38.067606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:38.069450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:38.320329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3515-c6fd-408c-8d34-f6f0cf35e84f service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:38.334937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc3a6b-8f28-413b-bda9-a5d2ab1864ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:38.335758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3a6b-8f28-413b-bda9-a5d2ab1864ce service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:38.336416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3a6b-8f28-413b-bda9-a5d2ab1864ce service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:38.336955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3a6b-8f28-413b-bda9-a5d2ab1864ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:38.371022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3a6b-8f28-413b-bda9-a5d2ab1864ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:38.375562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3a6b-8f28-413b-bda9-a5d2ab1864ce service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:38.406710 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1547/3047] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:39.065581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:39.066029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:39.066310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:39.115064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] MFA Rules not processed for user `c89ddff4ad7c4ef1b382b760918d6054`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:39.118272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:39.346418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1501/3048] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:39.363255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:39.364149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:39.364703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:39.431202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] MFA Rules not processed for user `c89ddff4ad7c4ef1b382b760918d6054`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:39.469017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:39.554520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1548/3049] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:43.826478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:43.828589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:44.042451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4b620-a9a6-4cf1-8f8a-6142403d992a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:44.050799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe881d-d5c8-48ea-b943-27ac40dc5d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:44.051742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe881d-d5c8-48ea-b943-27ac40dc5d4d service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:44.053461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe881d-d5c8-48ea-b943-27ac40dc5d4d service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:44.054664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe881d-d5c8-48ea-b943-27ac40dc5d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:44.079846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe881d-d5c8-48ea-b943-27ac40dc5d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:44.084759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe881d-d5c8-48ea-b943-27ac40dc5d4d service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:44.108933 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1502/3050] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:44.225710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:44.227421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:44.255454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce60fdc-f4f1-40d1-93c0-2480b5dbbaaa None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:44.262984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:44.264033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:44.264682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:44.265146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:44.267673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:44.399476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:44.401592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:44.441519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1549/3051] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:45.763211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e994b-8c92-4bb9-a951-8c04c47d2ed7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:45.763728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e994b-8c92-4bb9-a951-8c04c47d2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:45.763819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e994b-8c92-4bb9-a951-8c04c47d2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:45.807375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-670e994b-8c92-4bb9-a951-8c04c47d2ed7 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:45.809870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-670e994b-8c92-4bb9-a951-8c04c47d2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:45.934472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1503/3052] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:45.935076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:45.936583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:46.066743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e8ad-b7f1-42bc-87fb-74fe967c7702 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:46.080214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ca9cf-4cc3-4d97-b9ac-96a0e325171e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:46.081320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ca9cf-4cc3-4d97-b9ac-96a0e325171e service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:46.081777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ca9cf-4cc3-4d97-b9ac-96a0e325171e service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:46.082213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ca9cf-4cc3-4d97-b9ac-96a0e325171e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:46.098025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ca9cf-4cc3-4d97-b9ac-96a0e325171e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:46.100499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ca9cf-4cc3-4d97-b9ac-96a0e325171e service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:46.127609 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1550/3053] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:01:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:48.212788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc475-b881-49ca-86e2-27464ce1808f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:48.214708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc475-b881-49ca-86e2-27464ce1808f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:48.215237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc475-b881-49ca-86e2-27464ce1808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:48.282265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a04fc475-b881-49ca-86e2-27464ce1808f None None] MFA Rules not processed for user `33746e27054c4f1db976d4a4ae44e073`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:48.284321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a04fc475-b881-49ca-86e2-27464ce1808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:48.455539 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1504/3054] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:51.507567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775d7e-1aa5-4ef7-9247-8aaed1e13d49 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:51.508226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775d7e-1aa5-4ef7-9247-8aaed1e13d49 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:51.508226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775d7e-1aa5-4ef7-9247-8aaed1e13d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:51.532297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-28775d7e-1aa5-4ef7-9247-8aaed1e13d49 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:51.533916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-28775d7e-1aa5-4ef7-9247-8aaed1e13d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:51.581530 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1551/3055] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:51.581982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc475-b881-49ca-86e2-27464ce1808f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:51.609686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc475-b881-49ca-86e2-27464ce1808f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:51.632700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:51.633773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:51.634675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:51.635200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:51.663488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:51.671268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:51.724631 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1505/3056] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:01:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:53.035741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02c4be-7901-483a-92b4-154551af68bc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:53.036481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02c4be-7901-483a-92b4-154551af68bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:53.036481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02c4be-7901-483a-92b4-154551af68bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:53.075894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9f02c4be-7901-483a-92b4-154551af68bc None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:53.078423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9f02c4be-7901-483a-92b4-154551af68bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:53.089591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1552/3057] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:53.103520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:53.136512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d508c2-a5a3-41bb-b9ff-90e604c3df69 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:53.143073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f235bf-a761-41db-ae2f-de6db26b6788 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:53.144077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f235bf-a761-41db-ae2f-de6db26b6788 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:53.144612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f235bf-a761-41db-ae2f-de6db26b6788 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:53.145116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f235bf-a761-41db-ae2f-de6db26b6788 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:53.157408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f235bf-a761-41db-ae2f-de6db26b6788 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:53.158981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f235bf-a761-41db-ae2f-de6db26b6788 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:53.170792 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1506/3058] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:01:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:53.231018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02c4be-7901-483a-92b4-154551af68bc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:53.250889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02c4be-7901-483a-92b4-154551af68bc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:53.257794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0c043-42a6-4202-8bfa-32dbcec1b93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:53.258594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c043-42a6-4202-8bfa-32dbcec1b93e service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:53.259054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c043-42a6-4202-8bfa-32dbcec1b93e service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:53.259547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c043-42a6-4202-8bfa-32dbcec1b93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:53.261736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6c0c043-42a6-4202-8bfa-32dbcec1b93e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:53.352554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0c043-42a6-4202-8bfa-32dbcec1b93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:53.354409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0c043-42a6-4202-8bfa-32dbcec1b93e service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:53.377740 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1553/3059] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:55.173476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c855ca-18f6-4572-88ef-025901a38e11 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:55.174077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c855ca-18f6-4572-88ef-025901a38e11 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:55.174077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c855ca-18f6-4572-88ef-025901a38e11 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:55.175485 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1507/3060] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:01:55.181305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6750e-f8bb-4afb-8131-7b2332e59987 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:55.181936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6750e-f8bb-4afb-8131-7b2332e59987 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:55.182222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6750e-f8bb-4afb-8131-7b2332e59987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:55.216900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-82b6750e-f8bb-4afb-8131-7b2332e59987 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:55.222908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-82b6750e-f8bb-4afb-8131-7b2332e59987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:55.377283 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1554/3061] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:01:55.413835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c855ca-18f6-4572-88ef-025901a38e11 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:55.415667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d7c855ca-18f6-4572-88ef-025901a38e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:55.436787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c855ca-18f6-4572-88ef-025901a38e11 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:55.443280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dd19c-551b-4744-b580-01ad9c1b2c19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:55.444141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd19c-551b-4744-b580-01ad9c1b2c19 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:55.444581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd19c-551b-4744-b580-01ad9c1b2c19 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:55.445600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd19c-551b-4744-b580-01ad9c1b2c19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:55.461684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dd19c-551b-4744-b580-01ad9c1b2c19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:55.463807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dd19c-551b-4744-b580-01ad9c1b2c19 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:55.483943 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1508/3062] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:55.750430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6750e-f8bb-4afb-8131-7b2332e59987 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:55.774943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6750e-f8bb-4afb-8131-7b2332e59987 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:55.793172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:55.794421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:55.794421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:55.794646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:55.797468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:55.818563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:55.820745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:55.839370 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1555/3063] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:01:59.427110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:59.427751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:59.427751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:59.451140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:01:59.452852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:59.480065 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1509/3064] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:01:59.521873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:59.549896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d7e0-19ed-4ce1-95b7-ec109578340b service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:01:59.571086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:01:59.574034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:01:59.574347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:01:59.575783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:01:59.604359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:01:59.608112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:01:59.655160 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1556/3065] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:59.755233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:01:59.757451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:01:59.990212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b2378-7e64-48dd-a2ff-72a903101e23 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:00.011041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:00.012509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:00.012969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:00.013544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:00.023788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:00.274523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:00.289522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:00.328802 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1510/3066] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:01:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:02:09.820577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:09.842244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952527-627b-425d-9e86-eed90966f4a2 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:09.853906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed027187-2877-4413-944c-e77f5dafe81a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:09.854785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027187-2877-4413-944c-e77f5dafe81a service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:09.855431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027187-2877-4413-944c-e77f5dafe81a service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:09.857387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027187-2877-4413-944c-e77f5dafe81a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:09.860538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ed027187-2877-4413-944c-e77f5dafe81a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:09.994402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed027187-2877-4413-944c-e77f5dafe81a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:09.997972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed027187-2877-4413-944c-e77f5dafe81a service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:10.011015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1557/3067] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:12.119594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:12.162188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaac03-1ec3-47c6-bb56-7ce51c5cc2e0 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:12.172859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9ec2b-7861-440f-959e-a14660898f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:12.174116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ec2b-7861-440f-959e-a14660898f66 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:12.174686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ec2b-7861-440f-959e-a14660898f66 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:12.175166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ec2b-7861-440f-959e-a14660898f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:12.177700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dab9ec2b-7861-440f-959e-a14660898f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:12.194742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9ec2b-7861-440f-959e-a14660898f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:12.197069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9ec2b-7861-440f-959e-a14660898f66 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:12.233507 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1511/3068] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:12.924531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac66e6-b899-445b-904f-f97989e192fc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:12.925026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac66e6-b899-445b-904f-f97989e192fc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:12.925158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac66e6-b899-445b-904f-f97989e192fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:12.957378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fcac66e6-b899-445b-904f-f97989e192fc None None] MFA Rules not processed for user `dd753dc1202f4e138094f0f50b83b2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:12.960361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fcac66e6-b899-445b-904f-f97989e192fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:12.971782 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1558/3069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:14.202043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da300880-0554-4998-9b34-59eb50dd18bf None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:14.202711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da300880-0554-4998-9b34-59eb50dd18bf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:14.202711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da300880-0554-4998-9b34-59eb50dd18bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:14.241651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-da300880-0554-4998-9b34-59eb50dd18bf None None] MFA Rules not processed for user `c89ddff4ad7c4ef1b382b760918d6054`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:14.244130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-da300880-0554-4998-9b34-59eb50dd18bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:14.254460 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1512/3070] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:14.975011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac66e6-b899-445b-904f-f97989e192fc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:14.994592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac66e6-b899-445b-904f-f97989e192fc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:15.016616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:15.017299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:15.017578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:15.017851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:15.020830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:15.039441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:15.042319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:15.057757 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1559/3071] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:19.609305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca268df-47c1-4d13-8b8e-1a36057bec29 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:19.609832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca268df-47c1-4d13-8b8e-1a36057bec29 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:19.609950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca268df-47c1-4d13-8b8e-1a36057bec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:19.629273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1ca268df-47c1-4d13-8b8e-1a36057bec29 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:19.630505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1ca268df-47c1-4d13-8b8e-1a36057bec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:19.638417 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1513/3072] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:19.653890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:19.671003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69569-a219-4a4c-b796-58fab718df07 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:19.677999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:19.678648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:19.678969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:19.679261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:19.690841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:19.693732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:19.703296 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1560/3073] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:02:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:20.458811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:20.459308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:20.459740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:20.491857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:20.493786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:20.504411 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1514/3074] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:02:20.518060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:20.529354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0b413-1fae-449e-b7af-ceb27cc75244 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:20.538137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:20.538841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:20.539186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:20.539554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:20.552666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:20.555296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:20.567043 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1561/3075] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:02:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:29.286073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:29.287604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:29.305119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cbbd7-9dc8-4550-b285-fb9be447f14b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:29.311802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:29.313376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:29.313911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:29.314403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:29.318988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:29.342851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:29.344995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:29.368561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1515/3076] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:30.404266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:30.405848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:30.421849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f2f7-41ec-491a-8099-23e3ab4e0ac9 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:30.428131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:30.428551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:30.428855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:30.429160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] PATH_INFO: `/v3/users/33746e27054c4f1db976d4a4ae44e073` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:30.430369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33746e27054c4f1db976d4a4ae44e073)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:30.432490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:30.484351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33746e27054c4f1db976d4a4ae44e073'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:30.485149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33746e27054c4f1db976d4a4ae44e073'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:30.492728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33746e27054c4f1db976d4a4ae44e073'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:30.501588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33746e27054c4f1db976d4a4ae44e073'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:30.502256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bb302090-bcef-4a8c-b280-7878aebd4e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33746e27054c4f1db976d4a4ae44e073'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:30.520886 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1562/3077] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:30 2022] DELETE /identity/v3/users/33746e27054c4f1db976d4a4ae44e073 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:31.055172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:31.083543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998753de-75bf-4be9-8f8b-91317fdfe4fd service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:31.246016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:31.246943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:31.247207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:31.249756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] PATH_INFO: `/v3/projects/333402ee57fb405f856c323a638d2b7c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:31.251252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] RBAC: Authorizing `identity:delete_project(project_id=333402ee57fb405f856c323a638d2b7c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:31.253787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:31.339898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333402ee57fb405f856c323a638d2b7c', 'request_id': 'req-0761ec21-3e64-4bb3-bccc-c3df76b9376a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:31.347419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333402ee57fb405f856c323a638d2b7c', 'request_id': 'req-0761ec21-3e64-4bb3-bccc-c3df76b9376a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:31.361695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333402ee57fb405f856c323a638d2b7c', 'request_id': 'req-0761ec21-3e64-4bb3-bccc-c3df76b9376a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:31.381290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] The token cache is being invalidate because project 333402ee57fb405f856c323a638d2b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:31.381860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:31.383903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0761ec21-3e64-4bb3-bccc-c3df76b9376a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:31.386745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1516/3078] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:31 2022] DELETE /identity/v3/projects/333402ee57fb405f856c323a638d2b7c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:31.392674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a3e3-9c6a-4e94-9b7d-eb12e82f86fa None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:31.392968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a3e3-9c6a-4e94-9b7d-eb12e82f86fa None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:31.393386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a3e3-9c6a-4e94-9b7d-eb12e82f86fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:31.420397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5620a3e3-9c6a-4e94-9b7d-eb12e82f86fa None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:31.422072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5620a3e3-9c6a-4e94-9b7d-eb12e82f86fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:31.548077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1563/3079] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:31.556667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb051-2747-4da3-9ab0-2961c5fd579c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:31.557492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb051-2747-4da3-9ab0-2961c5fd579c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:31.557997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb051-2747-4da3-9ab0-2961c5fd579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:31.585579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-db7eb051-2747-4da3-9ab0-2961c5fd579c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:31.587757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-db7eb051-2747-4da3-9ab0-2961c5fd579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:31.602307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1517/3080] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:31.607062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620a3e3-9c6a-4e94-9b7d-eb12e82f86fa None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:31.631520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620a3e3-9c6a-4e94-9b7d-eb12e82f86fa None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:31.631520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:31.631520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:31.631520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:31.631906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:31.635870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:31.636448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:31.638760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:31.658210 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1564/3081] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:31.663111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb051-2747-4da3-9ab0-2961c5fd579c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:31.675304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb051-2747-4da3-9ab0-2961c5fd579c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:31.684892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:31.686319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:31.687954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:31.689317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:31.691551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:31.694448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:31.759270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1518/3082] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:31 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:31.763207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:31.779453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ec902-3a15-475d-90f5-19718136c869 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:31.934559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:31.935583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:31.936043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:31.936676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:31.938677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:31.941000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:31.996664 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1565/3083] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:31 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:31.996937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:32.025176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f59a-c0cf-4c8c-849e-1682b57a956d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:32.041843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:32.042812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:32.043471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:32.043471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:32.044130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:32.046330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:32.061119 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1519/3084] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:32.064714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:32.081434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24e06-a386-492a-9550-770079aea0ef admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:32.087106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7310cb-a5c7-4c4c-a626-a72403155c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:32.088912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7310cb-a5c7-4c4c-a626-a72403155c6f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:32.089748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7310cb-a5c7-4c4c-a626-a72403155c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:32.091164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7310cb-a5c7-4c4c-a626-a72403155c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:32.092141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7310cb-a5c7-4c4c-a626-a72403155c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:32.093978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7310cb-a5c7-4c4c-a626-a72403155c6f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:32.115828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:32.116384 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1566/3085] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:32.131647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89d6c-2c36-4ee9-9e07-72a07c34df2c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:32.138670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:32.141235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:32.141766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:32.142188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] PATH_INFO: `/v3/projects/ed5c4a7f5181441d9d3db5d4ed86133b/users/f6869f687bd8411ea81a24f566fef6b2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:32.165080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5c4a7f5181441d9d3db5d4ed86133b, user_id=f6869f687bd8411ea81a24f566fef6b2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:32.168700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:32.209653 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1520/3086] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:32 2022] PUT /identity/v3/projects/ed5c4a7f5181441d9d3db5d4ed86133b/users/f6869f687bd8411ea81a24f566fef6b2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:32.217960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50812-36b1-4f40-bd48-ab3be716094b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:32.218886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50812-36b1-4f40-bd48-ab3be716094b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:32.219485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50812-36b1-4f40-bd48-ab3be716094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:32.263481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-69c50812-36b1-4f40-bd48-ab3be716094b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:32.265476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-69c50812-36b1-4f40-bd48-ab3be716094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:32.427361 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1567/3087] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:32.475561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:32.477582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:32.553523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b225e0-99bc-435c-974f-d2145cb82715 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:32.560168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:32.560848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:32.561181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:32.561617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:32.573441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:32.575302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:32.590964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1521/3088] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:35.266245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50196-f48a-4945-af17-970521bf79b2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:35.266729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50196-f48a-4945-af17-970521bf79b2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:35.266937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50196-f48a-4945-af17-970521bf79b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:35.368717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:35.370835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:35.411553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-75b50196-f48a-4945-af17-970521bf79b2 None None] MFA Rules not processed for user `f6869f687bd8411ea81a24f566fef6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:35.413396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75b50196-f48a-4945-af17-970521bf79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:35.634945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c08578-d02f-4f3a-9fab-772c7fc9500f service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:35.643109 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1568/3089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:35.654757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:35.655340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:35.655776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:35.662543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4d3d4-d070-427d-a555-002357d1b06f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:35.665088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d3d4-d070-427d-a555-002357d1b06f service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:35.673617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d3d4-d070-427d-a555-002357d1b06f service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:35.674105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d3d4-d070-427d-a555-002357d1b06f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:35.681931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-52c4d3d4-d070-427d-a555-002357d1b06f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:35.687827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] MFA Rules not processed for user `f6869f687bd8411ea81a24f566fef6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:35.690663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:35.707981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1569/3090] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:35.709179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:35.711026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:35.738133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4d3d4-d070-427d-a555-002357d1b06f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:35.740544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4d3d4-d070-427d-a555-002357d1b06f service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:35.741737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ccf59-0bf7-4c38-8256-bd22c9001d65 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:35.760298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea3727-4e45-4603-a3f9-2e0057e311f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:35.762525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3727-4e45-4603-a3f9-2e0057e311f3 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:35.762879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3727-4e45-4603-a3f9-2e0057e311f3 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:35.770234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3727-4e45-4603-a3f9-2e0057e311f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:35.787970 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1522/3091] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:35.794887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea3727-4e45-4603-a3f9-2e0057e311f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:35.800844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea3727-4e45-4603-a3f9-2e0057e311f3 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:35.815579 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1570/3092] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:36.279939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec17dc2-950b-4297-889e-e1d90e25fc8c None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:36.280241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec17dc2-950b-4297-889e-e1d90e25fc8c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:36.280667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec17dc2-950b-4297-889e-e1d90e25fc8c None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:36.282647 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1523/3093] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:02:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:02:36.292357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:36.293354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:36.293624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:36.339477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:36.341197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:36.377193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1571/3094] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:36.427882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec17dc2-950b-4297-889e-e1d90e25fc8c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:36.462815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec17dc2-950b-4297-889e-e1d90e25fc8c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:36.474871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:36.476365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:36.476661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:36.476944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:36.493125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:36.496772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:36.518692 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1524/3095] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:36.884335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:36.887998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:37.020775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036e87-0dd5-4328-8361-5ab9942930bb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:37.040077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8d818-fb3f-4fef-8e5c-029613be7fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:37.040908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8d818-fb3f-4fef-8e5c-029613be7fb4 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:37.042648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8d818-fb3f-4fef-8e5c-029613be7fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:37.043987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8d818-fb3f-4fef-8e5c-029613be7fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:37.066234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8d818-fb3f-4fef-8e5c-029613be7fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:37.070416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8d818-fb3f-4fef-8e5c-029613be7fb4 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:37.083966 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1572/3096] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:37.380898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:37.383176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:37.420359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b790d-5cd7-4d4e-b1db-be6e21dd4fbc service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:37.429151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:37.455882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:37.456557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:37.457163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] PATH_INFO: `/v3/users/702df47948994dd085132f3264ff66f5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:37.461585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=702df47948994dd085132f3264ff66f5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:37.468362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:37.574878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702df47948994dd085132f3264ff66f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:37.576661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702df47948994dd085132f3264ff66f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:37.588994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702df47948994dd085132f3264ff66f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:37.590150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702df47948994dd085132f3264ff66f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:37.605797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702df47948994dd085132f3264ff66f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:37.655819 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1525/3097] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:37 2022] DELETE /identity/v3/users/702df47948994dd085132f3264ff66f5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:37.662573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:37.663081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:37.663186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:37.751521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:37.758468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:37.900855 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1573/3098] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:37.962280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:37.964063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:38.127413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395898-acb7-47c8-b801-82f2885caa4c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:38.133482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:38.135034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:38.135778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:38.136484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:38.152914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:38.154638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:38.167927 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1526/3099] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:38.719924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:38.721549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:38.736768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a063ba-acb7-4b3c-a894-20e2441b1fc2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:38.743169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:38.744120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:38.744637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:38.745091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] PATH_INFO: `/v3/users/08995e63d5ec446bbcf643822d5f37c7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:38.747355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:38.749359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:38.758228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08995e63d5ec446bbcf643822d5f37c7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:38.763711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:38.769814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34e7ff-e04a-4d9f-b0a4-a1bb7e816a11 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:38.782117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:38.784187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:38.788638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:38.789346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] PATH_INFO: `/v3/projects/34832c64cfe049768207fb5cb0dfc2a7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:38.791242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=34832c64cfe049768207fb5cb0dfc2a7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:38.794812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:38.876492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34832c64cfe049768207fb5cb0dfc2a7', 'request_id': 'req-7c54c20c-5880-4fed-a2af-84370ec73dfd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.878331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08995e63d5ec446bbcf643822d5f37c7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.879264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08995e63d5ec446bbcf643822d5f37c7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.885895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34832c64cfe049768207fb5cb0dfc2a7', 'request_id': 'req-7c54c20c-5880-4fed-a2af-84370ec73dfd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.888604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08995e63d5ec446bbcf643822d5f37c7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.900630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34832c64cfe049768207fb5cb0dfc2a7', 'request_id': 'req-7c54c20c-5880-4fed-a2af-84370ec73dfd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.909987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08995e63d5ec446bbcf643822d5f37c7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.912239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803521c1-9a09-4106-80d1-1d265d135f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08995e63d5ec446bbcf643822d5f37c7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.929198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] The token cache is being invalidate because project 34832c64cfe049768207fb5cb0dfc2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:38.930231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.932570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7c54c20c-5880-4fed-a2af-84370ec73dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:38.940975 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1527/3100] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:38 2022] DELETE /identity/v3/projects/34832c64cfe049768207fb5cb0dfc2a7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:38.944800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47756-772e-4139-95c3-dbb5d67127e5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:38.946041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47756-772e-4139-95c3-dbb5d67127e5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:38.946685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47756-772e-4139-95c3-dbb5d67127e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:38.954772 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1574/3101] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:38 2022] DELETE /identity/v3/users/08995e63d5ec446bbcf643822d5f37c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:38.976232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-17b47756-772e-4139-95c3-dbb5d67127e5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:38.978168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-17b47756-772e-4139-95c3-dbb5d67127e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:39.088274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1528/3102] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:39.096671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df06d-43d4-47e1-b9a8-8f9b5e4b8651 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.096876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df06d-43d4-47e1-b9a8-8f9b5e4b8651 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.098226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df06d-43d4-47e1-b9a8-8f9b5e4b8651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.148643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cf5df06d-43d4-47e1-b9a8-8f9b5e4b8651 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:39.150192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cf5df06d-43d4-47e1-b9a8-8f9b5e4b8651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:39.169445 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1575/3103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:39.173749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b47756-772e-4139-95c3-dbb5d67127e5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.206391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b47756-772e-4139-95c3-dbb5d67127e5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:39.222899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:39.224897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.226318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.227492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.228264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:39.228630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:39.230286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:39.246253 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1529/3104] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:39.253261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5df06d-43d4-47e1-b9a8-8f9b5e4b8651 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.266921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5df06d-43d4-47e1-b9a8-8f9b5e4b8651 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:39.274510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:39.275731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.276069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.276633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.277488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:39.280399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:39.329191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1576/3105] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:39 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:39.333235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.344103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18676735-d0ff-47a5-9fdd-b714c786eaba admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:39.383094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.385919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:39.533324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:39.534112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.534453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.534949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.535786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:39.538651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:39.578294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1530/3106] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:39 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:39.581819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.589226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718d938-2a15-4473-b158-72c0fe74c4fa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:39.603338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:39.604560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.605006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.605723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] PATH_INFO: `/v3/projects/8584541985ac44cc923c89a5a518ec32` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.606507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1aaa6-beab-46bb-9901-d9ecb24451d0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:39.607532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8584541985ac44cc923c89a5a518ec32)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:39.610251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:39.622589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:39.623332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.623552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.623881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.624587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:39.626758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:39.665517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1531/3107] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:39.666571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.680551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10460b-a53f-4d60-bdf5-5336028101fc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:39.699172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8584541985ac44cc923c89a5a518ec32', 'request_id': 'req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:39.705630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8584541985ac44cc923c89a5a518ec32', 'request_id': 'req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:39.719874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8584541985ac44cc923c89a5a518ec32', 'request_id': 'req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:39.735486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] The token cache is being invalidate because project 8584541985ac44cc923c89a5a518ec32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:39.736202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:39.736996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9bd0ac3-ea62-4d19-bd3a-de0924b175ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:39.739317 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1577/3108] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:39 2022] DELETE /identity/v3/projects/8584541985ac44cc923c89a5a518ec32 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:39.747382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7ff8d-7171-43b8-b52b-fa3f4d433557 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.747656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7ff8d-7171-43b8-b52b-fa3f4d433557 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.747939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7ff8d-7171-43b8-b52b-fa3f4d433557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.772472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-06b7ff8d-7171-43b8-b52b-fa3f4d433557 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:39.773796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-06b7ff8d-7171-43b8-b52b-fa3f4d433557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:39.790102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:39.790807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.791402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.791687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.792418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:39.794438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:39.806186 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1532/3109] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:39.810138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.812164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:39.827057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f37940-ec7d-4600-bb1b-abe004c569ea admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:39.832447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827bc6-bc2c-4f15-b3f5-55731e6eb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:39.833451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827bc6-bc2c-4f15-b3f5-55731e6eb198 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.833708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827bc6-bc2c-4f15-b3f5-55731e6eb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.833980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827bc6-bc2c-4f15-b3f5-55731e6eb198 admin admin] PATH_INFO: `/v3/projects/13cb060a48dc43898f363e5ba7d1ac6b/users/896b459a03794929a8eb550ac617b2db/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.852993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827bc6-bc2c-4f15-b3f5-55731e6eb198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb060a48dc43898f363e5ba7d1ac6b, user_id=896b459a03794929a8eb550ac617b2db, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:39.856309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827bc6-bc2c-4f15-b3f5-55731e6eb198 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:39.874837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1533/3110] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:39 2022] PUT /identity/v3/projects/13cb060a48dc43898f363e5ba7d1ac6b/users/896b459a03794929a8eb550ac617b2db/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:39.879757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.880257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.880724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.890671 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1578/3111] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:39.892805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf937c3-5822-471f-a3e4-36e7afaeedce None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:39.893258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf937c3-5822-471f-a3e4-36e7afaeedce None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:39.893633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf937c3-5822-471f-a3e4-36e7afaeedce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:39.903187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:39.904625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:39.916504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4cf937c3-5822-471f-a3e4-36e7afaeedce None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:39.917928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4cf937c3-5822-471f-a3e4-36e7afaeedce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:39.983552 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1534/3112] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:39.993292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:39.998740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:40.014016 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1579/3113] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:02:40.015248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf937c3-5822-471f-a3e4-36e7afaeedce None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:40.028318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf937c3-5822-471f-a3e4-36e7afaeedce None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.033971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.034908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.035282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.035647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.036480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:40.037069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.039329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.056212 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1580/3114] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:40.060910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:40.075926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095ac0-36a7-4d93-9979-1db691ccf986 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.087605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.088512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.089804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.091483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.092495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.094504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e634d9-a1dd-4fa0-aae7-7d94682fdf89 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.095009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.100011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.101185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.101624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.102192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.124530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.126714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.140958 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1535/3115] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:40.151820 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1581/3116] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:40 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:40.153449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:40.165364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f183057-8c97-4739-a03c-b96d83a00016 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.281094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.283705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.285220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.285572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.294367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.294367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.342262 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1536/3117] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:40 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:02:40.346827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:40.358635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ea2fb-4274-4e00-9134-67c493c82982 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.367446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.368381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.368508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.368776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.369851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.371722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.388763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:40.389258 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1582/3118] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:40.404984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa423de-7a6d-422c-92d9-6614a4b4738c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.412517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1539-bb74-49d3-8320-b1010f7798da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.413079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1539-bb74-49d3-8320-b1010f7798da admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.413369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1539-bb74-49d3-8320-b1010f7798da admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.414269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1539-bb74-49d3-8320-b1010f7798da admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.415023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1539-bb74-49d3-8320-b1010f7798da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.416699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1539-bb74-49d3-8320-b1010f7798da admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.437528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:40.437987 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1537/3119] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:40.452110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea580-532b-4d2e-a409-ce0614046e07 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.454710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.455623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.455944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.456260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] PATH_INFO: `/v3/projects/8e0bf14b8dad4360adb4727282b63237/users/57553270540e4163aad06138d03f9cb4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.476582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0bf14b8dad4360adb4727282b63237, user_id=57553270540e4163aad06138d03f9cb4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.480185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.505649 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1583/3120] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:40 2022] PUT /identity/v3/projects/8e0bf14b8dad4360adb4727282b63237/users/57553270540e4163aad06138d03f9cb4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:40.511192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100009e3-17f3-4bb4-abd1-3e1b96042d7b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.511508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100009e3-17f3-4bb4-abd1-3e1b96042d7b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.511765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100009e3-17f3-4bb4-abd1-3e1b96042d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.533296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-100009e3-17f3-4bb4-abd1-3e1b96042d7b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:40.534507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-100009e3-17f3-4bb4-abd1-3e1b96042d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:40.608179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1538/3121] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:02:40.618212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:40.620165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:40.679133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8c057-29f5-4a6f-b80f-6d74e23d8e70 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:40.684819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:40.685582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:40.685774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:40.686045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:40.695969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:40.697639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:40.708078 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1584/3122] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:41.273768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e6c45-20df-458d-b801-f973e9d6574c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:41.274380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e6c45-20df-458d-b801-f973e9d6574c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:41.274380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e6c45-20df-458d-b801-f973e9d6574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:41.339940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-034e6c45-20df-458d-b801-f973e9d6574c None None] MFA Rules not processed for user `896b459a03794929a8eb550ac617b2db`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:41.341836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-034e6c45-20df-458d-b801-f973e9d6574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:41.475763 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1539/3123] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:41.747955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:41.749638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:41.860242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cabb7-5653-4801-b286-1381bd8dd9e1 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:41.867899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f5ed1-dc9a-4694-85a1-25553d328913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:41.869313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5ed1-dc9a-4694-85a1-25553d328913 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:41.869866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5ed1-dc9a-4694-85a1-25553d328913 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:41.870340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5ed1-dc9a-4694-85a1-25553d328913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:41.889153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f5ed1-dc9a-4694-85a1-25553d328913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:41.892352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f5ed1-dc9a-4694-85a1-25553d328913 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:41.905801 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1585/3124] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:42.292497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:42.293128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:42.293128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:42.344579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] MFA Rules not processed for user `57553270540e4163aad06138d03f9cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:42.346099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:42.509708 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1540/3125] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:42.520658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f763a-8999-4a49-ae15-095653e42154 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:42.521715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f763a-8999-4a49-ae15-095653e42154 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:42.522158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f763a-8999-4a49-ae15-095653e42154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:42.559348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-549f763a-8999-4a49-ae15-095653e42154 None None] MFA Rules not processed for user `57553270540e4163aad06138d03f9cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:42.560681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-549f763a-8999-4a49-ae15-095653e42154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:42.572299 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1586/3126] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:42.666145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:42.668369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:42.701213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16ce1-c86a-46ee-a4c9-64fad09d2e44 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:42.718162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:42.718772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:42.722943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:42.723228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:42.742267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:42.744807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:42.760857 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1541/3127] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:02:47.030008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f763a-8999-4a49-ae15-095653e42154 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:47.032226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-549f763a-8999-4a49-ae15-095653e42154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:47.037998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:47.041590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:47.128825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f763a-8999-4a49-ae15-095653e42154 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:47.136117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:47.137629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:47.138660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:47.139580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:47.142782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:47.161534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:47.166527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:47.180635 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1587/3128] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:47.232910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ff2a-bdb6-46ac-b771-1aa5f51e951f service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:47.254034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61fee4-62f1-4f6e-ad4f-8bc1a8d319b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:47.256466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fee4-62f1-4f6e-ad4f-8bc1a8d319b0 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:47.256947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fee4-62f1-4f6e-ad4f-8bc1a8d319b0 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:47.257268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fee4-62f1-4f6e-ad4f-8bc1a8d319b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:47.278864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61fee4-62f1-4f6e-ad4f-8bc1a8d319b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:47.282736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61fee4-62f1-4f6e-ad4f-8bc1a8d319b0 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:47.314617 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1542/3129] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:47.703259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:47.705362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:47.727535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5de67d-5e74-452d-874e-14e3589b03ee service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:47.735955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:47.736968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:47.737646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:47.738040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] PATH_INFO: `/v3/users/5ab294d1890047aababb87b3a865a14c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:47.739730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab294d1890047aababb87b3a865a14c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:47.741989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:47.841028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab294d1890047aababb87b3a865a14c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:47.842005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab294d1890047aababb87b3a865a14c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:47.866677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab294d1890047aababb87b3a865a14c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:47.889421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab294d1890047aababb87b3a865a14c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:47.890120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab294d1890047aababb87b3a865a14c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:47.930543 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1588/3130] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:47 2022] DELETE /identity/v3/users/5ab294d1890047aababb87b3a865a14c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:47.938604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:47.939290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:47.939612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:47.973272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:47.974994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:48.136958 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1543/3131] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:48.142381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:48.143842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:48.207927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4ef01-4527-4ffe-a39c-ebc994d6fd7a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:48.212458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:48.213229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:48.213570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:48.213934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:48.223515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:48.225096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:48.234930 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1589/3132] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:48.524972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:48.528068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:48.544259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47db37e-760a-4371-a1d8-8f26c6a044fc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:48.550696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:48.552399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:48.552921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:48.553452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] PATH_INFO: `/v3/projects/e77d97d277f245d4822a646af7d5f50d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:48.555085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77d97d277f245d4822a646af7d5f50d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:48.557363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:48.625173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77d97d277f245d4822a646af7d5f50d', 'request_id': 'req-3bce2990-b427-494b-b757-cbb2dd325fe2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.632984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77d97d277f245d4822a646af7d5f50d', 'request_id': 'req-3bce2990-b427-494b-b757-cbb2dd325fe2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.645115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77d97d277f245d4822a646af7d5f50d', 'request_id': 'req-3bce2990-b427-494b-b757-cbb2dd325fe2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.657630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] The token cache is being invalidate because project e77d97d277f245d4822a646af7d5f50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:48.657908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.658830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.660984 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1544/3133] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:48 2022] DELETE /identity/v3/projects/e77d97d277f245d4822a646af7d5f50d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:48.665127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:48.677167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed591-1cd5-4632-9b2a-23168b215018 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:48.760265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:48.762007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:48.762419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:48.762785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] PATH_INFO: `/v3/users/0997b8a27edd4cc88479af11c71e53e6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:48.764563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0997b8a27edd4cc88479af11c71e53e6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:48.767230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:48.852649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0997b8a27edd4cc88479af11c71e53e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.854399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0997b8a27edd4cc88479af11c71e53e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.862357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0997b8a27edd4cc88479af11c71e53e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.871605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0997b8a27edd4cc88479af11c71e53e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.872703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38b80fc1-3c86-43af-a0a0-2e71c31b3cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0997b8a27edd4cc88479af11c71e53e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:48.896011 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1590/3134] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:48 2022] DELETE /identity/v3/users/0997b8a27edd4cc88479af11c71e53e6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:49.388471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:49.389608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:49.407786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce2990-b427-494b-b757-cbb2dd325fe2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:49.509870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:49.510757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:49.511041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:49.511309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] PATH_INFO: `/v3/projects/dc2f1362b9454910aca78105376f906b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:49.512725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2f1362b9454910aca78105376f906b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:49.514816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:49.568514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2f1362b9454910aca78105376f906b', 'request_id': 'req-d5d77290-d5f3-45a5-a0b2-768023a87b7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:49.576412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2f1362b9454910aca78105376f906b', 'request_id': 'req-d5d77290-d5f3-45a5-a0b2-768023a87b7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:49.587595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2f1362b9454910aca78105376f906b', 'request_id': 'req-d5d77290-d5f3-45a5-a0b2-768023a87b7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:49.601742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] The token cache is being invalidate because project dc2f1362b9454910aca78105376f906b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:49.602028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:49.602956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5d77290-d5f3-45a5-a0b2-768023a87b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:49.605610 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1545/3135] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:49 2022] DELETE /identity/v3/projects/dc2f1362b9454910aca78105376f906b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:49.611055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4257e-ada6-47e4-8f7a-6aa526e9d6e4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:49.611055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4257e-ada6-47e4-8f7a-6aa526e9d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:49.611723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4257e-ada6-47e4-8f7a-6aa526e9d6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:49.632805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c3a4257e-ada6-47e4-8f7a-6aa526e9d6e4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:49.634150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c3a4257e-ada6-47e4-8f7a-6aa526e9d6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:49.716707 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1591/3136] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:49.718741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbfd4e-4ba5-4f29-a59d-ee8b29a3b68c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:49.719582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbfd4e-4ba5-4f29-a59d-ee8b29a3b68c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:49.719874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbfd4e-4ba5-4f29-a59d-ee8b29a3b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:49.754518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-11fbfd4e-4ba5-4f29-a59d-ee8b29a3b68c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:49.756182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-11fbfd4e-4ba5-4f29-a59d-ee8b29a3b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:49.764973 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1546/3137] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:49.769403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4257e-ada6-47e4-8f7a-6aa526e9d6e4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:49.780331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4257e-ada6-47e4-8f7a-6aa526e9d6e4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:49.785994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:49.787097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:49.787566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:49.787845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:49.788589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:49.789106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:49.791056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:49.804187 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1592/3138] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:49.808963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbfd4e-4ba5-4f29-a59d-ee8b29a3b68c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:49.819025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbfd4e-4ba5-4f29-a59d-ee8b29a3b68c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:49.826949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:49.827742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:49.828089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:49.828432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:49.829537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:49.831607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:49.863148 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1547/3139] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:49 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:49.867442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:49.878782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e6657-929e-4ca0-8852-1ada10e8b59c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:49.968207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:49.968913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:49.969366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:49.969643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:49.970354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:49.972685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.000053 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1593/3140] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:49 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:50.001361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.012861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e6d7b-9e32-419d-ab82-c373d15b21ec admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.019336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.021278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.021732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.022176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.023111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.025000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.037352 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1548/3141] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:02:50.042479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.053123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9df9-6605-44cc-b0f7-70d7f4ed04ac admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.058070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9dc28-c2dd-4710-b8b0-5c0770083a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.058983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9dc28-c2dd-4710-b8b0-5c0770083a0a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.059265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9dc28-c2dd-4710-b8b0-5c0770083a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.059542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9dc28-c2dd-4710-b8b0-5c0770083a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.060280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9dc28-c2dd-4710-b8b0-5c0770083a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.061960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9dc28-c2dd-4710-b8b0-5c0770083a0a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.073505 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1594/3142] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:50.079495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.093084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f83ca3-4256-4c69-8611-cefac9445b73 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.103197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.104104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.104381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.104648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] PATH_INFO: `/v3/projects/6ebf1c29b3474bc5a1e9ead0d9376394/users/a6784ddd89c244979a85a6f0e6a72382/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.127338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf1c29b3474bc5a1e9ead0d9376394, user_id=a6784ddd89c244979a85a6f0e6a72382, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.130383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.153088 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1549/3143] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:50 2022] PUT /identity/v3/projects/6ebf1c29b3474bc5a1e9ead0d9376394/users/a6784ddd89c244979a85a6f0e6a72382/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:50.161671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc0b0-9941-4960-8a8d-22509142939f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.162915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc0b0-9941-4960-8a8d-22509142939f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.163703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc0b0-9941-4960-8a8d-22509142939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.201736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bdedc0b0-9941-4960-8a8d-22509142939f None None] MFA Rules not processed for user `a6784ddd89c244979a85a6f0e6a72382`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:50.204792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bdedc0b0-9941-4960-8a8d-22509142939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:50.299039 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1595/3144] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:50.303359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.381307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7a87-60ba-4510-9479-482cd72956a7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.408478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.410720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.411110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.411508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.412315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.414494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.459242 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1550/3145] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:50 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:50.462031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedc0b0-9941-4960-8a8d-22509142939f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.481134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedc0b0-9941-4960-8a8d-22509142939f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.539980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.540764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.541061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.541402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.542100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.544395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.570001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1596/3146] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:50 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:50.571364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.581910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936c756-7673-4087-929f-55a0167eaba8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.587109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.587983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.588168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.588692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.589450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.591361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.605222 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1551/3147] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:02:50.609279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.620189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2806e-da04-4e82-8597-1455a5581659 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.625440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.626601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.627044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.627477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] PATH_INFO: `/v3/projects/eee999ba637e4e588ffe216cacbcca85/users/35be73c86a98494793d3e6696d585cd5/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.643916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee999ba637e4e588ffe216cacbcca85, user_id=35be73c86a98494793d3e6696d585cd5, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.647336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.663457 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1597/3148] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:50 2022] PUT /identity/v3/projects/eee999ba637e4e588ffe216cacbcca85/users/35be73c86a98494793d3e6696d585cd5/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:50.667524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.677557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187610-7a4a-434c-8dfc-9a62005289b1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.735943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f522-6457-4d66-9278-034ac1c12e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.736252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f522-6457-4d66-9278-034ac1c12e07 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.736541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f522-6457-4d66-9278-034ac1c12e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.736817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f522-6457-4d66-9278-034ac1c12e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.737612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f522-6457-4d66-9278-034ac1c12e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.739253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f522-6457-4d66-9278-034ac1c12e07 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.749929 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1552/3149] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:50.754186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:50.764852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa66fb-932b-476e-b937-e81d8de8b4a4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:50.769666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:50.770570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.770870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.771149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] PATH_INFO: `/v3/projects/eee999ba637e4e588ffe216cacbcca85/users/35be73c86a98494793d3e6696d585cd5/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.773237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee999ba637e4e588ffe216cacbcca85, user_id=35be73c86a98494793d3e6696d585cd5, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:50.775994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:50.787303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1598/3150] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:50 2022] PUT /identity/v3/projects/eee999ba637e4e588ffe216cacbcca85/users/35be73c86a98494793d3e6696d585cd5/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:50.797879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761b1f6-9da5-49dc-9176-2af901b86d26 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:50.798386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761b1f6-9da5-49dc-9176-2af901b86d26 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:50.798742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761b1f6-9da5-49dc-9176-2af901b86d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:50.825941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5761b1f6-9da5-49dc-9176-2af901b86d26 None None] MFA Rules not processed for user `35be73c86a98494793d3e6696d585cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:50.827343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5761b1f6-9da5-49dc-9176-2af901b86d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:50.896380 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1553/3151] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:51.424660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:51.426524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:51.513309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25f56e-0a99-4d8c-acad-44ee3dcad822 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:51.518991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:51.519661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:51.519941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:51.520213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:51.529651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:51.531286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:51.542564 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1599/3152] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:52.489141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761b1f6-9da5-49dc-9176-2af901b86d26 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:52.567687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761b1f6-9da5-49dc-9176-2af901b86d26 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:52.575527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:52.577077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:52.577840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:52.577840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] PATH_INFO: `/v3/users/a6784ddd89c244979a85a6f0e6a72382` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:52.579224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6784ddd89c244979a85a6f0e6a72382)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:52.581402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:52.629610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:52.631034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:52.636958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6784ddd89c244979a85a6f0e6a72382'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.638012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6784ddd89c244979a85a6f0e6a72382'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.648502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6784ddd89c244979a85a6f0e6a72382'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.649561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6784ddd89c244979a85a6f0e6a72382'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.651906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd5fbf-265b-44b7-aeb9-3a20a8e367a8 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:52.661588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d940c80-2cd3-4c17-9e43-106c4a702f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6784ddd89c244979a85a6f0e6a72382'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.663621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:52.664587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:52.665069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:52.666800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] PATH_INFO: `/v3/users/896b459a03794929a8eb550ac617b2db` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:52.668316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896b459a03794929a8eb550ac617b2db)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:52.671100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:52.680884 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1554/3153] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:52 2022] DELETE /identity/v3/users/a6784ddd89c244979a85a6f0e6a72382 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:52.685207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:52.685494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:52.685769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:52.703384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:52.704607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:52.736618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896b459a03794929a8eb550ac617b2db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.737303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896b459a03794929a8eb550ac617b2db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.744969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896b459a03794929a8eb550ac617b2db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.756214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896b459a03794929a8eb550ac617b2db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.756912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896b459a03794929a8eb550ac617b2db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:52.768736 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1555/3154] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:02:52.776845 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1600/3155] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:52 2022] DELETE /identity/v3/users/896b459a03794929a8eb550ac617b2db => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:52.778524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:52.780583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:52.855971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279457a-a963-4c22-82ce-1163b430a9ec None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:52.921627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eef386-0ebd-4e67-bea4-84b54362e640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:52.922894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eef386-0ebd-4e67-bea4-84b54362e640 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:52.923172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eef386-0ebd-4e67-bea4-84b54362e640 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:52.923446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eef386-0ebd-4e67-bea4-84b54362e640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:52.966759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:52.968611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.009229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eef386-0ebd-4e67-bea4-84b54362e640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.010757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eef386-0ebd-4e67-bea4-84b54362e640 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.024700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1556/3156] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:53.060504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0741f-ccd1-4c06-8975-52e4bb3cb0c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.065925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.067011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.067380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.067741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] PATH_INFO: `/v3/projects/13cb060a48dc43898f363e5ba7d1ac6b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.069208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cb060a48dc43898f363e5ba7d1ac6b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.071432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.152686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cb060a48dc43898f363e5ba7d1ac6b', 'request_id': 'req-07430bcb-ee9f-4271-b1a2-33190d19b1e8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.161733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cb060a48dc43898f363e5ba7d1ac6b', 'request_id': 'req-07430bcb-ee9f-4271-b1a2-33190d19b1e8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.176953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cb060a48dc43898f363e5ba7d1ac6b', 'request_id': 'req-07430bcb-ee9f-4271-b1a2-33190d19b1e8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.192759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] The token cache is being invalidate because project 13cb060a48dc43898f363e5ba7d1ac6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:53.193073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.194462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-07430bcb-ee9f-4271-b1a2-33190d19b1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.201274 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1601/3157] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:52 2022] DELETE /identity/v3/projects/13cb060a48dc43898f363e5ba7d1ac6b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:53.202220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017917d8-0590-404d-a0d8-717329845890 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.202625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017917d8-0590-404d-a0d8-717329845890 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.202994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017917d8-0590-404d-a0d8-717329845890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.231327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-017917d8-0590-404d-a0d8-717329845890 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:53.233555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-017917d8-0590-404d-a0d8-717329845890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.326320 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1557/3158] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:02:53.334765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086467-99b4-4735-9c72-b7a2481e0c21 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.334985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086467-99b4-4735-9c72-b7a2481e0c21 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.335225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086467-99b4-4735-9c72-b7a2481e0c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.379844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d1086467-99b4-4735-9c72-b7a2481e0c21 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:53.383636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d1086467-99b4-4735-9c72-b7a2481e0c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.391251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017917d8-0590-404d-a0d8-717329845890 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.393390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-017917d8-0590-404d-a0d8-717329845890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.401288 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1602/3159] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:53.402894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086467-99b4-4735-9c72-b7a2481e0c21 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.417935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017917d8-0590-404d-a0d8-717329845890 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.430585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086467-99b4-4735-9c72-b7a2481e0c21 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.434443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.435818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.436361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.436874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] PATH_INFO: `/v3/projects/6ebf1c29b3474bc5a1e9ead0d9376394` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.438823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.439605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.439787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebf1c29b3474bc5a1e9ead0d9376394)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.442205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.442748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.443600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:53.444085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.444792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.445974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.474603 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1603/3160] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:53.476679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.495009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb140940-4bd0-448a-beb6-dba50dbcf2b3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.507959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.508663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.509355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.509800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.510556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.513128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.549123 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1604/3161] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:53 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:53.549886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebf1c29b3474bc5a1e9ead0d9376394', 'request_id': 'req-66b1438a-ba73-46ee-b5b9-9d78fde67763'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.552225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.559163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebf1c29b3474bc5a1e9ead0d9376394', 'request_id': 'req-66b1438a-ba73-46ee-b5b9-9d78fde67763'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.572558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebf1c29b3474bc5a1e9ead0d9376394', 'request_id': 'req-66b1438a-ba73-46ee-b5b9-9d78fde67763'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.597152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] The token cache is being invalidate because project 6ebf1c29b3474bc5a1e9ead0d9376394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:53.597969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.600702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.603426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1558/3162] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:53 2022] DELETE /identity/v3/projects/6ebf1c29b3474bc5a1e9ead0d9376394 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:53.608001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.609928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.667685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758da6-e71c-4235-9712-ec02372d6a84 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.674976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.675674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.675951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.676221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.676923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.678925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.688578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1438a-ba73-46ee-b5b9-9d78fde67763 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.695041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.696153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.696524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.696863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] PATH_INFO: `/v3/users/35be73c86a98494793d3e6696d585cd5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.698259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35be73c86a98494793d3e6696d585cd5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.700417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.702858 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1605/3163] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:53 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:53.706619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.708368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.724519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6dab1-aa7f-4521-a530-ec6f47f46056 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.730817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.732508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.732890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.733335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.734425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.736321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.749723 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1606/3164] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:02:53.754614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.765119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391757c-fc57-42fc-b612-f1f4ad7f6964 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.768047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35be73c86a98494793d3e6696d585cd5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.769158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35be73c86a98494793d3e6696d585cd5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.772686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.773549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.773824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.774092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.776685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.778352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.783486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35be73c86a98494793d3e6696d585cd5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.784256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35be73c86a98494793d3e6696d585cd5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.792934 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1607/3165] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:53.795782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b91bdf66-f2e8-48e6-8358-bfcc431d7754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35be73c86a98494793d3e6696d585cd5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:53.798234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:53.800497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.813614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c02b-1752-483c-a5bf-52fe7af3cdd6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:53.818682 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1559/3166] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:53 2022] DELETE /identity/v3/users/35be73c86a98494793d3e6696d585cd5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:53.821691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:53.823138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.823420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.823695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] PATH_INFO: `/v3/projects/bc7a2d61df2b4bfda6882e74e73b6cb5/users/fbcb9088698a4f478ccebca7a65f54c4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.841341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7a2d61df2b4bfda6882e74e73b6cb5, user_id=fbcb9088698a4f478ccebca7a65f54c4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:53.844958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:53.866013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1608/3167] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:53 2022] PUT /identity/v3/projects/bc7a2d61df2b4bfda6882e74e73b6cb5/users/fbcb9088698a4f478ccebca7a65f54c4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:53.871196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b58b2b-39b0-4a13-b2cb-0802ebbd55d1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:53.871598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b58b2b-39b0-4a13-b2cb-0802ebbd55d1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:53.871967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b58b2b-39b0-4a13-b2cb-0802ebbd55d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:53.902625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d5b58b2b-39b0-4a13-b2cb-0802ebbd55d1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:53.903115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d5b58b2b-39b0-4a13-b2cb-0802ebbd55d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:53.983762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1560/3168] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:02:53.998693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:54.001017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:54.078848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5521366-7b85-4a77-af57-0bbf20ef501a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:54.084922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:54.086800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:54.087338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:54.087965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:54.103701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:54.106384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:54.125450 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1609/3169] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:55.065551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db4c52-c643-45eb-b177-18fd5568d9f1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.066590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db4c52-c643-45eb-b177-18fd5568d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.066812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db4c52-c643-45eb-b177-18fd5568d9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.134554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-99db4c52-c643-45eb-b177-18fd5568d9f1 None None] MFA Rules not processed for user `fbcb9088698a4f478ccebca7a65f54c4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:55.139548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-99db4c52-c643-45eb-b177-18fd5568d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:55.180679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.183631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:55.209671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094affa-7883-4d57-9ff6-d70b684531e4 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.217155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.218424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.218938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.219313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] PATH_INFO: `/v3/projects/eee999ba637e4e588ffe216cacbcca85` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.221164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee999ba637e4e588ffe216cacbcca85)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.225217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:55.330843 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1561/3170] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:55.349225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee999ba637e4e588ffe216cacbcca85', 'request_id': 'req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:55.356984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee999ba637e4e588ffe216cacbcca85', 'request_id': 'req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:55.367761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee999ba637e4e588ffe216cacbcca85', 'request_id': 'req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:55.383791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] The token cache is being invalidate because project eee999ba637e4e588ffe216cacbcca85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:55.384028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:55.384639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a4d9c131-b59d-4005-8adf-daf04fb7e5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:55.386235 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1610/3171] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:55 2022] DELETE /identity/v3/projects/eee999ba637e4e588ffe216cacbcca85 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:55.391167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28234-c069-4a10-92ee-f8768d174050 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.391684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28234-c069-4a10-92ee-f8768d174050 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.391956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28234-c069-4a10-92ee-f8768d174050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.423264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-afe28234-c069-4a10-92ee-f8768d174050 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:55.424482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-afe28234-c069-4a10-92ee-f8768d174050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:55.496870 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1562/3172] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:55.566536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715761ea-a785-4b48-bf39-fe0b9cc2987b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.566895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715761ea-a785-4b48-bf39-fe0b9cc2987b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.567099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715761ea-a785-4b48-bf39-fe0b9cc2987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.587293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-715761ea-a785-4b48-bf39-fe0b9cc2987b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:55.588615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-715761ea-a785-4b48-bf39-fe0b9cc2987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:55.597188 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1611/3173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:55.601398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28234-c069-4a10-92ee-f8768d174050 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.611313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28234-c069-4a10-92ee-f8768d174050 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.616660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.617368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.617650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.618110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.618845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:55.619516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.620774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:55.638021 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1563/3174] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:55.641896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715761ea-a785-4b48-bf39-fe0b9cc2987b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.665532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715761ea-a785-4b48-bf39-fe0b9cc2987b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.670269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.672358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:55.676310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.677000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.677306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.677577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.678262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.680379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:55.722117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1612/3175] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:55 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:55.723507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.768505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406a425-3f81-4bfc-93fc-c121bf7454e3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.815536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41f83b-3bda-4fac-a1ab-c0de63d9069f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.821170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.821984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.822326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.822821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.823521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.825800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:55.850535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d3f5-e2bf-4e11-8870-0e059e2a85e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.851301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d3f5-e2bf-4e11-8870-0e059e2a85e2 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.851581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d3f5-e2bf-4e11-8870-0e059e2a85e2 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.851700 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1613/3176] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:55 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:55.851859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d3f5-e2bf-4e11-8870-0e059e2a85e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.854873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bbe0d3f5-e2bf-4e11-8870-0e059e2a85e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:55.856904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.869993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1a04-44d6-413e-bed2-d5b3cd1481bb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.880129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.880806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.881109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.881381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.882111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.883813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:55.897251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1614/3177] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:55.899098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.913858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d095947-ab58-4e10-ac31-37d230849721 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.920719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.921441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.921813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.922200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.922939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.924604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:55.929613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d3f5-e2bf-4e11-8870-0e059e2a85e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.931398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d3f5-e2bf-4e11-8870-0e059e2a85e2 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:55.939862 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1615/3178] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:02:55.943463 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1564/3179] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:55.944624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:55.956179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed0e7-377a-4726-a87f-a60ea7c01883 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:55.961091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:55.962063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:55.962419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:55.962684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] PATH_INFO: `/v3/projects/91b943e051be4eb5ab780d2ab1e202a5/users/0d6570d0b1b94713bccca9777e911595/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:55.982271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b943e051be4eb5ab780d2ab1e202a5, user_id=0d6570d0b1b94713bccca9777e911595, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:55.986308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.005990 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1616/3180] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:55 2022] PUT /identity/v3/projects/91b943e051be4eb5ab780d2ab1e202a5/users/0d6570d0b1b94713bccca9777e911595/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:56.016326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07229419-2d56-4304-b169-318b7ee8d244 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.016607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07229419-2d56-4304-b169-318b7ee8d244 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.016880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07229419-2d56-4304-b169-318b7ee8d244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.044923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-07229419-2d56-4304-b169-318b7ee8d244 None None] MFA Rules not processed for user `0d6570d0b1b94713bccca9777e911595`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:56.046517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-07229419-2d56-4304-b169-318b7ee8d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:56.133987 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1565/3181] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:02:56.138272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.221894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d95a-f63a-4836-98f8-4a91b4c794cd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.233291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.235123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.235654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.236100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.238194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.241664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.298220 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1617/3182] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:56 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:02:56.301767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07229419-2d56-4304-b169-318b7ee8d244 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.315712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07229419-2d56-4304-b169-318b7ee8d244 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.386404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.387091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.387365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.388212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.388503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.390774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.415968 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1566/3183] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:56 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:56.420182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.433006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1490861-f52d-4cb3-9374-0bd1d0b3d156 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.439773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.440615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.440954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.441271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.442004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.444034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.464105 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1618/3184] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:56.465398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.476585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926563-e75b-4bef-97ba-d042d5279e2c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.482712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.484593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.484875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.485184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] PATH_INFO: `/v3/projects/2dfd3c5b68a9485fb4bfbf0c2056cf42/users/126e39195ca04a9bb8361ed96f9f35ed/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.503512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfd3c5b68a9485fb4bfbf0c2056cf42, user_id=126e39195ca04a9bb8361ed96f9f35ed, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.507254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.529213 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1567/3185] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:56 2022] PUT /identity/v3/projects/2dfd3c5b68a9485fb4bfbf0c2056cf42/users/126e39195ca04a9bb8361ed96f9f35ed/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:56.529926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.541193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a884ef-c79b-4c22-8fd5-726c29f791fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.614281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.615048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.615431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.615979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.616792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.618637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.634194 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1619/3186] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:02:56.635653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.655206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.660288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cd447-ab3c-4abb-9d31-7bf0d55082c9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.660515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:56.666653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189c488-76ce-48e5-9acd-bd9a352e5303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.667801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c488-76ce-48e5-9acd-bd9a352e5303 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.668455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c488-76ce-48e5-9acd-bd9a352e5303 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.668807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c488-76ce-48e5-9acd-bd9a352e5303 admin admin] PATH_INFO: `/v3/projects/2dfd3c5b68a9485fb4bfbf0c2056cf42/users/126e39195ca04a9bb8361ed96f9f35ed/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.671018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189c488-76ce-48e5-9acd-bd9a352e5303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfd3c5b68a9485fb4bfbf0c2056cf42, user_id=126e39195ca04a9bb8361ed96f9f35ed, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.673973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189c488-76ce-48e5-9acd-bd9a352e5303 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.696017 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1568/3187] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:02:56 2022] PUT /identity/v3/projects/2dfd3c5b68a9485fb4bfbf0c2056cf42/users/126e39195ca04a9bb8361ed96f9f35ed/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:56.706549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b7f2-391c-4c7c-9f76-b130bf29a960 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.712872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b7f2-391c-4c7c-9f76-b130bf29a960 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.713244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b7f2-391c-4c7c-9f76-b130bf29a960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.753486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1c12b7f2-391c-4c7c-9f76-b130bf29a960 None None] MFA Rules not processed for user `126e39195ca04a9bb8361ed96f9f35ed`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:56.755249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1c12b7f2-391c-4c7c-9f76-b130bf29a960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:56.787849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a808f40-d7ac-49cb-8ac3-f0ef2326866e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.857715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.858904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.859625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.860087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.862357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:56.868549 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1569/3188] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:56.869749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b7f2-391c-4c7c-9f76-b130bf29a960 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.883359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b7f2-391c-4c7c-9f76-b130bf29a960 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.890017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.891149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.892125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.892632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.893611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:56.894133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.896614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.918844 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1570/3189] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:02:56.920006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:56.936049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d94a7-6a21-48d2-9f6d-cc1a37638b7b tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:56.943013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f8982-68e0-4b82-86dc-92a38cb9dd56 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:56.943535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8982-68e0-4b82-86dc-92a38cb9dd56 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:56.943814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8982-68e0-4b82-86dc-92a38cb9dd56 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:56.944146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8982-68e0-4b82-86dc-92a38cb9dd56 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:56.944915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f8982-68e0-4b82-86dc-92a38cb9dd56 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.947075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f8982-68e0-4b82-86dc-92a38cb9dd56 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.961337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:56.963133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:56.975471 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1620/3190] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:56.987451 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1571/3191] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:56 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:56.997145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:57.009413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2881-1651-4203-8d2e-3ed6dbf57234 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:57.099107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:57.100284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:57.100698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:57.101142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:57.102613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:57.103057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:57.105052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:57.149335 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1621/3192] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:57.446315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e18d-bb1e-4ce9-9a90-56ff687400be None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:57.446876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e18d-bb1e-4ce9-9a90-56ff687400be None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:57.446876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e18d-bb1e-4ce9-9a90-56ff687400be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:57.478317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9b52e18d-bb1e-4ce9-9a90-56ff687400be None None] MFA Rules not processed for user `fbcb9088698a4f478ccebca7a65f54c4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:57.479954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9b52e18d-bb1e-4ce9-9a90-56ff687400be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:57.575273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1572/3193] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:58.190175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:58.192280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:58.213290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e18d-bb1e-4ce9-9a90-56ff687400be None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:58.302498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edcae6-cee9-4cd3-a2df-6f7ce985c38a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:58.306858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e18d-bb1e-4ce9-9a90-56ff687400be None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:58.309221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:58.310494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:58.310944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:58.311366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] PATH_INFO: `/v3/users/ceba42e80d7746e4897669084c078c09` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:58.312713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceba42e80d7746e4897669084c078c09)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:58.313567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7099-d4c7-4289-b0c8-4e811f8fb6d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:58.314453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7099-d4c7-4289-b0c8-4e811f8fb6d8 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:58.314803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7099-d4c7-4289-b0c8-4e811f8fb6d8 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:58.315149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7099-d4c7-4289-b0c8-4e811f8fb6d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:58.315764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:58.324542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7099-d4c7-4289-b0c8-4e811f8fb6d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:58.326848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7099-d4c7-4289-b0c8-4e811f8fb6d8 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:58.338885 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1573/3194] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:02:58.355726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb988b3-91bd-41fe-8798-e8d1100f5716 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:58.356117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb988b3-91bd-41fe-8798-e8d1100f5716 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:58.356416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb988b3-91bd-41fe-8798-e8d1100f5716 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:58.358009 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1574/3195] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 21:02:58.363381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb988b3-91bd-41fe-8798-e8d1100f5716 None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:02:58.375660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceba42e80d7746e4897669084c078c09'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.376496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceba42e80d7746e4897669084c078c09'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.384450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb988b3-91bd-41fe-8798-e8d1100f5716 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:58.389488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceba42e80d7746e4897669084c078c09'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.396264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb988b3-91bd-41fe-8798-e8d1100f5716 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:58.401947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:58.402976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:58.403419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:58.403848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/projects/11a658a11a784f3d83f22c1219dfb00b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:58.404107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceba42e80d7746e4897669084c078c09'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.405433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:get_project(project_id=11a658a11a784f3d83f22c1219dfb00b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:58.405930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceba42e80d7746e4897669084c078c09'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.408296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:58.410298 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1575/3196] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:02:58 2022] GET /identity/v3/projects/11a658a11a784f3d83f22c1219dfb00b => generated 371 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:02:58.426573 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1622/3197] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:58 2022] DELETE /identity/v3/users/ceba42e80d7746e4897669084c078c09 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:58.630424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:58.632405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:58.647481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b4187-8350-49f8-acad-81b8ca75647d tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:58.709804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:58.710687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:58.711092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:58.711373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] PATH_INFO: `/v3/projects/352d269ab35841c397ca9168792c1ec4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:58.712594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352d269ab35841c397ca9168792c1ec4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:58.714588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:58.770756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352d269ab35841c397ca9168792c1ec4', 'request_id': 'req-c9d23456-2c13-46b0-b9b1-21af4daa5f73'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.777958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352d269ab35841c397ca9168792c1ec4', 'request_id': 'req-c9d23456-2c13-46b0-b9b1-21af4daa5f73'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.802001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352d269ab35841c397ca9168792c1ec4', 'request_id': 'req-c9d23456-2c13-46b0-b9b1-21af4daa5f73'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.817201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] The token cache is being invalidate because project 352d269ab35841c397ca9168792c1ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:58.817495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.818137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9d23456-2c13-46b0-b9b1-21af4daa5f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.822949 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1576/3198] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:58 2022] DELETE /identity/v3/projects/352d269ab35841c397ca9168792c1ec4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:02:58.824212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:58.834611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fbfa9-c8cd-4134-8c2b-8e2c48b9d3db admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:58.890108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:58.891007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:58.891285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:58.891553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] PATH_INFO: `/v3/users/08e4a286faa04d65bc28e426e9dd97af` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:58.892725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e4a286faa04d65bc28e426e9dd97af)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:58.894694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:58.949128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e4a286faa04d65bc28e426e9dd97af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.949765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e4a286faa04d65bc28e426e9dd97af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.956401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e4a286faa04d65bc28e426e9dd97af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.965483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e4a286faa04d65bc28e426e9dd97af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.966266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e4a286faa04d65bc28e426e9dd97af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:58.983776 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1623/3199] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:02:58 2022] DELETE /identity/v3/users/08e4a286faa04d65bc28e426e9dd97af => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:59.048345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc12b-a2fa-49c8-9dda-9ca2facb337e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.048557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc12b-a2fa-49c8-9dda-9ca2facb337e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.048808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc12b-a2fa-49c8-9dda-9ca2facb337e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.050464 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1577/3200] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:02:59.056313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:02:59.057912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:59.146610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.147983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:59.214741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cc12b-a2fa-49c8-9dda-9ca2facb337e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.216917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a98cc12b-a2fa-49c8-9dda-9ca2facb337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:59.253120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc45b5-1532-4d55-9a46-88890ca27915 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.260484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.261951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.262239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.262519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/projects/11a658a11a784f3d83f22c1219dfb00b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.264286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:get_project(project_id=11a658a11a784f3d83f22c1219dfb00b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.266701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:59.268549 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1624/3201] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:02:59 2022] GET /identity/v3/projects/11a658a11a784f3d83f22c1219dfb00b => generated 371 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:02:59.321440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.324307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cc12b-a2fa-49c8-9dda-9ca2facb337e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.329557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.330722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.331092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.331455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] PATH_INFO: `/v3/projects/fbdc275749894f1380ebab29d71ae52f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.333634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbdc275749894f1380ebab29d71ae52f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.335922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:59.343769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75af9-56ab-49e2-87b7-54d09dac2d1a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.374342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.374686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.374686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.374957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.376168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:59.376487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.384109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:59.416636 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1625/3202] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:59.421355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.446294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d68ad3-4db2-48f0-9ba3-cca188663a62 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.476786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbdc275749894f1380ebab29d71ae52f', 'request_id': 'req-ed3c56a0-493c-467d-9799-7a142ea3a327'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:59.487030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbdc275749894f1380ebab29d71ae52f', 'request_id': 'req-ed3c56a0-493c-467d-9799-7a142ea3a327'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:59.500431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbdc275749894f1380ebab29d71ae52f', 'request_id': 'req-ed3c56a0-493c-467d-9799-7a142ea3a327'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:59.528180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] The token cache is being invalidate because project fbdc275749894f1380ebab29d71ae52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:02:59.528638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:59.542960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed3c56a0-493c-467d-9799-7a142ea3a327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:02:59.551441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1578/3203] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:59 2022] DELETE /identity/v3/projects/fbdc275749894f1380ebab29d71ae52f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:02:59.553570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bb067-9e3d-45e7-8346-e256b5c8899f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.553951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bb067-9e3d-45e7-8346-e256b5c8899f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.554901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bb067-9e3d-45e7-8346-e256b5c8899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.561772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.562204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.562576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.562927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.563744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.566163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:59.600855 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1626/3204] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:59 2022] POST /identity/v3/users => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:59.603230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.604805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2b0bb067-9e3d-45e7-8346-e256b5c8899f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:59.606584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:59.614389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2b0bb067-9e3d-45e7-8346-e256b5c8899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:59.639792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb0485-6c79-47cf-a9f0-394850b6e3ae tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.652217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de63ac-bd68-4c5d-8f54-53e1fe6f9f3e tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.653400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de63ac-bd68-4c5d-8f54-53e1fe6f9f3e tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.654218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de63ac-bd68-4c5d-8f54-53e1fe6f9f3e tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.654458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de63ac-bd68-4c5d-8f54-53e1fe6f9f3e tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.656178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de63ac-bd68-4c5d-8f54-53e1fe6f9f3e tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:59.656494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de63ac-bd68-4c5d-8f54-53e1fe6f9f3e tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.659808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de63ac-bd68-4c5d-8f54-53e1fe6f9f3e tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:59.677842 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1627/3205] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:02:59.707048 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1579/3206] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:59.715885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddba2a-a3ae-4af2-b9a0-d359034273ad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.716122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddba2a-a3ae-4af2-b9a0-d359034273ad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.716397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddba2a-a3ae-4af2-b9a0-d359034273ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.737332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-faddba2a-a3ae-4af2-b9a0-d359034273ad None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:02:59.738716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-faddba2a-a3ae-4af2-b9a0-d359034273ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:59.748970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1628/3207] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:02:59.753970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bb067-9e3d-45e7-8346-e256b5c8899f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.768690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bb067-9e3d-45e7-8346-e256b5c8899f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.774391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f226b0-27d2-499a-b1ca-db12bfef0fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.774942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f226b0-27d2-499a-b1ca-db12bfef0fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.775269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f226b0-27d2-499a-b1ca-db12bfef0fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.775542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f226b0-27d2-499a-b1ca-db12bfef0fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.776273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f226b0-27d2-499a-b1ca-db12bfef0fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:02:59.776574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f226b0-27d2-499a-b1ca-db12bfef0fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.778216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f226b0-27d2-499a-b1ca-db12bfef0fa8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:59.795505 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1580/3208] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:02:59.798472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddba2a-a3ae-4af2-b9a0-d359034273ad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.810207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddba2a-a3ae-4af2-b9a0-d359034273ad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.818480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.823540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.823850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.824139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.824864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.827539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:02:59.831684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc306e2-ce0e-4c02-bd2e-f9c42aac29f0 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.832181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc306e2-ce0e-4c02-bd2e-f9c42aac29f0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.832616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc306e2-ce0e-4c02-bd2e-f9c42aac29f0 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.834658 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1581/3209] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:02:59.843160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc306e2-ce0e-4c02-bd2e-f9c42aac29f0 None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:02:59.845648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4dc306e2-ce0e-4c02-bd2e-f9c42aac29f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:02:59.870422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1629/3210] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:02:59 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:02:59.874571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.948549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc306e2-ce0e-4c02-bd2e-f9c42aac29f0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:02:59.958560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc306e2-ce0e-4c02-bd2e-f9c42aac29f0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.959314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fbc06-bd3f-4ae1-b13f-c41dd8e58e28 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:02:59.966265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:02:59.967638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:02:59.968092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:02:59.969168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:02:59.970493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:02:59.974077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.000122 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1630/3211] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:02:59 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:03:00.004508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.016273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870429f2-e9e6-49c6-aaa3-7307e4849ad9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.022042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.022743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.023023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.023300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.024036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.025822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.038776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.042487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1631/3212] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:03:00.042629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.042629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.042629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/projects/11a658a11a784f3d83f22c1219dfb00b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.042961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.043321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:get_project(project_id=11a658a11a784f3d83f22c1219dfb00b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.047824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.054311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc0c9-3e92-4cbe-a01d-d7403d4c9a2d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.054591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1582/3213] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:02:59 2022] GET /identity/v3/projects/11a658a11a784f3d83f22c1219dfb00b => generated 371 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:03:00.059709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e1de8-388d-46dd-b5d6-85f6cc1aafa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.060409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e1de8-388d-46dd-b5d6-85f6cc1aafa1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.060790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e1de8-388d-46dd-b5d6-85f6cc1aafa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.061207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e1de8-388d-46dd-b5d6-85f6cc1aafa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.062266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e1de8-388d-46dd-b5d6-85f6cc1aafa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.064092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e1de8-388d-46dd-b5d6-85f6cc1aafa1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.079117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1632/3214] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:00.083048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.104968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257f9d0-ec7c-43ea-9092-de0bea73adcc tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.114966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.116415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.116769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.117161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] PATH_INFO: `/v3/projects/ab5f53583b7444188c705ed472c3cf06/users/35025c6fdf024e8ea7d8d53db1a3974c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.133702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5f53583b7444188c705ed472c3cf06, user_id=35025c6fdf024e8ea7d8d53db1a3974c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.136715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.154591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1583/3215] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:00 2022] PUT /identity/v3/projects/ab5f53583b7444188c705ed472c3cf06/users/35025c6fdf024e8ea7d8d53db1a3974c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:00.169756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119dfd-4a62-406c-830d-02fdf41e04b8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.170047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119dfd-4a62-406c-830d-02fdf41e04b8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.170330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119dfd-4a62-406c-830d-02fdf41e04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.203595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-51119dfd-4a62-406c-830d-02fdf41e04b8 None None] MFA Rules not processed for user `35025c6fdf024e8ea7d8d53db1a3974c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:00.204807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-51119dfd-4a62-406c-830d-02fdf41e04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:00.275355 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1633/3216] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:00.279833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.343144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce990-ae42-4cd9-8f56-9b6efdabdcce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.348781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e8d4b-2005-49b9-b2bf-0f5055f13c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.361761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e8d4b-2005-49b9-b2bf-0f5055f13c7d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.362042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e8d4b-2005-49b9-b2bf-0f5055f13c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.362295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e8d4b-2005-49b9-b2bf-0f5055f13c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.363025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e8d4b-2005-49b9-b2bf-0f5055f13c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.364981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e8d4b-2005-49b9-b2bf-0f5055f13c7d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.404842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1584/3217] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:03:00 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:03:00.406449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51119dfd-4a62-406c-830d-02fdf41e04b8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.421303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51119dfd-4a62-406c-830d-02fdf41e04b8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.545709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.546517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.546805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.547549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.548316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.550321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.573222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9eb3-4941-45d7-ba16-e9a6b4815d23 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.573712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9eb3-4941-45d7-ba16-e9a6b4815d23 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.574107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9eb3-4941-45d7-ba16-e9a6b4815d23 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.575828 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1585/3218] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:03:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 21:03:00.583260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9eb3-4941-45d7-ba16-e9a6b4815d23 None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:03:00.587860 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1634/3219] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:03:00 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:03:00.588966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.607332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16c69-90f1-4b9a-afc2-9236fe734536 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.621301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.622287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.622570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.622849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.625796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.627867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.651978 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1635/3220] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:00.653433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.664645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263edc58-c618-461f-a565-2e8df2698847 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.669910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.671439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.671797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.672166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] PATH_INFO: `/v3/projects/e00846370b944c5da8e5f5e89038efd4/users/1e78125c236a44b1a3dfd4c239d35ff3/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.687130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9eb3-4941-45d7-ba16-e9a6b4815d23 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.689374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00846370b944c5da8e5f5e89038efd4, user_id=1e78125c236a44b1a3dfd4c239d35ff3, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.692908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.716563 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1636/3221] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:00 2022] PUT /identity/v3/projects/e00846370b944c5da8e5f5e89038efd4/users/1e78125c236a44b1a3dfd4c239d35ff3/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:03:00.717825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.772256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9eb3-4941-45d7-ba16-e9a6b4815d23 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.808129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9559fdf-fb45-4f62-8c4f-a0d875bb9730 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.813405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.814099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.814381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.814654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.815388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.817054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.828624 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1637/3222] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:00.832550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.843682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acea35-7ea9-4ff4-a036-4dd58ba0a789 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:00.849364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3690-cdbb-46b4-a1a6-06c20a5c9897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.850381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3690-cdbb-46b4-a1a6-06c20a5c9897 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.850769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3690-cdbb-46b4-a1a6-06c20a5c9897 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.851142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3690-cdbb-46b4-a1a6-06c20a5c9897 admin admin] PATH_INFO: `/v3/projects/e00846370b944c5da8e5f5e89038efd4/users/1e78125c236a44b1a3dfd4c239d35ff3/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.855621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3690-cdbb-46b4-a1a6-06c20a5c9897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00846370b944c5da8e5f5e89038efd4, user_id=1e78125c236a44b1a3dfd4c239d35ff3, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.858425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3690-cdbb-46b4-a1a6-06c20a5c9897 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.871550 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1638/3223] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:00 2022] PUT /identity/v3/projects/e00846370b944c5da8e5f5e89038efd4/users/1e78125c236a44b1a3dfd4c239d35ff3/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:03:00.878020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:00.878419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.878701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.878980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/projects/11a658a11a784f3d83f22c1219dfb00b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.881184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:get_project(project_id=11a658a11a784f3d83f22c1219dfb00b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:00.881991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb86c8-e955-4e16-b27d-ff3ebba0d373 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:00.882276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb86c8-e955-4e16-b27d-ff3ebba0d373 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:00.882556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb86c8-e955-4e16-b27d-ff3ebba0d373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:00.885169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:00.894440 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1586/3224] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:03:00 2022] GET /identity/v3/projects/11a658a11a784f3d83f22c1219dfb00b => generated 371 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:03:00.916971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9deb86c8-e955-4e16-b27d-ff3ebba0d373 None None] MFA Rules not processed for user `1e78125c236a44b1a3dfd4c239d35ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:00.918198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9deb86c8-e955-4e16-b27d-ff3ebba0d373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:00.926283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:00.942432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20e62-e491-43ce-84d9-8d5a67af3a01 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:01.046449 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1639/3225] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:01.048364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44321768-826b-4771-a964-3d95d0d312fd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:01.048661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44321768-826b-4771-a964-3d95d0d312fd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:01.048940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44321768-826b-4771-a964-3d95d0d312fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:01.074450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:01.075364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:01.075652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:01.075928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/users/8a45ad01dedf4a76839bdc85827ca8a7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:01.079951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-44321768-826b-4771-a964-3d95d0d312fd None None] MFA Rules not processed for user `35025c6fdf024e8ea7d8d53db1a3974c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:01.082024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-44321768-826b-4771-a964-3d95d0d312fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:01.098442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8a45ad01dedf4a76839bdc85827ca8a7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:01.101311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:01.164248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a45ad01dedf4a76839bdc85827ca8a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.164967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a45ad01dedf4a76839bdc85827ca8a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.172712 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1640/3226] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:01.179201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a45ad01dedf4a76839bdc85827ca8a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.179948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a45ad01dedf4a76839bdc85827ca8a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.190337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a45ad01dedf4a76839bdc85827ca8a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.215852 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1587/3227] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:03:00 2022] DELETE /identity/v3/users/8a45ad01dedf4a76839bdc85827ca8a7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:01.217127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44321768-826b-4771-a964-3d95d0d312fd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:01.233127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44321768-826b-4771-a964-3d95d0d312fd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:01.305743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126e39195ca04a9bb8361ed96f9f35ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:01.306642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:01.306929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:01.307210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] PATH_INFO: `/v3/projects/11a658a11a784f3d83f22c1219dfb00b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:01.308489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11a658a11a784f3d83f22c1219dfb00b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:01.310466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:01.366879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a658a11a784f3d83f22c1219dfb00b', 'request_id': 'req-ff930678-3b9c-40f0-9a25-3b6147b0b43c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.373158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a658a11a784f3d83f22c1219dfb00b', 'request_id': 'req-ff930678-3b9c-40f0-9a25-3b6147b0b43c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.385215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a658a11a784f3d83f22c1219dfb00b', 'request_id': 'req-ff930678-3b9c-40f0-9a25-3b6147b0b43c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.397942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] The token cache is being invalidate because project 11a658a11a784f3d83f22c1219dfb00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:03:01.398621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.399351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ff930678-3b9c-40f0-9a25-3b6147b0b43c tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.401628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1641/3228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:03:01 2022] DELETE /identity/v3/projects/11a658a11a784f3d83f22c1219dfb00b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:03:01.406958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:01.408382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:01.494802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45686e-89dc-480e-bbc0-5776356f2c35 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:01.569577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:01.570393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:01.570674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:01.571039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] PATH_INFO: `/v3/users/0d6570d0b1b94713bccca9777e911595` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:01.572719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6570d0b1b94713bccca9777e911595)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:01.575387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:01.652425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6570d0b1b94713bccca9777e911595'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.657757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6570d0b1b94713bccca9777e911595'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.669644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6570d0b1b94713bccca9777e911595'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.670813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6570d0b1b94713bccca9777e911595'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.682968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6570d0b1b94713bccca9777e911595'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:01.703737 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1588/3229] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:03:01 2022] DELETE /identity/v3/users/0d6570d0b1b94713bccca9777e911595 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:01.708348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:01.708637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:01.708914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:01.732106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:01.733743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:01.815250 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1642/3230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:01.829258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:01.830727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:01.905387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7466c-826f-43c7-adbb-e6a86370a33b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:01.909439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:01.910362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:01.913321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:01.913617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:01.928108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:01.929770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:01.941468 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1589/3231] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:02.405690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:02.410427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:02.507786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:02.510340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:02.550096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f8abd-4ade-4818-a746-0119ea91371b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:02.565419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:02.566608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:02.566888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:02.567163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] PATH_INFO: `/v3/projects/91b943e051be4eb5ab780d2ab1e202a5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:02.568414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b943e051be4eb5ab780d2ab1e202a5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:02.570694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:02.571802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfe934-0885-4d74-ba18-46800f5a7756 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:02.578451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:02.580560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:02.580855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:02.581176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:02.583142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:02.654502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b943e051be4eb5ab780d2ab1e202a5', 'request_id': 'req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.655321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:02.657058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:02.662247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b943e051be4eb5ab780d2ab1e202a5', 'request_id': 'req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.673819 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1643/3232] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:02.674258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b943e051be4eb5ab780d2ab1e202a5', 'request_id': 'req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.688566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] The token cache is being invalidate because project 91b943e051be4eb5ab780d2ab1e202a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:03:02.688857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.689803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.692524 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1590/3233] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:03:02 2022] DELETE /identity/v3/projects/91b943e051be4eb5ab780d2ab1e202a5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:02.696725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:02.709799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf785-56b8-498f-b1fc-4fea61b5c559 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:02.781800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:02.783424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:02.783901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:02.784393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] PATH_INFO: `/v3/users/126e39195ca04a9bb8361ed96f9f35ed` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:02.785703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126e39195ca04a9bb8361ed96f9f35ed)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:02.787736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:02.891558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126e39195ca04a9bb8361ed96f9f35ed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.891558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126e39195ca04a9bb8361ed96f9f35ed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.903770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126e39195ca04a9bb8361ed96f9f35ed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.920094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126e39195ca04a9bb8361ed96f9f35ed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.920830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-92786582-3a24-4cef-9018-c540404bbb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126e39195ca04a9bb8361ed96f9f35ed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:02.953646 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1644/3234] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:03:02 2022] DELETE /identity/v3/users/126e39195ca04a9bb8361ed96f9f35ed => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:03:03.386315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:03.387833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:03.402364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdfb2f-8c5a-44de-bc05-d245695edbd6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:03.470210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:03.471588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:03.471882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:03.472159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] PATH_INFO: `/v3/projects/2dfd3c5b68a9485fb4bfbf0c2056cf42` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:03.473416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dfd3c5b68a9485fb4bfbf0c2056cf42)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:03.475456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:03.532043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'request_id': 'req-798ecbf9-23ce-4691-8943-3fcaa105b656'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:03.538209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'request_id': 'req-798ecbf9-23ce-4691-8943-3fcaa105b656'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:03.547873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dfd3c5b68a9485fb4bfbf0c2056cf42', 'request_id': 'req-798ecbf9-23ce-4691-8943-3fcaa105b656'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:03.560949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] The token cache is being invalidate because project 2dfd3c5b68a9485fb4bfbf0c2056cf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:03:03.561387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:03.563189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-798ecbf9-23ce-4691-8943-3fcaa105b656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:03.565337 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1591/3235] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:03:03 2022] DELETE /identity/v3/projects/2dfd3c5b68a9485fb4bfbf0c2056cf42 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:03:03.571740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3126-6573-41e8-a139-254fdb34ce45 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:03.572241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3126-6573-41e8-a139-254fdb34ce45 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:03.572364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3126-6573-41e8-a139-254fdb34ce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:03.593769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f51b3126-6573-41e8-a139-254fdb34ce45 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:03.595745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f51b3126-6573-41e8-a139-254fdb34ce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:03.681689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1645/3236] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:03.690806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faab6fe-a82f-4368-99c3-62896900fbca None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:03.691092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faab6fe-a82f-4368-99c3-62896900fbca None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:03.691398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faab6fe-a82f-4368-99c3-62896900fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:03.717198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3faab6fe-a82f-4368-99c3-62896900fbca None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:03.718655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3faab6fe-a82f-4368-99c3-62896900fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:03.728918 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1592/3237] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:03.733011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3126-6573-41e8-a139-254fdb34ce45 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:03.743260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3126-6573-41e8-a139-254fdb34ce45 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:03.748141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:03.748871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:03.749139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:03.749419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:03.750287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:03:03.750596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:03.752217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:03.775529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1646/3238] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:03:03.776314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faab6fe-a82f-4368-99c3-62896900fbca None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:03.785739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faab6fe-a82f-4368-99c3-62896900fbca None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:03.790838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:03.791533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:03.791814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:03.792086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:03.792779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:03.794793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:03.832007 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1593/3239] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:03:03 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:03:03.836608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:03.847502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6387a-f92a-4b82-b089-d13672999793 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:03.908474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:03.909376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:03.909757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:03.910152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:03.911122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:03.913512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:03.945563 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1647/3240] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:03:03 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:03:03.949947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:03.965353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07751e7-1c1c-45af-a03e-cee8ea20ceda admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:03.972542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:03.973806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:03.974289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:03.974727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:03.975626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:03.977526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:03.998109 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1594/3241] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:03.998490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.011252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecca37-bf1e-468d-b82f-924a2d27989d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.020104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5a668-32d4-42f9-9109-d47e5f78a865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.020788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5a668-32d4-42f9-9109-d47e5f78a865 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.021223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5a668-32d4-42f9-9109-d47e5f78a865 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.021507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5a668-32d4-42f9-9109-d47e5f78a865 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.023058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5a668-32d4-42f9-9109-d47e5f78a865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.025677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5a668-32d4-42f9-9109-d47e5f78a865 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.052805 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1648/3242] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:03:04.057163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.071385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19973-2fee-45b8-b7eb-1a689dfc58bf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.079512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.080459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.080728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.080998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] PATH_INFO: `/v3/projects/54a9d66010e4404c82a529dd4bd18c3c/users/3d1c24bc22654cab94bc0b7b8e271c7e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.100045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a9d66010e4404c82a529dd4bd18c3c, user_id=3d1c24bc22654cab94bc0b7b8e271c7e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.105149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.123856 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1595/3243] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:04 2022] PUT /identity/v3/projects/54a9d66010e4404c82a529dd4bd18c3c/users/3d1c24bc22654cab94bc0b7b8e271c7e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:04.136046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1bd97-b255-4df9-aa65-e5b78c21fdd4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.136487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1bd97-b255-4df9-aa65-e5b78c21fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.136771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1bd97-b255-4df9-aa65-e5b78c21fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.165735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4bf1bd97-b255-4df9-aa65-e5b78c21fdd4 None None] MFA Rules not processed for user `3d1c24bc22654cab94bc0b7b8e271c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:04.167157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4bf1bd97-b255-4df9-aa65-e5b78c21fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:04.266064 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1649/3244] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:04.268278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.353413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4a988-6671-4bcf-ab53-f5a8ce81cc98 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.362299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.363380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.363834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.364276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.365228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.367369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.397915 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1596/3245] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:03:04 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:03:04.402267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1bd97-b255-4df9-aa65-e5b78c21fdd4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.419075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1bd97-b255-4df9-aa65-e5b78c21fdd4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.535176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.535940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.536223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.536500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.537435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.539603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.568389 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1650/3246] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:03:04 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:03:04.569939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.583109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d15367-50fd-4d86-8538-dbe959efcc93 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.590420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.591237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.591521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.591851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.592755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.594717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.612688 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1597/3247] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:04.616986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.627626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299025e1-9bcf-48da-8040-78a2b69a52a3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.632582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.636139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.636411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.636686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] PATH_INFO: `/v3/projects/ff352cfa067d4a45b06c494093a370bb/users/93e7d9641dc0480c9925179c2bc9cebd/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.655444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff352cfa067d4a45b06c494093a370bb, user_id=93e7d9641dc0480c9925179c2bc9cebd, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.657629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.674253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1651/3248] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:04 2022] PUT /identity/v3/projects/ff352cfa067d4a45b06c494093a370bb/users/93e7d9641dc0480c9925179c2bc9cebd/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:04.677951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.688396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a590-4b59-44ae-a113-d0091d7d3528 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.756085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0743a-d022-4828-a661-77b3a40c00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.756767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0743a-d022-4828-a661-77b3a40c00a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.757060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0743a-d022-4828-a661-77b3a40c00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.757343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0743a-d022-4828-a661-77b3a40c00a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.758066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0743a-d022-4828-a661-77b3a40c00a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.759734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0743a-d022-4828-a661-77b3a40c00a2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.774537 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1598/3249] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:04.775865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:04.803467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c75c-0e89-4f44-b05b-0ff1126b5bb9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:04.810276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3d45a-647c-4248-9ff0-c18944877300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:04.811208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d45a-647c-4248-9ff0-c18944877300 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.811491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d45a-647c-4248-9ff0-c18944877300 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.811770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d45a-647c-4248-9ff0-c18944877300 admin admin] PATH_INFO: `/v3/projects/ff352cfa067d4a45b06c494093a370bb/users/93e7d9641dc0480c9925179c2bc9cebd/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.813968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3d45a-647c-4248-9ff0-c18944877300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff352cfa067d4a45b06c494093a370bb, user_id=93e7d9641dc0480c9925179c2bc9cebd, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:04.816684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3d45a-647c-4248-9ff0-c18944877300 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:04.829739 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1652/3250] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:04 2022] PUT /identity/v3/projects/ff352cfa067d4a45b06c494093a370bb/users/93e7d9641dc0480c9925179c2bc9cebd/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:04.841955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.842378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.842738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.874741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] MFA Rules not processed for user `93e7d9641dc0480c9925179c2bc9cebd`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:04.876132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:04.959777 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1599/3251] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:04.973859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ca15-504a-41a4-bb0f-9bd6221f67fd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:04.974012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ca15-504a-41a4-bb0f-9bd6221f67fd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:04.974284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ca15-504a-41a4-bb0f-9bd6221f67fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:04.995202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6d36ca15-504a-41a4-bb0f-9bd6221f67fd None None] MFA Rules not processed for user `3d1c24bc22654cab94bc0b7b8e271c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:04.996767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6d36ca15-504a-41a4-bb0f-9bd6221f67fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:05.073285 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1653/3252] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:05.781712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:05.784353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:05.879784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88e4d-de09-4acb-8931-d1ac930dda02 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:05.886706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:05.887796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:05.888293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:05.889101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:05.898596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:05.901152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:05.912050 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1600/3253] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:07.243703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:07.244440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:07.244440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:07.275398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] MFA Rules not processed for user `3d1c24bc22654cab94bc0b7b8e271c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:07.276837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:07.294834 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1654/3254] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:22.474953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:22.500830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7dda5-dda5-48f4-b044-d7ae19a4f580 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:22.516880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:22.518114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:22.518593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:22.519061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:22.524525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:22.645906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:22.648226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:22.662590 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1601/3255] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:23.408324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:23.409760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:23.528177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f507e-57c8-41bb-9284-e44a147e2dd9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:23.533557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:23.534883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:23.535408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:23.535897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] PATH_INFO: `/v3/users/57553270540e4163aad06138d03f9cb4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:23.537405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57553270540e4163aad06138d03f9cb4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:23.539625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:23.619486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57553270540e4163aad06138d03f9cb4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:23.620261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57553270540e4163aad06138d03f9cb4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:23.628048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57553270540e4163aad06138d03f9cb4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:23.639059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57553270540e4163aad06138d03f9cb4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:23.639872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ffbd7b52-d737-4999-9f70-fb14cd73ff9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57553270540e4163aad06138d03f9cb4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:23.660366 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1655/3256] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:03:23 2022] DELETE /identity/v3/users/57553270540e4163aad06138d03f9cb4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:23.956711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:23.997128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519567ab-196c-48d4-8b54-6dfe96025754 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:24.027422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c23c5-e03d-4e13-a3c8-44ca7e150fea None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.027820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c23c5-e03d-4e13-a3c8-44ca7e150fea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.029102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c23c5-e03d-4e13-a3c8-44ca7e150fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.055717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f59c23c5-e03d-4e13-a3c8-44ca7e150fea None None] MFA Rules not processed for user `35025c6fdf024e8ea7d8d53db1a3974c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:24.057595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f59c23c5-e03d-4e13-a3c8-44ca7e150fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:24.153783 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1656/3257] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:24.170011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:24.174456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.175299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.175414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] PATH_INFO: `/v3/projects/8e0bf14b8dad4360adb4727282b63237` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.179756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0bf14b8dad4360adb4727282b63237)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:24.186020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:24.285518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0bf14b8dad4360adb4727282b63237', 'request_id': 'req-9594a130-c877-4264-b69e-4d01af3d53ba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:24.295222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0bf14b8dad4360adb4727282b63237', 'request_id': 'req-9594a130-c877-4264-b69e-4d01af3d53ba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:24.306479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0bf14b8dad4360adb4727282b63237', 'request_id': 'req-9594a130-c877-4264-b69e-4d01af3d53ba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:24.321852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] The token cache is being invalidate because project 8e0bf14b8dad4360adb4727282b63237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:03:24.322417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:24.323075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9594a130-c877-4264-b69e-4d01af3d53ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:24.324981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1602/3258] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:03:23 2022] DELETE /identity/v3/projects/8e0bf14b8dad4360adb4727282b63237 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:24.330337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f28a4-078b-4d9a-9ac7-dc7ff9e801dc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.330584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f28a4-078b-4d9a-9ac7-dc7ff9e801dc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.330871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f28a4-078b-4d9a-9ac7-dc7ff9e801dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.351061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-548f28a4-078b-4d9a-9ac7-dc7ff9e801dc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:24.352286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-548f28a4-078b-4d9a-9ac7-dc7ff9e801dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:24.426669 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1657/3259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:24.440568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf429-10c8-4ad8-8965-c1b7b5f3f242 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.441139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf429-10c8-4ad8-8965-c1b7b5f3f242 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.441362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf429-10c8-4ad8-8965-c1b7b5f3f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.467213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fbddf429-10c8-4ad8-8965-c1b7b5f3f242 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:24.468548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fbddf429-10c8-4ad8-8965-c1b7b5f3f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:24.477720 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1603/3260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:24.481774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f28a4-078b-4d9a-9ac7-dc7ff9e801dc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:24.494629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f28a4-078b-4d9a-9ac7-dc7ff9e801dc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:24.500158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:24.500842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.501222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.501495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.502225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:03:24.502520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:24.504337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:24.517843 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1658/3261] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:03:24.522416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddf429-10c8-4ad8-8965-c1b7b5f3f242 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:24.533548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddf429-10c8-4ad8-8965-c1b7b5f3f242 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:24.541074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:24.542022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.542433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.543559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.544534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:24.547131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:24.583342 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1604/3262] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:03:24 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:03:24.587817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:24.604273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509734-3b28-4e70-8c89-2b9b7b67362f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:24.695691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:24.696695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.697150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.697693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.698699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:24.701119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:24.726628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1659/3263] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:03:24 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:03:24.731037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:24.745970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d36357-e092-4567-aef2-d60dee09299a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:24.750970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:24.751729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.752233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.753730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.753730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:24.755063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:24.771839 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1605/3264] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:24.772478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:24.782368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9ee53-517a-4c15-8e97-059978c02caa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:24.787425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5652fb2-d913-4fef-8c67-474f49b51984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:24.788130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652fb2-d913-4fef-8c67-474f49b51984 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.788860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652fb2-d913-4fef-8c67-474f49b51984 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.789299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652fb2-d913-4fef-8c67-474f49b51984 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.790311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5652fb2-d913-4fef-8c67-474f49b51984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:24.791942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5652fb2-d913-4fef-8c67-474f49b51984 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:24.802278 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1660/3265] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:03:24.809656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:24.823911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c6c53-19da-4bd3-a7f5-0604d9127380 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:24.831992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:24.833551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.833913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.834614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] PATH_INFO: `/v3/projects/f87849ca88bb4519b329fab033911446/users/121a5a2fcd9f4420885f2a78c1dfc339/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.855063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87849ca88bb4519b329fab033911446, user_id=121a5a2fcd9f4420885f2a78c1dfc339, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:24.858522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:24.894566 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1606/3266] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:24 2022] PUT /identity/v3/projects/f87849ca88bb4519b329fab033911446/users/121a5a2fcd9f4420885f2a78c1dfc339/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:24.894731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e97be-a9a3-47c1-b15f-42d2d01cf127 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:24.894871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e97be-a9a3-47c1-b15f-42d2d01cf127 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:24.895153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e97be-a9a3-47c1-b15f-42d2d01cf127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:24.921096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c10e97be-a9a3-47c1-b15f-42d2d01cf127 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:24.923090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c10e97be-a9a3-47c1-b15f-42d2d01cf127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:25.001569 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1661/3267] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:25.071079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:25.072850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:25.168151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8345553-132f-4f32-81f5-8270e5a4cea0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:25.168378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8345553-132f-4f32-81f5-8270e5a4cea0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:25.168631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8345553-132f-4f32-81f5-8270e5a4cea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:25.182770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01458-a4dc-44b0-8ed5-824a1d1286b6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:25.188188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4608cc-716c-45f0-b01a-3821592d0fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:25.189169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4608cc-716c-45f0-b01a-3821592d0fae service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:25.189637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4608cc-716c-45f0-b01a-3821592d0fae service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:25.190095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4608cc-716c-45f0-b01a-3821592d0fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:25.194315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a8345553-132f-4f32-81f5-8270e5a4cea0 None None] MFA Rules not processed for user `f6869f687bd8411ea81a24f566fef6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:25.196442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a8345553-132f-4f32-81f5-8270e5a4cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:25.207996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4608cc-716c-45f0-b01a-3821592d0fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:25.209438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4608cc-716c-45f0-b01a-3821592d0fae service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:25.243595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1607/3268] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:25.315879 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1662/3269] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:26.203407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:26.203929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:26.203929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:26.247980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:26.249621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:26.371729 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1608/3270] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:26.384244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708e053-19df-47fd-8b09-80ca743baf8d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:26.384876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708e053-19df-47fd-8b09-80ca743baf8d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:26.384876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708e053-19df-47fd-8b09-80ca743baf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:26.415384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a708e053-19df-47fd-8b09-80ca743baf8d None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:26.416609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a708e053-19df-47fd-8b09-80ca743baf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:26.428517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1663/3271] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:27.174748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:27.176794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:27.281606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80c53a-4600-44e0-9d46-c7e2864eda39 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:27.303340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78144ec6-c60b-4441-a46b-61a61af79834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:27.304384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144ec6-c60b-4441-a46b-61a61af79834 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:27.305117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144ec6-c60b-4441-a46b-61a61af79834 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:27.305617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144ec6-c60b-4441-a46b-61a61af79834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:27.324309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78144ec6-c60b-4441-a46b-61a61af79834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:27.326108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78144ec6-c60b-4441-a46b-61a61af79834 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:27.357314 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1609/3272] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:30.419517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:30.420032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:30.420130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:30.441613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] MFA Rules not processed for user `3d1c24bc22654cab94bc0b7b8e271c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:30.443101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:30.569078 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1664/3273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:32.712990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3379f-2926-46a8-9cc0-0169073f275f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:32.714519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3379f-2926-46a8-9cc0-0169073f275f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:32.715036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3379f-2926-46a8-9cc0-0169073f275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:32.748065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-96b3379f-2926-46a8-9cc0-0169073f275f None None] MFA Rules not processed for user `fbcb9088698a4f478ccebca7a65f54c4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:32.749330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-96b3379f-2926-46a8-9cc0-0169073f275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:32.831482 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1610/3274] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:33.523930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:33.527547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:33.543347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a6f27-8234-4ae9-b9cd-ea68ad6e417e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:33.548847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:33.550159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:33.550617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:33.551073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] PATH_INFO: `/v3/users/c89ddff4ad7c4ef1b382b760918d6054` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:33.552661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89ddff4ad7c4ef1b382b760918d6054)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:33.554836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:33.613674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89ddff4ad7c4ef1b382b760918d6054'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:33.614901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89ddff4ad7c4ef1b382b760918d6054'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:33.625263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89ddff4ad7c4ef1b382b760918d6054'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:33.636503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89ddff4ad7c4ef1b382b760918d6054'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:33.637084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8aa1b9b-4285-444c-b50f-0ae93eb92b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89ddff4ad7c4ef1b382b760918d6054'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:33.656841 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1665/3275] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:03:33 2022] DELETE /identity/v3/users/c89ddff4ad7c4ef1b382b760918d6054 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:33.842323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3379f-2926-46a8-9cc0-0169073f275f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:33.864695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3379f-2926-46a8-9cc0-0169073f275f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:33.955092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:33.955995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:33.956281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:33.956559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] PATH_INFO: `/v3/projects/bd8c462cb0354f748ec4a7bfa561be3d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:33.957930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8c462cb0354f748ec4a7bfa561be3d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:33.960843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:34.016753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8c462cb0354f748ec4a7bfa561be3d', 'request_id': 'req-2101ee45-0af3-4c8a-afcd-25ddedde1332'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:34.023573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8c462cb0354f748ec4a7bfa561be3d', 'request_id': 'req-2101ee45-0af3-4c8a-afcd-25ddedde1332'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:34.034331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8c462cb0354f748ec4a7bfa561be3d', 'request_id': 'req-2101ee45-0af3-4c8a-afcd-25ddedde1332'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:34.047388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] The token cache is being invalidate because project bd8c462cb0354f748ec4a7bfa561be3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:03:34.047776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:34.048601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2101ee45-0af3-4c8a-afcd-25ddedde1332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:34.050630 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1611/3276] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:03:33 2022] DELETE /identity/v3/projects/bd8c462cb0354f748ec4a7bfa561be3d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:34.056398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c1fe-df1a-4e5a-be0b-575bf97e8e7f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.056689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c1fe-df1a-4e5a-be0b-575bf97e8e7f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.056970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c1fe-df1a-4e5a-be0b-575bf97e8e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.087443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a916c1fe-df1a-4e5a-be0b-575bf97e8e7f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:34.089064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a916c1fe-df1a-4e5a-be0b-575bf97e8e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:34.184411 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1666/3277] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:34.192548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ab1e-5527-4d13-afea-bfc0b1bda5d4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.192864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ab1e-5527-4d13-afea-bfc0b1bda5d4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.193158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ab1e-5527-4d13-afea-bfc0b1bda5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.218586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4e29ab1e-5527-4d13-afea-bfc0b1bda5d4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:34.220461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4e29ab1e-5527-4d13-afea-bfc0b1bda5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:34.231519 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1612/3278] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:34.236165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916c1fe-df1a-4e5a-be0b-575bf97e8e7f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:34.248759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916c1fe-df1a-4e5a-be0b-575bf97e8e7f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:34.258042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:34.259046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.259485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.259937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.261420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:03:34.261916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:34.264145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:34.296342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1667/3279] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:03:34.297196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ab1e-5527-4d13-afea-bfc0b1bda5d4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:34.307730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ab1e-5527-4d13-afea-bfc0b1bda5d4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:34.314615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:34.315644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.316156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.316657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.317658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:34.319883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:34.355409 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1613/3280] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:03:34 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:03:34.361088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:34.375276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2d109-f259-43cf-8545-a7843ee33366 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:34.479165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:34.479165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.479165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.479165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.479707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:34.479707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:34.527258 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1668/3281] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:03:34 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:03:34.530353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:34.555659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c34132-078b-412b-9a9d-8ca574a15ee6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:34.560532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:34.561246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.561526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.561798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.562534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:34.564172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:34.591650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:34.592235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1614/3282] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:03:34.611781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4974-4250-4fc3-a409-33da1b7b8654 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:34.618654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b31af-a072-4d90-b34d-514b3fe53b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:34.620033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b31af-a072-4d90-b34d-514b3fe53b00 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.620814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b31af-a072-4d90-b34d-514b3fe53b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.624264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b31af-a072-4d90-b34d-514b3fe53b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.625390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b31af-a072-4d90-b34d-514b3fe53b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:34.627274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b31af-a072-4d90-b34d-514b3fe53b00 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:34.649397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1669/3283] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:03:34.650392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:34.664970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89088740-3a0c-4599-86c5-bf22902b96c4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:34.672739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:34.677230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.677603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.677952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] PATH_INFO: `/v3/projects/f11b6741075b48eaaf64948d2ecace51/users/3e8935064f914d1293b9c264affed4ee/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.715282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11b6741075b48eaaf64948d2ecace51, user_id=3e8935064f914d1293b9c264affed4ee, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:34.718383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:34.744553 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1615/3284] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:03:34 2022] PUT /identity/v3/projects/f11b6741075b48eaaf64948d2ecace51/users/3e8935064f914d1293b9c264affed4ee/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:03:34.746748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c03c-3384-4420-a311-39a6daacaa4b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:34.747443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c03c-3384-4420-a311-39a6daacaa4b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:34.749024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c03c-3384-4420-a311-39a6daacaa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:34.770841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7616c03c-3384-4420-a311-39a6daacaa4b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:34.773172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7616c03c-3384-4420-a311-39a6daacaa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:34.870652 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1670/3285] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:34.902611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:34.905506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:35.043554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faabf49-6316-4038-9d73-47ce14cdc3de admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:35.049782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:35.051295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:35.051822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:35.052332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:35.067323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:35.069333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:35.104813 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1616/3286] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:42.052707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70356c2-4014-41af-ac61-1305faeac104 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:42.054663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70356c2-4014-41af-ac61-1305faeac104 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:42.055198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70356c2-4014-41af-ac61-1305faeac104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:42.099240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f70356c2-4014-41af-ac61-1305faeac104 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:42.105348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f70356c2-4014-41af-ac61-1305faeac104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:42.199099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1671/3287] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:03:42.251640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:42.253728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:42.382005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1df0-f021-4864-b024-d5d08bea6b0e service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:42.389691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:42.390784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:42.391284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:42.391749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:42.405216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:42.407329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:42.428351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1617/3288] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:03:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:44.675955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26181025-5eec-44a5-a487-a3ec83e31eb9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:44.677076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26181025-5eec-44a5-a487-a3ec83e31eb9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:44.678194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26181025-5eec-44a5-a487-a3ec83e31eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:44.711398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-26181025-5eec-44a5-a487-a3ec83e31eb9 None None] MFA Rules not processed for user `3e8935064f914d1293b9c264affed4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:44.713241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-26181025-5eec-44a5-a487-a3ec83e31eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:44.806558 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1672/3289] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:44.912688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:44.916300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:45.045905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5732-dec9-4f5a-8b17-d6b17635023b service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:45.052795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d99f3a-4dc1-49b0-bbd0-3923db07e559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:45.054091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d99f3a-4dc1-49b0-bbd0-3923db07e559 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:45.055085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d99f3a-4dc1-49b0-bbd0-3923db07e559 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:45.055686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d99f3a-4dc1-49b0-bbd0-3923db07e559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:45.075869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d99f3a-4dc1-49b0-bbd0-3923db07e559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:45.078120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d99f3a-4dc1-49b0-bbd0-3923db07e559 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:45.104774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1618/3290] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:50.576262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26181025-5eec-44a5-a487-a3ec83e31eb9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:50.622042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26181025-5eec-44a5-a487-a3ec83e31eb9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:50.631454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:50.632498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:50.632833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:50.633111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:50.638032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:50.737476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:50.739624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:50.751912 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1673/3291] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:03:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:03:53.349128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5c9a-ad46-4c84-893a-ba4b8bb4d5ee None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:53.349612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5c9a-ad46-4c84-893a-ba4b8bb4d5ee None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:53.350153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5c9a-ad46-4c84-893a-ba4b8bb4d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:53.375586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-357b5c9a-ad46-4c84-893a-ba4b8bb4d5ee None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:53.377467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-357b5c9a-ad46-4c84-893a-ba4b8bb4d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:53.496525 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1619/3292] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:58.757992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:58.759682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:58.775340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d4545-a883-43b3-9752-c92b6a18fe45 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:58.779971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:58.780879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:58.781186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:58.781459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] PATH_INFO: `/v3/users/dd753dc1202f4e138094f0f50b83b2f4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:58.782834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd753dc1202f4e138094f0f50b83b2f4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:58.785466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:58.888003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd753dc1202f4e138094f0f50b83b2f4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:58.888943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd753dc1202f4e138094f0f50b83b2f4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:58.898415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd753dc1202f4e138094f0f50b83b2f4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:58.912038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd753dc1202f4e138094f0f50b83b2f4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:58.913848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b387314-aab5-47b5-906b-5de37bdbfa32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd753dc1202f4e138094f0f50b83b2f4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:58.951578 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1674/3293] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:03:58 2022] DELETE /identity/v3/users/dd753dc1202f4e138094f0f50b83b2f4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:59.387977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5c9a-ad46-4c84-893a-ba4b8bb4d5ee None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:59.408243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5c9a-ad46-4c84-893a-ba4b8bb4d5ee None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:59.503192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:59.504498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:59.505125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:59.507769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] PATH_INFO: `/v3/projects/5d288e617526417680b8d375cf87e380` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:59.509685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d288e617526417680b8d375cf87e380)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:59.512306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:59.551001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15ca7-0ff2-4a5c-8f95-932d46440eca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:59.551578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15ca7-0ff2-4a5c-8f95-932d46440eca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:59.552098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15ca7-0ff2-4a5c-8f95-932d46440eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:59.576670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-97a15ca7-0ff2-4a5c-8f95-932d46440eca None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:03:59.578444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-97a15ca7-0ff2-4a5c-8f95-932d46440eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:59.624565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d288e617526417680b8d375cf87e380', 'request_id': 'req-4b5d95cf-772f-446d-8ee7-919fd9a8521e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.643950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d288e617526417680b8d375cf87e380', 'request_id': 'req-4b5d95cf-772f-446d-8ee7-919fd9a8521e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.656360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d288e617526417680b8d375cf87e380', 'request_id': 'req-4b5d95cf-772f-446d-8ee7-919fd9a8521e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.673091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] The token cache is being invalidate because project 5d288e617526417680b8d375cf87e380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:03:59.673921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.674956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.680664 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1620/3294] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:03:59 2022] DELETE /identity/v3/projects/5d288e617526417680b8d375cf87e380 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:03:59.682103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:03:59.684112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:03:59.695024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1675/3295] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:03:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:03:59.809709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d95cf-772f-446d-8ee7-919fd9a8521e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:03:59.815444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:03:59.817192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:03:59.818359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:03:59.818882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] PATH_INFO: `/v3/users/4006873e704042b6a4b62d643d4a4ddb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:03:59.830641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4006873e704042b6a4b62d643d4a4ddb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:03:59.832832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:03:59.931828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4006873e704042b6a4b62d643d4a4ddb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.932552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4006873e704042b6a4b62d643d4a4ddb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.945216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4006873e704042b6a4b62d643d4a4ddb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.946033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4006873e704042b6a4b62d643d4a4ddb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.964923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f65a5898-389e-415f-82bd-bd14fd41aca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4006873e704042b6a4b62d643d4a4ddb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:03:59.993358 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1621/3296] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:03:59 2022] DELETE /identity/v3/users/4006873e704042b6a4b62d643d4a4ddb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:00.661505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15ca7-0ff2-4a5c-8f95-932d46440eca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:00.691212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15ca7-0ff2-4a5c-8f95-932d46440eca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:00.831045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:00.832782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:00.834512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:00.834512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] PATH_INFO: `/v3/projects/8bd15ebf647e4d1988c25cd83baa5de1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:00.835838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd15ebf647e4d1988c25cd83baa5de1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:00.838409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:00.926588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd15ebf647e4d1988c25cd83baa5de1', 'request_id': 'req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:00.933434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd15ebf647e4d1988c25cd83baa5de1', 'request_id': 'req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:00.948525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd15ebf647e4d1988c25cd83baa5de1', 'request_id': 'req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:00.964130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] The token cache is being invalidate because project 8bd15ebf647e4d1988c25cd83baa5de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:00.964686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:00.965488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f2ecae2b-90e8-4bb9-bf71-2633c339b07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:00.971808 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1676/3297] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:00 2022] DELETE /identity/v3/projects/8bd15ebf647e4d1988c25cd83baa5de1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:00.973668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c67c-92f1-42b4-bc3b-b340f9be4fb0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:00.974175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c67c-92f1-42b4-bc3b-b340f9be4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:00.974292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c67c-92f1-42b4-bc3b-b340f9be4fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:00.994902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d445c67c-92f1-42b4-bc3b-b340f9be4fb0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:00.996123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d445c67c-92f1-42b4-bc3b-b340f9be4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:01.078560 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1622/3298] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:01.091331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c962a-928c-46b1-9b64-ac00e9aa388e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.091331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c962a-928c-46b1-9b64-ac00e9aa388e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.091331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c962a-928c-46b1-9b64-ac00e9aa388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.130266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4d8c962a-928c-46b1-9b64-ac00e9aa388e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:01.132934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d8c962a-928c-46b1-9b64-ac00e9aa388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:01.150838 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1677/3299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:01.155194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445c67c-92f1-42b4-bc3b-b340f9be4fb0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:01.188718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445c67c-92f1-42b4-bc3b-b340f9be4fb0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:01.208951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:01.209905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.210344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.210872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.211624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:01.211933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:01.213601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:01.231927 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1623/3300] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:01.233612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c962a-928c-46b1-9b64-ac00e9aa388e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:01.259110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c962a-928c-46b1-9b64-ac00e9aa388e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:01.270020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:01.271213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.271663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.272115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.273114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:01.275415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:01.333475 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1678/3301] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:01 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:01.334171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:01.349022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd110-1740-401a-aba2-1b3087cf014f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:01.444168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:01.445243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.445522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.445796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.451465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:01.451465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:01.481116 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1624/3302] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:01 2022] POST /identity/v3/users => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:01.485223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:01.498393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2568185-ce6c-443d-87b6-e4e42e485069 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:01.503142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:01.503907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.504253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.504589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.505491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:01.508297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:01.522381 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1679/3303] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:01.526597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:01.537399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317be00-2651-4c16-a382-87139f4c60a2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:01.543824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdff5a-c8d0-4e43-bcf8-f39ea14831a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:01.544918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdff5a-c8d0-4e43-bcf8-f39ea14831a9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.545299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdff5a-c8d0-4e43-bcf8-f39ea14831a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.545631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdff5a-c8d0-4e43-bcf8-f39ea14831a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.546431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdff5a-c8d0-4e43-bcf8-f39ea14831a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:01.548101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdff5a-c8d0-4e43-bcf8-f39ea14831a9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:01.559657 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1625/3304] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:01.564542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:01.576510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cefb2-e739-4dfc-8ebd-aeddc7ef4e76 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:01.582818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:01.583868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.584357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.584631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] PATH_INFO: `/v3/projects/596406a59ceb473f89a31ea38750883a/users/2cab23ec10d24a6fa2fd57c233947616/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.603228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596406a59ceb473f89a31ea38750883a, user_id=2cab23ec10d24a6fa2fd57c233947616, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:01.606119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:01.630716 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1680/3305] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:01 2022] PUT /identity/v3/projects/596406a59ceb473f89a31ea38750883a/users/2cab23ec10d24a6fa2fd57c233947616/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:01.637640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.637965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.638237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.669325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:01.671157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:01.789636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1626/3306] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:01.814416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:01.816326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:01.961962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9675eb-6ef1-4009-afd5-327acb63a3f1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:01.968483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:01.969651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:01.969935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:01.970209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:01.986038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:01.989321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:02.009626 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1681/3307] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:03.229595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:03.231144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:03.244383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d5bf-9d1d-4a3e-aa46-e1d0e790f316 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:03.249783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:03.251112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:03.251657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:03.252371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] PATH_INFO: `/v3/users/3e8935064f914d1293b9c264affed4ee` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:03.254349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8935064f914d1293b9c264affed4ee)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:03.257606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:03.336660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8935064f914d1293b9c264affed4ee'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:03.337354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8935064f914d1293b9c264affed4ee'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:03.350897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8935064f914d1293b9c264affed4ee'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:03.351878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8935064f914d1293b9c264affed4ee'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:03.363309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-807cde2f-a8d9-4b02-9bd7-4626e1611d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8935064f914d1293b9c264affed4ee'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:03.383310 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1627/3308] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:03 2022] DELETE /identity/v3/users/3e8935064f914d1293b9c264affed4ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:03.798195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:03.809573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf44839-0d73-4cbf-b692-99dfce0db0aa service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:03.886005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:03.887722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:03.888182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:03.889221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] PATH_INFO: `/v3/projects/f11b6741075b48eaaf64948d2ecace51` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:03.891052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11b6741075b48eaaf64948d2ecace51)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:03.893209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:03.968737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11b6741075b48eaaf64948d2ecace51', 'request_id': 'req-94402baa-7cf5-4817-a978-382de1175dd5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:03.980391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11b6741075b48eaaf64948d2ecace51', 'request_id': 'req-94402baa-7cf5-4817-a978-382de1175dd5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:03.994795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11b6741075b48eaaf64948d2ecace51', 'request_id': 'req-94402baa-7cf5-4817-a978-382de1175dd5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.058686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] The token cache is being invalidate because project f11b6741075b48eaaf64948d2ecace51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:04.060259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.062795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-94402baa-7cf5-4817-a978-382de1175dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.073134 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1682/3309] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:03 2022] DELETE /identity/v3/projects/f11b6741075b48eaaf64948d2ecace51 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:04.077658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011523-70bd-46b7-93c2-1c57125eb59b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.077948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011523-70bd-46b7-93c2-1c57125eb59b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.078224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011523-70bd-46b7-93c2-1c57125eb59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.131985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5e011523-70bd-46b7-93c2-1c57125eb59b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:04.133253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e011523-70bd-46b7-93c2-1c57125eb59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:04.305749 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1628/3310] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:04.313694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fabea-d076-4acf-bb38-7b1ec98bb127 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.314018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fabea-d076-4acf-bb38-7b1ec98bb127 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.314258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fabea-d076-4acf-bb38-7b1ec98bb127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.337146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b00fabea-d076-4acf-bb38-7b1ec98bb127 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:04.338864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b00fabea-d076-4acf-bb38-7b1ec98bb127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:04.356187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011523-70bd-46b7-93c2-1c57125eb59b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:04.363717 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1683/3311] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:04.369276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011523-70bd-46b7-93c2-1c57125eb59b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:04.378442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:04.379183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.379612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.379973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.380918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:04.381540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:04.384328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:04.411274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1629/3312] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:04.412502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fabea-d076-4acf-bb38-7b1ec98bb127 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:04.431934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fabea-d076-4acf-bb38-7b1ec98bb127 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:04.436586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:04.437413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.439065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.439065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.443782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:04.449750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:04.501263 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1684/3313] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:04 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:04.506972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:04.527904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa2e93-ce7c-4cee-a026-0c0ad714a98c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:04.619644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:04.620676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.621298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.621790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.622858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:04.625091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:04.664996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:04.672156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:04.682752 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1630/3314] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:04 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:04.684013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:04.695142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af7b0e-4573-4345-b28a-f35edb672229 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:04.699064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8a43-63a6-4485-b39a-109631d45d6a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:04.701653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:04.703031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.704114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.704610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] PATH_INFO: `/v3/users/35025c6fdf024e8ea7d8d53db1a3974c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.705185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:04.706668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] RBAC: Authorizing `identity:delete_user(user_id=35025c6fdf024e8ea7d8d53db1a3974c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:04.707013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.707454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.707929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.708837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:04.710690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:04.711004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:04.726061 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1631/3315] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:04.727329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:04.737784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80de6-fa1c-486d-b208-bf7cc54dc00c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:04.755074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:04.755992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.756134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.756320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.757266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:04.762543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:04.788001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1632/3316] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:04.789157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:04.802873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd2452-d24c-4049-ae4c-f07103b55cf6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:04.809445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbfd49-9fa0-4ded-b853-1f5db0daf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:04.809976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbfd49-9fa0-4ded-b853-1f5db0daf71a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.810261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbfd49-9fa0-4ded-b853-1f5db0daf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.810536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbfd49-9fa0-4ded-b853-1f5db0daf71a admin admin] PATH_INFO: `/v3/projects/1e2f7aa3f0c94253b265693d30844fd0/users/5fe69df11b2846f99843c4883a067021/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.826696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35025c6fdf024e8ea7d8d53db1a3974c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.828581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbfd49-9fa0-4ded-b853-1f5db0daf71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2f7aa3f0c94253b265693d30844fd0, user_id=5fe69df11b2846f99843c4883a067021, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:04.829663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35025c6fdf024e8ea7d8d53db1a3974c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.834807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbfd49-9fa0-4ded-b853-1f5db0daf71a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:04.853422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35025c6fdf024e8ea7d8d53db1a3974c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.865907 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1633/3317] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:04 2022] PUT /identity/v3/projects/1e2f7aa3f0c94253b265693d30844fd0/users/5fe69df11b2846f99843c4883a067021/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:04.869244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35025c6fdf024e8ea7d8d53db1a3974c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.870427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a2d225e5-63e1-490c-848b-aeb4496b957c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35025c6fdf024e8ea7d8d53db1a3974c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:04.876240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.877224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.877603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.918726 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1685/3318] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:04 2022] DELETE /identity/v3/users/35025c6fdf024e8ea7d8d53db1a3974c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:04.919972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] MFA Rules not processed for user `5fe69df11b2846f99843c4883a067021`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:04.921329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:04.923535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:04.924127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:04.924589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:04.946472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:04.948084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:05.049364 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1634/3319] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:05.063008 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1686/3320] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:05.070085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:05.073266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:05.081924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:05.083706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:05.188269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62107a8-a904-49fa-898f-317f0b268df7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:05.202367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:05.203914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:05.204347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:05.204647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:05.215618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642b53f-9a2f-4391-b7fe-36f147c3513d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:05.217686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:05.221091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:05.221506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:05.222443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:05.222783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:05.223127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:05.237007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:05.238895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:05.239917 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1635/3321] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:05.251198 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1687/3322] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:05.694751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:05.698053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:05.739906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aba3a-605a-4a66-9b7a-8dc0451835c1 service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:05.752366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:05.753680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:05.754205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:05.754722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] PATH_INFO: `/v3/projects/ab5f53583b7444188c705ed472c3cf06` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:05.756537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5f53583b7444188c705ed472c3cf06)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:05.758950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:05.864534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5f53583b7444188c705ed472c3cf06', 'request_id': 'req-291411d1-1d05-4eb7-8964-82b7735f3db2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:05.876108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5f53583b7444188c705ed472c3cf06', 'request_id': 'req-291411d1-1d05-4eb7-8964-82b7735f3db2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:05.893785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5f53583b7444188c705ed472c3cf06', 'request_id': 'req-291411d1-1d05-4eb7-8964-82b7735f3db2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:05.929892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] The token cache is being invalidate because project ab5f53583b7444188c705ed472c3cf06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:05.930287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:05.931074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-291411d1-1d05-4eb7-8964-82b7735f3db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:05.933567 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1636/3323] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:05 2022] DELETE /identity/v3/projects/ab5f53583b7444188c705ed472c3cf06 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:05.937286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:05.948272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018084-67f9-4d7c-8e53-2e21d98e4ab4 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:06.034813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:06.036124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:06.040358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:06.040959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] PATH_INFO: `/v3/users/1e78125c236a44b1a3dfd4c239d35ff3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:06.043049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e78125c236a44b1a3dfd4c239d35ff3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:06.048703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:06.133347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e78125c236a44b1a3dfd4c239d35ff3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:06.134270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e78125c236a44b1a3dfd4c239d35ff3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:06.155365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e78125c236a44b1a3dfd4c239d35ff3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:06.180116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e78125c236a44b1a3dfd4c239d35ff3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:06.180955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e78125c236a44b1a3dfd4c239d35ff3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:06.220540 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1688/3324] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:05 2022] DELETE /identity/v3/users/1e78125c236a44b1a3dfd4c239d35ff3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:06.416692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:06.417167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:06.417449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:06.437193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:06.438463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:06.510955 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1637/3325] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:04:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:06.523623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:06.525106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:06.632869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53126aad-b151-4f92-af4f-10bcd70356e5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:06.638922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:06.640781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:06.643017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fdf3f-435d-470b-8635-2f25a076cd51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:06.645286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fdf3f-435d-470b-8635-2f25a076cd51 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:06.645632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fdf3f-435d-470b-8635-2f25a076cd51 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:06.646095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fdf3f-435d-470b-8635-2f25a076cd51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:06.684158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fdf3f-435d-470b-8635-2f25a076cd51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:06.690567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fdf3f-435d-470b-8635-2f25a076cd51 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:06.719673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1689/3326] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:04:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:06.879636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08880264-bd0c-4e98-8f5e-aca53330ecbe None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:06.901976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:06.902884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:06.903255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:06.903712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] PATH_INFO: `/v3/projects/e00846370b944c5da8e5f5e89038efd4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:06.906768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00846370b944c5da8e5f5e89038efd4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:06.912609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:07.020589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00846370b944c5da8e5f5e89038efd4', 'request_id': 'req-069b6491-b50d-440a-84c0-eabc01164d86'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:07.027468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00846370b944c5da8e5f5e89038efd4', 'request_id': 'req-069b6491-b50d-440a-84c0-eabc01164d86'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:07.040573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00846370b944c5da8e5f5e89038efd4', 'request_id': 'req-069b6491-b50d-440a-84c0-eabc01164d86'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:07.055957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] The token cache is being invalidate because project e00846370b944c5da8e5f5e89038efd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:07.056354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:07.057149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-069b6491-b50d-440a-84c0-eabc01164d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:07.060234 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1638/3327] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:06 2022] DELETE /identity/v3/projects/e00846370b944c5da8e5f5e89038efd4 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:07.065283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531911-8082-4e56-b5b3-67dac24998e5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.065765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531911-8082-4e56-b5b3-67dac24998e5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.065872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531911-8082-4e56-b5b3-67dac24998e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.093099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-67531911-8082-4e56-b5b3-67dac24998e5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:07.096014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-67531911-8082-4e56-b5b3-67dac24998e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:07.168197 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1690/3328] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:07.176877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae79e-f562-43e9-b534-dad3389f5c75 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.177321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae79e-f562-43e9-b534-dad3389f5c75 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.177698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae79e-f562-43e9-b534-dad3389f5c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.203274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a32ae79e-f562-43e9-b534-dad3389f5c75 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:07.205278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a32ae79e-f562-43e9-b534-dad3389f5c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:07.225842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1639/3329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:07.226105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531911-8082-4e56-b5b3-67dac24998e5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:07.239805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531911-8082-4e56-b5b3-67dac24998e5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:07.252743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:07.253610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.253893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.254163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.255202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:07.255364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:07.257138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:07.287155 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1691/3330] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:04:07.291848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae79e-f562-43e9-b534-dad3389f5c75 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:07.308401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae79e-f562-43e9-b534-dad3389f5c75 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:07.325318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:07.326007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.342027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.343197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.347530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:07.353962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:07.436420 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1640/3331] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:07 2022] POST /identity/v3/projects => generated 361 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:07.443624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:07.463394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2149-a528-4cc7-bc1a-cefbd62e6bfd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:07.548455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:07.549383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.549765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.550312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.551402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:07.553693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:07.582449 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1692/3332] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:07 2022] POST /identity/v3/users => generated 281 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:07.585832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:07.597368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504adfb-ecec-4e6b-9244-2d79e1fac31a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:07.604089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48f438-6ab9-4e0f-b24f-6c28fe2d1d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:07.604790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48f438-6ab9-4e0f-b24f-6c28fe2d1d2b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.605150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48f438-6ab9-4e0f-b24f-6c28fe2d1d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.605363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48f438-6ab9-4e0f-b24f-6c28fe2d1d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.606103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48f438-6ab9-4e0f-b24f-6c28fe2d1d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:07.616655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48f438-6ab9-4e0f-b24f-6c28fe2d1d2b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:07.644437 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1641/3333] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:07.648452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:07.660616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e520a0-2f5f-4d3c-ba4f-28bd1b7b545a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.661222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e520a0-2f5f-4d3c-ba4f-28bd1b7b545a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.661500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e520a0-2f5f-4d3c-ba4f-28bd1b7b545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.670665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e70e04-d740-4914-a46e-88902805be13 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:07.676197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:07.677277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.677554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.677822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.678757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:07.680582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:07.686743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-93e520a0-2f5f-4d3c-ba4f-28bd1b7b545a None None] MFA Rules not processed for user `f6869f687bd8411ea81a24f566fef6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:07.688055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-93e520a0-2f5f-4d3c-ba4f-28bd1b7b545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:07.691573 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1693/3334] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:07.696162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:07.710120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fee1e-84c3-4546-88c5-0dd0d22c1b40 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:07.720181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:07.721237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.721623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.721966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] PATH_INFO: `/v3/projects/a5f5984766644e429d2138381b1eb16f/users/e9c89216e7424b8daec5da350751159b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.749704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f5984766644e429d2138381b1eb16f, user_id=e9c89216e7424b8daec5da350751159b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:07.755230 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1642/3335] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:07.755386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:07.777230 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1694/3336] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:07 2022] PUT /identity/v3/projects/a5f5984766644e429d2138381b1eb16f/users/e9c89216e7424b8daec5da350751159b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:07.787295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d4be-972a-47df-8e46-4fa5a1a4407e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:07.787560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d4be-972a-47df-8e46-4fa5a1a4407e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:07.787839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d4be-972a-47df-8e46-4fa5a1a4407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:07.837165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6383d4be-972a-47df-8e46-4fa5a1a4407e None None] MFA Rules not processed for user `e9c89216e7424b8daec5da350751159b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:07.838642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6383d4be-972a-47df-8e46-4fa5a1a4407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:07.995544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1643/3337] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:08.000060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:08.137586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dc667-1143-4cdf-a214-b5c87c9f1d99 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:08.149278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:08.149982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.150256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.150527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.151227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:08.153214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:08.221092 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1695/3338] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:07 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:08.224059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d4be-972a-47df-8e46-4fa5a1a4407e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:08.241451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d4be-972a-47df-8e46-4fa5a1a4407e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:08.326775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:08.327218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.327518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.327932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.328639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:08.330869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:08.364352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:08.371046 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1644/3339] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:08 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:04:08.377683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6a07c-1e82-4a87-a6b7-fd5bbe3d2f13 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:08.391565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:08.392636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.392961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.393276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.394187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:08.396634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:08.423718 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1696/3340] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:08.426848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:08.457745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41502d3-0ebc-46ee-8a00-165d01649168 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:08.462557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06c92b-387f-46a4-9ceb-52eaabaca06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:08.463510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c92b-387f-46a4-9ceb-52eaabaca06d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.463790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c92b-387f-46a4-9ceb-52eaabaca06d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.464064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c92b-387f-46a4-9ceb-52eaabaca06d admin admin] PATH_INFO: `/v3/projects/f92768f9f1824ecbb2917ae40da2d440/users/0b0107f85ece49d1aa3cfa5af844a57e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.483283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06c92b-387f-46a4-9ceb-52eaabaca06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92768f9f1824ecbb2917ae40da2d440, user_id=0b0107f85ece49d1aa3cfa5af844a57e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:08.486275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06c92b-387f-46a4-9ceb-52eaabaca06d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:08.510702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1645/3341] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:08 2022] PUT /identity/v3/projects/f92768f9f1824ecbb2917ae40da2d440/users/0b0107f85ece49d1aa3cfa5af844a57e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:08.517096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:08.528653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5fa5d-b0e7-4e65-8a8c-f17e7d90c4eb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:08.536500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.536904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.537234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.571318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:08.579826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:08.634100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:08.635353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.635634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.635907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.636954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:08.639691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:08.659175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1697/3342] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:08.660793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:08.697254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863417d-1689-4231-b7cb-5d427c1b1f46 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:08.704271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34915ae3-1b2b-41e0-a57a-6ab1e344482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:08.707778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915ae3-1b2b-41e0-a57a-6ab1e344482a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.708358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915ae3-1b2b-41e0-a57a-6ab1e344482a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.708880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915ae3-1b2b-41e0-a57a-6ab1e344482a admin admin] PATH_INFO: `/v3/projects/f92768f9f1824ecbb2917ae40da2d440/users/0b0107f85ece49d1aa3cfa5af844a57e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.709013 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1646/3343] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:04:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:08.711864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34915ae3-1b2b-41e0-a57a-6ab1e344482a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92768f9f1824ecbb2917ae40da2d440, user_id=0b0107f85ece49d1aa3cfa5af844a57e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:08.719624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34915ae3-1b2b-41e0-a57a-6ab1e344482a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:08.744616 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1698/3344] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:08 2022] PUT /identity/v3/projects/f92768f9f1824ecbb2917ae40da2d440/users/0b0107f85ece49d1aa3cfa5af844a57e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:08.744846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:08.744846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:08.746166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2964-9535-4ed1-9ecc-bf695f94ab5c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.746560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2964-9535-4ed1-9ecc-bf695f94ab5c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.747179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2964-9535-4ed1-9ecc-bf695f94ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.801751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0e6d2964-9535-4ed1-9ecc-bf695f94ab5c None None] MFA Rules not processed for user `0b0107f85ece49d1aa3cfa5af844a57e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:08.803189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0e6d2964-9535-4ed1-9ecc-bf695f94ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:08.830523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cadca-285e-4de0-bc52-a647c8d54030 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:08.933993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:08.934971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:08.935247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:08.935577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:08.993374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1699/3345] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:08 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:09.013689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:09.015846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:09.026962 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1647/3346] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:09.166438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346580d1-2f90-4d06-87aa-26c4a62af7fe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:09.167240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346580d1-2f90-4d06-87aa-26c4a62af7fe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:09.167240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346580d1-2f90-4d06-87aa-26c4a62af7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:09.289072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-346580d1-2f90-4d06-87aa-26c4a62af7fe None None] MFA Rules not processed for user `2cab23ec10d24a6fa2fd57c233947616`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:09.290664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-346580d1-2f90-4d06-87aa-26c4a62af7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:09.390532 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1700/3347] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:09.651614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:09.651614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:09.779798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf1361-90c8-4f89-9147-2d264ad18304 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:09.786092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:09.787032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:09.787423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:09.787914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:09.797489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:09.799395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:09.810667 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1648/3348] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:09 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:10.306938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346580d1-2f90-4d06-87aa-26c4a62af7fe None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:10.324916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346580d1-2f90-4d06-87aa-26c4a62af7fe None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:10.337545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eaac6-ac70-444b-9df5-3b3235b4b284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:10.338560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eaac6-ac70-444b-9df5-3b3235b4b284 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:10.338952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eaac6-ac70-444b-9df5-3b3235b4b284 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:10.340737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eaac6-ac70-444b-9df5-3b3235b4b284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:10.351473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eaac6-ac70-444b-9df5-3b3235b4b284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:10.353625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eaac6-ac70-444b-9df5-3b3235b4b284 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:10.368784 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1701/3349] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:11.711823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:11.840319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8eb273-3d06-4716-80e7-43b6e31e8adc service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:11.848162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:11.851037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:11.853087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:11.853521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] PATH_INFO: `/v3/users/e9c89216e7424b8daec5da350751159b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:11.858019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c89216e7424b8daec5da350751159b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:11.863654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:12.036394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c89216e7424b8daec5da350751159b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:12.039411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c89216e7424b8daec5da350751159b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:12.086852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c89216e7424b8daec5da350751159b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:12.092335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c89216e7424b8daec5da350751159b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:12.119579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c89216e7424b8daec5da350751159b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:12.160052 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1649/3350] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:11 2022] DELETE /identity/v3/users/e9c89216e7424b8daec5da350751159b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:12.161581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7748-2e10-429d-90a2-f4a8bd4e8e5e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:12.162403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7748-2e10-429d-90a2-f4a8bd4e8e5e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:12.162865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7748-2e10-429d-90a2-f4a8bd4e8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:12.189405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1e3e7748-2e10-429d-90a2-f4a8bd4e8e5e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:12.193841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1e3e7748-2e10-429d-90a2-f4a8bd4e8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:12.321788 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1702/3351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:12.345760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:12.347242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:12.369155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655a19-a37c-4d00-8edf-2d657a4828a2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:12.369805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655a19-a37c-4d00-8edf-2d657a4828a2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:12.372824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655a19-a37c-4d00-8edf-2d657a4828a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:12.398308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1b655a19-a37c-4d00-8edf-2d657a4828a2 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:12.399992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b655a19-a37c-4d00-8edf-2d657a4828a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:12.474863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deda84-222f-4339-9bce-85c4cb4d9190 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:12.489815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:12.490772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:12.491358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:12.491796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:12.509002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:12.511322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:12.525193 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1650/3352] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:12.546066 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1703/3353] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:12.552941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:12.554482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:12.723816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18452808-0ee9-42c9-92d4-d1b2bb96ef37 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:12.731938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:12.733620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:12.734143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:12.734831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:12.746640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:12.748289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:12.769897 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1651/3354] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:04:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:13.491806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3dfd-81f2-4565-9a17-9afabdd73489 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:13.492399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3dfd-81f2-4565-9a17-9afabdd73489 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:13.492399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3dfd-81f2-4565-9a17-9afabdd73489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:13.529802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8f9d3dfd-81f2-4565-9a17-9afabdd73489 None None] MFA Rules not processed for user `5fe69df11b2846f99843c4883a067021`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:13.531554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8f9d3dfd-81f2-4565-9a17-9afabdd73489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:13.653452 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1704/3355] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:13.665475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:13.669915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:13.685432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d5f9-55b9-4f9c-b18e-43d48b6ce34d service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:13.693092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:13.694606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:13.694606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:13.695053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] PATH_INFO: `/v3/projects/a5f5984766644e429d2138381b1eb16f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:13.697882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f5984766644e429d2138381b1eb16f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:13.700444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:13.777254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f5984766644e429d2138381b1eb16f', 'request_id': 'req-95462bd3-7c79-4b78-b008-a5aece4affec'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:13.799688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f5984766644e429d2138381b1eb16f', 'request_id': 'req-95462bd3-7c79-4b78-b008-a5aece4affec'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:13.814540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f5984766644e429d2138381b1eb16f', 'request_id': 'req-95462bd3-7c79-4b78-b008-a5aece4affec'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:13.833862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] The token cache is being invalidate because project a5f5984766644e429d2138381b1eb16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:13.834824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:13.835648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:13.837709 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1652/3356] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:13 2022] DELETE /identity/v3/projects/a5f5984766644e429d2138381b1eb16f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:13.841752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d3dfd-81f2-4565-9a17-9afabdd73489 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:13.855450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d3dfd-81f2-4565-9a17-9afabdd73489 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:13.951927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:13.953137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:13.953483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:13.953825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] PATH_INFO: `/v3/users/0b0107f85ece49d1aa3cfa5af844a57e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:13.955113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0107f85ece49d1aa3cfa5af844a57e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:13.957601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:14.019144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0107f85ece49d1aa3cfa5af844a57e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.019948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0107f85ece49d1aa3cfa5af844a57e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.026753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0107f85ece49d1aa3cfa5af844a57e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.038555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0107f85ece49d1aa3cfa5af844a57e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.040126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a50ec0-5e4c-4661-ac46-7475703168db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0107f85ece49d1aa3cfa5af844a57e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.061127 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1705/3357] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:13 2022] DELETE /identity/v3/users/0b0107f85ece49d1aa3cfa5af844a57e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:14.415416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:14.417798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:14.438837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95462bd3-7c79-4b78-b008-a5aece4affec admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:14.502802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:14.503843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:14.504187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:14.504461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] PATH_INFO: `/v3/projects/f92768f9f1824ecbb2917ae40da2d440` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:14.506007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92768f9f1824ecbb2917ae40da2d440)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:14.507989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:14.558314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92768f9f1824ecbb2917ae40da2d440', 'request_id': 'req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.564330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92768f9f1824ecbb2917ae40da2d440', 'request_id': 'req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.574208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92768f9f1824ecbb2917ae40da2d440', 'request_id': 'req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.586393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] The token cache is being invalidate because project f92768f9f1824ecbb2917ae40da2d440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:14.586681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.587309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca3e6a9e-1d82-408a-965b-cba4fc7a21e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:14.588890 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1653/3358] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:14 2022] DELETE /identity/v3/projects/f92768f9f1824ecbb2917ae40da2d440 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:14.594209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2a701-0bdf-4960-a9e0-85d333f3ff8d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:14.594700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2a701-0bdf-4960-a9e0-85d333f3ff8d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:14.595332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2a701-0bdf-4960-a9e0-85d333f3ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:14.614034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-46b2a701-0bdf-4960-a9e0-85d333f3ff8d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:14.615766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46b2a701-0bdf-4960-a9e0-85d333f3ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:14.677162 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1706/3359] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:14.685065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d951-f080-4454-82bc-4c74ad1c3e7c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:14.685369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d951-f080-4454-82bc-4c74ad1c3e7c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:14.685895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d951-f080-4454-82bc-4c74ad1c3e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:14.704931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7355d951-f080-4454-82bc-4c74ad1c3e7c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:14.706251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7355d951-f080-4454-82bc-4c74ad1c3e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:14.716037 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1654/3360] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:14.721239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2a701-0bdf-4960-a9e0-85d333f3ff8d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:14.738946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2a701-0bdf-4960-a9e0-85d333f3ff8d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:14.743978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:14.744716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:14.745310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:14.745630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:14.747334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:14.747334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:14.748491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:14.767256 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1707/3361] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:14.772042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d951-f080-4454-82bc-4c74ad1c3e7c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:14.794944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d951-f080-4454-82bc-4c74ad1c3e7c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:14.808288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff61ea-f268-4ecf-b244-b59e06004044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:14.809211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff61ea-f268-4ecf-b244-b59e06004044 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:14.809490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff61ea-f268-4ecf-b244-b59e06004044 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:14.809776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff61ea-f268-4ecf-b244-b59e06004044 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:14.810484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff61ea-f268-4ecf-b244-b59e06004044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:14.816854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff61ea-f268-4ecf-b244-b59e06004044 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:14.875597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:14.877003 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1655/3362] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:14 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:14.890936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f1aa-3a4d-4093-aa2f-d67ef585eb51 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.000296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb646d-5218-4afb-922d-1aab52b5b580 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.000756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb646d-5218-4afb-922d-1aab52b5b580 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.002019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb646d-5218-4afb-922d-1aab52b5b580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.055226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.056133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.056437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.057440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.059152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:15.061484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0dcb646d-5218-4afb-922d-1aab52b5b580 None None] MFA Rules not processed for user `5fe69df11b2846f99843c4883a067021`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:15.063346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0dcb646d-5218-4afb-922d-1aab52b5b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:15.063499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:15.126423 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1708/3363] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:14 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:04:15.131705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:15.162920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10a294-8930-4151-8d6b-3b5057078b91 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.181020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.181777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.182151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.182501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.186832 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1656/3364] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:15.187071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:15.188756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:15.216897 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1709/3365] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:15.217191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb646d-5218-4afb-922d-1aab52b5b580 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:15.234321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb646d-5218-4afb-922d-1aab52b5b580 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.251855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982e38e-ff23-4b90-9803-90c056452649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.252778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982e38e-ff23-4b90-9803-90c056452649 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.257279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982e38e-ff23-4b90-9803-90c056452649 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.257752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982e38e-ff23-4b90-9803-90c056452649 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.259099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982e38e-ff23-4b90-9803-90c056452649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:15.261184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982e38e-ff23-4b90-9803-90c056452649 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:15.291199 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1657/3366] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:15.292927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:15.311307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff7c2-4fb8-4d99-9806-0165926ba37d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.319721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.321024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.321197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.321545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] PATH_INFO: `/v3/projects/1259b37d6b274a81b0c5f997c6687d79/users/a1c6ba12bc6d4a9985f35f507b8c427c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.358561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1259b37d6b274a81b0c5f997c6687d79, user_id=a1c6ba12bc6d4a9985f35f507b8c427c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:15.361385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:15.388516 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1710/3367] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:15 2022] PUT /identity/v3/projects/1259b37d6b274a81b0c5f997c6687d79/users/a1c6ba12bc6d4a9985f35f507b8c427c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:15.399020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed625fe-e64b-41b0-b051-cf0d4bebcf28 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.399311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed625fe-e64b-41b0-b051-cf0d4bebcf28 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.399603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed625fe-e64b-41b0-b051-cf0d4bebcf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.456462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ed625fe-e64b-41b0-b051-cf0d4bebcf28 None None] MFA Rules not processed for user `a1c6ba12bc6d4a9985f35f507b8c427c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:15.458120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ed625fe-e64b-41b0-b051-cf0d4bebcf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:15.577432 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1658/3368] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:15.580081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:15.662685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90266bf-adf9-4906-938e-740c0784236a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.670556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.671787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.672828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.673330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.674538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:15.677371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:15.718515 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1711/3369] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:15 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:15.719614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed625fe-e64b-41b0-b051-cf0d4bebcf28 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:15.738496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed625fe-e64b-41b0-b051-cf0d4bebcf28 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.847046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.848805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.849409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.850057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.851152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:15.853637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:15.893108 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1659/3370] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:15 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:15.894763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:15.923531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbde40-9f85-4ba8-b693-b8a02aeaf5fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.929008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.929973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.930400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.930685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:15.931673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:15.933363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:15.945816 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1712/3371] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:15.949861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:15.963942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0a399-233c-45a9-b31d-13f2c7ee364a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:15.970440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:15.971355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:15.971637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:15.972086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] PATH_INFO: `/v3/projects/1722513343d549f2b548c1121de1eb50/users/7305c11b7752404983dbb1c298b26c40/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:16.014616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1722513343d549f2b548c1121de1eb50, user_id=7305c11b7752404983dbb1c298b26c40, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:16.017468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:16.039640 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1660/3372] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:15 2022] PUT /identity/v3/projects/1722513343d549f2b548c1121de1eb50/users/7305c11b7752404983dbb1c298b26c40/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:16.047707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:16.063454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0e8a-bff8-4a63-8b68-e7be0f1b2f80 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:16.137007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e2141-667f-4a62-920b-eb978d72ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:16.137761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2141-667f-4a62-920b-eb978d72ac0a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:16.137962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2141-667f-4a62-920b-eb978d72ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:16.138228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2141-667f-4a62-920b-eb978d72ac0a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:16.138962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2141-667f-4a62-920b-eb978d72ac0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:16.140798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2141-667f-4a62-920b-eb978d72ac0a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:16.157155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:16.157736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1713/3373] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:16.171963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf589-1615-42f4-a702-4cc6a2018cfc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:16.185384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:16.188340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:16.188849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:16.189680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] PATH_INFO: `/v3/projects/1722513343d549f2b548c1121de1eb50/users/7305c11b7752404983dbb1c298b26c40/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:16.195576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1722513343d549f2b548c1121de1eb50, user_id=7305c11b7752404983dbb1c298b26c40, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:16.204646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:16.234012 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1661/3374] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:16 2022] PUT /identity/v3/projects/1722513343d549f2b548c1121de1eb50/users/7305c11b7752404983dbb1c298b26c40/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:16.245441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:16.245861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:16.245981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:16.298478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] MFA Rules not processed for user `7305c11b7752404983dbb1c298b26c40`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:16.299692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:16.460773 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1714/3375] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:16.668991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:16.671331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:16.856352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905893-56ab-4cf8-8d46-2b60cd7a51f2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:16.873724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:16.874876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:16.875370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:16.876060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:16.903024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:16.906123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:16.934550 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1662/3376] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:17.983471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:17.986319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:18.090893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250168d2-8711-4dbc-80aa-636b436e1697 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:18.099505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:18.100801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:18.101387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:18.101887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] PATH_INFO: `/v3/users/2cab23ec10d24a6fa2fd57c233947616` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:18.103821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cab23ec10d24a6fa2fd57c233947616)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:18.107823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:18.256917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cab23ec10d24a6fa2fd57c233947616'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.269123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cab23ec10d24a6fa2fd57c233947616'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.285103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cab23ec10d24a6fa2fd57c233947616'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.302959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cab23ec10d24a6fa2fd57c233947616'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.304836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ec69c95-723c-4d99-a195-5cfc793058a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cab23ec10d24a6fa2fd57c233947616'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.339391 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1715/3377] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:17 2022] DELETE /identity/v3/users/2cab23ec10d24a6fa2fd57c233947616 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:18.463934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:18.487918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bba87-e8e4-482a-aa25-840a035dedfc service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:18.611192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:18.612435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:18.612851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:18.613749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] PATH_INFO: `/v3/users/a1c6ba12bc6d4a9985f35f507b8c427c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:18.615327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c6ba12bc6d4a9985f35f507b8c427c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:18.618455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:18.689265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c6ba12bc6d4a9985f35f507b8c427c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.690028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c6ba12bc6d4a9985f35f507b8c427c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.698577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c6ba12bc6d4a9985f35f507b8c427c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.699505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c6ba12bc6d4a9985f35f507b8c427c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.714159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c6ba12bc6d4a9985f35f507b8c427c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:18.742282 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1663/3378] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:18 2022] DELETE /identity/v3/users/a1c6ba12bc6d4a9985f35f507b8c427c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:18.743946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:18.744403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:18.745392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:18.765869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:18.767255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:18.792587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:18.797433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:18.896271 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1716/3379] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:18.919095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:18.921476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:18.930070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e56e-e0db-44b2-9a1a-fe3fe2191706 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:18.936223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:18.937294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:18.937579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:18.937892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] PATH_INFO: `/v3/projects/596406a59ceb473f89a31ea38750883a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:18.939933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596406a59ceb473f89a31ea38750883a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:18.943611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.010344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596406a59ceb473f89a31ea38750883a', 'request_id': 'req-99aa8331-ade2-4c98-b387-a0417a40fb34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:19.015841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596406a59ceb473f89a31ea38750883a', 'request_id': 'req-99aa8331-ade2-4c98-b387-a0417a40fb34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:19.025417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596406a59ceb473f89a31ea38750883a', 'request_id': 'req-99aa8331-ade2-4c98-b387-a0417a40fb34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:19.046110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c718b-5175-459f-8bda-386b7b68eaf0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:19.052331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] The token cache is being invalidate because project 596406a59ceb473f89a31ea38750883a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:19.052754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:19.053676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-99aa8331-ade2-4c98-b387-a0417a40fb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:19.055930 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1664/3380] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:18 2022] DELETE /identity/v3/projects/596406a59ceb473f89a31ea38750883a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:04:19.063048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82921-7591-4734-9917-3442defe62a1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.063341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82921-7591-4734-9917-3442defe62a1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.063624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82921-7591-4734-9917-3442defe62a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.121608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b9a82921-7591-4734-9917-3442defe62a1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:19.122928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b9a82921-7591-4734-9917-3442defe62a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:19.172088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:19.172330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.172424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.172757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.175379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:19.258963 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1665/3381] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:19.277981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520d73-732d-4de5-af61-fc2ba59fed3f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.279770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520d73-732d-4de5-af61-fc2ba59fed3f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.280772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520d73-732d-4de5-af61-fc2ba59fed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.327792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:19.329303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.331981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-28520d73-732d-4de5-af61-fc2ba59fed3f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:19.334072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-28520d73-732d-4de5-af61-fc2ba59fed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:19.340529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1717/3382] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:19.355901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1666/3383] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:19.360354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:19.373346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c890e-6ce2-4950-9d9a-0fc7341c1bb0 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:19.380190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:19.381068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.381475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.385468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.385468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:19.385468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:19.385468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.416213 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1718/3384] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:19.416771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28520d73-732d-4de5-af61-fc2ba59fed3f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:19.429989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28520d73-732d-4de5-af61-fc2ba59fed3f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:19.441758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:19.442557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.443070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.443332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.444126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:19.453840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.492106 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1667/3385] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:19 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:19.496023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:19.507103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ef2b1-0e2b-4dd5-9613-f073cb4ab7cc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:19.574493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:19.575368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.575651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.575913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.577506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:19.579530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.604904 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1719/3386] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:19 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:19.608938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:19.630705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88ecf7-7b87-4a07-a66f-99c9786c33fc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:19.636510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:19.637288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.637873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.638018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.638901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:19.640985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.659208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:19.659586 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1668/3387] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:19.670226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0e23-adb1-4b05-86d1-bb23cff8ec41 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:19.675449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2faf3-1f72-4ef7-ba51-c474eb20a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:19.676166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2faf3-1f72-4ef7-ba51-c474eb20a27c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.682343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2faf3-1f72-4ef7-ba51-c474eb20a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.682343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2faf3-1f72-4ef7-ba51-c474eb20a27c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.682343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2faf3-1f72-4ef7-ba51-c474eb20a27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:19.682343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2faf3-1f72-4ef7-ba51-c474eb20a27c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.693982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:19.704319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048222-26aa-475c-9dfe-ade999aa6ce6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:19.705314 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1720/3388] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:19.709748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:19.710696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.710972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.711297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] PATH_INFO: `/v3/projects/bdb08a53dc70466b8d34e3a35af8cd9b/users/e3e3f3ffa0474b85b05d05d0363084e8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.728263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb08a53dc70466b8d34e3a35af8cd9b, user_id=e3e3f3ffa0474b85b05d05d0363084e8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:19.731105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:19.762193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8063df-b427-481b-9b32-54c34941f51c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:19.762481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8063df-b427-481b-9b32-54c34941f51c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:19.762751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8063df-b427-481b-9b32-54c34941f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:19.764175 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1669/3389] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:19 2022] PUT /identity/v3/projects/bdb08a53dc70466b8d34e3a35af8cd9b/users/e3e3f3ffa0474b85b05d05d0363084e8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:19.794842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cf8063df-b427-481b-9b32-54c34941f51c None None] MFA Rules not processed for user `e3e3f3ffa0474b85b05d05d0363084e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:19.798813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cf8063df-b427-481b-9b32-54c34941f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:19.915018 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1721/3390] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:19.935632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:19.939474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:20.050177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e744da-0a6c-4e74-9f76-4d052fff6676 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:20.055564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:20.056726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:20.057283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:20.057773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] PATH_INFO: `/v3/projects/1259b37d6b274a81b0c5f997c6687d79` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:20.059514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1259b37d6b274a81b0c5f997c6687d79)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:20.062843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:20.126823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1259b37d6b274a81b0c5f997c6687d79', 'request_id': 'req-0a815ccf-9e62-4f4a-a095-311c9861f555'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.141265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1259b37d6b274a81b0c5f997c6687d79', 'request_id': 'req-0a815ccf-9e62-4f4a-a095-311c9861f555'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.154588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1259b37d6b274a81b0c5f997c6687d79', 'request_id': 'req-0a815ccf-9e62-4f4a-a095-311c9861f555'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.200755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] The token cache is being invalidate because project 1259b37d6b274a81b0c5f997c6687d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:20.206706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.206706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.211868 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1670/3391] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:19 2022] DELETE /identity/v3/projects/1259b37d6b274a81b0c5f997c6687d79 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:20.217469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8063df-b427-481b-9b32-54c34941f51c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:20.240910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8063df-b427-481b-9b32-54c34941f51c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:20.319264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:20.321082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:20.433523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:20.437226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:20.437226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:20.437226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] PATH_INFO: `/v3/users/7305c11b7752404983dbb1c298b26c40` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:20.443562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7305c11b7752404983dbb1c298b26c40)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:20.445424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:20.509521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815ccf-9e62-4f4a-a095-311c9861f555 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:20.520814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742fda8-6e72-4cd9-842f-be86ee738795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:20.524080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742fda8-6e72-4cd9-842f-be86ee738795 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:20.526478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742fda8-6e72-4cd9-842f-be86ee738795 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:20.530244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742fda8-6e72-4cd9-842f-be86ee738795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:20.537268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b742fda8-6e72-4cd9-842f-be86ee738795 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:20.547323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7305c11b7752404983dbb1c298b26c40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.549408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7305c11b7752404983dbb1c298b26c40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.569756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7305c11b7752404983dbb1c298b26c40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.590668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7305c11b7752404983dbb1c298b26c40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.591539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7305c11b7752404983dbb1c298b26c40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:20.638367 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1722/3392] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:20 2022] DELETE /identity/v3/users/7305c11b7752404983dbb1c298b26c40 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:20.675389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742fda8-6e72-4cd9-842f-be86ee738795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:20.677263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742fda8-6e72-4cd9-842f-be86ee738795 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:20.688140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1671/3393] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:21.539856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:21.542109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:21.624687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2d6e-1fba-4e78-b7b7-282989156ad1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:21.629602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:21.630508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:21.630791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:21.631065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] PATH_INFO: `/v3/projects/1722513343d549f2b548c1121de1eb50` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:21.632336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1722513343d549f2b548c1121de1eb50)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:21.634390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:21.696874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1722513343d549f2b548c1121de1eb50', 'request_id': 'req-c8453eaa-38fb-49ea-b8a7-b5a4838df871'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:21.703261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1722513343d549f2b548c1121de1eb50', 'request_id': 'req-c8453eaa-38fb-49ea-b8a7-b5a4838df871'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:21.720322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1722513343d549f2b548c1121de1eb50', 'request_id': 'req-c8453eaa-38fb-49ea-b8a7-b5a4838df871'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:21.733947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] The token cache is being invalidate because project 1722513343d549f2b548c1121de1eb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:21.734381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:21.735633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8453eaa-38fb-49ea-b8a7-b5a4838df871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:21.739155 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1723/3394] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:21 2022] DELETE /identity/v3/projects/1722513343d549f2b548c1121de1eb50 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:21.744312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5540a-b3bd-4aa6-ad16-93839005f6af None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:21.744902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5540a-b3bd-4aa6-ad16-93839005f6af None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:21.744902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5540a-b3bd-4aa6-ad16-93839005f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:21.766573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c2e5540a-b3bd-4aa6-ad16-93839005f6af None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:21.768161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c2e5540a-b3bd-4aa6-ad16-93839005f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:21.867574 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1672/3395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:21.869511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b3cdf-4c38-4eaa-a786-7e64fcc3ecff None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:21.869805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b3cdf-4c38-4eaa-a786-7e64fcc3ecff None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:21.871166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b3cdf-4c38-4eaa-a786-7e64fcc3ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:21.892370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-690b3cdf-4c38-4eaa-a786-7e64fcc3ecff None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:21.893656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-690b3cdf-4c38-4eaa-a786-7e64fcc3ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:21.904469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1724/3396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:21.909254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5540a-b3bd-4aa6-ad16-93839005f6af None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:21.920225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5540a-b3bd-4aa6-ad16-93839005f6af None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:21.925142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:21.926088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:21.926462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:21.927009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:21.927885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:21.928286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:21.930039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:21.946447 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1673/3397] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:21.948300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b3cdf-4c38-4eaa-a786-7e64fcc3ecff None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:21.958833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b3cdf-4c38-4eaa-a786-7e64fcc3ecff None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:21.963966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:21.964654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:21.964934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:21.965244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:21.965952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:21.967913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:21.998386 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1725/3398] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:21 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:22.002673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.014084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158f3e-3b7c-48ad-bb94-3359cb164379 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.098099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.099095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.099583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.100045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.100935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.103102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.136116 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1674/3399] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:22 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:22.136990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.142461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.144888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:22.160357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3738-435b-4dc3-be3f-75abf0af353f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.168546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.169747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.170211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.170406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] PATH_INFO: `/v3/users/e3e3f3ffa0474b85b05d05d0363084e8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.172701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e3f3ffa0474b85b05d05d0363084e8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.172992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec31565-1a0e-4252-b96d-f8621f09586a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.175336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.195203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.195924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.196211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.196487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.197257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.207354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.229151 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1726/3400] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:22.233222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.245588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e3f3ffa0474b85b05d05d0363084e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:22.246362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e3f3ffa0474b85b05d05d0363084e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:22.255670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e3f3ffa0474b85b05d05d0363084e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:22.256559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e3f3ffa0474b85b05d05d0363084e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:22.266906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f96c8-021e-436b-b7f8-6912d86ba29d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.273160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05c10b0e-c0ae-423c-a5e1-f82963a3d2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e3f3ffa0474b85b05d05d0363084e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:22.275253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.276329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.279903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.279903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.286024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.287876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.311439 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1727/3401] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:22.317850 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1675/3402] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:22 2022] DELETE /identity/v3/users/e3e3f3ffa0474b85b05d05d0363084e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:22.321015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.321533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.323424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.323693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.327879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:22.357082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393ea9-4b6e-4a36-8390-16384aab30f2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.358236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:22.359656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:22.430503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d26ff-fa74-4828-ba9e-bfe12fe1bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.431772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d26ff-fa74-4828-ba9e-bfe12fe1bbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.432023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d26ff-fa74-4828-ba9e-bfe12fe1bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.432301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d26ff-fa74-4828-ba9e-bfe12fe1bbd4 admin admin] PATH_INFO: `/v3/projects/4b9455ce3b4e4d268c23b32258d8eeaa/users/877cb7c7f5da43638d8cb4fe28a927ae/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.460667 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1676/3403] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:22.461454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d26ff-fa74-4828-ba9e-bfe12fe1bbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9455ce3b4e4d268c23b32258d8eeaa, user_id=877cb7c7f5da43638d8cb4fe28a927ae, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.465971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d26ff-fa74-4828-ba9e-bfe12fe1bbd4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.471972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.473716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:22.485147 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1728/3404] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:22 2022] PUT /identity/v3/projects/4b9455ce3b4e4d268c23b32258d8eeaa/users/877cb7c7f5da43638d8cb4fe28a927ae/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:22.497803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739be2-4736-41f8-b4c7-1c76c0bbeb69 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.498332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739be2-4736-41f8-b4c7-1c76c0bbeb69 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.498840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739be2-4736-41f8-b4c7-1c76c0bbeb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.531539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fb739be2-4736-41f8-b4c7-1c76c0bbeb69 None None] MFA Rules not processed for user `877cb7c7f5da43638d8cb4fe28a927ae`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:22.532851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fb739be2-4736-41f8-b4c7-1c76c0bbeb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:22.554475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c8fd-5850-4bd2-9ee5-aef77a6ce0fc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.611061 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1729/3405] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:22.614544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.615212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.615492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.615621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739be2-4736-41f8-b4c7-1c76c0bbeb69 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.615764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.688776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739be2-4736-41f8-b4c7-1c76c0bbeb69 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.695237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.695825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.696424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.696893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.697329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.697599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.698620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.700778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.708618 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1677/3406] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:22.741012 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1730/3407] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:22 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:22.741505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.765423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568c2d-e249-447f-8dc4-9a18681ca262 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.850037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.851620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.852337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.853272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.854867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.859140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.897014 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1678/3408] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:22 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:04:22.899801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.910856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9a2f0-fcc8-493b-bcc3-9bb0229ef6a9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.928143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.928852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.929304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.929626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:22.930345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:22.931983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:22.945109 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1731/3409] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:22.950088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:22.968983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa471c2d-b43a-4e05-9afe-1af6a63c9fe4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:22.981803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:22.982715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:22.982999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:22.983274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] PATH_INFO: `/v3/projects/e0f29f40a0af408baa6e1fc0868a7513/users/9fd23fd1d7a243798cbacdaeacb8e711/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.002436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f29f40a0af408baa6e1fc0868a7513, user_id=9fd23fd1d7a243798cbacdaeacb8e711, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.005712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.027388 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1679/3410] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:22 2022] PUT /identity/v3/projects/e0f29f40a0af408baa6e1fc0868a7513/users/9fd23fd1d7a243798cbacdaeacb8e711/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:23.029834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.041432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6391f6-7e7e-458d-ba9c-8dcb67217e4f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.114687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.115775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.116276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.131042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.132286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.134517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.151502 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1732/3411] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:23.155449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.164538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.166590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.171356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68d596-31e9-402b-bb67-5e004fdcddcb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.177273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098148f3-b35b-4202-a49c-e2ac0b3d1af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.178663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098148f3-b35b-4202-a49c-e2ac0b3d1af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.179889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098148f3-b35b-4202-a49c-e2ac0b3d1af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.180381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098148f3-b35b-4202-a49c-e2ac0b3d1af1 admin admin] PATH_INFO: `/v3/projects/e0f29f40a0af408baa6e1fc0868a7513/users/9fd23fd1d7a243798cbacdaeacb8e711/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.182706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe5250-1ce7-49fb-bc77-ce7c8c8c4a76 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.188468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.189372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.189782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.190123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] PATH_INFO: `/v3/projects/bdb08a53dc70466b8d34e3a35af8cd9b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.191543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb08a53dc70466b8d34e3a35af8cd9b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.193629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.203961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098148f3-b35b-4202-a49c-e2ac0b3d1af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f29f40a0af408baa6e1fc0868a7513, user_id=9fd23fd1d7a243798cbacdaeacb8e711, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.217215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098148f3-b35b-4202-a49c-e2ac0b3d1af1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.237084 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1680/3412] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:23 2022] PUT /identity/v3/projects/e0f29f40a0af408baa6e1fc0868a7513/users/9fd23fd1d7a243798cbacdaeacb8e711/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:04:23.241814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19bcc-e787-4bfd-97fa-510a72127722 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.242452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19bcc-e787-4bfd-97fa-510a72127722 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.243133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19bcc-e787-4bfd-97fa-510a72127722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.261725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb08a53dc70466b8d34e3a35af8cd9b', 'request_id': 'req-5225ca15-923b-4ff8-a243-549c79a65590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:23.273063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb08a53dc70466b8d34e3a35af8cd9b', 'request_id': 'req-5225ca15-923b-4ff8-a243-549c79a65590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:23.282452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0ad19bcc-e787-4bfd-97fa-510a72127722 None None] MFA Rules not processed for user `9fd23fd1d7a243798cbacdaeacb8e711`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:23.283826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0ad19bcc-e787-4bfd-97fa-510a72127722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.286639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb08a53dc70466b8d34e3a35af8cd9b', 'request_id': 'req-5225ca15-923b-4ff8-a243-549c79a65590'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:23.302768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] The token cache is being invalidate because project bdb08a53dc70466b8d34e3a35af8cd9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:23.303390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:23.304561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5225ca15-923b-4ff8-a243-549c79a65590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:23.306895 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1733/3413] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:23 2022] DELETE /identity/v3/projects/bdb08a53dc70466b8d34e3a35af8cd9b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:04:23.313383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a79f-8e15-4079-abdf-45657f4946e5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.313921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a79f-8e15-4079-abdf-45657f4946e5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.314509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a79f-8e15-4079-abdf-45657f4946e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.334505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b565a79f-8e15-4079-abdf-45657f4946e5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:23.336426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b565a79f-8e15-4079-abdf-45657f4946e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.378703 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1681/3414] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:23.380836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8324cb0-4742-4d30-ad48-c810d8bcafa4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.381270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8324cb0-4742-4d30-ad48-c810d8bcafa4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.381596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8324cb0-4742-4d30-ad48-c810d8bcafa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.420876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c8324cb0-4742-4d30-ad48-c810d8bcafa4 None None] MFA Rules not processed for user `877cb7c7f5da43638d8cb4fe28a927ae`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:23.425283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c8324cb0-4742-4d30-ad48-c810d8bcafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.445145 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1734/3415] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:23.447030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c58e4d-1d5f-48db-8fc5-bf3b8159758b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.447497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c58e4d-1d5f-48db-8fc5-bf3b8159758b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.447931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c58e4d-1d5f-48db-8fc5-bf3b8159758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.475958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d5c58e4d-1d5f-48db-8fc5-bf3b8159758b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:23.477484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d5c58e4d-1d5f-48db-8fc5-bf3b8159758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.489354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1735/3416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:23.493973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c58e4d-1d5f-48db-8fc5-bf3b8159758b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.506381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c58e4d-1d5f-48db-8fc5-bf3b8159758b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.512675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.513394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.513722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.514001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.514736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:23.515039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.517394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.531302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1736/3417] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:23.535887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.539223 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1682/3418] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:23.553020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdea87-b67e-43cd-8bb2-49e6cc29efd0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.558166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.558841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.559120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.559393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.560099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.562072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.594725 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1737/3419] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:23 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:04:23.599377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8324cb0-4742-4d30-ad48-c810d8bcafa4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.610693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8324cb0-4742-4d30-ad48-c810d8bcafa4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.668582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.669296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.669579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.669854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.670655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.672659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.683978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.686146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.701081 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1683/3420] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:23 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:23.704324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.717486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a08a9-3344-438b-9997-5ea88233727e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.737487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdc029-b7c7-4e85-8706-99aada2bb807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.738791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdc029-b7c7-4e85-8706-99aada2bb807 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.739146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdc029-b7c7-4e85-8706-99aada2bb807 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.739490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdc029-b7c7-4e85-8706-99aada2bb807 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.741391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdc029-b7c7-4e85-8706-99aada2bb807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.744087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdc029-b7c7-4e85-8706-99aada2bb807 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.764878 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1684/3421] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:23.766807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64def95-8167-405c-9029-9354a805fc94 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.767360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64def95-8167-405c-9029-9354a805fc94 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.767360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64def95-8167-405c-9029-9354a805fc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.785592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d4504-fbdc-463b-8899-60ed84ea8e4b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.791589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.792732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.793572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.794843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.798452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.806545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f64def95-8167-405c-9029-9354a805fc94 None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:23.807957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f64def95-8167-405c-9029-9354a805fc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:23.866553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.868696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.879805 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1738/3422] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:23.880699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.886552 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1685/3423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:23.891996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14cfb-6500-4c3b-939d-ae4a94a65a2f service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.897940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1a3cb-6739-4655-99de-1417405724bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.898625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1a3cb-6739-4655-99de-1417405724bc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.899113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1a3cb-6739-4655-99de-1417405724bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.899541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1a3cb-6739-4655-99de-1417405724bc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.900421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1a3cb-6739-4655-99de-1417405724bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.902253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1a3cb-6739-4655-99de-1417405724bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.915936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1739/3424] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:23.920103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64def95-8167-405c-9029-9354a805fc94 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:23.933543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64def95-8167-405c-9029-9354a805fc94 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:23.946685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:23.947848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:23.948639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:23.949223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] PATH_INFO: `/v3/projects/720fd939cec64e069f36f74f4a2007ef/users/e1baa603ea934446bc560f273872dc24/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:23.973844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720fd939cec64e069f36f74f4a2007ef, user_id=e1baa603ea934446bc560f273872dc24, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:23.977502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:23.999782 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1686/3425] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:23 2022] PUT /identity/v3/projects/720fd939cec64e069f36f74f4a2007ef/users/e1baa603ea934446bc560f273872dc24/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:24.010045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f11e6-39a4-492b-97a5-89c3d24c9475 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:24.010747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f11e6-39a4-492b-97a5-89c3d24c9475 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:24.011083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f11e6-39a4-492b-97a5-89c3d24c9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:24.046795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f52f11e6-39a4-492b-97a5-89c3d24c9475 None None] MFA Rules not processed for user `e1baa603ea934446bc560f273872dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:24.048247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f52f11e6-39a4-492b-97a5-89c3d24c9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:24.188544 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1740/3426] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:24.908917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:25.010738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1b580-13ef-413f-873c-98c56c6af505 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:25.019249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:25.019914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:25.020189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:25.020518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:25.034709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:25.040914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:25.068488 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1687/3427] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:25.123167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef03f0-927d-414f-859d-c7d6641fae62 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:25.123738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef03f0-927d-414f-859d-c7d6641fae62 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:25.123738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef03f0-927d-414f-859d-c7d6641fae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:25.202396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e8ef03f0-927d-414f-859d-c7d6641fae62 None None] MFA Rules not processed for user `e1baa603ea934446bc560f273872dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:25.203721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8ef03f0-927d-414f-859d-c7d6641fae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:25.221673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1741/3428] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:25.954442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:26.061475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25a31-9188-4d5c-bbb0-a903a8592a3d service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:26.065991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:26.066880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:26.067158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:26.067457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] PATH_INFO: `/v3/users/e1baa603ea934446bc560f273872dc24` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:26.068655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1baa603ea934446bc560f273872dc24)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:26.070628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:26.118872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1baa603ea934446bc560f273872dc24'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.119516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1baa603ea934446bc560f273872dc24'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.126498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1baa603ea934446bc560f273872dc24'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.127153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1baa603ea934446bc560f273872dc24'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.135714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1baa603ea934446bc560f273872dc24'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.153994 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1688/3429] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:25 2022] DELETE /identity/v3/users/e1baa603ea934446bc560f273872dc24 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:26.158845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:26.159346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:26.159346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:26.177736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:26.179080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:26.240891 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1742/3430] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:26.250825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:26.252357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:26.321849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036670-e9e5-45dd-a69f-9569a5c04f29 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:26.326214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547575a7-7ae7-4a5b-ae71-5419f0de7b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:26.326934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547575a7-7ae7-4a5b-ae71-5419f0de7b89 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:26.327207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547575a7-7ae7-4a5b-ae71-5419f0de7b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:26.327479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547575a7-7ae7-4a5b-ae71-5419f0de7b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:26.337911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547575a7-7ae7-4a5b-ae71-5419f0de7b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:26.339537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547575a7-7ae7-4a5b-ae71-5419f0de7b89 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:26.361169 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1689/3431] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:26.737020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:26.739297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:26.771687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a38ab2-63cd-4e42-bfd7-118200ffcb65 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:26.782603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:26.787636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:26.788222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:26.791439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] PATH_INFO: `/v3/projects/720fd939cec64e069f36f74f4a2007ef` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:26.793763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720fd939cec64e069f36f74f4a2007ef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:26.795790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:26.882957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720fd939cec64e069f36f74f4a2007ef', 'request_id': 'req-242156f0-b7af-4572-b3d6-5e280c680699'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.890299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720fd939cec64e069f36f74f4a2007ef', 'request_id': 'req-242156f0-b7af-4572-b3d6-5e280c680699'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.904620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720fd939cec64e069f36f74f4a2007ef', 'request_id': 'req-242156f0-b7af-4572-b3d6-5e280c680699'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.926166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] The token cache is being invalidate because project 720fd939cec64e069f36f74f4a2007ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:26.926625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.927598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-242156f0-b7af-4572-b3d6-5e280c680699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:26.931056 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1743/3432] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:26 2022] DELETE /identity/v3/projects/720fd939cec64e069f36f74f4a2007ef => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:26.939860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77208298-1fb4-485c-be04-cb2be164d99f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:26.940234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77208298-1fb4-485c-be04-cb2be164d99f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:26.940381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77208298-1fb4-485c-be04-cb2be164d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:26.973402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-77208298-1fb4-485c-be04-cb2be164d99f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:26.974732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-77208298-1fb4-485c-be04-cb2be164d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:27.074513 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1690/3433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:27.082568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123f701-60e3-42bc-b66e-ab954188ab5c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.082863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123f701-60e3-42bc-b66e-ab954188ab5c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.083283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123f701-60e3-42bc-b66e-ab954188ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.102781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5123f701-60e3-42bc-b66e-ab954188ab5c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:27.103967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5123f701-60e3-42bc-b66e-ab954188ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:27.111784 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1744/3434] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:27.116175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77208298-1fb4-485c-be04-cb2be164d99f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:27.126078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77208298-1fb4-485c-be04-cb2be164d99f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:27.130638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:27.131298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.131577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.131850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.132575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:27.132878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:27.134512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:27.146205 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1691/3435] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:27.150151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123f701-60e3-42bc-b66e-ab954188ab5c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:27.159314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123f701-60e3-42bc-b66e-ab954188ab5c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:27.164930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:27.165624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.165904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.166175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.166846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:27.168800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:27.197103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1745/3436] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:27 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:27.201493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:27.214544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf403a8-338d-45c5-801a-bce92c5ac3ce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:27.277076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:27.277846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.278275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.278493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.279264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:27.281388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:27.307077 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1692/3437] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:27 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:27.310791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:27.321784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797a3f1-0eb4-439a-9fe6-276de38ee10b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:27.326837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:27.327515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.327794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.328061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.328781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:27.330457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:27.356118 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1746/3438] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:27.363089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:27.378827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09bc59-d003-4aaa-80ac-ab79488fb041 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:27.385944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44533d-ba9d-4e0a-b6a4-cd3cdd3d98ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:27.387901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44533d-ba9d-4e0a-b6a4-cd3cdd3d98ba admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.388415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44533d-ba9d-4e0a-b6a4-cd3cdd3d98ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.388906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44533d-ba9d-4e0a-b6a4-cd3cdd3d98ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.391643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44533d-ba9d-4e0a-b6a4-cd3cdd3d98ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:27.394248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44533d-ba9d-4e0a-b6a4-cd3cdd3d98ba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:27.409551 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1693/3439] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:27.414397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:27.427813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac2fb4-5d78-46d2-b78e-8c07aadd7f97 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:27.434477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:27.436092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.436550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.437067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] PATH_INFO: `/v3/projects/ab023af112834d0eb9a847bacc3fa37e/users/c6dfc7d9ec04440290b61e87a8fecad4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.460892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab023af112834d0eb9a847bacc3fa37e, user_id=c6dfc7d9ec04440290b61e87a8fecad4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:27.464347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:27.482183 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1747/3440] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:27 2022] PUT /identity/v3/projects/ab023af112834d0eb9a847bacc3fa37e/users/c6dfc7d9ec04440290b61e87a8fecad4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:27.487276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f6ef-81b1-4b1a-b9c8-b6464d5dcbfe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.487601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f6ef-81b1-4b1a-b9c8-b6464d5dcbfe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.487877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f6ef-81b1-4b1a-b9c8-b6464d5dcbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.507126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c6d6f6ef-81b1-4b1a-b9c8-b6464d5dcbfe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:27.508350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c6d6f6ef-81b1-4b1a-b9c8-b6464d5dcbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:27.595126 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1694/3441] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:27.619728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:27.623298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:27.696056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2c4fc-131b-47b2-bee5-e350e6422ec4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:27.699885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c483b38-76c3-4390-b259-e64df9f95280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:27.700618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c483b38-76c3-4390-b259-e64df9f95280 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:27.700957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c483b38-76c3-4390-b259-e64df9f95280 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:27.701317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c483b38-76c3-4390-b259-e64df9f95280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:27.712396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c483b38-76c3-4390-b259-e64df9f95280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:27.714299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c483b38-76c3-4390-b259-e64df9f95280 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:27.724508 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1748/3442] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:29.152098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:29.152695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:29.152695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:29.187911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] MFA Rules not processed for user `c6dfc7d9ec04440290b61e87a8fecad4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:29.190213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:29.289105 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1695/3443] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:29.299407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:29.299872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:29.299872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:29.327217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] MFA Rules not processed for user `c6dfc7d9ec04440290b61e87a8fecad4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:29.328467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:29.348766 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1749/3444] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:29.798471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:29.800278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:29.904396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e421-8b1a-42ae-8a8d-aa0ec473cc0b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:29.911662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:29.912605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:29.913234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:29.913715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:29.928390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:29.930843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:29.985918 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1696/3445] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:30.125455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:30.127238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:30.151050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5d97-80e9-4824-9b37-187f75671573 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:30.162535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:30.163461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:30.163739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:30.164046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] PATH_INFO: `/v3/users/fbcb9088698a4f478ccebca7a65f54c4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:30.165720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbcb9088698a4f478ccebca7a65f54c4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:30.168457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:30.266256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbcb9088698a4f478ccebca7a65f54c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.267336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbcb9088698a4f478ccebca7a65f54c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.277241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbcb9088698a4f478ccebca7a65f54c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.288422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbcb9088698a4f478ccebca7a65f54c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.289268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebabefba-a266-40f1-ba5b-93159aac6e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbcb9088698a4f478ccebca7a65f54c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.312107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1750/3446] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:30 2022] DELETE /identity/v3/users/fbcb9088698a4f478ccebca7a65f54c4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:30.691328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:30.705473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373a8e-9533-4999-a82d-b6435168b363 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:30.785849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:30.786928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:30.787255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:30.788266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] PATH_INFO: `/v3/projects/bc7a2d61df2b4bfda6882e74e73b6cb5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:30.789703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7a2d61df2b4bfda6882e74e73b6cb5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:30.791812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:30.845610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'request_id': 'req-036b6460-8b2d-41f5-a875-0c9edabe2973'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.852186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'request_id': 'req-036b6460-8b2d-41f5-a875-0c9edabe2973'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.864109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'request_id': 'req-036b6460-8b2d-41f5-a875-0c9edabe2973'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.878175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] The token cache is being invalidate because project bc7a2d61df2b4bfda6882e74e73b6cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:30.878464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.879341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-036b6460-8b2d-41f5-a875-0c9edabe2973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:30.881000 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1697/3447] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:30 2022] DELETE /identity/v3/projects/bc7a2d61df2b4bfda6882e74e73b6cb5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:30.886067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37573f4-8f49-4b66-86c7-fd74bb7aee19 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:30.886744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37573f4-8f49-4b66-86c7-fd74bb7aee19 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:30.887104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37573f4-8f49-4b66-86c7-fd74bb7aee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:30.908207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e37573f4-8f49-4b66-86c7-fd74bb7aee19 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:30.909914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e37573f4-8f49-4b66-86c7-fd74bb7aee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:30.985972 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1751/3448] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:30.994852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240231-72ac-4e4b-a3b3-98cf368d1343 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:30.995169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240231-72ac-4e4b-a3b3-98cf368d1343 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:30.995482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240231-72ac-4e4b-a3b3-98cf368d1343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.015907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-03240231-72ac-4e4b-a3b3-98cf368d1343 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:31.017173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-03240231-72ac-4e4b-a3b3-98cf368d1343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:31.026216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1698/3449] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:31.030477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37573f4-8f49-4b66-86c7-fd74bb7aee19 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:31.040360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37573f4-8f49-4b66-86c7-fd74bb7aee19 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:31.045458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:31.046138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.046420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.046695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.047431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:31.047737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:31.049411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:31.062759 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1752/3450] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:31.067443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240231-72ac-4e4b-a3b3-98cf368d1343 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:31.078136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240231-72ac-4e4b-a3b3-98cf368d1343 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:31.083314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:31.083960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.084525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.084766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.085509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:31.087588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:31.118922 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1699/3451] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:31 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:04:31.123089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:31.133790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3598-ae3c-45f0-bc5c-2d5fbe199bc9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:31.193303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:31.194130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.194412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.194690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.195387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:31.197371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:31.223691 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1753/3452] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:31 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:04:31.225275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:31.236295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab7c9-53e7-497d-85db-414f5d1219d6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:31.242040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:31.242727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.242977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.243249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.243978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:31.245617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:31.256349 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1700/3453] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:31.260868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:31.271514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b2ccb-8eaf-4645-81b2-ff9783f06ede admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:31.278769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3e08b-3d06-4bc7-8fe4-e95f5c2bb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:31.278769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3e08b-3d06-4bc7-8fe4-e95f5c2bb36c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.278769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3e08b-3d06-4bc7-8fe4-e95f5c2bb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.278769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3e08b-3d06-4bc7-8fe4-e95f5c2bb36c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.279595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3e08b-3d06-4bc7-8fe4-e95f5c2bb36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:31.280434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3e08b-3d06-4bc7-8fe4-e95f5c2bb36c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:31.293281 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1754/3454] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:31.297866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:31.308986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d24864-55a4-43d6-a868-970c197ab400 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:31.314497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:31.315493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.316002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.316313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] PATH_INFO: `/v3/projects/184d9189f1364fc1bdd88feff79103e6/users/38f474d5daf947ff9f632424e909390a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.333092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=184d9189f1364fc1bdd88feff79103e6, user_id=38f474d5daf947ff9f632424e909390a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:31.336238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:31.358257 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1701/3455] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:31 2022] PUT /identity/v3/projects/184d9189f1364fc1bdd88feff79103e6/users/38f474d5daf947ff9f632424e909390a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:31.360310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.360788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.361160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.382119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:31.383807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:31.471491 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1755/3456] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:31.482602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:31.484614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:31.604082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23a7ad-ee5c-48d1-b877-5a6997273bcb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:31.611404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826830de-ce47-4c6f-b8e2-0b15edd9140f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:31.615631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826830de-ce47-4c6f-b8e2-0b15edd9140f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:31.615631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826830de-ce47-4c6f-b8e2-0b15edd9140f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:31.615631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826830de-ce47-4c6f-b8e2-0b15edd9140f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:31.641909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826830de-ce47-4c6f-b8e2-0b15edd9140f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:31.643602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826830de-ce47-4c6f-b8e2-0b15edd9140f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:31.683055 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1702/3457] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:32.437511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:32.439236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:32.457553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff2f8-d52a-49c1-82ee-681da56b8cac None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:32.462947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:32.463744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccb307-ac03-4e2e-a58a-e82a76de67d7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:32.464234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccb307-ac03-4e2e-a58a-e82a76de67d7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:32.464343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccb307-ac03-4e2e-a58a-e82a76de67d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:32.465236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:32.465699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:32.466227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] PATH_INFO: `/v3/users/f6869f687bd8411ea81a24f566fef6b2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:32.467694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6869f687bd8411ea81a24f566fef6b2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:32.470378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:32.518032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-efccb307-ac03-4e2e-a58a-e82a76de67d7 None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:32.520434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-efccb307-ac03-4e2e-a58a-e82a76de67d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:32.530748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6869f687bd8411ea81a24f566fef6b2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:32.531440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6869f687bd8411ea81a24f566fef6b2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:32.544721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6869f687bd8411ea81a24f566fef6b2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:32.557486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6869f687bd8411ea81a24f566fef6b2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:32.561137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6869f687bd8411ea81a24f566fef6b2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:32.598766 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1703/3458] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:32.601436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1756/3459] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:32 2022] DELETE /identity/v3/users/f6869f687bd8411ea81a24f566fef6b2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:32.609731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:32.610094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:32.610440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:32.630362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:32.631688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:32.767059 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1704/3460] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:32.844587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:32.846823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:32.920317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:32.922553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:32.949869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03cb12-1068-4416-9c6d-0663006f61a8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:32.956428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:32.957418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:32.957706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:32.957984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] PATH_INFO: `/v3/projects/ed5c4a7f5181441d9d3db5d4ed86133b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:32.960517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5c4a7f5181441d9d3db5d4ed86133b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:32.963502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.026185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4913b36-aa7d-4c82-84a2-93ff0a587e02 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:33.040002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'request_id': 'req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:33.046421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'request_id': 'req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:33.063280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'request_id': 'req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:33.101655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] The token cache is being invalidate because project ed5c4a7f5181441d9d3db5d4ed86133b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:33.107446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:33.108262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-88089f8a-0ea1-41a3-b3f9-e11db1acd8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:33.112654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1757/3461] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:32 2022] DELETE /identity/v3/projects/ed5c4a7f5181441d9d3db5d4ed86133b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:33.117561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f0b2-f0a3-4184-8bce-7d2789ffa2d2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.117850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f0b2-f0a3-4184-8bce-7d2789ffa2d2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.118127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f0b2-f0a3-4184-8bce-7d2789ffa2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.122525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:33.123361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.123754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.124111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.126146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:33.157356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9a21f0b2-f0a3-4184-8bce-7d2789ffa2d2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:33.158634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9a21f0b2-f0a3-4184-8bce-7d2789ffa2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:33.245959 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1758/3462] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:33.251567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13216439-854a-42ad-b1c6-8fbdf4b4e165 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.251983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13216439-854a-42ad-b1c6-8fbdf4b4e165 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.252431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13216439-854a-42ad-b1c6-8fbdf4b4e165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.263432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:33.271086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.297758 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1705/3463] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:33.301433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-13216439-854a-42ad-b1c6-8fbdf4b4e165 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:33.303100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-13216439-854a-42ad-b1c6-8fbdf4b4e165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:33.322322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:33.336459 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1759/3464] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:33.341378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91b238-2f86-4d88-9870-ffeae97a3027 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:33.347346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:33.348219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.348653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.349024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.350078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:33.350486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:33.353308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.372835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13216439-854a-42ad-b1c6-8fbdf4b4e165 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:33.384713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13216439-854a-42ad-b1c6-8fbdf4b4e165 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:33.384908 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1706/3465] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:33.398512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:33.399481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.402541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.403681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.404029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:33.406843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.471173 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1760/3466] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:33 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:33.477741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:33.489086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec3f4-836f-432b-8cc9-3ffc712a5c60 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:33.588077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:33.588683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.588956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.589258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.589963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:33.591910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.629351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1707/3467] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:33 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:33.632086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:33.643893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d789c4-f67c-4b71-b51d-967ca59b989a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:33.648732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:33.649485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.649764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.650039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.650826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:33.652456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.666889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1761/3468] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:33.668089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:33.682563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1bbeb-9a23-404c-b180-335cdded5b9e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:33.688790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c16d6-5092-4cfd-8975-10042d1ddcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:33.689504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c16d6-5092-4cfd-8975-10042d1ddcfc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.689781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c16d6-5092-4cfd-8975-10042d1ddcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.691419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c16d6-5092-4cfd-8975-10042d1ddcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.697845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c16d6-5092-4cfd-8975-10042d1ddcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:33.699877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c16d6-5092-4cfd-8975-10042d1ddcfc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.717528 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1708/3469] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:33.719331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:33.730586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626eb7-7be0-43e9-95be-e39ec843e26c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:33.736711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:33.737767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.738290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.738784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] PATH_INFO: `/v3/projects/0bd152d85c8c464c8fd7b7cd0679876c/users/9b1cf86802694d0084818aae72131e01/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.755637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd152d85c8c464c8fd7b7cd0679876c, user_id=9b1cf86802694d0084818aae72131e01, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:33.758772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:33.776343 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1762/3470] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:33 2022] PUT /identity/v3/projects/0bd152d85c8c464c8fd7b7cd0679876c/users/9b1cf86802694d0084818aae72131e01/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:33.787867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d52026-0195-4eb4-984f-d32c12670bab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:33.788251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d52026-0195-4eb4-984f-d32c12670bab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:33.788537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d52026-0195-4eb4-984f-d32c12670bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:33.823861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-71d52026-0195-4eb4-984f-d32c12670bab None None] MFA Rules not processed for user `9b1cf86802694d0084818aae72131e01`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:33.825157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-71d52026-0195-4eb4-984f-d32c12670bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:33.909294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1709/3471] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:33.930985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:33.932844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:34.013757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a324988-b677-4461-b8fd-91fc5d2f15f3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:34.019373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdc08b-1d1e-48d6-abfa-371676f85a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:34.020037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdc08b-1d1e-48d6-abfa-371676f85a7a service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:34.020313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdc08b-1d1e-48d6-abfa-371676f85a7a service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:34.020674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdc08b-1d1e-48d6-abfa-371676f85a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:34.028752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdc08b-1d1e-48d6-abfa-371676f85a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:34.030391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdc08b-1d1e-48d6-abfa-371676f85a7a service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:34.039839 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1763/3472] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:36.451290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d52026-0195-4eb4-984f-d32c12670bab None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:36.516110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d52026-0195-4eb4-984f-d32c12670bab None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:36.521217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:36.522283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:36.522530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:36.522886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] PATH_INFO: `/v3/users/9b1cf86802694d0084818aae72131e01` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:36.524168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1cf86802694d0084818aae72131e01)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:36.526494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:36.591523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1cf86802694d0084818aae72131e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:36.592334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1cf86802694d0084818aae72131e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:36.602283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1cf86802694d0084818aae72131e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:36.602959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1cf86802694d0084818aae72131e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:36.616214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1cf86802694d0084818aae72131e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:36.636883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1710/3473] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:36 2022] DELETE /identity/v3/users/9b1cf86802694d0084818aae72131e01 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:36.641432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:36.641958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:36.642053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:36.660315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:36.674291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:36.742629 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1764/3474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:36.755450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:36.757081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:36.814184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d3db3-b5f0-42f0-abd4-118ac9d5505e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:36.817996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78025c0e-001d-4293-b77b-6f6726ca99b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:36.818729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025c0e-001d-4293-b77b-6f6726ca99b0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:36.819073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025c0e-001d-4293-b77b-6f6726ca99b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:36.819409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025c0e-001d-4293-b77b-6f6726ca99b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:36.829369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025c0e-001d-4293-b77b-6f6726ca99b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:36.830981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025c0e-001d-4293-b77b-6f6726ca99b0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:36.842027 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1711/3475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:37.128135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.129688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:37.145101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2b0b8-ca02-416c-957e-89f3c927f2fa None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:37.149569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:37.150469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.150757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.151013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] PATH_INFO: `/v3/projects/0bd152d85c8c464c8fd7b7cd0679876c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.152529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd152d85c8c464c8fd7b7cd0679876c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:37.155351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:37.201233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd152d85c8c464c8fd7b7cd0679876c', 'request_id': 'req-712d23f9-ef9d-429b-a690-a260a7e1ec4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:37.206869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd152d85c8c464c8fd7b7cd0679876c', 'request_id': 'req-712d23f9-ef9d-429b-a690-a260a7e1ec4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:37.215995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd152d85c8c464c8fd7b7cd0679876c', 'request_id': 'req-712d23f9-ef9d-429b-a690-a260a7e1ec4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:37.229154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] The token cache is being invalidate because project 0bd152d85c8c464c8fd7b7cd0679876c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:37.229444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:37.230141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-712d23f9-ef9d-429b-a690-a260a7e1ec4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:37.231925 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1765/3476] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:37 2022] DELETE /identity/v3/projects/0bd152d85c8c464c8fd7b7cd0679876c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:37.237199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060cfa-5639-41df-8ded-b0fa36ca2b89 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.237487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060cfa-5639-41df-8ded-b0fa36ca2b89 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.237758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060cfa-5639-41df-8ded-b0fa36ca2b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.261307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5e060cfa-5639-41df-8ded-b0fa36ca2b89 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:37.262514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e060cfa-5639-41df-8ded-b0fa36ca2b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:37.325570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1712/3477] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:37.332993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432f55-4d77-4bae-af26-ecb5eead43ce None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.333337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432f55-4d77-4bae-af26-ecb5eead43ce None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.333591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432f55-4d77-4bae-af26-ecb5eead43ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.356929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-13432f55-4d77-4bae-af26-ecb5eead43ce None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:37.358341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-13432f55-4d77-4bae-af26-ecb5eead43ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:37.367689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1766/3478] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:37.372080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060cfa-5639-41df-8ded-b0fa36ca2b89 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.382239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060cfa-5639-41df-8ded-b0fa36ca2b89 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:37.387050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:37.387720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.387996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.388273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.389057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:37.389371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:37.390983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:37.403090 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1713/3479] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:04:37.407646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13432f55-4d77-4bae-af26-ecb5eead43ce None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.418108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13432f55-4d77-4bae-af26-ecb5eead43ce None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:37.423567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:37.424243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.424515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.424777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.425646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:37.427726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:37.462022 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1767/3480] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:37 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:37.466109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.476841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf018099-137a-48f8-8545-f47e6a837658 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:37.538667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:37.539408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.539692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.539967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.540647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:37.542844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:37.576075 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1714/3481] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:37 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:37.579893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.590532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6c68-9ab1-4725-adf8-09fe2c4ca39f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:37.595439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:37.596113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.596446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.596717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.597483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:37.599098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:37.610776 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1768/3482] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:04:37.614704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.624764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f12132-f787-4ea1-a372-d31e70e4c6b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:37.629625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29c400-6633-492d-ab93-cebe7b7d2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:37.630286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c400-6633-492d-ab93-cebe7b7d2e3f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.630566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c400-6633-492d-ab93-cebe7b7d2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.630838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c400-6633-492d-ab93-cebe7b7d2e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.631566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29c400-6633-492d-ab93-cebe7b7d2e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:37.633207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29c400-6633-492d-ab93-cebe7b7d2e3f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:37.644176 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1715/3483] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:37.649058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.659251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a57f82-bd34-445b-8852-80cc609475e8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:37.663925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:37.664931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.665302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.665759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] PATH_INFO: `/v3/projects/c4993e6d7126462e9ead71ecf95a3cae/users/86c2cb30466f4a9184e7e8ed34aad193/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.682623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4993e6d7126462e9ead71ecf95a3cae, user_id=86c2cb30466f4a9184e7e8ed34aad193, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:37.685591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:37.714509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1769/3484] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:37 2022] PUT /identity/v3/projects/c4993e6d7126462e9ead71ecf95a3cae/users/86c2cb30466f4a9184e7e8ed34aad193/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:04:37.725568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc971fd-98b5-4c00-8ef5-1589d9d3f67b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:37.725995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc971fd-98b5-4c00-8ef5-1589d9d3f67b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:37.726489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc971fd-98b5-4c00-8ef5-1589d9d3f67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:37.758212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cdc971fd-98b5-4c00-8ef5-1589d9d3f67b None None] MFA Rules not processed for user `86c2cb30466f4a9184e7e8ed34aad193`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:37.760038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cdc971fd-98b5-4c00-8ef5-1589d9d3f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:37.825605 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1716/3485] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:37.982562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:37.984508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:38.060431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f42c-f047-477f-8974-583726b88f00 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:38.066746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:38.067420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:38.067680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:38.067968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:38.076768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:38.078407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:38.088306 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1770/3486] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:39.330700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc971fd-98b5-4c00-8ef5-1589d9d3f67b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:39.351037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:39.353019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:39.370438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66f272-9bc2-478e-a6f4-7c70f6f58bb6 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:39.381766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f051de-5262-4fc6-a3b3-c3b1d9b39464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:39.382790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f051de-5262-4fc6-a3b3-c3b1d9b39464 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:39.383285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f051de-5262-4fc6-a3b3-c3b1d9b39464 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:39.383762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f051de-5262-4fc6-a3b3-c3b1d9b39464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:39.386197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e3f051de-5262-4fc6-a3b3-c3b1d9b39464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:39.410498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc971fd-98b5-4c00-8ef5-1589d9d3f67b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:39.415485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:39.416397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:39.416668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:39.417166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] PATH_INFO: `/v3/users/86c2cb30466f4a9184e7e8ed34aad193` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:39.418309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c2cb30466f4a9184e7e8ed34aad193)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:39.420207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:39.466241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f051de-5262-4fc6-a3b3-c3b1d9b39464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:39.468271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f051de-5262-4fc6-a3b3-c3b1d9b39464 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:39.478663 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1771/3487] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:39.484329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c2cb30466f4a9184e7e8ed34aad193'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:39.485096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c2cb30466f4a9184e7e8ed34aad193'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:39.493292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c2cb30466f4a9184e7e8ed34aad193'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:39.494038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c2cb30466f4a9184e7e8ed34aad193'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:39.503554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c2cb30466f4a9184e7e8ed34aad193'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:39.526105 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1717/3488] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:39 2022] DELETE /identity/v3/users/86c2cb30466f4a9184e7e8ed34aad193 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:39.531036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:39.531597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:39.532241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:39.556308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:39.557775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:39.621759 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1772/3489] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:39.631541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:39.633173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:39.692893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25503f-f59c-4eff-a7aa-980a4e970948 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:39.696719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d7771-c963-41d7-8eeb-b584910694a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:39.697410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7771-c963-41d7-8eeb-b584910694a9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:39.697718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7771-c963-41d7-8eeb-b584910694a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:39.698293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7771-c963-41d7-8eeb-b584910694a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:39.708133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d7771-c963-41d7-8eeb-b584910694a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:39.709661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d7771-c963-41d7-8eeb-b584910694a9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:39.719719 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1718/3490] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:40.017100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.018842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:40.040097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673801-cf23-4406-87ae-184b31d7a840 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.056670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.056670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.056670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.056670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] PATH_INFO: `/v3/projects/c4993e6d7126462e9ead71ecf95a3cae` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.059727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4993e6d7126462e9ead71ecf95a3cae)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.066913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.139120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4993e6d7126462e9ead71ecf95a3cae', 'request_id': 'req-efdaaf4c-c5da-4040-95f8-a2c9387f3950'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:40.145579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4993e6d7126462e9ead71ecf95a3cae', 'request_id': 'req-efdaaf4c-c5da-4040-95f8-a2c9387f3950'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:40.157121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4993e6d7126462e9ead71ecf95a3cae', 'request_id': 'req-efdaaf4c-c5da-4040-95f8-a2c9387f3950'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:40.169912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] The token cache is being invalidate because project c4993e6d7126462e9ead71ecf95a3cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:40.170582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:40.171413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efdaaf4c-c5da-4040-95f8-a2c9387f3950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:40.173420 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1773/3491] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:40 2022] DELETE /identity/v3/projects/c4993e6d7126462e9ead71ecf95a3cae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:40.178407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdcdaa-5072-4170-aea7-862788626313 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.178697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdcdaa-5072-4170-aea7-862788626313 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.178980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdcdaa-5072-4170-aea7-862788626313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.202149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a8cdcdaa-5072-4170-aea7-862788626313 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:40.203580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a8cdcdaa-5072-4170-aea7-862788626313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:40.269611 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1719/3492] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:40.278570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f696e4-2404-4028-b11d-a9c8b5e355d8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.278858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f696e4-2404-4028-b11d-a9c8b5e355d8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.279118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f696e4-2404-4028-b11d-a9c8b5e355d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.299560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-02f696e4-2404-4028-b11d-a9c8b5e355d8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:40.301070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02f696e4-2404-4028-b11d-a9c8b5e355d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:40.309598 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1774/3493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:40.313972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdcdaa-5072-4170-aea7-862788626313 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.323356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdcdaa-5072-4170-aea7-862788626313 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.328521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.329227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.329504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.329770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.330490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:40.330873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.332466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.344363 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1720/3494] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:40.348717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f696e4-2404-4028-b11d-a9c8b5e355d8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.358417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f696e4-2404-4028-b11d-a9c8b5e355d8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.363688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.364370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.364649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.364921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.365646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.367592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.399266 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1775/3495] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:40 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:04:40.401139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.411622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4377-51bd-4785-b03e-b200bb7b8427 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.471840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.472418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.472695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.472966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.473691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.475615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.499357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1721/3496] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:40 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:40.503758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.514122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10cdfc-bec7-48fe-ac60-e60924cfccc0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.520930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.522040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.522590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.523032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.523773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.526023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.541342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1776/3497] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:40.542053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.552630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a974-d6d7-4f02-8246-45416490f23d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.561801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ccc7-2ca1-4948-8dba-0f69348e9a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.562925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ccc7-2ca1-4948-8dba-0f69348e9a5c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.563274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ccc7-2ca1-4948-8dba-0f69348e9a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.563618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ccc7-2ca1-4948-8dba-0f69348e9a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.564416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1ccc7-2ca1-4948-8dba-0f69348e9a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.566878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1ccc7-2ca1-4948-8dba-0f69348e9a5c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.579065 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1722/3498] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:40.583826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.599388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559aff5-7eb3-445c-9cfa-393c3ce01715 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.608182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.609119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.609398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.609663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] PATH_INFO: `/v3/projects/48b917a437e7432bbfc884a1067fdfaa/users/fbb1a0d6db7847aa851d3f8244c998c7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.629167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b917a437e7432bbfc884a1067fdfaa, user_id=fbb1a0d6db7847aa851d3f8244c998c7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.631837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.651436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1777/3499] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:40 2022] PUT /identity/v3/projects/48b917a437e7432bbfc884a1067fdfaa/users/fbb1a0d6db7847aa851d3f8244c998c7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:40.656907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312c788-abe7-4d44-a97c-3dd0c2976a79 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.657454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312c788-abe7-4d44-a97c-3dd0c2976a79 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.657844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312c788-abe7-4d44-a97c-3dd0c2976a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.677116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0312c788-abe7-4d44-a97c-3dd0c2976a79 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:40.678479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0312c788-abe7-4d44-a97c-3dd0c2976a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:40.737458 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1723/3500] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:04:40.748371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:40.750296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:40.808573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdb671-d9c3-45d5-94eb-350c0742f088 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:40.812726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2736f1-18d1-4263-919f-582c2f1530d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:40.813425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2736f1-18d1-4263-919f-582c2f1530d2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:40.813709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2736f1-18d1-4263-919f-582c2f1530d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:40.813985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2736f1-18d1-4263-919f-582c2f1530d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:40.824020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2736f1-18d1-4263-919f-582c2f1530d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:40.825531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2736f1-18d1-4263-919f-582c2f1530d2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:40.835527 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1778/3501] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:43.759254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:43.759823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:43.759823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:43.779004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:43.780085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:43.841629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1724/3502] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:44.847167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26511f-a8e6-4028-a2ce-f0df575c8d4c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:44.847697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26511f-a8e6-4028-a2ce-f0df575c8d4c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:44.847697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26511f-a8e6-4028-a2ce-f0df575c8d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:44.875277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aa26511f-a8e6-4028-a2ce-f0df575c8d4c None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:44.880832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aa26511f-a8e6-4028-a2ce-f0df575c8d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:44.962137 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1779/3503] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:44.994041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:44.996091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:45.079864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cdf15-aeb8-4f0d-a9ed-917f9a2628cd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:45.089026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:45.090284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:45.090675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:45.091072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:45.105006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:45.108686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:45.131435 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1725/3504] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:53.078439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:53.079521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:53.080227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:53.158852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] MFA Rules not processed for user `fbb1a0d6db7847aa851d3f8244c998c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:53.164213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:53.346236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1780/3505] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:53.532520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:53.534021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:53.693074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630f73-f0bb-4139-abaf-d7bdaa3fdd03 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:53.703852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7eda-0ef0-4691-a216-ab6a4c8190b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:53.704531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7eda-0ef0-4691-a216-ab6a4c8190b2 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:53.704934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7eda-0ef0-4691-a216-ab6a4c8190b2 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:53.705287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7eda-0ef0-4691-a216-ab6a4c8190b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:53.715678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7eda-0ef0-4691-a216-ab6a4c8190b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:53.717956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7eda-0ef0-4691-a216-ab6a4c8190b2 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:53.745739 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1726/3506] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:55.275654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:55.283788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:55.497497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc26a-41b7-4dc2-9b7b-3a18e768551c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:55.509717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:55.510967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:55.511427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:55.511860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] PATH_INFO: `/v3/users/c6dfc7d9ec04440290b61e87a8fecad4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:55.516282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6dfc7d9ec04440290b61e87a8fecad4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:55.530283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:55.618249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6dfc7d9ec04440290b61e87a8fecad4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:55.619195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6dfc7d9ec04440290b61e87a8fecad4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:55.632898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6dfc7d9ec04440290b61e87a8fecad4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:55.652011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6dfc7d9ec04440290b61e87a8fecad4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:55.652712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6dfc7d9ec04440290b61e87a8fecad4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:55.700695 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1781/3507] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:04:55 2022] DELETE /identity/v3/users/c6dfc7d9ec04440290b61e87a8fecad4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:55.902441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a7d9-d0a1-474a-b9a9-55f58a4aa3bd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:55.903014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a7d9-d0a1-474a-b9a9-55f58a4aa3bd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:55.903014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a7d9-d0a1-474a-b9a9-55f58a4aa3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:55.950699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-76d0a7d9-d0a1-474a-b9a9-55f58a4aa3bd None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:55.952226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76d0a7d9-d0a1-474a-b9a9-55f58a4aa3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:56.144201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:56.146541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:56.147972 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1727/3508] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:56.323121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08f18-0c2c-485d-865d-f53f5b78e407 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:56.336487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:56.337507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:56.348407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:56.348954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] PATH_INFO: `/v3/projects/ab023af112834d0eb9a847bacc3fa37e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:56.358273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab023af112834d0eb9a847bacc3fa37e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:56.360659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:56.509948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab023af112834d0eb9a847bacc3fa37e', 'request_id': 'req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:56.517400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab023af112834d0eb9a847bacc3fa37e', 'request_id': 'req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:56.532282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab023af112834d0eb9a847bacc3fa37e', 'request_id': 'req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:56.547489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] The token cache is being invalidate because project ab023af112834d0eb9a847bacc3fa37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:04:56.560519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:56.561794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6c0d51e2-d9b4-4ceb-b057-3bd86bf629ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:04:56.563501 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1782/3509] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:56 2022] DELETE /identity/v3/projects/ab023af112834d0eb9a847bacc3fa37e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:56.568850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f43e6e-bd92-4c95-9a08-5e7be878fad4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:56.569302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f43e6e-bd92-4c95-9a08-5e7be878fad4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:56.569677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f43e6e-bd92-4c95-9a08-5e7be878fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:56.689697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-33f43e6e-bd92-4c95-9a08-5e7be878fad4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:56.692042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33f43e6e-bd92-4c95-9a08-5e7be878fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:56.851522 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1728/3510] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:56.854030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df61f-631c-4375-af04-673c41cb5463 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:56.854319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df61f-631c-4375-af04-673c41cb5463 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:56.854605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df61f-631c-4375-af04-673c41cb5463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:56.886712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-590df61f-631c-4375-af04-673c41cb5463 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:56.888646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-590df61f-631c-4375-af04-673c41cb5463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:56.908069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f43e6e-bd92-4c95-9a08-5e7be878fad4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:56.920291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1783/3511] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:56.921082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f43e6e-bd92-4c95-9a08-5e7be878fad4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:56.927043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:56.928072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:56.928624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:56.929405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:56.930358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:04:56.930893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:56.933308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:56.956972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df61f-631c-4375-af04-673c41cb5463 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:56.968062 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1729/3512] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:04:56.968423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df61f-631c-4375-af04-673c41cb5463 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:56.975332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:56.976102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:56.976567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:56.977028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:56.979107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:56.981940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:57.056290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:57.056990 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1784/3513] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:04:56 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:57.071897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fe79b-7209-44da-b51e-6da24f6fc0b3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:57.278534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:57.282549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:57.283144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:57.284880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:57.288489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:57.291288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:57.374815 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1730/3514] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:04:57 2022] POST /identity/v3/users => generated 300 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:04:57.379405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:57.399439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2991e6-b0a5-44fa-80cb-950ab60e4a60 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:57.406297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:57.407334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:57.407839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:57.408332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:57.409140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:57.410957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:57.433651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:57.434668 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1785/3515] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:57.448595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b469-b8c6-4a69-8a7c-98df60f0632e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:57.470767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f2071-a569-4bee-84a4-5d7494315f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:57.471565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f2071-a569-4bee-84a4-5d7494315f70 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:57.471843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f2071-a569-4bee-84a4-5d7494315f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:57.472108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f2071-a569-4bee-84a4-5d7494315f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:57.472842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f2071-a569-4bee-84a4-5d7494315f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:57.474498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f2071-a569-4bee-84a4-5d7494315f70 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:57.512450 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1731/3516] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:04:57.514025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:57.531441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe292e5-4f28-481c-9f75-4f343c163004 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:57.551415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:57.555184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:57.555700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:57.556144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] PATH_INFO: `/v3/projects/9867219547a94880ba048320401ac44a/users/5981fe7d48ad4381a72d723ea5c6a08f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:57.600326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9867219547a94880ba048320401ac44a, user_id=5981fe7d48ad4381a72d723ea5c6a08f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:57.603294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:57.644479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1786/3517] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:04:57 2022] PUT /identity/v3/projects/9867219547a94880ba048320401ac44a/users/5981fe7d48ad4381a72d723ea5c6a08f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:04:57.646313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514f5c7-3878-462d-8fdc-44a415fa0ce3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:57.647071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514f5c7-3878-462d-8fdc-44a415fa0ce3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:57.647445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514f5c7-3878-462d-8fdc-44a415fa0ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:57.684835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2514f5c7-3878-462d-8fdc-44a415fa0ce3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:04:57.686292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2514f5c7-3878-462d-8fdc-44a415fa0ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:57.906706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1732/3518] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:04:57.925288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:57.930217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:58.021180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0e688-7bbd-40e1-87c1-2db579ad6976 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:58.026140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c6f4a-fd58-46f9-ae9d-f56fdf4010e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:58.027168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c6f4a-fd58-46f9-ae9d-f56fdf4010e1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:58.033920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c6f4a-fd58-46f9-ae9d-f56fdf4010e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:58.034507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c6f4a-fd58-46f9-ae9d-f56fdf4010e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:58.046715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c6f4a-fd58-46f9-ae9d-f56fdf4010e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:58.048873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c6f4a-fd58-46f9-ae9d-f56fdf4010e1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:58.060959 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1787/3519] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:58.745326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514f5c7-3878-462d-8fdc-44a415fa0ce3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:04:58.762572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514f5c7-3878-462d-8fdc-44a415fa0ce3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:04:58.776581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb0ed0-ae40-4664-a4b8-b3349edb1118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:04:58.777719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0ed0-ae40-4664-a4b8-b3349edb1118 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:04:58.779131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0ed0-ae40-4664-a4b8-b3349edb1118 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:04:58.779656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0ed0-ae40-4664-a4b8-b3349edb1118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:04:58.786296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-15cb0ed0-ae40-4664-a4b8-b3349edb1118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:04:58.981499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb0ed0-ae40-4664-a4b8-b3349edb1118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:04:58.983160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb0ed0-ae40-4664-a4b8-b3349edb1118 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:04:59.021427 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1733/3520] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:00.250381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918e706-1547-459f-8855-ee7c8b0a2a74 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:00.251199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918e706-1547-459f-8855-ee7c8b0a2a74 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:00.251728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918e706-1547-459f-8855-ee7c8b0a2a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:00.293344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5918e706-1547-459f-8855-ee7c8b0a2a74 None None] MFA Rules not processed for user `fbb1a0d6db7847aa851d3f8244c998c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:00.299089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5918e706-1547-459f-8855-ee7c8b0a2a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:00.428928 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1788/3521] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:00.581919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:00.582346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:00.582520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:00.626400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] MFA Rules not processed for user `5981fe7d48ad4381a72d723ea5c6a08f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:00.627634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:00.789093 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1734/3522] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:00.800543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7f00-6577-40b6-8cfa-1173aebf6840 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:00.801163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7f00-6577-40b6-8cfa-1173aebf6840 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:00.801613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7f00-6577-40b6-8cfa-1173aebf6840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:00.846701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-74ac7f00-6577-40b6-8cfa-1173aebf6840 None None] MFA Rules not processed for user `5981fe7d48ad4381a72d723ea5c6a08f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:00.855017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-74ac7f00-6577-40b6-8cfa-1173aebf6840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:00.882153 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1789/3523] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:01.417299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:01.418703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:01.445658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8c166-b074-4ca9-85b6-7ae649d8fedd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:01.458565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:01.459541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:01.459983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:01.460416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:01.471420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:01.473624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:01.488981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1735/3524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:04.512965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac7f00-6577-40b6-8cfa-1173aebf6840 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:04.522872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac7f00-6577-40b6-8cfa-1173aebf6840 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:04.527934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9db2b-b52f-4292-bd53-731a1a5478b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:04.528608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9db2b-b52f-4292-bd53-731a1a5478b5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:04.528892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9db2b-b52f-4292-bd53-731a1a5478b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:04.529705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9db2b-b52f-4292-bd53-731a1a5478b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:04.531558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2fd9db2b-b52f-4292-bd53-731a1a5478b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:04.554315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9db2b-b52f-4292-bd53-731a1a5478b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:04.556354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9db2b-b52f-4292-bd53-731a1a5478b5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:04.569447 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1790/3525] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:06.698553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:06.700239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:06.716130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81f735-2e1f-42ae-ab0d-d5a79627e0a7 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:06.722983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:06.724973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:06.725516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:06.725986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:06.728608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:06.758890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:06.759975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:06.760459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:06.791956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:06.796895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:06.865116 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1791/3526] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:06.870870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:06.873355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:06.903001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1736/3527] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:05:13.996214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:13.998111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:14.024547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5adba-7d6b-40a0-911f-c0928fa3ffbe None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:14.028828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af9163-995c-474c-a770-87ba1b85b03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:14.029538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9163-995c-474c-a770-87ba1b85b03b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:14.029848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9163-995c-474c-a770-87ba1b85b03b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:14.030148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9163-995c-474c-a770-87ba1b85b03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:14.032061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f5af9163-995c-474c-a770-87ba1b85b03b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:14.044295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9163-995c-474c-a770-87ba1b85b03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:14.045782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9163-995c-474c-a770-87ba1b85b03b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:14.056121 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1792/3528] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:15.834499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:15.847088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869a24-7086-4f6b-930f-7ff9b28b908a service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:15.856657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:15.857919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:15.858365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:15.858927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:15.864330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:15.896510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:15.900722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:15.919706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1737/3529] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:22.207280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:22.208216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:22.208616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:22.314147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:22.315397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:22.517586 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1793/3530] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:22.531223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:22.534315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:22.700656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506597-1375-4ee0-8617-bdf9f2b2f721 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:22.707524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:22.708696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:22.709440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:22.710111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:22.723396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:22.727180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:22.756086 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1738/3531] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:05:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:05:24.845852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:24.848097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:24.873631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b48d8c-d414-42e3-a144-145be49b4e0e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:24.893397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:24.894575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:24.895012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:24.895406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] PATH_INFO: `/v3/users/c3f004d8412d43d7a82f7daa56f47305` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:24.896845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f004d8412d43d7a82f7daa56f47305)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:24.898988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:24.986878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f004d8412d43d7a82f7daa56f47305'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:24.987545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f004d8412d43d7a82f7daa56f47305'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:24.995584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f004d8412d43d7a82f7daa56f47305'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.012188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f004d8412d43d7a82f7daa56f47305'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.013125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f004d8412d43d7a82f7daa56f47305'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.049582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1794/3532] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:24 2022] DELETE /identity/v3/users/c3f004d8412d43d7a82f7daa56f47305 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:25.308475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:25.330125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d022a22-cb9d-4b40-8004-b0e9d88e959b service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:25.447296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:25.448582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:25.449066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:25.449482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] PATH_INFO: `/v3/projects/9dbc8f96549e4dfaaf941d571addb9c6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:25.454203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbc8f96549e4dfaaf941d571addb9c6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:25.456429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:25.545764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbc8f96549e4dfaaf941d571addb9c6', 'request_id': 'req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.552181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbc8f96549e4dfaaf941d571addb9c6', 'request_id': 'req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.567801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbc8f96549e4dfaaf941d571addb9c6', 'request_id': 'req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.582567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] The token cache is being invalidate because project 9dbc8f96549e4dfaaf941d571addb9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:25.583211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.584078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.589133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1739/3533] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:25 2022] DELETE /identity/v3/projects/9dbc8f96549e4dfaaf941d571addb9c6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:05:25.590255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:25.592187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:25.609511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9113-ffe5-484c-befd-e1c27b9df5a2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:25.713687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:25.714897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:25.715387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:25.715854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] PATH_INFO: `/v3/users/5ed102e585f64369a331be11ab73dd34` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:25.717662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed102e585f64369a331be11ab73dd34)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:25.720257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:25.809723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed102e585f64369a331be11ab73dd34'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.810400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed102e585f64369a331be11ab73dd34'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.824040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed102e585f64369a331be11ab73dd34'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.841252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed102e585f64369a331be11ab73dd34'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.842399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-843c59fa-4bd3-496e-aa28-c0106387c9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed102e585f64369a331be11ab73dd34'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:25.886777 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1795/3534] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:25 2022] DELETE /identity/v3/users/5ed102e585f64369a331be11ab73dd34 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:26.654743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:26.656315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:26.679856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b2aa-9210-485e-ab29-b3e35dbec3ae admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:26.776458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:26.778258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:26.778734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:26.779259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] PATH_INFO: `/v3/projects/e2d0c5c00bd44d33a97c1057b4ab5f9c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:26.781347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d0c5c00bd44d33a97c1057b4ab5f9c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:26.784615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:26.913736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d0c5c00bd44d33a97c1057b4ab5f9c', 'request_id': 'req-2c971b4d-d900-4452-9877-0568c86cf00c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:26.928612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d0c5c00bd44d33a97c1057b4ab5f9c', 'request_id': 'req-2c971b4d-d900-4452-9877-0568c86cf00c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:26.944809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d0c5c00bd44d33a97c1057b4ab5f9c', 'request_id': 'req-2c971b4d-d900-4452-9877-0568c86cf00c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:26.973766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] The token cache is being invalidate because project e2d0c5c00bd44d33a97c1057b4ab5f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:26.974056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:26.977429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2c971b4d-d900-4452-9877-0568c86cf00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:26.980724 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1740/3535] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:26 2022] DELETE /identity/v3/projects/e2d0c5c00bd44d33a97c1057b4ab5f9c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:26.985525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993643-ebe1-415c-a1b1-f1cac5d39c97 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:26.986003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993643-ebe1-415c-a1b1-f1cac5d39c97 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:26.986088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993643-ebe1-415c-a1b1-f1cac5d39c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.019050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e1993643-ebe1-415c-a1b1-f1cac5d39c97 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:27.021563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1993643-ebe1-415c-a1b1-f1cac5d39c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:27.168571 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1796/3536] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:27.176554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c64fd-4bc3-44f3-be0f-1ab0b2299a1e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.177154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c64fd-4bc3-44f3-be0f-1ab0b2299a1e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.179075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c64fd-4bc3-44f3-be0f-1ab0b2299a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.231857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d33c64fd-4bc3-44f3-be0f-1ab0b2299a1e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:27.233882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d33c64fd-4bc3-44f3-be0f-1ab0b2299a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:27.248012 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1741/3537] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:27.252330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993643-ebe1-415c-a1b1-f1cac5d39c97 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:27.272651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993643-ebe1-415c-a1b1-f1cac5d39c97 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:27.289267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:27.290174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.290552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.292516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.293824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:27.296213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:27.305771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:27.347910 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1797/3538] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:05:27.349930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c64fd-4bc3-44f3-be0f-1ab0b2299a1e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:27.363084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c64fd-4bc3-44f3-be0f-1ab0b2299a1e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:27.378753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:27.379712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.380143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.380560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.383080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:27.388034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:27.475511 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1742/3539] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:27 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:27.476880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:27.492570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4cbe-00b2-4246-af3c-84a17e9460a6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:27.631706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:27.633143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.633426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.633703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.636341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:27.640404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:27.688670 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1798/3540] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:27 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:27.692881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:27.707517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804236c4-b98f-4a77-a7ec-c410c66e9bf8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:27.722592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:27.723298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.723578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.724104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.724919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:27.727824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:27.784075 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1743/3541] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:27.787639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:27.813926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ead1-37f4-4ece-a221-370215194b51 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:27.826696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eeea1-3a64-4613-aa6e-691edaf7e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:27.828616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eeea1-3a64-4613-aa6e-691edaf7e2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.828927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eeea1-3a64-4613-aa6e-691edaf7e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.830471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eeea1-3a64-4613-aa6e-691edaf7e2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.832968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eeea1-3a64-4613-aa6e-691edaf7e2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:27.836331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eeea1-3a64-4613-aa6e-691edaf7e2d0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:27.869646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:27.869985 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1799/3542] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:27.881013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbfa74-92f1-48de-a382-97bbd0aa5d25 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:27.895551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:27.896474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.896752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.897021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] PATH_INFO: `/v3/projects/0f4ad084f5dd44c2b99960f4df5cb0e8/users/4719eac69a2f4f25bbb1abfb3ef7c980/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:27.936914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4ad084f5dd44c2b99960f4df5cb0e8, user_id=4719eac69a2f4f25bbb1abfb3ef7c980, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:27.940054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:27.969524 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1744/3543] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:27 2022] PUT /identity/v3/projects/0f4ad084f5dd44c2b99960f4df5cb0e8/users/4719eac69a2f4f25bbb1abfb3ef7c980/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:27.974993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282b01a-348b-4cd6-9017-40944926c1c7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:27.975470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282b01a-348b-4cd6-9017-40944926c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:27.975752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282b01a-348b-4cd6-9017-40944926c1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:28.002599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0282b01a-348b-4cd6-9017-40944926c1c7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:28.005126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0282b01a-348b-4cd6-9017-40944926c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:28.140355 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1800/3544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:28.156528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:28.158773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:28.285261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994ed7-73da-4914-83f6-ee22b897e321 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:28.293813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631edd5a-ed99-4e44-b551-1977b6950f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:28.294742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edd5a-ed99-4e44-b551-1977b6950f14 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:28.295157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edd5a-ed99-4e44-b551-1977b6950f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:28.295539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edd5a-ed99-4e44-b551-1977b6950f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:28.348502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631edd5a-ed99-4e44-b551-1977b6950f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:28.354059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631edd5a-ed99-4e44-b551-1977b6950f14 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:28.375998 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1745/3545] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:29.191242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718891a-2134-4049-a401-1e6eed5ff6f5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:29.192403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718891a-2134-4049-a401-1e6eed5ff6f5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:29.192817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718891a-2134-4049-a401-1e6eed5ff6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:29.226081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d718891a-2134-4049-a401-1e6eed5ff6f5 None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:29.228363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d718891a-2134-4049-a401-1e6eed5ff6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:29.340679 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1801/3546] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:30.146533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.147620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.148043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:30.207007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] MFA Rules not processed for user `4719eac69a2f4f25bbb1abfb3ef7c980`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:30.208496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.397623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1746/3547] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:30.407062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.407580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.407666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:30.472166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:30.472362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] MFA Rules not processed for user `4719eac69a2f4f25bbb1abfb3ef7c980`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:30.473616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.473917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.491372 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1802/3548] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:30.492587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:30.494978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.527634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b1d34-adc6-44f4-ae02-c0db638f7de6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:30.544449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:30.546075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.546805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.547373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] PATH_INFO: `/v3/users/3d1c24bc22654cab94bc0b7b8e271c7e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:30.548810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1c24bc22654cab94bc0b7b8e271c7e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:30.550847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:30.640945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1c24bc22654cab94bc0b7b8e271c7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:30.644132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1c24bc22654cab94bc0b7b8e271c7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:30.658956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1c24bc22654cab94bc0b7b8e271c7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:30.664508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28594240-67a9-4056-9653-326cc24a6a84 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:30.674231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1c24bc22654cab94bc0b7b8e271c7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:30.675269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1c24bc22654cab94bc0b7b8e271c7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:30.682400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18f2f1-9700-4415-8065-90ceaab08f84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:30.685340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f2f1-9700-4415-8065-90ceaab08f84 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.685659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f2f1-9700-4415-8065-90ceaab08f84 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.685945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f2f1-9700-4415-8065-90ceaab08f84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:30.690342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cf18f2f1-9700-4415-8065-90ceaab08f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.700742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1803/3549] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:30 2022] DELETE /identity/v3/users/3d1c24bc22654cab94bc0b7b8e271c7e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:30.702251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:30.704852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.728631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18f2f1-9700-4415-8065-90ceaab08f84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:30.731072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18f2f1-9700-4415-8065-90ceaab08f84 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:30.776069 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1747/3550] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:30.777692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134909bc-1bb9-41e3-8ccb-eaa0909b89ae None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.777961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134909bc-1bb9-41e3-8ccb-eaa0909b89ae None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.779304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134909bc-1bb9-41e3-8ccb-eaa0909b89ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:30.824130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-134909bc-1bb9-41e3-8ccb-eaa0909b89ae None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:30.827603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-134909bc-1bb9-41e3-8ccb-eaa0909b89ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.848610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25ad1-114f-4db5-a37d-455486ffd7bf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:30.859128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b1901-3bdd-49c6-972b-271dc6c99ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:30.860028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1901-3bdd-49c6-972b-271dc6c99ea6 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.860213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1901-3bdd-49c6-972b-271dc6c99ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.860594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1901-3bdd-49c6-972b-271dc6c99ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:30.862722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-723b1901-3bdd-49c6-972b-271dc6c99ea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.938797 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1748/3551] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:30.940391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5d03-a7d8-4dc7-a1a3-af9c3463b0f0 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.940783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5d03-a7d8-4dc7-a1a3-af9c3463b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.941322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5d03-a7d8-4dc7-a1a3-af9c3463b0f0 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:30.943349 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1749/3552] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:05:30.944167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5d03-a7d8-4dc7-a1a3-af9c3463b0f0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:30.946233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fccf5d03-a7d8-4dc7-a1a3-af9c3463b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:30.968345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b1901-3bdd-49c6-972b-271dc6c99ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:30.971156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b1901-3bdd-49c6-972b-271dc6c99ea6 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:30.983974 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1804/3553] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:30.985489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:30.985953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:30.986234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:31.046978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:31.048298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:31.059856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5d03-a7d8-4dc7-a1a3-af9c3463b0f0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:31.065169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:31.066024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:31.066309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:31.066575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:31.077223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:31.079104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:31.106297 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1750/3554] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:31.127738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1805/3555] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:31.156827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:31.159627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:31.194289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778758b-1e2c-45d3-94cd-4d5249396961 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:31.214697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:31.215463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:31.216088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:31.216362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:31.250314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:31.252321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:31.283050 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1751/3556] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:31.642710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:31.644590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:31.646215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:31.647153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:31.666893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e2901-e60e-43fc-b164-7ae6e0cc8599 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:31.679573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985293-0abb-4248-b3b9-aef0838b695f service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:31.686715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:31.691742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:31.692708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:31.692998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:31.693297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] PATH_INFO: `/v3/projects/54a9d66010e4404c82a529dd4bd18c3c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:31.694656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:31.694924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:31.695195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] PATH_INFO: `/v3/users/5981fe7d48ad4381a72d723ea5c6a08f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:31.696446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a9d66010e4404c82a529dd4bd18c3c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:31.698425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:31.700622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5981fe7d48ad4381a72d723ea5c6a08f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:31.707369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:31.806730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5981fe7d48ad4381a72d723ea5c6a08f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.809310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5981fe7d48ad4381a72d723ea5c6a08f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.820543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5981fe7d48ad4381a72d723ea5c6a08f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.827953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a9d66010e4404c82a529dd4bd18c3c', 'request_id': 'req-27b6dbdd-5c43-4beb-8410-47df14301f67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.835912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5981fe7d48ad4381a72d723ea5c6a08f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.837475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d337a11-6417-44ef-beb7-38440d375b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5981fe7d48ad4381a72d723ea5c6a08f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.839762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a9d66010e4404c82a529dd4bd18c3c', 'request_id': 'req-27b6dbdd-5c43-4beb-8410-47df14301f67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.853257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a9d66010e4404c82a529dd4bd18c3c', 'request_id': 'req-27b6dbdd-5c43-4beb-8410-47df14301f67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.873813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] The token cache is being invalidate because project 54a9d66010e4404c82a529dd4bd18c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:31.874152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.874931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:31.877086 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1752/3558] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:31 2022] DELETE /identity/v3/projects/54a9d66010e4404c82a529dd4bd18c3c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:05:31.877279 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1806/3558] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:31 2022] DELETE /identity/v3/users/5981fe7d48ad4381a72d723ea5c6a08f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:31.881166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:31.882990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:32.003352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6dbdd-5c43-4beb-8410-47df14301f67 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:32.089723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.090583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.091396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:32.111599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:32.112854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.113488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.113959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] PATH_INFO: `/v3/users/93e7d9641dc0480c9925179c2bc9cebd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:32.117670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e7d9641dc0480c9925179c2bc9cebd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:32.122239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:32.130821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:32.132759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:32.267877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e7d9641dc0480c9925179c2bc9cebd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.268814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e7d9641dc0480c9925179c2bc9cebd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.279782 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1807/3559] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:32.280955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:32.284276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:32.286969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e7d9641dc0480c9925179c2bc9cebd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.288091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e7d9641dc0480c9925179c2bc9cebd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.307370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f22e43c-315b-4e8d-9101-4491c5d9ba22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e7d9641dc0480c9925179c2bc9cebd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.318391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db50ee-8edd-4d82-ba70-7a206d0fd15f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:32.328625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:32.346262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.347813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.348375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] PATH_INFO: `/v3/projects/9867219547a94880ba048320401ac44a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:32.351598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9867219547a94880ba048320401ac44a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:32.356108 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1753/3560] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:31 2022] DELETE /identity/v3/users/93e7d9641dc0480c9925179c2bc9cebd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:05:32.359417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:32.465200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9867219547a94880ba048320401ac44a', 'request_id': 'req-296bb484-9b76-488b-a2b6-3097b5040a28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.493264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9867219547a94880ba048320401ac44a', 'request_id': 'req-296bb484-9b76-488b-a2b6-3097b5040a28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.513816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9867219547a94880ba048320401ac44a', 'request_id': 'req-296bb484-9b76-488b-a2b6-3097b5040a28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.539896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] The token cache is being invalidate because project 9867219547a94880ba048320401ac44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:32.545832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.548580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.551037 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1808/3561] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:32 2022] DELETE /identity/v3/projects/9867219547a94880ba048320401ac44a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:32.556010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eeb51-ea7f-468a-be42-e808549407e5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.556289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eeb51-ea7f-468a-be42-e808549407e5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.556561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eeb51-ea7f-468a-be42-e808549407e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:32.602488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fe0eeb51-ea7f-468a-be42-e808549407e5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:32.603871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fe0eeb51-ea7f-468a-be42-e808549407e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:32.770623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:32.772314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:32.791389 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1754/3562] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:32.802110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb484-9b76-488b-a2b6-3097b5040a28 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:32.803112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7994a-a5e1-4b05-9d48-171ae21234a4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.804448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7994a-a5e1-4b05-9d48-171ae21234a4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.804762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7994a-a5e1-4b05-9d48-171ae21234a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:32.828963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-95b7994a-a5e1-4b05-9d48-171ae21234a4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:32.830196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95b7994a-a5e1-4b05-9d48-171ae21234a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:32.834462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:32.835374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.835726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.835976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] PATH_INFO: `/v3/projects/ff352cfa067d4a45b06c494093a370bb` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:32.837872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff352cfa067d4a45b06c494093a370bb)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:32.839876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:32.840282 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1755/3563] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:32.844486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7994a-a5e1-4b05-9d48-171ae21234a4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:32.857294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7994a-a5e1-4b05-9d48-171ae21234a4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:32.867775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:32.868691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.877690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.880088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:32.881454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:32.881858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:32.883840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:32.907109 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1756/3564] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:05:32.907899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:32.925258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e139a-38da-41e2-9424-0cbba3c56e15 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:32.940855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff352cfa067d4a45b06c494093a370bb', 'request_id': 'req-dea2b17a-d099-4877-a2bb-60f25b04c364'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.948494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff352cfa067d4a45b06c494093a370bb', 'request_id': 'req-dea2b17a-d099-4877-a2bb-60f25b04c364'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.962345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff352cfa067d4a45b06c494093a370bb', 'request_id': 'req-dea2b17a-d099-4877-a2bb-60f25b04c364'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.981557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] The token cache is being invalidate because project ff352cfa067d4a45b06c494093a370bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:32.981749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.982842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dea2b17a-d099-4877-a2bb-60f25b04c364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:32.988716 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1809/3565] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:32 2022] DELETE /identity/v3/projects/ff352cfa067d4a45b06c494093a370bb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:05:32.991256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97d4f-23b4-46d9-80c8-117de7d5f291 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:32.991547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97d4f-23b4-46d9-80c8-117de7d5f291 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:32.991827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97d4f-23b4-46d9-80c8-117de7d5f291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.016781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5bf97d4f-23b4-46d9-80c8-117de7d5f291 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:33.018979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5bf97d4f-23b4-46d9-80c8-117de7d5f291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:33.041435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.043198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.043491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.043769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.044483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.046803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.106450 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1757/3566] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:32 2022] POST /identity/v3/projects => generated 395 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:33.107443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.117435 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1810/3567] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:33.117649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:33.134972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c891be-e4d4-4653-b5f1-cec8cab3b881 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.135667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c891be-e4d4-4653-b5f1-cec8cab3b881 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.138517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c891be-e4d4-4653-b5f1-cec8cab3b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.244875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e0c891be-e4d4-4653-b5f1-cec8cab3b881 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:33.249713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e0c891be-e4d4-4653-b5f1-cec8cab3b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:33.265456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcee25-c2b1-4c4b-ab37-435e508a49ec admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:33.290601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.291315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.293798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.294832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.297881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.307756 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1811/3568] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:33.308070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.311879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c891be-e4d4-4653-b5f1-cec8cab3b881 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.339502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c891be-e4d4-4653-b5f1-cec8cab3b881 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:33.350146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.351110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.351540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.355007 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1758/3569] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:33 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:33.355361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.356379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:33.356879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.357932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.362002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.383154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05021d3-9ac9-4854-86bd-f5e3abae6f4c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:33.387113 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1812/3570] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:05:33.391226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.393695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.394397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.394966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.394966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.395679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.397328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.411173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa61c8-6fbe-499c-b5ef-64c0374f2b35 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:33.413280 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1759/3571] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:33.418403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.429638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.433439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.436325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.436753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.437523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e822-d193-4586-8335-880dc90acefc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:33.439052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.445506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.446445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.446864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.447529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.448626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.449022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.451043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.471844 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1760/3572] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:05:33.476067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.496502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c873-93b9-481a-bffc-c1eb0338ddbf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:33.517379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed311e70-2e6a-4f59-aa70-b4a948cc2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.521516 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1813/3573] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:33 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:05:33.521682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed311e70-2e6a-4f59-aa70-b4a948cc2917 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.521682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed311e70-2e6a-4f59-aa70-b4a948cc2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.521682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed311e70-2e6a-4f59-aa70-b4a948cc2917 admin admin] PATH_INFO: `/v3/projects/f502d4df1e734e299d496111206e0bf0/users/f1b45ff3203a45609c6a2a57b3004dd3/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.523141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.573206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed311e70-2e6a-4f59-aa70-b4a948cc2917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f502d4df1e734e299d496111206e0bf0, user_id=f1b45ff3203a45609c6a2a57b3004dd3, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.577790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed311e70-2e6a-4f59-aa70-b4a948cc2917 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.625272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1761/3574] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:33 2022] PUT /identity/v3/projects/f502d4df1e734e299d496111206e0bf0/users/f1b45ff3203a45609c6a2a57b3004dd3/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:33.631334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.632348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.632644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.696372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:33.697711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:33.735710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdb079-e53a-4cfc-8aec-cc0bf96d1046 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:33.885145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1762/3575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:33.897418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:33.899214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:33.931867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:33.932564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:33.932891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:33.933192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:33.933939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:33.937717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:33.989810 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1814/3576] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:33 2022] POST /identity/v3/users => generated 290 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:33.994697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:34.000121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010945a-834e-49b5-864f-1df6fe91bb37 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:34.005780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:34.007341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:34.007693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:34.008033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:34.016718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc309-afb1-44af-9cfe-659e2127dde2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:34.020538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:34.021643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:34.022328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:34.022607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:34.022821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:34.022941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:34.023650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:34.025410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:34.037173 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1763/3577] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:05:34.058548 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1815/3578] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:34.059942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:34.110779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952f8f-1bef-436c-a13e-9026abf04969 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:34.120332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08fac2-353a-4984-a181-a780d5b20966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:34.121184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fac2-353a-4984-a181-a780d5b20966 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:34.121680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fac2-353a-4984-a181-a780d5b20966 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:34.122024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fac2-353a-4984-a181-a780d5b20966 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:34.124129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08fac2-353a-4984-a181-a780d5b20966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:34.141758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08fac2-353a-4984-a181-a780d5b20966 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:34.158029 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1764/3579] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:34.163736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:34.180648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6bb47-5303-4154-a478-d6ac78687b99 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:34.192642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:34.193609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:34.193888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:34.194157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] PATH_INFO: `/v3/projects/7209c92456be408e875634c6af7ea93f/users/b56b2ea6899f44798e190e598c4ced7d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:34.255656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7209c92456be408e875634c6af7ea93f, user_id=b56b2ea6899f44798e190e598c4ced7d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:34.260419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:34.290753 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1816/3580] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:34 2022] PUT /identity/v3/projects/7209c92456be408e875634c6af7ea93f/users/b56b2ea6899f44798e190e598c4ced7d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:34.302906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098af2-982e-4871-8de6-f11f536417e7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:34.303872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098af2-982e-4871-8de6-f11f536417e7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:34.304473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098af2-982e-4871-8de6-f11f536417e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:34.421487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8b098af2-982e-4871-8de6-f11f536417e7 None None] MFA Rules not processed for user `b56b2ea6899f44798e190e598c4ced7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:34.428349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8b098af2-982e-4871-8de6-f11f536417e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:34.675599 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1765/3581] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:34.676856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:34.826035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41823a-eaaf-403b-8089-bfdbf5ba104b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:34.841503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:34.842740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:34.843124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:34.843551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:34.844457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:34.846964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:34.969013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1817/3582] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:34 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:34.973202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098af2-982e-4871-8de6-f11f536417e7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:34.995849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098af2-982e-4871-8de6-f11f536417e7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:35.125526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:35.126218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.126493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.126769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.127735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:35.129785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:35.181160 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1766/3583] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:34 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:35.187127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:35.205471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6bae7-a334-4af0-8525-3071b8c810d2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:35.213329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:35.214089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.214376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.214646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.215378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:35.219717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:35.249780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:35.261514 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1818/3584] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:35.264268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a6aa3-62f0-4ac2-9b9a-f5d1c4d32a94 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:35.268577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:35.270003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.270274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.270598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] PATH_INFO: `/v3/projects/790e8af282944a37852149d0aff6784e/users/982d01a4cc8f4beabcdabbccbf4b476b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.290169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=790e8af282944a37852149d0aff6784e, user_id=982d01a4cc8f4beabcdabbccbf4b476b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:35.294105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:35.341275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:35.343081 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1767/3585] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:35 2022] PUT /identity/v3/projects/790e8af282944a37852149d0aff6784e/users/982d01a4cc8f4beabcdabbccbf4b476b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:35.357491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d3cd8-8de1-46ea-8842-4a10370a9a17 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:35.465845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba6de0-3c4b-436a-9b41-6ad1b2b4d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:35.466903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba6de0-3c4b-436a-9b41-6ad1b2b4d8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.467191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba6de0-3c4b-436a-9b41-6ad1b2b4d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.467469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba6de0-3c4b-436a-9b41-6ad1b2b4d8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.468325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba6de0-3c4b-436a-9b41-6ad1b2b4d8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:35.470337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba6de0-3c4b-436a-9b41-6ad1b2b4d8f6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:35.509214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1819/3586] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:35.511943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:35.525243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec5fc9-7739-43a5-88dd-01d2125dbdbd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:35.540402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36f9db-cdf2-4bdf-8763-abfba5bb67b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:35.540762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e804d-11e5-4c2f-893f-51ecf627fb91 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.541011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e804d-11e5-4c2f-893f-51ecf627fb91 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.541337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e804d-11e5-4c2f-893f-51ecf627fb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.545475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36f9db-cdf2-4bdf-8763-abfba5bb67b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.546129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36f9db-cdf2-4bdf-8763-abfba5bb67b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.547903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36f9db-cdf2-4bdf-8763-abfba5bb67b7 admin admin] PATH_INFO: `/v3/projects/790e8af282944a37852149d0aff6784e/users/982d01a4cc8f4beabcdabbccbf4b476b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.554982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36f9db-cdf2-4bdf-8763-abfba5bb67b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790e8af282944a37852149d0aff6784e, user_id=982d01a4cc8f4beabcdabbccbf4b476b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:35.563458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36f9db-cdf2-4bdf-8763-abfba5bb67b7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:35.589267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9e9e804d-11e5-4c2f-893f-51ecf627fb91 None None] MFA Rules not processed for user `f1b45ff3203a45609c6a2a57b3004dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:35.590079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1768/3587] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:35 2022] PUT /identity/v3/projects/790e8af282944a37852149d0aff6784e/users/982d01a4cc8f4beabcdabbccbf4b476b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:35.597263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9e9e804d-11e5-4c2f-893f-51ecf627fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:35.600915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.601247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.601529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.652986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] MFA Rules not processed for user `982d01a4cc8f4beabcdabbccbf4b476b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:35.654280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:35.747794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1820/3588] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:35.751191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.751501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.751757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.779922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] MFA Rules not processed for user `f1b45ff3203a45609c6a2a57b3004dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:35.795622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:35.819818 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1821/3589] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:35.822640 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1769/3590] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:35.838451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:35.842100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:35.849646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:35.870749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:35.960072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317df7-e7bc-4450-9f9b-d29f976fe88b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:35.966724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:35.967407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.967690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.968032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.975008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b70980-ef6d-4987-879a-f0978f582e89 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:35.978341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:35.980168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:35.983809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f07709-522d-4004-8e82-d6d5c19eb911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:35.984912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f07709-522d-4004-8e82-d6d5c19eb911 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:35.985380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f07709-522d-4004-8e82-d6d5c19eb911 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:35.985782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f07709-522d-4004-8e82-d6d5c19eb911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:35.994419 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1822/3591] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:36.000055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f07709-522d-4004-8e82-d6d5c19eb911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:36.001758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f07709-522d-4004-8e82-d6d5c19eb911 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:36.014222 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1770/3592] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:37.340307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:37.470233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0398da4-b633-4410-857a-7c11ad643a74 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:37.484405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:37.487530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:37.487807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:37.488665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] PATH_INFO: `/v3/users/b56b2ea6899f44798e190e598c4ced7d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:37.490730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56b2ea6899f44798e190e598c4ced7d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:37.492719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:37.607890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56b2ea6899f44798e190e598c4ced7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:37.609245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56b2ea6899f44798e190e598c4ced7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:37.619262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56b2ea6899f44798e190e598c4ced7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:37.637276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56b2ea6899f44798e190e598c4ced7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:37.638011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56b2ea6899f44798e190e598c4ced7d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:37.675357 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1823/3593] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:37 2022] DELETE /identity/v3/users/b56b2ea6899f44798e190e598c4ced7d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:37.676532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c91665-8a09-482b-be80-0ba2ccdc03a7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:37.677000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c91665-8a09-482b-be80-0ba2ccdc03a7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:37.677222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c91665-8a09-482b-be80-0ba2ccdc03a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:37.700924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-34c91665-8a09-482b-be80-0ba2ccdc03a7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:37.702777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-34c91665-8a09-482b-be80-0ba2ccdc03a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:37.784129 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1771/3594] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:37.816583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:37.817948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:37.989534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3917a7-236f-43aa-9f75-10080776e410 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:38.005194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:38.006244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:38.006606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:38.007797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:38.034373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:38.036670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:38.069859 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1824/3595] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:39.455096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458565-fb9b-4fa2-9267-d7ccad5b2323 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:39.455685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458565-fb9b-4fa2-9267-d7ccad5b2323 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:39.455685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458565-fb9b-4fa2-9267-d7ccad5b2323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:39.482241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:39.484160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:39.493575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-57458565-fb9b-4fa2-9267-d7ccad5b2323 None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:39.495140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-57458565-fb9b-4fa2-9267-d7ccad5b2323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:39.542514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179296b-a3d4-4f73-ab83-3793a1d3d8e5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:39.562066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:39.562998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:39.563280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:39.563595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] PATH_INFO: `/v3/projects/7209c92456be408e875634c6af7ea93f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:39.565719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7209c92456be408e875634c6af7ea93f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:39.570167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:39.583231 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1772/3596] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:39.717597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7209c92456be408e875634c6af7ea93f', 'request_id': 'req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.741294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7209c92456be408e875634c6af7ea93f', 'request_id': 'req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.760020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7209c92456be408e875634c6af7ea93f', 'request_id': 'req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.774871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] The token cache is being invalidate because project 7209c92456be408e875634c6af7ea93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:39.775167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.776159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.781748 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1825/3597] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:39 2022] DELETE /identity/v3/projects/7209c92456be408e875634c6af7ea93f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:39.783051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57458565-fb9b-4fa2-9267-d7ccad5b2323 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:39.797142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57458565-fb9b-4fa2-9267-d7ccad5b2323 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:39.881252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:39.882153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:39.882588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:39.882883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] PATH_INFO: `/v3/users/982d01a4cc8f4beabcdabbccbf4b476b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:39.885445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982d01a4cc8f4beabcdabbccbf4b476b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:39.887603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:39.964225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982d01a4cc8f4beabcdabbccbf4b476b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.964957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982d01a4cc8f4beabcdabbccbf4b476b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.974588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982d01a4cc8f4beabcdabbccbf4b476b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.975870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982d01a4cc8f4beabcdabbccbf4b476b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:39.987447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982d01a4cc8f4beabcdabbccbf4b476b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:40.027682 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1773/3598] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:39 2022] DELETE /identity/v3/users/982d01a4cc8f4beabcdabbccbf4b476b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:40.635102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:40.637070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:40.790215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba274a0-e1bb-4bb7-a9f7-1c37cc50e5c9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:40.855852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8635bf-fa1d-41ed-a46a-6dce16c99b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:40.856803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8635bf-fa1d-41ed-a46a-6dce16c99b24 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:40.857445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8635bf-fa1d-41ed-a46a-6dce16c99b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:40.857981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8635bf-fa1d-41ed-a46a-6dce16c99b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:40.861447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b8635bf-fa1d-41ed-a46a-6dce16c99b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:40.874601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8635bf-fa1d-41ed-a46a-6dce16c99b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:40.876353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8635bf-fa1d-41ed-a46a-6dce16c99b24 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:40.877605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:40.879693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:40.888070 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1826/3599] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:41.006534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3faef8-261d-4533-8d21-9dd46fb310f0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.011588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.012841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.013152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.013484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] PATH_INFO: `/v3/projects/790e8af282944a37852149d0aff6784e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.015075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790e8af282944a37852149d0aff6784e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.017338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:41.124613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790e8af282944a37852149d0aff6784e', 'request_id': 'req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:41.131660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790e8af282944a37852149d0aff6784e', 'request_id': 'req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:41.143913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790e8af282944a37852149d0aff6784e', 'request_id': 'req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:41.160455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] The token cache is being invalidate because project 790e8af282944a37852149d0aff6784e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:41.160749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:41.161433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20fe35a7-b25d-4f31-bf3a-6a4206ffc385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:41.163375 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1774/3600] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:40 2022] DELETE /identity/v3/projects/790e8af282944a37852149d0aff6784e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:05:41.168799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492151fb-819b-45fc-a8fa-db5309f4c08a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.169117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492151fb-819b-45fc-a8fa-db5309f4c08a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.169397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492151fb-819b-45fc-a8fa-db5309f4c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.192860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-492151fb-819b-45fc-a8fa-db5309f4c08a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:41.194163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-492151fb-819b-45fc-a8fa-db5309f4c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:41.315761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1827/3601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:41.325243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795109-0055-48e2-88e6-ae0468a8187b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.325656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795109-0055-48e2-88e6-ae0468a8187b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.325940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795109-0055-48e2-88e6-ae0468a8187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.377919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c2795109-0055-48e2-88e6-ae0468a8187b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:41.380060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c2795109-0055-48e2-88e6-ae0468a8187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:41.400173 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1775/3602] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:41.404694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492151fb-819b-45fc-a8fa-db5309f4c08a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:41.429704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492151fb-819b-45fc-a8fa-db5309f4c08a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.437423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.438167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.438452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.439366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.440118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:41.440945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.442736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:41.480165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1828/3603] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:05:41.480680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795109-0055-48e2-88e6-ae0468a8187b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:41.492737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795109-0055-48e2-88e6-ae0468a8187b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.497946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.498906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.498906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.499141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.500072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.502637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:41.545082 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1776/3604] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:41 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:41.547341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:41.559781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723e0d-6436-4634-9b0b-608a66881c75 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.642742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.643429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.643824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.644102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.644786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.646770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:41.674507 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1829/3605] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:41 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:41.677557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:41.691388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae84f9-3183-4ec4-8408-d281fe68ef78 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.696986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.698270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.698644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.698962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.699822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.701716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:41.713411 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1777/3606] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:41.717777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:41.729180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668bc79-3302-4a71-b6a3-9857c518c089 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.734958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393ad09-6b9a-4961-984c-4a4fdddc0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.736215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393ad09-6b9a-4961-984c-4a4fdddc0925 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.736635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393ad09-6b9a-4961-984c-4a4fdddc0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.737088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393ad09-6b9a-4961-984c-4a4fdddc0925 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.737844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393ad09-6b9a-4961-984c-4a4fdddc0925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.739502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393ad09-6b9a-4961-984c-4a4fdddc0925 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:41.749912 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1830/3607] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:41.754213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:41.765250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04005f58-9758-4f0e-9449-4e72ef9e152b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.769985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.770878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.771294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.771569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] PATH_INFO: `/v3/projects/aead5a374fd746ebbe70d73a43bedf40/users/51454cd474cc4b2c8d6ac3b4546c9da4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.787537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aead5a374fd746ebbe70d73a43bedf40, user_id=51454cd474cc4b2c8d6ac3b4546c9da4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.790524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:41.808359 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1778/3608] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:41 2022] PUT /identity/v3/projects/aead5a374fd746ebbe70d73a43bedf40/users/51454cd474cc4b2c8d6ac3b4546c9da4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:41.819731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51802b-29ba-46ed-9f58-9c72db4706c9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.820319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51802b-29ba-46ed-9f58-9c72db4706c9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.820748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51802b-29ba-46ed-9f58-9c72db4706c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.849012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-be51802b-29ba-46ed-9f58-9c72db4706c9 None None] MFA Rules not processed for user `51454cd474cc4b2c8d6ac3b4546c9da4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:41.850254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-be51802b-29ba-46ed-9f58-9c72db4706c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:41.914424 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1831/3609] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:41.918767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:41.983631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7f0e-c605-4e34-8032-1fee638425c8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:41.988357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:41.989216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:41.989496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:41.989763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:41.990528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:41.992424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.030707 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1779/3610] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:41 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:42.035335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51802b-29ba-46ed-9f58-9c72db4706c9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:42.048144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51802b-29ba-46ed-9f58-9c72db4706c9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:42.105283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:42.105893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.106164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.106440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.107137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:42.109088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.130421 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1832/3611] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:42 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:42.134658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:42.145671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a3fd-c1f4-43e3-a3a5-ec979c8ff740 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:42.150632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:42.151296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.151649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.151925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.152646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:42.154331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.165825 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1780/3612] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:42.170116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:42.181896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e400ec-22fb-480f-8de3-47eedf44babb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:42.186795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:42.187696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.187973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.188247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] PATH_INFO: `/v3/projects/d10099e36b7f489cbd961cc976548de6/users/e0950a576945428c8c87f54da8ff940d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.207132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10099e36b7f489cbd961cc976548de6, user_id=e0950a576945428c8c87f54da8ff940d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:42.209933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.224550 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1833/3613] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:42 2022] PUT /identity/v3/projects/d10099e36b7f489cbd961cc976548de6/users/e0950a576945428c8c87f54da8ff940d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:42.228492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:42.246381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52799-74b7-49b3-ac73-b12c4a5d5b52 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:42.322775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09367ab1-823f-4638-a5c6-df59cce90bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:42.323465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09367ab1-823f-4638-a5c6-df59cce90bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.323780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09367ab1-823f-4638-a5c6-df59cce90bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.324109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09367ab1-823f-4638-a5c6-df59cce90bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.324992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09367ab1-823f-4638-a5c6-df59cce90bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:42.327070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09367ab1-823f-4638-a5c6-df59cce90bf4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.337806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1781/3614] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:05:42.342515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:42.357066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f105d-c9a3-4e56-b922-ed308c25a39f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:42.361630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:42.362549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.362824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.363091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] PATH_INFO: `/v3/projects/d10099e36b7f489cbd961cc976548de6/users/e0950a576945428c8c87f54da8ff940d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.365104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10099e36b7f489cbd961cc976548de6, user_id=e0950a576945428c8c87f54da8ff940d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:42.367893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.388676 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1834/3615] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:42 2022] PUT /identity/v3/projects/d10099e36b7f489cbd961cc976548de6/users/e0950a576945428c8c87f54da8ff940d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:42.390124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.390411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.390686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.418488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] MFA Rules not processed for user `e0950a576945428c8c87f54da8ff940d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:42.419711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:42.510923 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1782/3616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:42.519359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:42.521150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:42.548828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:42.550528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:42.606030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247de01-55aa-4af9-8e19-fcd090acad88 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:42.612803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:42.613597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.613883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.614172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.622893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:42.625374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.629275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e304deb-531f-4fad-8415-a0f5f16221e5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:42.635412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:42.636074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:42.636377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:42.636645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:42.637279 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1835/3617] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:42.639156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:42.655257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:42.656956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:42.670156 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1783/3618] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:05:44.369187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:44.383118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc585-0af2-40c0-8029-1f514daaf7c6 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:44.390208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3bf7a-1e76-4923-a58d-0670e31cf60a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:44.391034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3bf7a-1e76-4923-a58d-0670e31cf60a service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:44.391406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3bf7a-1e76-4923-a58d-0670e31cf60a service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:44.391820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3bf7a-1e76-4923-a58d-0670e31cf60a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:44.490728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3bf7a-1e76-4923-a58d-0670e31cf60a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:44.492341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3bf7a-1e76-4923-a58d-0670e31cf60a service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:44.501247 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1836/3619] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:44.516361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:44.575850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281274b-2b0f-44e7-91c6-0241883bed58 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:44.580931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:44.581925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:44.582193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:44.582473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] PATH_INFO: `/v3/users/51454cd474cc4b2c8d6ac3b4546c9da4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:44.583726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51454cd474cc4b2c8d6ac3b4546c9da4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:44.585687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:44.642395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51454cd474cc4b2c8d6ac3b4546c9da4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:44.643497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51454cd474cc4b2c8d6ac3b4546c9da4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:44.650995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51454cd474cc4b2c8d6ac3b4546c9da4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:44.651997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51454cd474cc4b2c8d6ac3b4546c9da4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:44.660451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51454cd474cc4b2c8d6ac3b4546c9da4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:44.687632 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1784/3620] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:44 2022] DELETE /identity/v3/users/51454cd474cc4b2c8d6ac3b4546c9da4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:44.692866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:44.693112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:44.693378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:44.714542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:44.716718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:44.793582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1837/3621] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:44.805017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:44.806506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:44.890477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41ed99-2fd3-49a2-8801-d32fa3b726c7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:44.895126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:44.896093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:44.896532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:44.896808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:44.910460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:44.911877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:44.924837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1785/3622] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:45.261326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:45.263350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:45.280399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0380-0fd8-4f8c-8e99-673996f8f94a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:45.286148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:45.287332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:45.287713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:45.288044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] PATH_INFO: `/v3/projects/aead5a374fd746ebbe70d73a43bedf40` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:45.291148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aead5a374fd746ebbe70d73a43bedf40)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:45.293219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:45.371001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aead5a374fd746ebbe70d73a43bedf40', 'request_id': 'req-f1d6059a-649b-4c44-b3df-a64929168abe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.377029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aead5a374fd746ebbe70d73a43bedf40', 'request_id': 'req-f1d6059a-649b-4c44-b3df-a64929168abe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.388694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aead5a374fd746ebbe70d73a43bedf40', 'request_id': 'req-f1d6059a-649b-4c44-b3df-a64929168abe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.401827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] The token cache is being invalidate because project aead5a374fd746ebbe70d73a43bedf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:45.402165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.402762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.407820 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1838/3623] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:45 2022] DELETE /identity/v3/projects/aead5a374fd746ebbe70d73a43bedf40 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:45.409903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:45.421653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73d0b-3dfc-4f7d-96da-d5a09b1acc30 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:45.486639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:45.488351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:45.488763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:45.489059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] PATH_INFO: `/v3/users/e0950a576945428c8c87f54da8ff940d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:45.490652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0950a576945428c8c87f54da8ff940d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:45.492309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:45.550334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0950a576945428c8c87f54da8ff940d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.551023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0950a576945428c8c87f54da8ff940d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.558408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0950a576945428c8c87f54da8ff940d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.559774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0950a576945428c8c87f54da8ff940d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.569485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1d24d781-3415-41e2-951e-91c1ffee87fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0950a576945428c8c87f54da8ff940d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.590914 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1786/3624] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:45 2022] DELETE /identity/v3/users/e0950a576945428c8c87f54da8ff940d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:45.783565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:45.785202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:45.801585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6059a-649b-4c44-b3df-a64929168abe admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:45.882092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:45.883103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:45.883439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:45.883778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] PATH_INFO: `/v3/users/877cb7c7f5da43638d8cb4fe28a927ae` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:45.885132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=877cb7c7f5da43638d8cb4fe28a927ae)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:45.887468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:45.974659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877cb7c7f5da43638d8cb4fe28a927ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.975376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877cb7c7f5da43638d8cb4fe28a927ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.985885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877cb7c7f5da43638d8cb4fe28a927ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.997901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877cb7c7f5da43638d8cb4fe28a927ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:45.998639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877cb7c7f5da43638d8cb4fe28a927ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:46.060823 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1839/3625] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:45 2022] DELETE /identity/v3/users/877cb7c7f5da43638d8cb4fe28a927ae => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:46.065647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.066250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.066807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.088906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:46.093460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:46.187010 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1787/3626] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:46.246821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:46.248376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:46.317156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a1290-5d7b-4f0b-b8c1-bf7a8c29c37a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:46.320717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1e6c2-0090-4179-a8b6-60fea26d68da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:46.321422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e6c2-0090-4179-a8b6-60fea26d68da service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.321699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e6c2-0090-4179-a8b6-60fea26d68da service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.321970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e6c2-0090-4179-a8b6-60fea26d68da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.332933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1e6c2-0090-4179-a8b6-60fea26d68da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:46.334812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1e6c2-0090-4179-a8b6-60fea26d68da service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:46.347590 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1840/3627] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:46.424570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:46.426443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:46.442672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2ae6-92e1-4a65-9977-de85c988e14d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:46.449841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:46.450743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.451021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.451350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] PATH_INFO: `/v3/projects/d10099e36b7f489cbd961cc976548de6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.452615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10099e36b7f489cbd961cc976548de6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:46.457007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:46.515748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10099e36b7f489cbd961cc976548de6', 'request_id': 'req-0c6297db-025a-4516-9117-b8577e1df4d5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:46.522181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10099e36b7f489cbd961cc976548de6', 'request_id': 'req-0c6297db-025a-4516-9117-b8577e1df4d5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:46.537104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10099e36b7f489cbd961cc976548de6', 'request_id': 'req-0c6297db-025a-4516-9117-b8577e1df4d5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:46.577062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] The token cache is being invalidate because project d10099e36b7f489cbd961cc976548de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:46.577062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:46.577062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0c6297db-025a-4516-9117-b8577e1df4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:46.584619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dca13-f5ac-4364-85b2-b4a795ecb75a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.585190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dca13-f5ac-4364-85b2-b4a795ecb75a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.585190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dca13-f5ac-4364-85b2-b4a795ecb75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.588220 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1788/3628] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:46 2022] DELETE /identity/v3/projects/d10099e36b7f489cbd961cc976548de6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:46.614759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d02dca13-f5ac-4364-85b2-b4a795ecb75a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:46.616288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d02dca13-f5ac-4364-85b2-b4a795ecb75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:46.695929 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1841/3629] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:46.706723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f16e7-93a6-4679-a16e-2b688853081a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.706971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f16e7-93a6-4679-a16e-2b688853081a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.707248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f16e7-93a6-4679-a16e-2b688853081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.730450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7e6f16e7-93a6-4679-a16e-2b688853081a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:46.731662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7e6f16e7-93a6-4679-a16e-2b688853081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:46.746147 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1789/3630] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:46.746976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dca13-f5ac-4364-85b2-b4a795ecb75a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:46.760276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dca13-f5ac-4364-85b2-b4a795ecb75a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:46.772976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:46.773972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.774319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.777162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.778567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:46.778956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:46.781296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:46.807030 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1842/3631] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:05:46.807719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f16e7-93a6-4679-a16e-2b688853081a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:46.820673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f16e7-93a6-4679-a16e-2b688853081a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:46.826387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:46.835196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.835699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.836043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.837302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:46.839394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:46.870362 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1790/3632] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:46 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:46.874865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:46.885345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990925ea-f9c9-471b-b598-8b8a8e3df2b7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:46.945300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:46.946085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:46.946501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:46.946781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:46.947477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:46.949485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:46.978480 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1843/3633] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:46 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:46.979936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:46.993196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956de5fd-5eb4-4a17-9419-098945f68236 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:46.998681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:46.999517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:47.000428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:47.000428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:47.001308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:47.002921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:47.014351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1791/3634] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:47.018455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:47.028736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dcba0-4133-4399-9e2e-fb717d713d28 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:47.033719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cab4f5-367e-4097-95ad-80df3ae901dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:47.034392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cab4f5-367e-4097-95ad-80df3ae901dd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:47.034668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cab4f5-367e-4097-95ad-80df3ae901dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:47.035064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cab4f5-367e-4097-95ad-80df3ae901dd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:47.035797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cab4f5-367e-4097-95ad-80df3ae901dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:47.037474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cab4f5-367e-4097-95ad-80df3ae901dd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:47.048718 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1844/3635] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:47.052898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:47.062833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b73a-4063-46ae-ac48-da7ef793b6e3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:47.067980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:47.069178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:47.069604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:47.070036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] PATH_INFO: `/v3/projects/8984499dc1d144e6a6f276b3505fa716/users/07b3d5d6e3a041dd8ec1686636891572/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:47.087712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8984499dc1d144e6a6f276b3505fa716, user_id=07b3d5d6e3a041dd8ec1686636891572, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:47.091163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:47.109331 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1792/3636] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:47 2022] PUT /identity/v3/projects/8984499dc1d144e6a6f276b3505fa716/users/07b3d5d6e3a041dd8ec1686636891572/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:47.119069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:47.119375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:47.119651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:47.149795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] MFA Rules not processed for user `07b3d5d6e3a041dd8ec1686636891572`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:47.151064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:47.257785 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1845/3637] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:47.532054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:47.534492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:47.606120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1696-f82c-48fe-a90b-67d1281b77e2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:47.612435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:47.613455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:47.613657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:47.614097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] PATH_INFO: `/v3/projects/4b9455ce3b4e4d268c23b32258d8eeaa` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:47.615298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9455ce3b4e4d268c23b32258d8eeaa)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:47.617404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:47.635554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:47.637098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:47.690183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9455ce3b4e4d268c23b32258d8eeaa', 'request_id': 'req-f2772c24-59cd-4ee5-bcd5-e7eab051406f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.695503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9455ce3b4e4d268c23b32258d8eeaa', 'request_id': 'req-f2772c24-59cd-4ee5-bcd5-e7eab051406f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.704049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9455ce3b4e4d268c23b32258d8eeaa', 'request_id': 'req-f2772c24-59cd-4ee5-bcd5-e7eab051406f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.717784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] The token cache is being invalidate because project 4b9455ce3b4e4d268c23b32258d8eeaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:47.718170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.719680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.721408 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1793/3638] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:47 2022] DELETE /identity/v3/projects/4b9455ce3b4e4d268c23b32258d8eeaa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:47.725992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:47.726747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb48b-b464-48ed-91f9-9edafb184b46 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:47.727690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:47.798729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:47.799477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:47.799880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:47.800913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:47.803689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:47.808248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772c24-59cd-4ee5-bcd5-e7eab051406f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:47.814724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:47.814991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:47.815267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:47.815537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] PATH_INFO: `/v3/users/9fd23fd1d7a243798cbacdaeacb8e711` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:47.816735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd23fd1d7a243798cbacdaeacb8e711)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:47.818692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:47.868490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:47.870245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:47.879838 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1846/3639] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:05:47.880403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd23fd1d7a243798cbacdaeacb8e711'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.881677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd23fd1d7a243798cbacdaeacb8e711'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.889771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd23fd1d7a243798cbacdaeacb8e711'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.890505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd23fd1d7a243798cbacdaeacb8e711'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.905927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd23fd1d7a243798cbacdaeacb8e711'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:47.925370 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1794/3640] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:47 2022] DELETE /identity/v3/users/9fd23fd1d7a243798cbacdaeacb8e711 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:05:48.388269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:48.402175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ce81d-5595-440b-8282-a4124de6c77c service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:48.498926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:48.499860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:48.500143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:48.500418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] PATH_INFO: `/v3/projects/e0f29f40a0af408baa6e1fc0868a7513` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:48.501833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f29f40a0af408baa6e1fc0868a7513)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:48.503820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:48.583484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f29f40a0af408baa6e1fc0868a7513', 'request_id': 'req-399b7ba5-0147-49b6-a2c5-e550200fb9bd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.598180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f29f40a0af408baa6e1fc0868a7513', 'request_id': 'req-399b7ba5-0147-49b6-a2c5-e550200fb9bd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.608922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f29f40a0af408baa6e1fc0868a7513', 'request_id': 'req-399b7ba5-0147-49b6-a2c5-e550200fb9bd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.624464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] The token cache is being invalidate because project e0f29f40a0af408baa6e1fc0868a7513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:48.624750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.631768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-399b7ba5-0147-49b6-a2c5-e550200fb9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.632539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:48.634255 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1847/3641] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:48 2022] DELETE /identity/v3/projects/e0f29f40a0af408baa6e1fc0868a7513 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:48.635404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:48.642355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7134ed-8288-4d7d-b482-dc3cd7d0476e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:48.642786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7134ed-8288-4d7d-b482-dc3cd7d0476e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:48.642917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7134ed-8288-4d7d-b482-dc3cd7d0476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:48.655509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd074-67b6-472a-93c3-6a24c8717ddb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:48.664945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bd7134ed-8288-4d7d-b482-dc3cd7d0476e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:48.666387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bd7134ed-8288-4d7d-b482-dc3cd7d0476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:48.753122 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1848/3642] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:48.765472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb873866-cf91-4ef7-bec2-8acb1da931d4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:48.765914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb873866-cf91-4ef7-bec2-8acb1da931d4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:48.766399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb873866-cf91-4ef7-bec2-8acb1da931d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:48.770203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:48.771280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:48.771699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:48.772156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] PATH_INFO: `/v3/users/07b3d5d6e3a041dd8ec1686636891572` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:48.773794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b3d5d6e3a041dd8ec1686636891572)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:48.775897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:48.792933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cb873866-cf91-4ef7-bec2-8acb1da931d4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:48.794645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cb873866-cf91-4ef7-bec2-8acb1da931d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:48.830279 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1849/3643] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:48.831354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb873866-cf91-4ef7-bec2-8acb1da931d4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:48.848164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b3d5d6e3a041dd8ec1686636891572'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.849097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b3d5d6e3a041dd8ec1686636891572'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.856827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b3d5d6e3a041dd8ec1686636891572'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.858588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b3d5d6e3a041dd8ec1686636891572'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.862034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb873866-cf91-4ef7-bec2-8acb1da931d4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:48.869583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9acaa0bd-497e-4f8f-8a71-11f97ab0f776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b3d5d6e3a041dd8ec1686636891572'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:48.883871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:48.884850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:48.885341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:48.885745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:48.886666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:48.887204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:48.889574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:48.898593 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1795/3644] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:48 2022] DELETE /identity/v3/users/07b3d5d6e3a041dd8ec1686636891572 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:48.900274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:48.900635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:48.901258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:48.908603 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1850/3645] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:05:48.912741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:48.915127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:48.926032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:48.927871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:48.930268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4f357-6bdc-40de-bf56-36c40a4f3382 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.006503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.008092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.008549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.008961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.009458 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1796/3646] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:49.010068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.013160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.027587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.029176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.051969 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1851/3647] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:48 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:05:49.053073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.092831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1f99-2de8-4a84-8acb-7a6e03f715c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.140225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6b8bb-5fb7-426d-9a2a-56ce10c8a5ac admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.145479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.146192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.146476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.146749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.147608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.149523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.168887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.169629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.170008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.170278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.177981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1852/3648] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:49 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:49.177981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.177981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.180070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.181549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.191293 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1797/3649] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:05:49.192076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.202057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1d9f3-068d-4534-9b44-a6e6e2cbbe73 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.206912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.207574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.207852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.208122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.208839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.210458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.221594 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1798/3650] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:49.225612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.235987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e621021-5006-46fc-a8b7-1f29ce5e9085 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.242269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.243030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.243322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.243600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.244382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.248287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.254191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3578ee-4034-4e93-b9c7-1ea77dc27650 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.260135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1994a-3650-4f40-8a5e-8fc7a99316c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.260967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1994a-3650-4f40-8a5e-8fc7a99316c5 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.261354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1994a-3650-4f40-8a5e-8fc7a99316c5 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.261670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1994a-3650-4f40-8a5e-8fc7a99316c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.266181 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1799/3651] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:05:49.267471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.267861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e4d1994a-3650-4f40-8a5e-8fc7a99316c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.278117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bf752-0102-4102-b400-7667bb3afa89 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.281774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1994a-3650-4f40-8a5e-8fc7a99316c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.283244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.283382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1994a-3650-4f40-8a5e-8fc7a99316c5 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.284619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.285085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.285504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] PATH_INFO: `/v3/projects/521149a43ad4462a915b38310df08c37/users/51e0eda090fe47abb90b99dfcdc663c8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.295480 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1853/3652] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:49.304589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=521149a43ad4462a915b38310df08c37, user_id=51e0eda090fe47abb90b99dfcdc663c8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.309891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.330128 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1800/3653] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:49 2022] PUT /identity/v3/projects/521149a43ad4462a915b38310df08c37/users/51e0eda090fe47abb90b99dfcdc663c8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:49.342063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.342351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.342801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.369661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] MFA Rules not processed for user `51e0eda090fe47abb90b99dfcdc663c8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:49.370883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.454657 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1854/3654] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:49.466258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.469303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.535525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c9550-35f5-49e3-8aef-e3664ff8a21d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.539261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9d039-9b29-4af9-ab32-f5987c24ebb2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.539912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9d039-9b29-4af9-ab32-f5987c24ebb2 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.540186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9d039-9b29-4af9-ab32-f5987c24ebb2 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.540457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9d039-9b29-4af9-ab32-f5987c24ebb2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.550016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9d039-9b29-4af9-ab32-f5987c24ebb2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.551582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9d039-9b29-4af9-ab32-f5987c24ebb2 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.561053 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1801/3655] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:49.667768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.669325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.670555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.671212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.671448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.694843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:49.696701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.776841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88850fff-ccc1-4c8e-ae79-5a6e7c730ba8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.783793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.784697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.784979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.785287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] PATH_INFO: `/v3/projects/8984499dc1d144e6a6f276b3505fa716` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.786596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8984499dc1d144e6a6f276b3505fa716)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:49.788537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:49.789704 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1802/3656] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:49.814684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:49.816385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.851127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8984499dc1d144e6a6f276b3505fa716', 'request_id': 'req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:49.862010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8984499dc1d144e6a6f276b3505fa716', 'request_id': 'req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:49.872739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8984499dc1d144e6a6f276b3505fa716', 'request_id': 'req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:49.884372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] The token cache is being invalidate because project 8984499dc1d144e6a6f276b3505fa716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:49.884870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:49.885831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c26d01d9-b7dd-453b-b5e8-182aa11c8abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:49.887690 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1855/3657] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:49 2022] DELETE /identity/v3/projects/8984499dc1d144e6a6f276b3505fa716 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:49.892497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95597-ec72-40fc-9041-8f44c13b7df5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.892644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95597-ec72-40fc-9041-8f44c13b7df5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.892888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95597-ec72-40fc-9041-8f44c13b7df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.894639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5557c2-298a-4c93-bd16-4b1d18fface9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:49.911651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9dc95597-ec72-40fc-9041-8f44c13b7df5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:49.912881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9dc95597-ec72-40fc-9041-8f44c13b7df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.975647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:49.976368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.976655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.976930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:49.978538 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1856/3658] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:49.979000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:49.986394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ee2db-f825-4e26-b790-63750ba2c7a1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:49.986670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ee2db-f825-4e26-b790-63750ba2c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:49.986947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ee2db-f825-4e26-b790-63750ba2c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.005631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-970ee2db-f825-4e26-b790-63750ba2c7a1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:50.006978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-970ee2db-f825-4e26-b790-63750ba2c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:50.015828 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1857/3659] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:50.020489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ee2db-f825-4e26-b790-63750ba2c7a1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.031787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ee2db-f825-4e26-b790-63750ba2c7a1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.037402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.038276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.038523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.038865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.039803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:50.040109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.041837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.050356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.052045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.062479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1858/3660] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:05:50.063917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.072273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1803/3661] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:05:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:50.079146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626bf8e-ee8a-4f7d-991e-b7538ee1a4ce admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.084396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.085108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.085508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.085785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.086722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.089433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.138817 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1859/3662] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:50 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:50.139885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.165477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b412d-f569-42fd-be30-bbb9e61f62cc service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.271613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.272440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.272809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.273272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.274199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.276231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.299183 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1804/3663] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:50 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:05:50.304398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.315700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c309a-cae3-4c59-8e73-039a5c652dc8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.321646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.322339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.322615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.322914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.323730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.325467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.336959 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1860/3664] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:50.341463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.353340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826a47e-114f-4b76-8b73-a6b02fa98cad admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.359667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c475880-2b16-442e-9bbe-71f51b5a4357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.360895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475880-2b16-442e-9bbe-71f51b5a4357 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.361361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475880-2b16-442e-9bbe-71f51b5a4357 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.362184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475880-2b16-442e-9bbe-71f51b5a4357 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.362394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c475880-2b16-442e-9bbe-71f51b5a4357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.364217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c475880-2b16-442e-9bbe-71f51b5a4357 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.380158 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1805/3665] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:05:50.381504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.392186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e8c5d-7e6d-4ffd-a3bd-ca69bffa9456 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.396782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.397734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.398015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.398299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] PATH_INFO: `/v3/projects/d0441116f4304a50980e38da701e6939/users/430e38b8763e4fdfb3bcb7299699dbb5/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.413952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0441116f4304a50980e38da701e6939, user_id=430e38b8763e4fdfb3bcb7299699dbb5, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.416972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.434819 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1861/3666] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:50 2022] PUT /identity/v3/projects/d0441116f4304a50980e38da701e6939/users/430e38b8763e4fdfb3bcb7299699dbb5/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:50.446181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578bde-0a6d-4af9-b229-7bec01f229b4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.446476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578bde-0a6d-4af9-b229-7bec01f229b4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.446782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578bde-0a6d-4af9-b229-7bec01f229b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.488024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d2578bde-0a6d-4af9-b229-7bec01f229b4 None None] MFA Rules not processed for user `430e38b8763e4fdfb3bcb7299699dbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:50.489342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d2578bde-0a6d-4af9-b229-7bec01f229b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:50.564306 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1806/3667] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:50.579973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.581880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:50.654770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40aab-9b8e-4e1f-b3e2-ba04be998e56 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.660459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462d533-84a8-488f-9e15-ba7a6b3b812c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.661278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462d533-84a8-488f-9e15-ba7a6b3b812c service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.661563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462d533-84a8-488f-9e15-ba7a6b3b812c service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.661842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462d533-84a8-488f-9e15-ba7a6b3b812c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.670374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462d533-84a8-488f-9e15-ba7a6b3b812c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.672017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462d533-84a8-488f-9e15-ba7a6b3b812c service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.681441 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1862/3668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:50.727977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2578bde-0a6d-4af9-b229-7bec01f229b4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.793784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2578bde-0a6d-4af9-b229-7bec01f229b4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:50.798540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:50.799419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.799696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.799961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] PATH_INFO: `/v3/users/430e38b8763e4fdfb3bcb7299699dbb5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.801343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=430e38b8763e4fdfb3bcb7299699dbb5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:50.803089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:50.851873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430e38b8763e4fdfb3bcb7299699dbb5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:50.852620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430e38b8763e4fdfb3bcb7299699dbb5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:50.859582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430e38b8763e4fdfb3bcb7299699dbb5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:50.860289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430e38b8763e4fdfb3bcb7299699dbb5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:50.869474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430e38b8763e4fdfb3bcb7299699dbb5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:50.887774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1807/3669] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:50 2022] DELETE /identity/v3/users/430e38b8763e4fdfb3bcb7299699dbb5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:50.892499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:50.892793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:50.893193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:50.910377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:50.911585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:50.971299 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1863/3670] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:50.981422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:50.983012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:51.047603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4925a-34bc-42f7-8e9f-cb8c4f6e1c10 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.052402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dab65-039b-4bfd-81c8-be2185de3c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:51.053140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dab65-039b-4bfd-81c8-be2185de3c51 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.053422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dab65-039b-4bfd-81c8-be2185de3c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.053691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dab65-039b-4bfd-81c8-be2185de3c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.065833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dab65-039b-4bfd-81c8-be2185de3c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:51.067370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dab65-039b-4bfd-81c8-be2185de3c51 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:51.081139 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1808/3671] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:51.415359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:51.417395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:51.433777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6358c27-9fb9-4176-a917-8296ea496bbd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.440634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:51.450062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.450502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.450788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] PATH_INFO: `/v3/projects/d0441116f4304a50980e38da701e6939` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.452780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0441116f4304a50980e38da701e6939)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:51.454774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:51.516535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0441116f4304a50980e38da701e6939', 'request_id': 'req-4bbfb128-632c-40d1-887f-6bba9dc34c68'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:51.523243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0441116f4304a50980e38da701e6939', 'request_id': 'req-4bbfb128-632c-40d1-887f-6bba9dc34c68'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:51.532129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0441116f4304a50980e38da701e6939', 'request_id': 'req-4bbfb128-632c-40d1-887f-6bba9dc34c68'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:51.545864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] The token cache is being invalidate because project d0441116f4304a50980e38da701e6939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:51.546304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:51.546995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4bbfb128-632c-40d1-887f-6bba9dc34c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:51.550045 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1864/3672] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:51 2022] DELETE /identity/v3/projects/d0441116f4304a50980e38da701e6939 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:51.556102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1cf9-d716-4e98-84ae-4fa033a5c85a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.556476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1cf9-d716-4e98-84ae-4fa033a5c85a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.556812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1cf9-d716-4e98-84ae-4fa033a5c85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.578935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-96ed1cf9-d716-4e98-84ae-4fa033a5c85a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:51.580181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-96ed1cf9-d716-4e98-84ae-4fa033a5c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:51.657226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1809/3673] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:51.665251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30539f-5115-4989-bbf9-e4394a8bb889 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.665536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30539f-5115-4989-bbf9-e4394a8bb889 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.665936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30539f-5115-4989-bbf9-e4394a8bb889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.686017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ed30539f-5115-4989-bbf9-e4394a8bb889 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:51.687931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ed30539f-5115-4989-bbf9-e4394a8bb889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:51.696896 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1865/3674] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:51.701406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1cf9-d716-4e98-84ae-4fa033a5c85a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:51.713068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1cf9-d716-4e98-84ae-4fa033a5c85a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.723128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:51.723648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.723927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.724199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.724933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:51.725260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:51.726941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:51.740433 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1810/3675] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:05:51.744921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30539f-5115-4989-bbf9-e4394a8bb889 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:51.755032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30539f-5115-4989-bbf9-e4394a8bb889 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.760168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:51.761089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.762130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.762411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.763258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:51.765460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:51.801363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1866/3676] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:51 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:05:51.802944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:51.814110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef590d4-4231-4554-9afa-b0a891176be5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.872978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:51.875079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.875359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.875982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.876325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:51.878307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:51.907448 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1811/3677] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:05:51 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:05:51.911810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:51.926069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd826f6-5af6-41ac-975a-92ad121cd773 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.931437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:51.932113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.932388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.932655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.933610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:51.935253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:51.947140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1867/3678] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:05:51.951197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:51.961775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e431b5d-d3da-4e20-919a-202152ab2722 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.966769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb6a47-b8ca-4dc1-be26-f34642c28ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:51.967550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb6a47-b8ca-4dc1-be26-f34642c28ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:51.967932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb6a47-b8ca-4dc1-be26-f34642c28ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:51.968247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb6a47-b8ca-4dc1-be26-f34642c28ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:51.969094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb6a47-b8ca-4dc1-be26-f34642c28ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:51.970752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb6a47-b8ca-4dc1-be26-f34642c28ed5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:51.980629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1812/3679] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:05:51.984883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:51.994892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3afcb-47b0-4f2b-8e3c-833d594795d4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:51.999496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:52.000385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:52.000658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:52.000925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] PATH_INFO: `/v3/projects/b4603cd745c848eba3a1645f624e590e/users/0f54a88615644f5da8173e9bade66599/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:52.015202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4603cd745c848eba3a1645f624e590e, user_id=0f54a88615644f5da8173e9bade66599, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:52.018047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:52.032352 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1868/3680] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:05:51 2022] PUT /identity/v3/projects/b4603cd745c848eba3a1645f624e590e/users/0f54a88615644f5da8173e9bade66599/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:52.037280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51580a-f23f-49c5-8216-0cafd6413e84 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:52.037570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51580a-f23f-49c5-8216-0cafd6413e84 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:52.037849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51580a-f23f-49c5-8216-0cafd6413e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:52.055752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7a51580a-f23f-49c5-8216-0cafd6413e84 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:52.056992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7a51580a-f23f-49c5-8216-0cafd6413e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:52.116611 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1813/3681] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:52.126794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:52.128728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:52.188140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d530ac9-0fd7-42db-afa1-9b169957bdef admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:52.191931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea39d8f-d233-465a-a158-8f7e3415b3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:52.192684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39d8f-d233-465a-a158-8f7e3415b3be service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:52.192862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39d8f-d233-465a-a158-8f7e3415b3be service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:52.193172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39d8f-d233-465a-a158-8f7e3415b3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:52.202950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea39d8f-d233-465a-a158-8f7e3415b3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:52.204406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea39d8f-d233-465a-a158-8f7e3415b3be service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:52.214440 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1869/3682] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:56.787300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564398d-cd15-443a-a086-6fecb9d409c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:56.787771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564398d-cd15-443a-a086-6fecb9d409c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:56.787939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564398d-cd15-443a-a086-6fecb9d409c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:56.817785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8564398d-cd15-443a-a086-6fecb9d409c0 None None] MFA Rules not processed for user `f1b45ff3203a45609c6a2a57b3004dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:56.819406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8564398d-cd15-443a-a086-6fecb9d409c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:56.932104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1814/3683] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:56.946318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:56.946751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:56.946913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:56.971500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:56.972921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:56.986126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5539-59ee-483c-9e22-f3f0941d63c2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:56.986548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5539-59ee-483c-9e22-f3f0941d63c2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:56.987054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5539-59ee-483c-9e22-f3f0941d63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:57.015076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6dbd5539-59ee-483c-9e22-f3f0941d63c2 None None] MFA Rules not processed for user `f1b45ff3203a45609c6a2a57b3004dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:57.016580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6dbd5539-59ee-483c-9e22-f3f0941d63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:57.028088 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1815/3684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:57.051641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6c77-de7f-41b4-9db2-bd2f2be1a3fb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:57.051960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6c77-de7f-41b4-9db2-bd2f2be1a3fb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:57.052220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6c77-de7f-41b4-9db2-bd2f2be1a3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:57.066444 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1870/3685] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:57.072131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b30f6c77-de7f-41b4-9db2-bd2f2be1a3fb None None] MFA Rules not processed for user `f1b45ff3203a45609c6a2a57b3004dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:57.073383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b30f6c77-de7f-41b4-9db2-bd2f2be1a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:57.082974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:57.084541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:57.085573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1816/3686] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:57.107465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9e16-8b7b-4ea1-be3a-6d907e37f831 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:57.107753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9e16-8b7b-4ea1-be3a-6d907e37f831 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:57.108215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9e16-8b7b-4ea1-be3a-6d907e37f831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:57.128790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-47ef9e16-8b7b-4ea1-be3a-6d907e37f831 None None] MFA Rules not processed for user `f1b45ff3203a45609c6a2a57b3004dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:57.130472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-47ef9e16-8b7b-4ea1-be3a-6d907e37f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:57.147179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1817/3687] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:57.170426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:57.171252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:57.171535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:57.190567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] MFA Rules not processed for user `f1b45ff3203a45609c6a2a57b3004dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:57.191805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:57.201318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1818/3688] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:57.214332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213355-1b3a-4310-bf44-3b1c6db51c12 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:57.222410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fcdc6-3416-4402-ab3c-a46337b43c07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:57.223200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fcdc6-3416-4402-ab3c-a46337b43c07 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:57.223825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fcdc6-3416-4402-ab3c-a46337b43c07 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:57.224162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fcdc6-3416-4402-ab3c-a46337b43c07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:57.240700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fcdc6-3416-4402-ab3c-a46337b43c07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:57.242570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fcdc6-3416-4402-ab3c-a46337b43c07 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:57.254290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1871/3689] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:05:57.485807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:57.487517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:57.506199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a817fa-401b-49fa-aee4-1ca383479994 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:57.511871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:57.512973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:57.513540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:57.513905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] PATH_INFO: `/v3/users/51e0eda090fe47abb90b99dfcdc663c8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:57.519423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e0eda090fe47abb90b99dfcdc663c8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:57.523728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:57.633332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e0eda090fe47abb90b99dfcdc663c8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:57.639134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e0eda090fe47abb90b99dfcdc663c8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:57.657570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e0eda090fe47abb90b99dfcdc663c8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:57.658479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e0eda090fe47abb90b99dfcdc663c8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:57.691145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e0eda090fe47abb90b99dfcdc663c8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:57.720669 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1819/3690] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:05:57 2022] DELETE /identity/v3/users/51e0eda090fe47abb90b99dfcdc663c8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:57.722097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9680421-e5be-4599-b495-d5bbb92c591e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:57.722409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9680421-e5be-4599-b495-d5bbb92c591e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:57.723092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9680421-e5be-4599-b495-d5bbb92c591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:57.759406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d9680421-e5be-4599-b495-d5bbb92c591e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:57.764803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d9680421-e5be-4599-b495-d5bbb92c591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:57.879217 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1872/3691] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:05:57.906791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:57.909673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:58.068654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:58.069217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:58.069376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:58.100343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce74db2-214b-4f80-b67a-b48ac98a328b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:58.109650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f5a9d-87a6-4880-b614-f9bb93a1f2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:58.110675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5a9d-87a6-4880-b614-f9bb93a1f2da service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:58.111063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5a9d-87a6-4880-b614-f9bb93a1f2da service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:58.111480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5a9d-87a6-4880-b614-f9bb93a1f2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:58.126987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f5a9d-87a6-4880-b614-f9bb93a1f2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:58.127300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] MFA Rules not processed for user `0f54a88615644f5da8173e9bade66599`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:58.129205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f5a9d-87a6-4880-b614-f9bb93a1f2da service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:58.130497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:58.142469 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1820/3692] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:58.165977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:58.166747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:58.167995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:58.234675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:58.236302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:58.252987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1873/3693] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:58.270760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:58.272268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:58.357632 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1821/3694] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:58.367112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:58.368622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:58.402873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5deb35-b9b8-4002-94c0-13b0bcf2d4c1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:58.411821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:58.412848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:58.412848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:58.413188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:58.424360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:58.426805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:58.452184 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1874/3695] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:05:58.509857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c7fe-89b0-41eb-a1e4-84ab16b97f6b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:58.515565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc4083-941c-4296-8975-4204f6c3dc2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:58.516188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc4083-941c-4296-8975-4204f6c3dc2a service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:58.516518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc4083-941c-4296-8975-4204f6c3dc2a service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:58.516793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc4083-941c-4296-8975-4204f6c3dc2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:58.526782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc4083-941c-4296-8975-4204f6c3dc2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:58.529255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc4083-941c-4296-8975-4204f6c3dc2a service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:58.539760 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1822/3696] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:05:59.238258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:59.238258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:59.261928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b65904-07e2-44f1-858c-aac71bb3e3fb service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:59.280696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:59.284970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:59.285312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:59.285590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] PATH_INFO: `/v3/projects/521149a43ad4462a915b38310df08c37` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:59.291338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521149a43ad4462a915b38310df08c37)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:59.293320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:59.419957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521149a43ad4462a915b38310df08c37', 'request_id': 'req-6b65eeb2-15ce-459b-9192-883f94be66e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:59.444358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521149a43ad4462a915b38310df08c37', 'request_id': 'req-6b65eeb2-15ce-459b-9192-883f94be66e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:59.469227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521149a43ad4462a915b38310df08c37', 'request_id': 'req-6b65eeb2-15ce-459b-9192-883f94be66e0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:59.495343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] The token cache is being invalidate because project 521149a43ad4462a915b38310df08c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:05:59.495625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:59.496229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b65eeb2-15ce-459b-9192-883f94be66e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:05:59.497917 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1875/3697] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:59 2022] DELETE /identity/v3/projects/521149a43ad4462a915b38310df08c37 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:05:59.503606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a0dc-b734-4bcd-a95b-552bf32060cb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:59.504570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a0dc-b734-4bcd-a95b-552bf32060cb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:59.505593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a0dc-b734-4bcd-a95b-552bf32060cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:59.545771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3634a0dc-b734-4bcd-a95b-552bf32060cb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:59.547251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3634a0dc-b734-4bcd-a95b-552bf32060cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:59.677000 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1823/3698] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:59.685015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234839f-97ae-4c01-bb92-4e8e266a8c0e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:59.685533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234839f-97ae-4c01-bb92-4e8e266a8c0e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:59.685964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234839f-97ae-4c01-bb92-4e8e266a8c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:59.727701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2234839f-97ae-4c01-bb92-4e8e266a8c0e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:05:59.730120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2234839f-97ae-4c01-bb92-4e8e266a8c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:05:59.766719 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1876/3699] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:05:59.767726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a0dc-b734-4bcd-a95b-552bf32060cb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:59.778524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a0dc-b734-4bcd-a95b-552bf32060cb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:59.796775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:59.800398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:59.800678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:59.800958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:59.801794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:05:59.802097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:59.814595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:05:59.872585 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1824/3700] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:05:59.878162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234839f-97ae-4c01-bb92-4e8e266a8c0e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:05:59.894484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234839f-97ae-4c01-bb92-4e8e266a8c0e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:05:59.910790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:05:59.911786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:05:59.915630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:05:59.916464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:05:59.917400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:05:59.921095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:00.002155 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1877/3701] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:05:59 2022] POST /identity/v3/projects => generated 395 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:00.003529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:00.021811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9407-bbc0-430e-9ede-dd6b28056676 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:00.166728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:00.167456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:00.167742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:00.168020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:00.168731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:00.173908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:00.226298 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1825/3702] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:06:00 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:06:00.230699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:00.249356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4c88-1b98-4b3c-8fe0-2ebb631ef233 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:00.262317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:00.263029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:00.263376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:00.263652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:00.264388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:00.267925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:00.323817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:00.324266 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1878/3703] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:00.358378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9b0c8-aaac-49b1-a861-d2330c96ef76 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:00.376478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5307c4f-eec1-445f-9687-31ae563d7078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:00.377432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5307c4f-eec1-445f-9687-31ae563d7078 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:00.386111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5307c4f-eec1-445f-9687-31ae563d7078 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:00.386664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5307c4f-eec1-445f-9687-31ae563d7078 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:00.389749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5307c4f-eec1-445f-9687-31ae563d7078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:00.391625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5307c4f-eec1-445f-9687-31ae563d7078 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:00.436336 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1826/3704] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:00.438033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:00.452539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c06e-051e-42b2-b687-f76540799ae6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:00.473405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:00.474348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:00.474632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:00.474913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] PATH_INFO: `/v3/projects/3412c8ffd9dd4f7f8040580d1fcb4a7b/users/2ecd603dff7a4691938715928c4bd522/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:00.525490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3412c8ffd9dd4f7f8040580d1fcb4a7b, user_id=2ecd603dff7a4691938715928c4bd522, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:00.530701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:00.562577 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1879/3705] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:06:00 2022] PUT /identity/v3/projects/3412c8ffd9dd4f7f8040580d1fcb4a7b/users/2ecd603dff7a4691938715928c4bd522/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:00.573085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac1383-c4a8-4ee6-80b8-b7d212e0141f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:00.574115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac1383-c4a8-4ee6-80b8-b7d212e0141f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:00.574556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac1383-c4a8-4ee6-80b8-b7d212e0141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:00.641055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-99ac1383-c4a8-4ee6-80b8-b7d212e0141f None None] MFA Rules not processed for user `2ecd603dff7a4691938715928c4bd522`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:00.643876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-99ac1383-c4a8-4ee6-80b8-b7d212e0141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:00.812261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1827/3706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:01.236072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:01.238346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:01.238493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77440e6-2c69-44a7-8715-23351b18e244 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:01.238715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77440e6-2c69-44a7-8715-23351b18e244 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:01.238916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77440e6-2c69-44a7-8715-23351b18e244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:01.287733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e77440e6-2c69-44a7-8715-23351b18e244 None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:01.293092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e77440e6-2c69-44a7-8715-23351b18e244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:01.335789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45690-7f31-49cb-8140-56f00793d7c8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:01.343662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2771f-6bae-4964-95f8-e99e6ec848bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:01.344507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2771f-6bae-4964-95f8-e99e6ec848bc service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:01.344843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2771f-6bae-4964-95f8-e99e6ec848bc service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:01.345156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2771f-6bae-4964-95f8-e99e6ec848bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:01.379793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2771f-6bae-4964-95f8-e99e6ec848bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:01.385093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2771f-6bae-4964-95f8-e99e6ec848bc service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:01.419567 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1880/3707] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:01.447756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1828/3708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:06:01.689864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53df3-70c9-454e-9787-4f1acf977822 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:01.690554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53df3-70c9-454e-9787-4f1acf977822 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:01.691065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53df3-70c9-454e-9787-4f1acf977822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:01.730540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-35a53df3-70c9-454e-9787-4f1acf977822 None None] MFA Rules not processed for user `0f54a88615644f5da8173e9bade66599`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:01.732406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35a53df3-70c9-454e-9787-4f1acf977822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:01.846728 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1881/3709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:03.443461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77440e6-2c69-44a7-8715-23351b18e244 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:03.686685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77440e6-2c69-44a7-8715-23351b18e244 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:03.701570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:03.703775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:03.707104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:03.709325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] PATH_INFO: `/v3/users/2ecd603dff7a4691938715928c4bd522` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:03.714287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecd603dff7a4691938715928c4bd522)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:03.718310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:03.817018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecd603dff7a4691938715928c4bd522'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:03.818962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecd603dff7a4691938715928c4bd522'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:03.838248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecd603dff7a4691938715928c4bd522'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:03.839874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecd603dff7a4691938715928c4bd522'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:03.864957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecd603dff7a4691938715928c4bd522'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:03.906463 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1829/3710] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:06:03 2022] DELETE /identity/v3/users/2ecd603dff7a4691938715928c4bd522 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:03.908399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:03.908848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:03.909240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:03.934183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:03.935774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:04.017734 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1882/3711] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:04.032110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:04.034100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:04.233345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d072-54c1-409d-9b78-a35e0233bd33 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:04.249824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:04.251321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:04.253804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:04.255017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:04.284814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:04.287699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:04.328902 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1830/3712] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:05.686517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:05.688825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:05.707786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232611ea-e984-4352-82eb-0a677b2fb3fe None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:05.715072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:05.716538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:05.716959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:05.717423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] PATH_INFO: `/v3/users/f1b45ff3203a45609c6a2a57b3004dd3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:05.720537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b45ff3203a45609c6a2a57b3004dd3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:05.723129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:05.802870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:05.806955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:05.839236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ec523-9ba0-47e4-967e-34657bd3b334 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:05.852675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:05.854165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:05.854677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:05.855159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] PATH_INFO: `/v3/projects/3412c8ffd9dd4f7f8040580d1fcb4a7b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:05.856940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b45ff3203a45609c6a2a57b3004dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:05.857999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b45ff3203a45609c6a2a57b3004dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:05.868389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3412c8ffd9dd4f7f8040580d1fcb4a7b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:05.879444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b45ff3203a45609c6a2a57b3004dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:05.880069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:05.901682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b45ff3203a45609c6a2a57b3004dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:05.902849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b91df265-864f-40c6-b882-e5ec8b25aeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b45ff3203a45609c6a2a57b3004dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:05.968144 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1883/3713] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:06:05 2022] DELETE /identity/v3/users/f1b45ff3203a45609c6a2a57b3004dd3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:06.039775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3412c8ffd9dd4f7f8040580d1fcb4a7b', 'request_id': 'req-942c195b-95f5-4eac-9b54-1f97843cc444'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.058765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3412c8ffd9dd4f7f8040580d1fcb4a7b', 'request_id': 'req-942c195b-95f5-4eac-9b54-1f97843cc444'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.084241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3412c8ffd9dd4f7f8040580d1fcb4a7b', 'request_id': 'req-942c195b-95f5-4eac-9b54-1f97843cc444'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.125797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] The token cache is being invalidate because project 3412c8ffd9dd4f7f8040580d1fcb4a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:06:06.126089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.127145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-942c195b-95f5-4eac-9b54-1f97843cc444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.140553 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1831/3714] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:05 2022] DELETE /identity/v3/projects/3412c8ffd9dd4f7f8040580d1fcb4a7b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:06.142299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c53cb-2477-45b4-b921-c46a04256c29 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.142787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c53cb-2477-45b4-b921-c46a04256c29 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.143280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c53cb-2477-45b4-b921-c46a04256c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.190095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-735c53cb-2477-45b4-b921-c46a04256c29 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:06.191530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-735c53cb-2477-45b4-b921-c46a04256c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:06.268005 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1884/3715] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:06:06.277439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.277734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.278015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.311998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:06.313382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:06.331946 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1832/3716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:06.340329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c53cb-2477-45b4-b921-c46a04256c29 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.366646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c53cb-2477-45b4-b921-c46a04256c29 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:06.374856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.376278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:06.399029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74dc30-e585-44a2-998a-f5abc9ab62a5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:06.406420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:06.407997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.408116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.408387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.409556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:06:06.409868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:06.417948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:06.423340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:06.424244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.424525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.424794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] PATH_INFO: `/v3/projects/f502d4df1e734e299d496111206e0bf0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.426848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f502d4df1e734e299d496111206e0bf0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:06.440835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:06.473100 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1885/3717] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:06:06.474117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.500598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcd89f-f2bc-4fc3-b129-6c49ac94b6f9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:06.529744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:06.530441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.531514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.531863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.532565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:06.550814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:06.605571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f502d4df1e734e299d496111206e0bf0', 'request_id': 'req-5d79ba9d-ed70-4c13-8f28-6863d93425b8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.617674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f502d4df1e734e299d496111206e0bf0', 'request_id': 'req-5d79ba9d-ed70-4c13-8f28-6863d93425b8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.631340 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1886/3718] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:06:06 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:06.632292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.647931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f502d4df1e734e299d496111206e0bf0', 'request_id': 'req-5d79ba9d-ed70-4c13-8f28-6863d93425b8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.673625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] The token cache is being invalidate because project f502d4df1e734e299d496111206e0bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:06:06.674081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.675495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5d79ba9d-ed70-4c13-8f28-6863d93425b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:06.682851 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1833/3719] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:06 2022] DELETE /identity/v3/projects/f502d4df1e734e299d496111206e0bf0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:06:06.690547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe9b2-fc88-4928-bd19-438023af5cd4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.690977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe9b2-fc88-4928-bd19-438023af5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.691348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe9b2-fc88-4928-bd19-438023af5cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.722663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ffffe9b2-fc88-4928-bd19-438023af5cd4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:06.725658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ffffe9b2-fc88-4928-bd19-438023af5cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:06.751021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece451e-ccd2-4793-a539-e9ee343fb328 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:06.757327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:06.758427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.758862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.759288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.760278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:06.762729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:06.803569 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1887/3720] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:06:06 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:06.805277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.808619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:06.848151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38166812-803a-4f0e-be91-779d9b8186c5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:06.865461 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1834/3721] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:06.866000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:06.866000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.866000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.866000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.866331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:06.866331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:06.872717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e32b-902e-45be-9e50-fec0211379e8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.873395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e32b-902e-45be-9e50-fec0211379e8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.873751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e32b-902e-45be-9e50-fec0211379e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.894400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1888/3722] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:06.905490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.916263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d484e32b-902e-45be-9e50-fec0211379e8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:06.920171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d484e32b-902e-45be-9e50-fec0211379e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:06.921925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f90e7-021e-4468-8174-df6b235ea96f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:06.929244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:06.930064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:06.930455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:06.931120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:06.933137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:06.933940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:06.944651 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1835/3723] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:06.954043 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1889/3724] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:06.967215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.968616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e32b-902e-45be-9e50-fec0211379e8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:06.989332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e32b-902e-45be-9e50-fec0211379e8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:06.995175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d9f7-2da4-47ab-993d-995ed5f978c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.002663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.003451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.003735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.004019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.005432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:06:07.005745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.007521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.011097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2ec92-e188-4877-80ac-213a415e1523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.012272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ec92-e188-4877-80ac-213a415e1523 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.012705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ec92-e188-4877-80ac-213a415e1523 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.014889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ec92-e188-4877-80ac-213a415e1523 admin admin] PATH_INFO: `/v3/projects/c8db9d188edc4c1fb6fb85e81e8dba79/users/4bc27b3989d24806b90e581b5f605288/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.050730 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1836/3725] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:06:07.052930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2ec92-e188-4877-80ac-213a415e1523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8db9d188edc4c1fb6fb85e81e8dba79, user_id=4bc27b3989d24806b90e581b5f605288, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.054249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:07.057983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2ec92-e188-4877-80ac-213a415e1523 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.074929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f875b-066f-435a-b2ef-5e043ef8dbb8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.103507 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1890/3726] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:06:06 2022] PUT /identity/v3/projects/c8db9d188edc4c1fb6fb85e81e8dba79/users/4bc27b3989d24806b90e581b5f605288/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:07.108932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ec9f-752a-4921-b2b5-11da802d2694 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.109489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ec9f-752a-4921-b2b5-11da802d2694 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.109864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ec9f-752a-4921-b2b5-11da802d2694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.112024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.112714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.112996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.113327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.114191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.118738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.178456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5093ec9f-752a-4921-b2b5-11da802d2694 None None] MFA Rules not processed for user `4bc27b3989d24806b90e581b5f605288`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:07.179847 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1837/3727] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:06:07 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:07.180880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5093ec9f-752a-4921-b2b5-11da802d2694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:07.186713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:07.270984 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1891/3728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:07.282576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221324-c170-4afe-afce-39019bff480c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.283095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221324-c170-4afe-afce-39019bff480c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.283566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221324-c170-4afe-afce-39019bff480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.312896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-09221324-c170-4afe-afce-39019bff480c None None] MFA Rules not processed for user `4bc27b3989d24806b90e581b5f605288`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:07.315510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-09221324-c170-4afe-afce-39019bff480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:07.317633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7bb3b-c07f-496b-ba79-01ba37be2819 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.324492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.325349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.325649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.325935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.326984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.327457 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1892/3729] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:07.336847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.364037 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1838/3730] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:06:07 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:07.368356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221324-c170-4afe-afce-39019bff480c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:07.382727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221324-c170-4afe-afce-39019bff480c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.394091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.394787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.395090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.395341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.396141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.398269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.409714 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1893/3731] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:07.414102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:07.424987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9c96-220e-4fd3-a663-c3c9399ed49e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.429966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb254e1-6763-488c-8545-40de14955a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.430659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb254e1-6763-488c-8545-40de14955a30 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.430940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb254e1-6763-488c-8545-40de14955a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.431215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb254e1-6763-488c-8545-40de14955a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.431959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb254e1-6763-488c-8545-40de14955a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.433956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb254e1-6763-488c-8545-40de14955a30 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.454525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:07.457159 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1839/3732] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:07.468064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b919f44-1ae0-4cf9-87f1-39f732786662 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.474473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.475965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.476325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.476781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] PATH_INFO: `/v3/projects/3e27519c6c114724bf36126f0362a7c0/users/cdab30a578b947068144a0509c85eb0c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.499595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e27519c6c114724bf36126f0362a7c0, user_id=cdab30a578b947068144a0509c85eb0c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.502695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.538922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.539231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.540313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.540426 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1894/3733] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:06:07 2022] PUT /identity/v3/projects/3e27519c6c114724bf36126f0362a7c0/users/cdab30a578b947068144a0509c85eb0c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:07.571179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:07.573244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:07.636396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:07.638913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:07.726588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1840/3734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:06:07.738993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:07.741870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:07.798368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071938c-c2a3-4812-9e76-baf9650107e8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.816900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b04f22-60da-4188-bc69-b6fc42f5391c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.817618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b04f22-60da-4188-bc69-b6fc42f5391c service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.818359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b04f22-60da-4188-bc69-b6fc42f5391c service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.818819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b04f22-60da-4188-bc69-b6fc42f5391c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.842629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f454d4-4cac-495f-bf4f-7be3d33c93ad None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:07.846744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:07.847411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:07.848183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:07.848465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:07.860560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.862213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.874349 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1841/3735] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:06:07.924142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b04f22-60da-4188-bc69-b6fc42f5391c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:07.926344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b04f22-60da-4188-bc69-b6fc42f5391c service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:07.959270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1895/3736] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:06:08.060302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:08.061778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:08.081919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea3c99-c352-4bd1-88cf-1a455843c73b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:08.092855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7b4a0-9d10-412e-a276-ea04d85dbfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:08.094480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7b4a0-9d10-412e-a276-ea04d85dbfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:08.097205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7b4a0-9d10-412e-a276-ea04d85dbfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:08.098303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7b4a0-9d10-412e-a276-ea04d85dbfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:08.105909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62d7b4a0-9d10-412e-a276-ea04d85dbfa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:08.130938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7b4a0-9d10-412e-a276-ea04d85dbfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:08.133557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7b4a0-9d10-412e-a276-ea04d85dbfa9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:08.170887 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1842/3737] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:08.884259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d15f3-6ab3-45c9-b77b-d775879c8807 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:08.884826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d15f3-6ab3-45c9-b77b-d775879c8807 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:08.884826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d15f3-6ab3-45c9-b77b-d775879c8807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:08.943237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f40d15f3-6ab3-45c9-b77b-d775879c8807 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:08.944429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f40d15f3-6ab3-45c9-b77b-d775879c8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:09.091745 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1896/3738] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:09.108666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8909d9-810a-4550-ab5f-761f649200ef None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:09.109271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8909d9-810a-4550-ab5f-761f649200ef None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:09.109849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8909d9-810a-4550-ab5f-761f649200ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:09.155330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4e8909d9-810a-4550-ab5f-761f649200ef None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:09.156931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4e8909d9-810a-4550-ab5f-761f649200ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:09.204391 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1843/3739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:10.405668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:10.406233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:10.406324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:10.457747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] MFA Rules not processed for user `121a5a2fcd9f4420885f2a78c1dfc339`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:10.459093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:10.538101 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1897/3740] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:10.555785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8909d9-810a-4550-ab5f-761f649200ef None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:10.571909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8909d9-810a-4550-ab5f-761f649200ef None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:10.579834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:10.581143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:10.581604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:10.582054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:10.599741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:10.601747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:10.648580 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1844/3741] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:14.927068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:14.929155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:14.955724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c7ba8-98f7-42d7-b9fa-909dbdcf9643 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:14.971612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:14.972382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:14.972916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:14.982429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:14.985987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:15.011319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:15.013413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:15.038847 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1898/3742] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:21.583636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:21.586067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:21.606394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfaf0f-9db4-4086-9d36-ee424d0b43ce service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:21.640506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:21.642298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:21.642795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:21.652190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] PATH_INFO: `/v3/users/fbb1a0d6db7847aa851d3f8244c998c7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:21.653700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb1a0d6db7847aa851d3f8244c998c7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:21.656635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:21.781206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb1a0d6db7847aa851d3f8244c998c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:21.784441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb1a0d6db7847aa851d3f8244c998c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:21.798557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb1a0d6db7847aa851d3f8244c998c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:21.799396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb1a0d6db7847aa851d3f8244c998c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:21.810791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-79b773b1-edea-4bc9-87bb-e12bda45b835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb1a0d6db7847aa851d3f8244c998c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:21.842919 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1845/3743] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:06:21 2022] DELETE /identity/v3/users/fbb1a0d6db7847aa851d3f8244c998c7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:22.528677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:22.539696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57620948-4c67-4f9b-8d88-3b87827f9219 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:22.603747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:22.604676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:22.605249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:22.605529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] PATH_INFO: `/v3/projects/48b917a437e7432bbfc884a1067fdfaa` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:22.606819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b917a437e7432bbfc884a1067fdfaa)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:22.618332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:22.674839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b917a437e7432bbfc884a1067fdfaa', 'request_id': 'req-fdb04105-bb90-4200-95fb-99f32e7b5a62'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:22.681955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b917a437e7432bbfc884a1067fdfaa', 'request_id': 'req-fdb04105-bb90-4200-95fb-99f32e7b5a62'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:22.691730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b917a437e7432bbfc884a1067fdfaa', 'request_id': 'req-fdb04105-bb90-4200-95fb-99f32e7b5a62'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:22.704146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] The token cache is being invalidate because project 48b917a437e7432bbfc884a1067fdfaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:06:22.704427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:22.705250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fdb04105-bb90-4200-95fb-99f32e7b5a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:22.710574 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1899/3744] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:22 2022] DELETE /identity/v3/projects/48b917a437e7432bbfc884a1067fdfaa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:22.712330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8042c-06b4-4117-aa24-f739d199d009 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:22.712839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8042c-06b4-4117-aa24-f739d199d009 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:22.712953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8042c-06b4-4117-aa24-f739d199d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:22.731592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4cd8042c-06b4-4117-aa24-f739d199d009 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:22.732794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4cd8042c-06b4-4117-aa24-f739d199d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:22.795878 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1846/3745] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:22.803871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743add3-bfe6-41d8-997b-6920ce05fddf None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:22.804163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743add3-bfe6-41d8-997b-6920ce05fddf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:22.804438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743add3-bfe6-41d8-997b-6920ce05fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:22.826747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3743add3-bfe6-41d8-997b-6920ce05fddf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:22.828407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3743add3-bfe6-41d8-997b-6920ce05fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:22.836530 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1900/3746] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:22.841503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8042c-06b4-4117-aa24-f739d199d009 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:22.852495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8042c-06b4-4117-aa24-f739d199d009 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:22.857730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:22.858592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:22.859021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:22.859467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:22.860549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:06:22.860941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:22.862728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:22.876615 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1847/3747] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:06:22.881418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743add3-bfe6-41d8-997b-6920ce05fddf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:22.891387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743add3-bfe6-41d8-997b-6920ce05fddf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:22.896318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:22.897158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:22.897444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:22.897778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:22.898540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:22.900580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:22.927743 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1901/3748] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:06:22 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:06:22.932072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:22.942353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5488c24-d48d-48f4-9de5-3a8ce2136c79 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:22.999460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:23.000140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:23.000420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:23.000718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:23.001422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:23.003474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:23.044280 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1848/3749] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:06:22 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:23.048653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:23.059532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff1594-cd67-4e11-9a2c-4526afc543a7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:23.064277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:23.064965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:23.065357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:23.065628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:23.066376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:23.068030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:23.080089 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1902/3750] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:23.082839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:23.093276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d70d23-02bc-4254-8d3f-253212beae57 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:23.101539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0b576-805e-4a32-ba37-52de15bddcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:23.101539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b576-805e-4a32-ba37-52de15bddcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:23.101539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b576-805e-4a32-ba37-52de15bddcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:23.101539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b576-805e-4a32-ba37-52de15bddcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:23.101933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0b576-805e-4a32-ba37-52de15bddcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:23.101933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0b576-805e-4a32-ba37-52de15bddcd1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:23.113624 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1849/3751] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:23.117731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:23.127882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa52f8-6ac7-452e-b56c-56c3366d4446 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:23.132442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:23.133374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:23.133654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:23.133926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] PATH_INFO: `/v3/projects/be8cef49b0454f9bb34f7d52b7918a6c/users/8844e9ec7bb34861aa23f38af40da479/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:23.148385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8cef49b0454f9bb34f7d52b7918a6c, user_id=8844e9ec7bb34861aa23f38af40da479, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:23.151620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:23.165990 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1903/3752] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:06:23 2022] PUT /identity/v3/projects/be8cef49b0454f9bb34f7d52b7918a6c/users/8844e9ec7bb34861aa23f38af40da479/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:23.171322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12104bc3-f9b1-4e55-97db-984fb846e2e8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:23.171613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12104bc3-f9b1-4e55-97db-984fb846e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:23.171890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12104bc3-f9b1-4e55-97db-984fb846e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:23.189909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-12104bc3-f9b1-4e55-97db-984fb846e2e8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:23.191267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12104bc3-f9b1-4e55-97db-984fb846e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:23.257843 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1850/3753] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:23.270306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:23.272255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:23.352782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634a21-79a9-467f-99e7-53cdaca2c0e3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:23.356342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:23.356995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:23.357785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:23.358061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:23.373631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:23.375138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:23.387465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1904/3754] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:06:28.802331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce7e7-dca0-470e-ac86-43ec6212ae87 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:28.803392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce7e7-dca0-470e-ac86-43ec6212ae87 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:28.804109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce7e7-dca0-470e-ac86-43ec6212ae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:28.833126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-339ce7e7-dca0-470e-ac86-43ec6212ae87 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:28.836339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-339ce7e7-dca0-470e-ac86-43ec6212ae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:28.929396 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1851/3755] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:28.944896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:28.946453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:29.071326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ff76-797b-489a-a0dd-3bec653baa18 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:29.105331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc54f35-cac5-474e-b81d-55c1155be3ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:29.106403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54f35-cac5-474e-b81d-55c1155be3ea service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:29.106885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54f35-cac5-474e-b81d-55c1155be3ea service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:29.107384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54f35-cac5-474e-b81d-55c1155be3ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:29.133682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc54f35-cac5-474e-b81d-55c1155be3ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:29.135814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc54f35-cac5-474e-b81d-55c1155be3ea service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:29.156881 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1905/3756] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:06:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:30.334755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1ce29-6781-4491-9ee0-7154d9b6c499 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:30.335246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1ce29-6781-4491-9ee0-7154d9b6c499 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:30.335489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1ce29-6781-4491-9ee0-7154d9b6c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:30.347215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aad1d-c17a-4ae0-87df-fb0ce9d58c0b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:30.347710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aad1d-c17a-4ae0-87df-fb0ce9d58c0b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:30.347968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aad1d-c17a-4ae0-87df-fb0ce9d58c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:30.384108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e40aad1d-c17a-4ae0-87df-fb0ce9d58c0b None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:30.386005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e40aad1d-c17a-4ae0-87df-fb0ce9d58c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:30.403401 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1906/3757] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 09 21:06:30.416559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-95b1ce29-6781-4491-9ee0-7154d9b6c499 None None] MFA Rules not processed for user `8844e9ec7bb34861aa23f38af40da479`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:30.417967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95b1ce29-6781-4491-9ee0-7154d9b6c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:30.418159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aad1d-c17a-4ae0-87df-fb0ce9d58c0b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:30.438700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aad1d-c17a-4ae0-87df-fb0ce9d58c0b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:30.460083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:30.461004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:30.461421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:30.462104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:30.484893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:30.486871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:30.507281 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1907/3758] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:06:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:06:30.538682 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1852/3759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:31.142101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:31.143886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:31.229373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb34f2-0025-418d-bfbf-eb23fbdfc96f service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:31.235881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:31.236587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:31.237066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:31.237496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:31.253456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:31.255550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:31.276503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1908/3760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:31.743505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc5749-ab49-4f13-837f-7647827d4cc2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:31.745800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc5749-ab49-4f13-837f-7647827d4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:31.748483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc5749-ab49-4f13-837f-7647827d4cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:31.812423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8edc5749-ab49-4f13-837f-7647827d4cc2 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:31.818813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8edc5749-ab49-4f13-837f-7647827d4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:31.834803 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1853/3761] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:31.851063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:31.870085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ff0cf-7f45-4717-9892-8626a8da2075 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:31.878942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d797ec-98ee-4395-820b-a6895aeb878a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:31.884268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d797ec-98ee-4395-820b-a6895aeb878a service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:31.884836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d797ec-98ee-4395-820b-a6895aeb878a service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:31.885305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d797ec-98ee-4395-820b-a6895aeb878a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:31.909517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d797ec-98ee-4395-820b-a6895aeb878a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:31.912180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d797ec-98ee-4395-820b-a6895aeb878a service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:31.956214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1909/3762] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:06:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:06:33.600634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ade4-c143-4771-81f1-02bc30198ffd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:33.601724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ade4-c143-4771-81f1-02bc30198ffd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:33.602191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ade4-c143-4771-81f1-02bc30198ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:33.649906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1c47ade4-c143-4771-81f1-02bc30198ffd None None] MFA Rules not processed for user `8844e9ec7bb34861aa23f38af40da479`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:33.651342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1c47ade4-c143-4771-81f1-02bc30198ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:33.666595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1854/3763] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:33.837823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9d33-076d-4741-ae74-d26f196e9a2f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:33.838349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9d33-076d-4741-ae74-d26f196e9a2f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:33.838571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9d33-076d-4741-ae74-d26f196e9a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:33.879568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f92d9d33-076d-4741-ae74-d26f196e9a2f None None] MFA Rules not processed for user `4719eac69a2f4f25bbb1abfb3ef7c980`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:33.884006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f92d9d33-076d-4741-ae74-d26f196e9a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:34.007630 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1910/3764] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:39.386979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928981-a250-42ae-b9f9-5faff2613590 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:39.387953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928981-a250-42ae-b9f9-5faff2613590 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:39.388371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928981-a250-42ae-b9f9-5faff2613590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:39.411080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-02928981-a250-42ae-b9f9-5faff2613590 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:39.412870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-02928981-a250-42ae-b9f9-5faff2613590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:39.471732 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1855/3765] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:45.351394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:45.351883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:45.352198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:45.374600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:45.375920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:45.384460 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1911/3766] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:45.407375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02928981-a250-42ae-b9f9-5faff2613590 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:45.422172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02928981-a250-42ae-b9f9-5faff2613590 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:45.428098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2d79e-9cda-4425-ab99-b279c9df40ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:45.428952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d79e-9cda-4425-ab99-b279c9df40ee service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:45.429300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d79e-9cda-4425-ab99-b279c9df40ee service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:45.429644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d79e-9cda-4425-ab99-b279c9df40ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:45.433246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:45.438848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:45.440731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2d79e-9cda-4425-ab99-b279c9df40ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:45.442850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2d79e-9cda-4425-ab99-b279c9df40ee service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:45.456347 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1856/3767] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:06:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:45.462641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696e1b-d627-4328-ba53-406d11b7ffad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:45.468578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:45.469603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:45.470059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:45.470326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] PATH_INFO: `/v3/users/4bc27b3989d24806b90e581b5f605288` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:45.471724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc27b3989d24806b90e581b5f605288)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:45.473834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:45.536171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc27b3989d24806b90e581b5f605288'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:45.536865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc27b3989d24806b90e581b5f605288'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:45.544338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc27b3989d24806b90e581b5f605288'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:45.556699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc27b3989d24806b90e581b5f605288'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:45.557698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3d89024-7878-42d7-bd5f-660650e5751a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc27b3989d24806b90e581b5f605288'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:45.577653 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1912/3768] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:06:45 2022] DELETE /identity/v3/users/4bc27b3989d24806b90e581b5f605288 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:06:45.582471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:45.582829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:45.583253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:45.606828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:45.608179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:45.618411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:45.619372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:45.619372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:45.654967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:45.656510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:45.688180 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1857/3769] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:45.699983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:45.705392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:45.754004 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1913/3770] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:06:45.771096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:45.772985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:45.787097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8ab64-0ac5-4b56-97f4-149efa4bdd59 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:45.791774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:45.792704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:45.793074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:45.793517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:45.805384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:45.808272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:45.824958 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1858/3771] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:45.934066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2ed7d-09b3-42e8-a1f6-f05055bd4076 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:45.945166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ee2ab-7ebc-4881-8cd2-a0826934cb92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:45.946231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ee2ab-7ebc-4881-8cd2-a0826934cb92 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:45.946525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ee2ab-7ebc-4881-8cd2-a0826934cb92 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:45.946840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ee2ab-7ebc-4881-8cd2-a0826934cb92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:45.957523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ee2ab-7ebc-4881-8cd2-a0826934cb92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:45.959299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ee2ab-7ebc-4881-8cd2-a0826934cb92 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:45.969685 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1914/3772] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:06:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:06:46.047560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.049061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:46.063457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b451271-a8d9-43c0-8763-6d3c2902d5f0 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.068584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.069367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.069644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.069915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] PATH_INFO: `/v3/projects/c8db9d188edc4c1fb6fb85e81e8dba79` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.071098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8db9d188edc4c1fb6fb85e81e8dba79)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.073373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.143672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'request_id': 'req-c3298136-18dc-4bd4-a432-9a364b36585f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:46.151763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'request_id': 'req-c3298136-18dc-4bd4-a432-9a364b36585f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:46.163216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'request_id': 'req-c3298136-18dc-4bd4-a432-9a364b36585f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:46.176326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] The token cache is being invalidate because project c8db9d188edc4c1fb6fb85e81e8dba79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:06:46.176612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:46.177309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3298136-18dc-4bd4-a432-9a364b36585f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:46.179163 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1859/3773] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:46 2022] DELETE /identity/v3/projects/c8db9d188edc4c1fb6fb85e81e8dba79 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:46.183860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876daa-20b2-4689-bb55-f9818fc90f1e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.184549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876daa-20b2-4689-bb55-f9818fc90f1e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.184774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876daa-20b2-4689-bb55-f9818fc90f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.206720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-50876daa-20b2-4689-bb55-f9818fc90f1e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:46.208864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-50876daa-20b2-4689-bb55-f9818fc90f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:46.278124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1915/3774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:46.287751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5bf44-f1f5-4c77-81ed-4a97f6853860 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.288253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5bf44-f1f5-4c77-81ed-4a97f6853860 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.288671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5bf44-f1f5-4c77-81ed-4a97f6853860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.311678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5da5bf44-f1f5-4c77-81ed-4a97f6853860 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:46.313092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5da5bf44-f1f5-4c77-81ed-4a97f6853860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:46.322879 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1860/3775] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:46.328513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50876daa-20b2-4689-bb55-f9818fc90f1e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.343122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50876daa-20b2-4689-bb55-f9818fc90f1e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.365763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385c31-cbe3-4eb5-b2d9-af5e795def14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.366466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385c31-cbe3-4eb5-b2d9-af5e795def14 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.366747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385c31-cbe3-4eb5-b2d9-af5e795def14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.367044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385c31-cbe3-4eb5-b2d9-af5e795def14 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.367940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385c31-cbe3-4eb5-b2d9-af5e795def14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:06:46.368247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385c31-cbe3-4eb5-b2d9-af5e795def14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.369939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385c31-cbe3-4eb5-b2d9-af5e795def14 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.385699 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1916/3776] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:06:46.386832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5bf44-f1f5-4c77-81ed-4a97f6853860 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.397765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5bf44-f1f5-4c77-81ed-4a97f6853860 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.403218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.403870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.404146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.404419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.405153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.405488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.405874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.406762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.407200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.425066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:46.426576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:46.461717 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1861/3777] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:06:46 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:46.462757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.509152 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1917/3778] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:46.524298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.526703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:46.558778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154826af-867a-4fbd-8405-88bd4d9ef707 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.565794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.566518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.566805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.567086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.567794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.574282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.600256 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1862/3779] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:06:46 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:46.606189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.618995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe4cd1-a5d6-46a2-9c80-6bbf0b4db536 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.625158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.626164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.626895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.627326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.628249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.630171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.639314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131542e-cc9d-49d3-ae8d-60236170b59d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.654001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1863/3780] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:46.655175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.668666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac77d-969c-49ee-a975-75be3df8bb45 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.677349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.678048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.678444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.679537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.679861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.681562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.697835 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1864/3781] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:46.707054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.721810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91ff5-d40b-40e1-9609-92b5aa047c76 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:46.731736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25f370-b63b-40cd-ba73-18593ec96ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.733027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f370-b63b-40cd-ba73-18593ec96ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.734513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f370-b63b-40cd-ba73-18593ec96ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.735005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f370-b63b-40cd-ba73-18593ec96ee0 admin admin] PATH_INFO: `/v3/projects/ec920d3f032a48b4b57ca7e343c18e3f/users/e8f139c65a434c5c815998553b0dddc8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.736453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:46.737174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.737458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.737733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.763004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25f370-b63b-40cd-ba73-18593ec96ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec920d3f032a48b4b57ca7e343c18e3f, user_id=e8f139c65a434c5c815998553b0dddc8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.767103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25f370-b63b-40cd-ba73-18593ec96ee0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.788072 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1865/3782] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:06:46 2022] PUT /identity/v3/projects/ec920d3f032a48b4b57ca7e343c18e3f/users/e8f139c65a434c5c815998553b0dddc8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:46.799787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:46.800084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:46.800409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:46.806284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:46.807980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:46.817234 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1918/3783] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:46.833637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] MFA Rules not processed for user `e8f139c65a434c5c815998553b0dddc8`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:46.835086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:46.909094 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1866/3784] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:46.940639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:46.943534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:46.959864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759046-4a58-4749-ae37-1c609ee691f6 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:47.023184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:47.024134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.024439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.024712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] PATH_INFO: `/v3/users/5fe69df11b2846f99843c4883a067021` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.026054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe69df11b2846f99843c4883a067021)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:47.028181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:47.074510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:47.076276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:47.087895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe69df11b2846f99843c4883a067021'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.088937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe69df11b2846f99843c4883a067021'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.096708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe69df11b2846f99843c4883a067021'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.106078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe69df11b2846f99843c4883a067021'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.106936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5ef89969-eaf1-423f-a845-0a73b1d2b303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe69df11b2846f99843c4883a067021'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.128463 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1919/3785] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:06:46 2022] DELETE /identity/v3/users/5fe69df11b2846f99843c4883a067021 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:47.133204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.133491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.133767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.152542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:47.153848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:47.174773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27914c-7cdb-439c-8485-03cc49d12db0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:47.237664 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1920/3786] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:06:47.244879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:47.249693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:47.262059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:47.262863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.263208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.263554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.265868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:47.325183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e56c5b-4e68-4edb-9dc1-456ebf9638c3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:47.329560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46f377-5c78-4357-adab-a1bf634cf825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:47.330312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46f377-5c78-4357-adab-a1bf634cf825 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.330662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46f377-5c78-4357-adab-a1bf634cf825 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.331033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46f377-5c78-4357-adab-a1bf634cf825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.334600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:47.336229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:47.341530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46f377-5c78-4357-adab-a1bf634cf825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:47.342853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46f377-5c78-4357-adab-a1bf634cf825 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:47.345976 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1867/3787] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:47.353921 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1921/3788] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:06:47.564286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:47.565777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:47.604700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9763c-0bfb-4d3d-ae77-cba45eed768a service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:47.610342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:47.611762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.612223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.612645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] PATH_INFO: `/v3/projects/1e2f7aa3f0c94253b265693d30844fd0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.614257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2f7aa3f0c94253b265693d30844fd0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:47.616210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:47.691376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2f7aa3f0c94253b265693d30844fd0', 'request_id': 'req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.703913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2f7aa3f0c94253b265693d30844fd0', 'request_id': 'req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.713543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2f7aa3f0c94253b265693d30844fd0', 'request_id': 'req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.734657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] The token cache is being invalidate because project 1e2f7aa3f0c94253b265693d30844fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:06:47.735108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.736251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df4f9e5f-9491-4ea4-a63e-47d56d5080c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:47.739715 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1868/3789] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:47 2022] DELETE /identity/v3/projects/1e2f7aa3f0c94253b265693d30844fd0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:47.744917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ca0f-d9ea-489a-bb17-0e3d0b5b0823 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.745588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ca0f-d9ea-489a-bb17-0e3d0b5b0823 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.745678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ca0f-d9ea-489a-bb17-0e3d0b5b0823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.772585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-acb2ca0f-d9ea-489a-bb17-0e3d0b5b0823 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:47.773989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-acb2ca0f-d9ea-489a-bb17-0e3d0b5b0823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:47.857941 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1922/3790] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:47.866599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56abd5a-bf54-4595-891b-bf031901c9b0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.866957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56abd5a-bf54-4595-891b-bf031901c9b0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.867650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56abd5a-bf54-4595-891b-bf031901c9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.889211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a56abd5a-bf54-4595-891b-bf031901c9b0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:47.890446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a56abd5a-bf54-4595-891b-bf031901c9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:47.901730 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1869/3791] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:06:47.906068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2ca0f-d9ea-489a-bb17-0e3d0b5b0823 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:47.920701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2ca0f-d9ea-489a-bb17-0e3d0b5b0823 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:47.927550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:47.928371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.928729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.929161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.930527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:06:47.930903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:47.933071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:47.953928 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1923/3792] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:06:47.955219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56abd5a-bf54-4595-891b-bf031901c9b0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:47.967562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56abd5a-bf54-4595-891b-bf031901c9b0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:47.978964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:47.979919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:47.980361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:47.981215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:47.982158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:47.984725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:48.020755 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1870/3793] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:06:47 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:06:48.022798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:48.035358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc740-f4dc-4305-a1da-d62518fe375d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:48.098428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:48.099125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:48.099551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:48.099831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:48.100596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:48.102778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:48.134905 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1924/3794] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:06:48 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:48.139550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:48.155009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f7a2b-52e0-4ec8-9e62-126a447e7922 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:48.161397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:48.162219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:48.162903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:48.162903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:48.163665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:48.165942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:48.183522 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1871/3795] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:48.187725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:48.201405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dfa29-e48f-4dd8-b686-0f18c3b07807 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:48.205242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2656f-5aea-413e-af27-f99977c419ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:48.205923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2656f-5aea-413e-af27-f99977c419ea admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:48.206234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2656f-5aea-413e-af27-f99977c419ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:48.206507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2656f-5aea-413e-af27-f99977c419ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:48.207237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2656f-5aea-413e-af27-f99977c419ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:48.211018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2656f-5aea-413e-af27-f99977c419ea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:48.238443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:48.238875 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1925/3796] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:06:48.251360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d26ac-aaff-4fea-8a7c-cfe445881e83 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:48.260082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:48.262036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:48.265487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:48.265795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] PATH_INFO: `/v3/projects/fe0cf872e6394079be75ef13dcfb4772/users/15adc9f64bcd449e98b533450a87f6f2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:48.307143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0cf872e6394079be75ef13dcfb4772, user_id=15adc9f64bcd449e98b533450a87f6f2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:48.310459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:48.341936 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1872/3797] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:06:48 2022] PUT /identity/v3/projects/fe0cf872e6394079be75ef13dcfb4772/users/15adc9f64bcd449e98b533450a87f6f2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:48.347721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ef6c8-89b9-43c6-bc4e-da1a634569d3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:48.348007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ef6c8-89b9-43c6-bc4e-da1a634569d3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:48.348291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ef6c8-89b9-43c6-bc4e-da1a634569d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:48.372370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6b6ef6c8-89b9-43c6-bc4e-da1a634569d3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:48.373654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6b6ef6c8-89b9-43c6-bc4e-da1a634569d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:48.467404 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1926/3798] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:48.476394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:48.478558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:48.569890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b5390-63df-4c96-857d-3371afc17148 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:48.575659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:48.576551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:48.576989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:48.577408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:48.588959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:48.591034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:48.603273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1873/3799] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:49.771675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:49.773140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:49.773684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:49.871288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] MFA Rules not processed for user `15adc9f64bcd449e98b533450a87f6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:49.872744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:50.032475 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1927/3800] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:50.138031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:50.139641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:50.223921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018cb5f-601d-42fa-91df-9a0ece59e55e service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:50.231267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591fcc9-7bbe-4063-8cc4-245aed6b5963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:50.232712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591fcc9-7bbe-4063-8cc4-245aed6b5963 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:50.233023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591fcc9-7bbe-4063-8cc4-245aed6b5963 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:50.233734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591fcc9-7bbe-4063-8cc4-245aed6b5963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:50.243654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591fcc9-7bbe-4063-8cc4-245aed6b5963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:50.245463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591fcc9-7bbe-4063-8cc4-245aed6b5963 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:50.255244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1874/3801] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:51.142419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:51.144634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:51.162064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210f536-0e81-4145-9bc4-69cb4b129bd3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:51.170473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:51.171908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:51.172296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:51.172674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] PATH_INFO: `/v3/users/e8f139c65a434c5c815998553b0dddc8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:51.174337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f139c65a434c5c815998553b0dddc8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:51.177186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:51.231803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f139c65a434c5c815998553b0dddc8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:51.232487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f139c65a434c5c815998553b0dddc8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:51.242349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f139c65a434c5c815998553b0dddc8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:51.251866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f139c65a434c5c815998553b0dddc8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:51.252589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f139c65a434c5c815998553b0dddc8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:51.274184 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1928/3802] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:06:51 2022] DELETE /identity/v3/users/e8f139c65a434c5c815998553b0dddc8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:51.284695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:51.284695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:51.284695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:51.301897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:51.303147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:51.392941 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1875/3803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:06:51.413633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:51.415977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:51.513938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbd1d9-148d-4215-815a-3bfb304eee7b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:51.518476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba22ac-6798-4a39-8285-c7949315e70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:51.519511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba22ac-6798-4a39-8285-c7949315e70f service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:51.520025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba22ac-6798-4a39-8285-c7949315e70f service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:51.520443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba22ac-6798-4a39-8285-c7949315e70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:51.534036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba22ac-6798-4a39-8285-c7949315e70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:51.536237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba22ac-6798-4a39-8285-c7949315e70f service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:51.552741 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1929/3804] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:52.327921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:52.329901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:52.351464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705275d-4072-49b3-83a6-df81380a0808 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:52.358507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:52.359753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:52.360026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:52.360358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] PATH_INFO: `/v3/projects/ec920d3f032a48b4b57ca7e343c18e3f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:52.362082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec920d3f032a48b4b57ca7e343c18e3f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:52.364039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:52.477196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec920d3f032a48b4b57ca7e343c18e3f', 'request_id': 'req-ccc420a7-1962-4552-8e4d-e23d94d3879c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:52.487198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec920d3f032a48b4b57ca7e343c18e3f', 'request_id': 'req-ccc420a7-1962-4552-8e4d-e23d94d3879c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:52.497352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec920d3f032a48b4b57ca7e343c18e3f', 'request_id': 'req-ccc420a7-1962-4552-8e4d-e23d94d3879c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:52.518356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] The token cache is being invalidate because project ec920d3f032a48b4b57ca7e343c18e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:06:52.518601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:52.520209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ccc420a7-1962-4552-8e4d-e23d94d3879c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:06:52.523163 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1876/3805] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:52 2022] DELETE /identity/v3/projects/ec920d3f032a48b4b57ca7e343c18e3f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:52.528204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498240-e20a-4bea-8a66-8807a2acf9f6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:52.529108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498240-e20a-4bea-8a66-8807a2acf9f6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:52.529609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498240-e20a-4bea-8a66-8807a2acf9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:52.550696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-52498240-e20a-4bea-8a66-8807a2acf9f6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:52.552002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-52498240-e20a-4bea-8a66-8807a2acf9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:52.633538 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1930/3806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:52.636805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ec04-edf5-40dc-b789-dbb53fe42831 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:52.640316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ec04-edf5-40dc-b789-dbb53fe42831 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:52.643481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ec04-edf5-40dc-b789-dbb53fe42831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:52.677479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bd87ec04-edf5-40dc-b789-dbb53fe42831 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:52.678700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bd87ec04-edf5-40dc-b789-dbb53fe42831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:52.688384 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1877/3807] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:52.693481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498240-e20a-4bea-8a66-8807a2acf9f6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:52.707276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498240-e20a-4bea-8a66-8807a2acf9f6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:52.712950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:52.713764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:52.714107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:52.714383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:52.716186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:06:52.716597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:52.719613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:52.755736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1931/3808] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:06:52.758026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87ec04-edf5-40dc-b789-dbb53fe42831 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:52.771951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87ec04-edf5-40dc-b789-dbb53fe42831 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:52.778931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:52.780055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:52.780333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:52.780833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:52.782021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:52.784266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:52.822889 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1878/3809] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:06:52 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:52.827238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:52.841680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8bd12-b8fc-471e-a0f0-5fb01c5cf61d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:52.940638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:52.941600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:52.941923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:52.942247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:52.942998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:52.945533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:52.975623 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1932/3810] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:06:52 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:06:52.980192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:52.993932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8be9-bbba-4c09-b104-d37a2c957a8c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:53.001953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:53.003091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:53.003525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:53.003950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:53.004844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:53.007498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:53.022359 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1879/3811] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:53.026541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:53.040242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bbef7-4761-45a7-9d23-cc9f2bf3dd70 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:53.048107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a0f9e-85c1-42af-ac79-61c5c4df4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:53.049191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0f9e-85c1-42af-ac79-61c5c4df4b7b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:53.049671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0f9e-85c1-42af-ac79-61c5c4df4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:53.050150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0f9e-85c1-42af-ac79-61c5c4df4b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:53.051135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a0f9e-85c1-42af-ac79-61c5c4df4b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:53.053795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a0f9e-85c1-42af-ac79-61c5c4df4b7b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:53.069806 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1933/3812] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:06:53.074500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:53.090927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f01ea-c5e9-4bd8-97ff-832b35587f74 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:53.098957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:53.100752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:53.101057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:53.101597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] PATH_INFO: `/v3/projects/c950fe626e0b4d1a88be8c0943fe3965/users/918209191d2a40e5a996bb469bc26b4f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:53.132319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c950fe626e0b4d1a88be8c0943fe3965, user_id=918209191d2a40e5a996bb469bc26b4f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:53.143234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:53.171892 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1880/3813] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:06:53 2022] PUT /identity/v3/projects/c950fe626e0b4d1a88be8c0943fe3965/users/918209191d2a40e5a996bb469bc26b4f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:06:53.178578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485ba3-df98-4583-a416-e99251a269db None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:53.178873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485ba3-df98-4583-a416-e99251a269db None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:53.179158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485ba3-df98-4583-a416-e99251a269db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:53.226498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d8485ba3-df98-4583-a416-e99251a269db None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:53.230458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d8485ba3-df98-4583-a416-e99251a269db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:53.355111 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1934/3814] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:06:53.367883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:06:53.371025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:06:53.467957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8728eb-58c5-4aef-a4c9-c36d6b0c58e5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:06:53.473390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28116544-7163-4540-972c-25ae8c756eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:06:53.474079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28116544-7163-4540-972c-25ae8c756eed service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:53.474343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28116544-7163-4540-972c-25ae8c756eed service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:53.474695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28116544-7163-4540-972c-25ae8c756eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:53.488368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28116544-7163-4540-972c-25ae8c756eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:06:53.490155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28116544-7163-4540-972c-25ae8c756eed service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:06:53.503900 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1881/3815] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:06:59.811426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5902-cad3-47d8-90f5-996c26c605f9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:06:59.811909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5902-cad3-47d8-90f5-996c26c605f9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:06:59.812025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5902-cad3-47d8-90f5-996c26c605f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:06:59.851713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-299c5902-cad3-47d8-90f5-996c26c605f9 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:06:59.853017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-299c5902-cad3-47d8-90f5-996c26c605f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:00.123457 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1935/3816] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:00.220380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:00.221529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:00.222030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:00.255194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] MFA Rules not processed for user `918209191d2a40e5a996bb469bc26b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:00.257224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:00.406870 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1882/3817] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:00.479624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:00.480114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:00.480576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:00.520831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:00.525328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:00.525772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:00.527177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:00.610528 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1936/3818] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:00.638699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167cc9f-8c9e-4f90-af37-19b6650dd01a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:00.647931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:00.649080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d66c8a-f082-4760-8155-d330bf5a4614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:00.649812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:00.652829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66c8a-f082-4760-8155-d330bf5a4614 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:00.653136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66c8a-f082-4760-8155-d330bf5a4614 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:00.653427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66c8a-f082-4760-8155-d330bf5a4614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:00.668050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66c8a-f082-4760-8155-d330bf5a4614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:00.670473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66c8a-f082-4760-8155-d330bf5a4614 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:00.679964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1883/3819] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:00.746242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ad0a-c9a8-4978-895f-cbf58e36ce10 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:00.752796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a654c9-49c6-4788-9095-c69956fa13d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:00.753521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a654c9-49c6-4788-9095-c69956fa13d5 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:00.753833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a654c9-49c6-4788-9095-c69956fa13d5 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:00.754072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a654c9-49c6-4788-9095-c69956fa13d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:00.763763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a654c9-49c6-4788-9095-c69956fa13d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:00.765634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a654c9-49c6-4788-9095-c69956fa13d5 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:00.776358 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1937/3820] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:07:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:03.434198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d842e-d241-411c-9019-a997fc566f27 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:03.445732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d842e-d241-411c-9019-a997fc566f27 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:03.446288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d842e-d241-411c-9019-a997fc566f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:03.482389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-632d842e-d241-411c-9019-a997fc566f27 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:03.484006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-632d842e-d241-411c-9019-a997fc566f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:03.500293 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1884/3821] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:04.072520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7c1e-a46e-4199-875f-05d77bdafbd6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:04.073404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7c1e-a46e-4199-875f-05d77bdafbd6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:04.073908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7c1e-a46e-4199-875f-05d77bdafbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:04.106493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e24f7c1e-a46e-4199-875f-05d77bdafbd6 None None] MFA Rules not processed for user `918209191d2a40e5a996bb469bc26b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:04.110466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e24f7c1e-a46e-4199-875f-05d77bdafbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:04.151700 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1938/3822] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:04.718159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d842e-d241-411c-9019-a997fc566f27 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:04.720289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-632d842e-d241-411c-9019-a997fc566f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:04.763336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d842e-d241-411c-9019-a997fc566f27 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:04.776401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:04.777683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:04.778507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:04.781513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] PATH_INFO: `/v3/users/15adc9f64bcd449e98b533450a87f6f2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:04.783315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15adc9f64bcd449e98b533450a87f6f2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:04.790695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:04.886170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15adc9f64bcd449e98b533450a87f6f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:04.886528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15adc9f64bcd449e98b533450a87f6f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:04.895051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15adc9f64bcd449e98b533450a87f6f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:04.900276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15adc9f64bcd449e98b533450a87f6f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:04.918025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-90fbe52a-ee22-444d-8565-40a7a5fe57e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15adc9f64bcd449e98b533450a87f6f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:04.944801 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1885/3823] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:04 2022] DELETE /identity/v3/users/15adc9f64bcd449e98b533450a87f6f2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:05.403270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f7c1e-a46e-4199-875f-05d77bdafbd6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:05.419465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f7c1e-a46e-4199-875f-05d77bdafbd6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:05.609667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:05.621426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:05.621709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:05.625274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] PATH_INFO: `/v3/projects/fe0cf872e6394079be75ef13dcfb4772` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:05.627454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0cf872e6394079be75ef13dcfb4772)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:05.631231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:05.750179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0cf872e6394079be75ef13dcfb4772', 'request_id': 'req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:05.777322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0cf872e6394079be75ef13dcfb4772', 'request_id': 'req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:05.810428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0cf872e6394079be75ef13dcfb4772', 'request_id': 'req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:05.856205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] The token cache is being invalidate because project fe0cf872e6394079be75ef13dcfb4772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:05.856731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:05.866315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eda4b444-fbe2-432a-8cd8-3b5ebddfb9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:05.870471 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1939/3824] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:05 2022] DELETE /identity/v3/projects/fe0cf872e6394079be75ef13dcfb4772 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:05.878748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7349e-6e6d-451f-9f49-d92a57811345 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:05.879677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7349e-6e6d-451f-9f49-d92a57811345 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:05.880123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7349e-6e6d-451f-9f49-d92a57811345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:05.909731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ded7349e-6e6d-451f-9f49-d92a57811345 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:05.917792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ded7349e-6e6d-451f-9f49-d92a57811345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:06.040542 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1886/3825] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:06.048310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c52e52-7a45-4262-b562-f7ae36ddc517 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.048603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c52e52-7a45-4262-b562-f7ae36ddc517 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.048923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c52e52-7a45-4262-b562-f7ae36ddc517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.111882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-80c52e52-7a45-4262-b562-f7ae36ddc517 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:06.125516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-80c52e52-7a45-4262-b562-f7ae36ddc517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:06.150749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1940/3826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:06.156135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7349e-6e6d-451f-9f49-d92a57811345 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:06.193272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7349e-6e6d-451f-9f49-d92a57811345 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:06.209892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:06.210862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.211297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.211734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.212643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:06.213245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:06.216491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:06.258821 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1887/3827] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:06.263099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c52e52-7a45-4262-b562-f7ae36ddc517 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:06.274366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c52e52-7a45-4262-b562-f7ae36ddc517 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:06.282752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2378a-9a29-4c05-a174-d2ba9b7eba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:06.284036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2378a-9a29-4c05-a174-d2ba9b7eba69 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.284480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2378a-9a29-4c05-a174-d2ba9b7eba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.284577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2378a-9a29-4c05-a174-d2ba9b7eba69 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.285990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2378a-9a29-4c05-a174-d2ba9b7eba69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:06.288599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2378a-9a29-4c05-a174-d2ba9b7eba69 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:06.335904 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1941/3828] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:06 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:06.340687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:06.355336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ffe0-7de1-4cd3-904f-7ef1dfe51e05 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:06.430932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e809-bad1-4aae-a290-710699f8059c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.431513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e809-bad1-4aae-a290-710699f8059c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.437155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e809-bad1-4aae-a290-710699f8059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.482365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8cd5e809-bad1-4aae-a290-710699f8059c None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:06.483574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8cd5e809-bad1-4aae-a290-710699f8059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:06.527301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:06.528329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.530401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.531354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.533600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:06.536582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:06.596143 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1888/3829] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:06 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:06.599824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:06.624793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aca99-f297-4da1-aa50-36db9e084120 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:06.632879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:06.634570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.636359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.636807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.639153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:06.642096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:06.644974 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1942/3830] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:06.669482 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1889/3831] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:06.673632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e809-bad1-4aae-a290-710699f8059c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:06.705215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e809-bad1-4aae-a290-710699f8059c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:06.721833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a2ec-8055-4a38-beb4-108ab038939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:06.723960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a2ec-8055-4a38-beb4-108ab038939b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.725313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a2ec-8055-4a38-beb4-108ab038939b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.726723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a2ec-8055-4a38-beb4-108ab038939b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.732875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2a2ec-8055-4a38-beb4-108ab038939b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:06.738732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2a2ec-8055-4a38-beb4-108ab038939b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:06.775239 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1943/3832] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:06.776692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:06.792960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473503b-482c-4c59-bdee-49043915de2f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:06.807795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:06.811661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.811940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.812384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] PATH_INFO: `/v3/projects/959fb92f2def47deb85d73cc0493c295/users/8437faedd74046fc81e05d2dadc1dd3d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.835827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=959fb92f2def47deb85d73cc0493c295, user_id=8437faedd74046fc81e05d2dadc1dd3d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:06.840212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:06.865370 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1890/3833] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:06 2022] PUT /identity/v3/projects/959fb92f2def47deb85d73cc0493c295/users/8437faedd74046fc81e05d2dadc1dd3d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:06.867676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78d95-628a-4e4b-8c95-2ea6853c2533 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:06.868216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78d95-628a-4e4b-8c95-2ea6853c2533 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:06.868515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78d95-628a-4e4b-8c95-2ea6853c2533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:06.927985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d6b78d95-628a-4e4b-8c95-2ea6853c2533 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:06.948841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d6b78d95-628a-4e4b-8c95-2ea6853c2533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:07.037371 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1944/3834] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:07.052076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:07.054631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:07.212939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02de0-97f5-4bfe-ac6d-a05c9f2ed87b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:07.221371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee76e7-5f10-4dfa-8f15-812c50167da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:07.224905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee76e7-5f10-4dfa-8f15-812c50167da1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:07.225888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee76e7-5f10-4dfa-8f15-812c50167da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:07.227239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee76e7-5f10-4dfa-8f15-812c50167da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:07.260683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee76e7-5f10-4dfa-8f15-812c50167da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:07.262499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee76e7-5f10-4dfa-8f15-812c50167da1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:07.305124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1891/3835] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:07.518034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4610-064b-4beb-abd9-08c9707b7a6c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:07.519110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4610-064b-4beb-abd9-08c9707b7a6c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:07.519614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4610-064b-4beb-abd9-08c9707b7a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:07.564188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-30ac4610-064b-4beb-abd9-08c9707b7a6c None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:07.566071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-30ac4610-064b-4beb-abd9-08c9707b7a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:07.668831 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1945/3836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:08.429684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:08.430739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:08.431024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:08.501907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e1e61-8641-4190-b028-87d2b5e6e4ac None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:08.502408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e1e61-8641-4190-b028-87d2b5e6e4ac None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:08.502822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e1e61-8641-4190-b028-87d2b5e6e4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:08.519212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] MFA Rules not processed for user `8437faedd74046fc81e05d2dadc1dd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:08.520757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:08.552392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c79e1e61-8641-4190-b028-87d2b5e6e4ac None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:08.555969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c79e1e61-8641-4190-b028-87d2b5e6e4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:08.577902 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1946/3837] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:08.715500 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1892/3838] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:08.717402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54b11-22eb-4d1f-949d-e6db426be2c5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:08.717692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54b11-22eb-4d1f-949d-e6db426be2c5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:08.717972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54b11-22eb-4d1f-949d-e6db426be2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:08.761135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-33b54b11-22eb-4d1f-949d-e6db426be2c5 None None] MFA Rules not processed for user `8437faedd74046fc81e05d2dadc1dd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:08.767429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-33b54b11-22eb-4d1f-949d-e6db426be2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:08.787752 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1947/3839] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:08.866228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:08.867951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:08.994591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47f22-d396-4023-89a6-ff2a1c26d45a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:09.004494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3cd04-0522-4c45-9e84-ad3b7833a43f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:09.005656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cd04-0522-4c45-9e84-ad3b7833a43f service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:09.006109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cd04-0522-4c45-9e84-ad3b7833a43f service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:09.006723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cd04-0522-4c45-9e84-ad3b7833a43f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:09.016383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3cd04-0522-4c45-9e84-ad3b7833a43f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:09.018158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3cd04-0522-4c45-9e84-ad3b7833a43f service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:09.044127 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1893/3840] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:09.961416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82723672-0233-49af-b87b-f4c3a21750bd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:09.962442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82723672-0233-49af-b87b-f4c3a21750bd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:09.962893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82723672-0233-49af-b87b-f4c3a21750bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:09.989282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-82723672-0233-49af-b87b-f4c3a21750bd None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:09.991114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-82723672-0233-49af-b87b-f4c3a21750bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:10.002499 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1948/3841] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:12.723358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8cde-e69b-4ef4-9967-09336eaf2730 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:12.723910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8cde-e69b-4ef4-9967-09336eaf2730 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:12.724007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8cde-e69b-4ef4-9967-09336eaf2730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:12.751220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b5aa8cde-e69b-4ef4-9967-09336eaf2730 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:12.752927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b5aa8cde-e69b-4ef4-9967-09336eaf2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:12.763565 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1894/3842] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:14.600026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03490-c289-44d9-9aac-532cd162e32c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:14.600990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03490-c289-44d9-9aac-532cd162e32c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:14.601544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03490-c289-44d9-9aac-532cd162e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:14.638259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b6c03490-c289-44d9-9aac-532cd162e32c None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:14.639935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6c03490-c289-44d9-9aac-532cd162e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:14.717430 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1949/3843] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:15.769111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039414-bd11-4dd4-82a3-233be439232b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:15.769943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039414-bd11-4dd4-82a3-233be439232b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:15.770373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039414-bd11-4dd4-82a3-233be439232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:15.797318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d6039414-bd11-4dd4-82a3-233be439232b None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:15.799308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d6039414-bd11-4dd4-82a3-233be439232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:15.811829 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1895/3844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:18.069195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:18.069839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:18.069839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:18.090555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:18.092243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:18.100916 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1950/3845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:19.444850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87bbc3-a0fe-40db-864b-6fd1ddccd95a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:19.445332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87bbc3-a0fe-40db-864b-6fd1ddccd95a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:19.445430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87bbc3-a0fe-40db-864b-6fd1ddccd95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:19.521639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7b87bbc3-a0fe-40db-864b-6fd1ddccd95a None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:19.522948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b87bbc3-a0fe-40db-864b-6fd1ddccd95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:19.615818 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1896/3846] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:19.631932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:19.633912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:19.740777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be18dd9-1c1e-4c38-a633-ace9510fd6e8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:19.748552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd281bdf-f744-4a1a-b3e0-38c1c46d4309 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:19.749301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd281bdf-f744-4a1a-b3e0-38c1c46d4309 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:19.749724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd281bdf-f744-4a1a-b3e0-38c1c46d4309 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:19.750159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd281bdf-f744-4a1a-b3e0-38c1c46d4309 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:19.760615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd281bdf-f744-4a1a-b3e0-38c1c46d4309 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:19.762318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd281bdf-f744-4a1a-b3e0-38c1c46d4309 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:19.774379 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1951/3847] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:07:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:21.193522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79debb2d-810f-4b11-905c-94cfa23dd86d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:21.194280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79debb2d-810f-4b11-905c-94cfa23dd86d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:21.194563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79debb2d-810f-4b11-905c-94cfa23dd86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:21.215376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-79debb2d-810f-4b11-905c-94cfa23dd86d None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:21.217765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-79debb2d-810f-4b11-905c-94cfa23dd86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:21.298352 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1897/3848] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:24.315021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:24.315633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:24.315633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:24.335111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:24.336333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:24.344520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1952/3849] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:24.968999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7106-9ffd-440d-951b-fb6bc2374316 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:24.969601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7106-9ffd-440d-951b-fb6bc2374316 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:24.969601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7106-9ffd-440d-951b-fb6bc2374316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:24.987856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-15cf7106-9ffd-440d-951b-fb6bc2374316 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:24.989455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-15cf7106-9ffd-440d-951b-fb6bc2374316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:24.996342 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1898/3850] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:28.844264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:28.845893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:28.875323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dae929-ddb8-4132-9ba8-dee8f8e3f695 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:28.880595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:28.881845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:28.882248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:28.882619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] PATH_INFO: `/v3/users/121a5a2fcd9f4420885f2a78c1dfc339` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:28.883973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121a5a2fcd9f4420885f2a78c1dfc339)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:28.886389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:28.941926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121a5a2fcd9f4420885f2a78c1dfc339'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:28.942687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121a5a2fcd9f4420885f2a78c1dfc339'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:28.949993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121a5a2fcd9f4420885f2a78c1dfc339'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:28.958813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121a5a2fcd9f4420885f2a78c1dfc339'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:28.959613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4370662-49c6-483f-980e-23dc52fa63d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121a5a2fcd9f4420885f2a78c1dfc339'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:28.977846 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1953/3851] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:28 2022] DELETE /identity/v3/users/121a5a2fcd9f4420885f2a78c1dfc339 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:29.191127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7106-9ffd-440d-951b-fb6bc2374316 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:29.206993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7106-9ffd-440d-951b-fb6bc2374316 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:29.297395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:29.298427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.298975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.299258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] PATH_INFO: `/v3/projects/f87849ca88bb4519b329fab033911446` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.300453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87849ca88bb4519b329fab033911446)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:29.302569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:29.366130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87849ca88bb4519b329fab033911446', 'request_id': 'req-081344b2-cab2-4fed-a1e5-74b1a540d3d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:29.371859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87849ca88bb4519b329fab033911446', 'request_id': 'req-081344b2-cab2-4fed-a1e5-74b1a540d3d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:29.383051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87849ca88bb4519b329fab033911446', 'request_id': 'req-081344b2-cab2-4fed-a1e5-74b1a540d3d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:29.398779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] The token cache is being invalidate because project f87849ca88bb4519b329fab033911446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:29.399358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:29.400150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-081344b2-cab2-4fed-a1e5-74b1a540d3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:29.401840 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1899/3852] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:29 2022] DELETE /identity/v3/projects/f87849ca88bb4519b329fab033911446 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:29.407436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee605b-7c2a-4835-90f1-7de05b38e03f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.407886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee605b-7c2a-4835-90f1-7de05b38e03f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.408161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee605b-7c2a-4835-90f1-7de05b38e03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.433406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c5ee605b-7c2a-4835-90f1-7de05b38e03f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:29.437564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c5ee605b-7c2a-4835-90f1-7de05b38e03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:29.517119 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1954/3853] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:29.524685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bbb8-0600-4c88-8599-44f89b5afa7c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.524994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bbb8-0600-4c88-8599-44f89b5afa7c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.525426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bbb8-0600-4c88-8599-44f89b5afa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.553504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7db9bbb8-0600-4c88-8599-44f89b5afa7c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:29.555743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7db9bbb8-0600-4c88-8599-44f89b5afa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:29.572206 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1900/3854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:29.574445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee605b-7c2a-4835-90f1-7de05b38e03f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:29.585766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee605b-7c2a-4835-90f1-7de05b38e03f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:29.593675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:29.594549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.594956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.595460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.596329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:29.596719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:29.598924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:29.613569 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1955/3855] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:29.618330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9bbb8-0600-4c88-8599-44f89b5afa7c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:29.634097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9bbb8-0600-4c88-8599-44f89b5afa7c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:29.640414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:29.641193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.641504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.641780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.642484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:29.644411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:29.683279 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1901/3856] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:29 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:29.684722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:29.701284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726930e-deea-470e-871f-8ada1412c37d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:29.770494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:29.771199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.771483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.771761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.772457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:29.774444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:29.797589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1956/3857] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:29 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:29.802289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:29.816027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dc3d1-c3d7-402f-acf4-67c1637dfd80 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:29.822066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:29.822985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.823148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.823457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.824254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:29.825950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:29.840341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1902/3858] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:29.845321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:29.858232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b1593-1c06-4ca6-ba3e-43d95d65447d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:29.863865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4903-5eca-4ae1-bb4a-b6c7f298b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:29.865176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4903-5eca-4ae1-bb4a-b6c7f298b544 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.865500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4903-5eca-4ae1-bb4a-b6c7f298b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.865820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4903-5eca-4ae1-bb4a-b6c7f298b544 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.866615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d4903-5eca-4ae1-bb4a-b6c7f298b544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:29.868444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d4903-5eca-4ae1-bb4a-b6c7f298b544 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:29.881965 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1957/3859] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:29.886387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:29.907677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5de785-3642-461a-88fe-becae7bd5218 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:29.916753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029bfc0-3a3f-4dd6-8f60-3da03d6d5230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:29.918105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029bfc0-3a3f-4dd6-8f60-3da03d6d5230 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.918402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029bfc0-3a3f-4dd6-8f60-3da03d6d5230 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.918735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029bfc0-3a3f-4dd6-8f60-3da03d6d5230 admin admin] PATH_INFO: `/v3/projects/9c7578f9ead04b7384247947593935dd/users/33ea3acc687d49a9868219b4c9fa34dc/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:29.940530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029bfc0-3a3f-4dd6-8f60-3da03d6d5230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7578f9ead04b7384247947593935dd, user_id=33ea3acc687d49a9868219b4c9fa34dc, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:29.944155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029bfc0-3a3f-4dd6-8f60-3da03d6d5230 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:29.963723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1903/3860] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:29 2022] PUT /identity/v3/projects/9c7578f9ead04b7384247947593935dd/users/33ea3acc687d49a9868219b4c9fa34dc/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:29.976117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:29.976381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:29.976688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:30.005949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] MFA Rules not processed for user `33ea3acc687d49a9868219b4c9fa34dc`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:30.007304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:30.081415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1958/3861] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:30.094961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:30.095248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:30.095523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:30.115100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] MFA Rules not processed for user `33ea3acc687d49a9868219b4c9fa34dc`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:30.116742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:30.128428 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1904/3862] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:30.140016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:30.141574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:30.219438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8118-55c6-421b-982e-677973ce5e0e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:30.226017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:30.226857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:30.227147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:30.227454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:30.236693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:30.238679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:30.249337 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1959/3863] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:34.372050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:34.374498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:34.473275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9695854-f431-435a-97b4-d6dc7a1b5e35 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:34.479235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:34.480198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:34.480554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:34.480865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] PATH_INFO: `/v3/users/8437faedd74046fc81e05d2dadc1dd3d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:34.482353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8437faedd74046fc81e05d2dadc1dd3d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:34.484689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:34.551459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8437faedd74046fc81e05d2dadc1dd3d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:34.552115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8437faedd74046fc81e05d2dadc1dd3d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:34.558861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8437faedd74046fc81e05d2dadc1dd3d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:34.559602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8437faedd74046fc81e05d2dadc1dd3d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:34.568386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ecb0626-ea3b-40f3-88c4-7be08c49e998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8437faedd74046fc81e05d2dadc1dd3d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:34.586585 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1905/3864] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:34 2022] DELETE /identity/v3/users/8437faedd74046fc81e05d2dadc1dd3d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:34.843166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:34.853640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3d601-dc4e-436b-b4f4-fb61c2835c71 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:34.921616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:34.922497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:34.922769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:34.923033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] PATH_INFO: `/v3/projects/959fb92f2def47deb85d73cc0493c295` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:34.924206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=959fb92f2def47deb85d73cc0493c295)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:34.926311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:34.977390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959fb92f2def47deb85d73cc0493c295', 'request_id': 'req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:34.984302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959fb92f2def47deb85d73cc0493c295', 'request_id': 'req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:34.995103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959fb92f2def47deb85d73cc0493c295', 'request_id': 'req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:35.007577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] The token cache is being invalidate because project 959fb92f2def47deb85d73cc0493c295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:35.007865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:35.008833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9756f4b8-ccc0-49b0-a76f-ec647d91a6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:35.019562 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1960/3865] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:34 2022] DELETE /identity/v3/projects/959fb92f2def47deb85d73cc0493c295 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:35.021904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46c1e-c927-4366-8ba3-f46712a0f440 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.022196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46c1e-c927-4366-8ba3-f46712a0f440 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.022484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46c1e-c927-4366-8ba3-f46712a0f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.043689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ef46c1e-c927-4366-8ba3-f46712a0f440 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:35.045229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ef46c1e-c927-4366-8ba3-f46712a0f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:35.107689 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1906/3866] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:35.116638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da0eb1-2d1c-43de-8d90-b2ef884686ce None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.117006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da0eb1-2d1c-43de-8d90-b2ef884686ce None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.117373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da0eb1-2d1c-43de-8d90-b2ef884686ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.136586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-92da0eb1-2d1c-43de-8d90-b2ef884686ce None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:35.137916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-92da0eb1-2d1c-43de-8d90-b2ef884686ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:35.147245 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1961/3867] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:35.151456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46c1e-c927-4366-8ba3-f46712a0f440 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.161720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46c1e-c927-4366-8ba3-f46712a0f440 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.166771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.167442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.167720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.167987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.168718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:35.169028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.170724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.194747 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1907/3868] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:35.198039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da0eb1-2d1c-43de-8d90-b2ef884686ce None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.210158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da0eb1-2d1c-43de-8d90-b2ef884686ce None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.216443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.217855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.218135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.218404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.219100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.221122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.261694 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1962/3869] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:35 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:35.270223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.295562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe85d-e78d-4baf-8401-ccfd55e97cec admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.364666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.365558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.366618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.367089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.367817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.369848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.392255 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1908/3870] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:35 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:35.396410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.407637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d999f0-0d93-46bf-ae97-24273403a57e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.413234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.413517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.413759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.414034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.415122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.416671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.433788 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1963/3871] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:35.441204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.457409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970657a0-0a91-4b59-8794-4abefaea90d0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.462924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c7f96-9594-4c39-8b31-9aade34e73f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.463600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7f96-9594-4c39-8b31-9aade34e73f8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.463878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7f96-9594-4c39-8b31-9aade34e73f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.464151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7f96-9594-4c39-8b31-9aade34e73f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.464864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c7f96-9594-4c39-8b31-9aade34e73f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.466619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c7f96-9594-4c39-8b31-9aade34e73f8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.477602 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1909/3872] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:35.481758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.492114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c2ebd-5f3f-41ee-b453-aeee04ba66e0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.497991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.499099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.499383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.499663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] PATH_INFO: `/v3/projects/723ef1695c854e1a81cabaa6f400a422/users/96485658cdcc40c4b1594fe55e7a0768/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.517362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723ef1695c854e1a81cabaa6f400a422, user_id=96485658cdcc40c4b1594fe55e7a0768, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.520090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.545129 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1964/3873] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:35 2022] PUT /identity/v3/projects/723ef1695c854e1a81cabaa6f400a422/users/96485658cdcc40c4b1594fe55e7a0768/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:35.551298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341fec5-c840-4ed0-8b7a-524c99d50516 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.551588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341fec5-c840-4ed0-8b7a-524c99d50516 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.551871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341fec5-c840-4ed0-8b7a-524c99d50516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.580565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2341fec5-c840-4ed0-8b7a-524c99d50516 None None] MFA Rules not processed for user `96485658cdcc40c4b1594fe55e7a0768`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:35.581847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2341fec5-c840-4ed0-8b7a-524c99d50516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:35.660692 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1910/3874] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:35.661839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.735556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8cfde-951f-4bfe-b2c5-9f369e810dd7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.742246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.742919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.743232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.743514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.744267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.746455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.774668 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1965/3875] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:35 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:35.778449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341fec5-c840-4ed0-8b7a-524c99d50516 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.789779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341fec5-c840-4ed0-8b7a-524c99d50516 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.855007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.855693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.855974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.856247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.856968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.859266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.884137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1911/3876] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:35 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:35.888026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.900587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44d97-8713-4a6a-ab69-796ca09aa381 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.906346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.906960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.907315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.907667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.908664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.910338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.925383 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1966/3877] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:35.927389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:35.940295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e02d7-7528-4910-a2d9-8393ca66b738 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:35.957088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:35.957088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:35.957088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:35.957691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] PATH_INFO: `/v3/projects/d75ca92cbb2e48ae91cd914a17954ba4/users/d563f507a14440b38e598afcafdbf7b8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:35.969404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75ca92cbb2e48ae91cd914a17954ba4, user_id=d563f507a14440b38e598afcafdbf7b8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:35.972077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:35.989608 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1912/3878] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:35 2022] PUT /identity/v3/projects/d75ca92cbb2e48ae91cd914a17954ba4/users/d563f507a14440b38e598afcafdbf7b8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:35.993397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.005170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e119efe-c26a-4699-9ab9-5c8c18a22d49 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:36.069458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3487d07-0be7-4c67-bac2-811d98bd6dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:36.070154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3487d07-0be7-4c67-bac2-811d98bd6dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.070439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3487d07-0be7-4c67-bac2-811d98bd6dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.070791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3487d07-0be7-4c67-bac2-811d98bd6dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.072773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3487d07-0be7-4c67-bac2-811d98bd6dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:36.090119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3487d07-0be7-4c67-bac2-811d98bd6dc4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:36.107646 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1967/3879] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:36.109013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.125362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a00ffa-707a-4737-8cbf-726145849965 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:36.131690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:36.133390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.133989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.134401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] PATH_INFO: `/v3/projects/d75ca92cbb2e48ae91cd914a17954ba4/users/d563f507a14440b38e598afcafdbf7b8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.136583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75ca92cbb2e48ae91cd914a17954ba4, user_id=d563f507a14440b38e598afcafdbf7b8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:36.139636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:36.152118 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1913/3880] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:36 2022] PUT /identity/v3/projects/d75ca92cbb2e48ae91cd914a17954ba4/users/d563f507a14440b38e598afcafdbf7b8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:36.162883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfb33-4219-4661-a850-3d030cc34a05 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.163169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfb33-4219-4661-a850-3d030cc34a05 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.163439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfb33-4219-4661-a850-3d030cc34a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.195165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3c4cfb33-4219-4661-a850-3d030cc34a05 None None] MFA Rules not processed for user `d563f507a14440b38e598afcafdbf7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:36.196453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c4cfb33-4219-4661-a850-3d030cc34a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:36.277052 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1968/3881] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:36.281929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.293251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947d96-bb19-4279-a129-73c23680106a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:36.298163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd563f507a14440b38e598afcafdbf7b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75ca92cbb2e48ae91cd914a17954ba4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:36.299150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.299150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.299385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.300119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:36.301182 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:36.301182 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:36.301182 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:36.302054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:36.320374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1914/3882] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:07:36 2022] POST /identity/v3/roles => generated 240 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:36.324511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfb33-4219-4661-a850-3d030cc34a05 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.334718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfb33-4219-4661-a850-3d030cc34a05 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:36.339432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d8fb-6388-41f2-a8e4-02a02a9dde15 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd563f507a14440b38e598afcafdbf7b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75ca92cbb2e48ae91cd914a17954ba4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:36.340350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d8fb-6388-41f2-a8e4-02a02a9dde15 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.340623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d8fb-6388-41f2-a8e4-02a02a9dde15 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.340893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d8fb-6388-41f2-a8e4-02a02a9dde15 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] PATH_INFO: `/v3/projects/723ef1695c854e1a81cabaa6f400a422/users/96485658cdcc40c4b1594fe55e7a0768/roles/d02f9d7939da4742aa20e63021944fa8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.343527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d8fb-6388-41f2-a8e4-02a02a9dde15 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: Authorizing `identity:create_grant(project_id=723ef1695c854e1a81cabaa6f400a422, user_id=96485658cdcc40c4b1594fe55e7a0768, role_id=d02f9d7939da4742aa20e63021944fa8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:36.346267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d8fb-6388-41f2-a8e4-02a02a9dde15 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:36.360415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1969/3883] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:36 2022] PUT /identity/v3/projects/723ef1695c854e1a81cabaa6f400a422/users/96485658cdcc40c4b1594fe55e7a0768/roles/d02f9d7939da4742aa20e63021944fa8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:36.365107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.430065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303cde2-f3b7-4579-be0b-087b6de55298 tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:36.492637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96485658cdcc40c4b1594fe55e7a0768', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723ef1695c854e1a81cabaa6f400a422', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1517399191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:36.493563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.493838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.494108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] PATH_INFO: `/v3/users/96485658cdcc40c4b1594fe55e7a0768/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.494833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] RBAC: Authorizing `identity:create_application_credential(user_id=96485658cdcc40c4b1594fe55e7a0768)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:36.495980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:36.582598 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1915/3884] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Apr 9 21:07:36 2022] POST /identity/v3/users/96485658cdcc40c4b1594fe55e7a0768/application_credentials => generated 660 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:36.583667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deedc41-0c4c-4014-a653-2b9769b753bc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.583982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deedc41-0c4c-4014-a653-2b9769b753bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.584255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deedc41-0c4c-4014-a653-2b9769b753bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.612451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2deedc41-0c4c-4014-a653-2b9769b753bc None None] MFA Rules not processed for user `96485658cdcc40c4b1594fe55e7a0768`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:36.613835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2deedc41-0c4c-4014-a653-2b9769b753bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:36.728274 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1970/3885] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Apr 09 21:07:36.738399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.750820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6161ef-f815-4872-bd3a-f70b21893c8a tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:36.755902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96485658cdcc40c4b1594fe55e7a0768', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723ef1695c854e1a81cabaa6f400a422', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1517399191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:36.757069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.757540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.757959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] PATH_INFO: `/v3/users/96485658cdcc40c4b1594fe55e7a0768/application_credentials/0f287333b19445a88b844ec6cd28b684` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.759591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] RBAC: Authorizing `identity:delete_application_credential(user_id=96485658cdcc40c4b1594fe55e7a0768, application_credential_id=0f287333b19445a88b844ec6cd28b684)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:36.761439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:36.790177 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1916/3886] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:07:36 2022] DELETE /identity/v3/users/96485658cdcc40c4b1594fe55e7a0768/application_credentials/0f287333b19445a88b844ec6cd28b684 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:36.794189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deedc41-0c4c-4014-a653-2b9769b753bc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.868089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deedc41-0c4c-4014-a653-2b9769b753bc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:36.873063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd563f507a14440b38e598afcafdbf7b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75ca92cbb2e48ae91cd914a17954ba4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:36.874026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:36.874304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:36.874705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] PATH_INFO: `/v3/roles/d02f9d7939da4742aa20e63021944fa8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:36.876232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d02f9d7939da4742aa20e63021944fa8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:36.877281 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:36.877281 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:36.877281 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:36.878238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:36.932859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] Invalidating the token cache because role d02f9d7939da4742aa20e63021944fa8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:36.933566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:36.934184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8fe678ef-2014-4271-9f83-70cf2035f86a tempest-ApplicationCredentialsV3AdminTest-1078104804 tempest-ApplicationCredentialsV3AdminTest-1078104804-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:36.937400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1971/3887] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:36 2022] DELETE /identity/v3/roles/d02f9d7939da4742aa20e63021944fa8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:36.942284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:36.944021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:37.030690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc860e-2fe0-4e3d-b47e-ca03c90139cf tempest-ApplicationCredentialsV3AdminTest-92917340 tempest-ApplicationCredentialsV3AdminTest-92917340-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:37.093195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:37.094705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:37.095379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:37.095853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] PATH_INFO: `/v3/users/96485658cdcc40c4b1594fe55e7a0768` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:37.098022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96485658cdcc40c4b1594fe55e7a0768)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:37.101471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:37.151183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96485658cdcc40c4b1594fe55e7a0768'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.151863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96485658cdcc40c4b1594fe55e7a0768'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.158756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96485658cdcc40c4b1594fe55e7a0768'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.159554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96485658cdcc40c4b1594fe55e7a0768'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.169295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96485658cdcc40c4b1594fe55e7a0768'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.205133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1917/3888] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:36 2022] DELETE /identity/v3/users/96485658cdcc40c4b1594fe55e7a0768 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:37.208909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5467-9a3f-43b4-9c52-17f25b245db2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:37.209457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5467-9a3f-43b4-9c52-17f25b245db2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:37.210201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5467-9a3f-43b4-9c52-17f25b245db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:37.231229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a2fd5467-9a3f-43b4-9c52-17f25b245db2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:37.232901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a2fd5467-9a3f-43b4-9c52-17f25b245db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:37.304901 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1972/3889] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:37.321729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:37.324192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:37.384319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256e15-0dad-4cd2-a89f-ff9c72700d08 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:37.384600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256e15-0dad-4cd2-a89f-ff9c72700d08 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:37.384757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1c979-cbc2-4198-8b98-56516e99e685 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:37.384860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256e15-0dad-4cd2-a89f-ff9c72700d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:37.388648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:37.389339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:37.389621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:37.389888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:37.399295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:37.400880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:37.402516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e4256e15-0dad-4cd2-a89f-ff9c72700d08 None None] MFA Rules not processed for user `cdab30a578b947068144a0509c85eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:37.403849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e4256e15-0dad-4cd2-a89f-ff9c72700d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:37.410783 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1918/3890] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:37.462361 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1973/3891] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:37.834966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:37.837096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:37.863631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98913fe5-fcd1-4389-9013-aa648177b158 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:37.868613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:37.869549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:37.869830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:37.870092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] PATH_INFO: `/v3/projects/723ef1695c854e1a81cabaa6f400a422` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:37.871455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723ef1695c854e1a81cabaa6f400a422)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:37.873668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:37.921889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723ef1695c854e1a81cabaa6f400a422', 'request_id': 'req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.927012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723ef1695c854e1a81cabaa6f400a422', 'request_id': 'req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.935632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723ef1695c854e1a81cabaa6f400a422', 'request_id': 'req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.950989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] The token cache is being invalidate because project 723ef1695c854e1a81cabaa6f400a422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:37.951317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.952333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:37.954252 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1919/3892] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:37 2022] DELETE /identity/v3/projects/723ef1695c854e1a81cabaa6f400a422 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:37.958153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4256e15-0dad-4cd2-a89f-ff9c72700d08 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:37.970501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4256e15-0dad-4cd2-a89f-ff9c72700d08 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:38.050668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:38.050668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:38.050668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:38.050668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] PATH_INFO: `/v3/users/d563f507a14440b38e598afcafdbf7b8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:38.050997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d563f507a14440b38e598afcafdbf7b8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:38.051336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:38.124331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd563f507a14440b38e598afcafdbf7b8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.128060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd563f507a14440b38e598afcafdbf7b8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.135943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd563f507a14440b38e598afcafdbf7b8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.145600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd563f507a14440b38e598afcafdbf7b8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.146325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68fcf3fe-ccf6-4ffb-8378-1ce09d994404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd563f507a14440b38e598afcafdbf7b8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.178432 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1974/3893] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:37 2022] DELETE /identity/v3/users/d563f507a14440b38e598afcafdbf7b8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:38.495433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:38.497350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:38.514597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcb8fd-5132-4a71-b41e-532cd6fb7534 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:38.583728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:38.584609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:38.584885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:38.585190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] PATH_INFO: `/v3/projects/d75ca92cbb2e48ae91cd914a17954ba4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:38.586407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75ca92cbb2e48ae91cd914a17954ba4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:38.588316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:38.639690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75ca92cbb2e48ae91cd914a17954ba4', 'request_id': 'req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.645128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75ca92cbb2e48ae91cd914a17954ba4', 'request_id': 'req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.652562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75ca92cbb2e48ae91cd914a17954ba4', 'request_id': 'req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.664255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] The token cache is being invalidate because project d75ca92cbb2e48ae91cd914a17954ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:38.664494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.665161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f5eb246-30e6-4c74-88a0-77908c3f9a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:38.666716 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1920/3894] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:38 2022] DELETE /identity/v3/projects/d75ca92cbb2e48ae91cd914a17954ba4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:38.671661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c11ed-cd4a-4069-95dc-01f1b0122a9a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:38.671945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c11ed-cd4a-4069-95dc-01f1b0122a9a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:38.672234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c11ed-cd4a-4069-95dc-01f1b0122a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:38.691307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-200c11ed-cd4a-4069-95dc-01f1b0122a9a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:38.692500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-200c11ed-cd4a-4069-95dc-01f1b0122a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:38.752619 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1975/3895] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:38.761094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796257-947a-40d3-8646-e97afa42a913 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:38.761569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796257-947a-40d3-8646-e97afa42a913 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:38.761958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796257-947a-40d3-8646-e97afa42a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:38.782392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ee796257-947a-40d3-8646-e97afa42a913 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:38.783610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ee796257-947a-40d3-8646-e97afa42a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:38.795099 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1921/3896] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:38.796149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c11ed-cd4a-4069-95dc-01f1b0122a9a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:38.806277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c11ed-cd4a-4069-95dc-01f1b0122a9a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:38.812185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:38.813104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:38.813571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:38.813847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:38.814634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:38.814879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:38.816791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:38.830475 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1976/3897] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:38.835074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796257-947a-40d3-8646-e97afa42a913 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:38.845730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796257-947a-40d3-8646-e97afa42a913 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:38.850894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:38.851781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:38.852043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:38.852487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:38.853525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:38.855862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:38.900282 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1922/3898] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:38 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:38.902223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:38.912547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79611-496a-4985-a282-5454e6158b43 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:38.967752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:38.968548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:38.968698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:38.968968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:38.969799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:38.971806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:38.994916 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1977/3899] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:38 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:38.999122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.010622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64a99-ae87-49c0-b8b8-69683b06cfd9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.015737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.016310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.016592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.016950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.017665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.019276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.033121 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1923/3900] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:39.035372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.046904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e9d6-b275-4916-8b69-9b427bb6b3e5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.053286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72559-bf66-4950-9768-40734378aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.053988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72559-bf66-4950-9768-40734378aaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.054258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72559-bf66-4950-9768-40734378aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.054541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72559-bf66-4950-9768-40734378aaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.057801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72559-bf66-4950-9768-40734378aaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.059561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72559-bf66-4950-9768-40734378aaf0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.073923 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1978/3901] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:39.078074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.089441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778266c9-41ea-4a1c-94ac-a6189f388189 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.095019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.095926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.096212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.096477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] PATH_INFO: `/v3/projects/aa11c45bb6014b27957d6f3ae6f66288/users/7e6c6e40f8404713a06f2dc648da0f5b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.119255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa11c45bb6014b27957d6f3ae6f66288, user_id=7e6c6e40f8404713a06f2dc648da0f5b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.122622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.142144 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1924/3902] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:39 2022] PUT /identity/v3/projects/aa11c45bb6014b27957d6f3ae6f66288/users/7e6c6e40f8404713a06f2dc648da0f5b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:39.152761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1559-a0c9-4394-9775-ecb306a3a22c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.153911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1559-a0c9-4394-9775-ecb306a3a22c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.153911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1559-a0c9-4394-9775-ecb306a3a22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.181786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f15c1559-a0c9-4394-9775-ecb306a3a22c None None] MFA Rules not processed for user `7e6c6e40f8404713a06f2dc648da0f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:39.184424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f15c1559-a0c9-4394-9775-ecb306a3a22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:39.271254 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1979/3903] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:39.275827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.346654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010038b-f8d1-4587-88bb-57b33e64e5ee admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.351963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.352706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.353148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.353545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.354307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.356290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.385963 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1925/3904] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:39 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:39.387322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c1559-a0c9-4394-9775-ecb306a3a22c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.399308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c1559-a0c9-4394-9775-ecb306a3a22c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.458194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.458892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.459174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.459449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.460150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.462146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.487282 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1980/3905] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:39 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:39.488797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.499637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751cb5-fed2-4f24-a67a-96916f4a50d3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.504742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.505566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.505844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.506119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.506837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.508510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.519320 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1926/3906] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:39.523557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.533908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c753-6df7-4ff3-bbac-7940f223ebab admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.538784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.539818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.540297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.540754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] PATH_INFO: `/v3/projects/9dbbf8af0631466ea29321a186498bda/users/aad68dd6c58e425d9489a9423a9708f2/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.559254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbbf8af0631466ea29321a186498bda, user_id=aad68dd6c58e425d9489a9423a9708f2, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.562941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.581414 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1981/3907] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:39 2022] PUT /identity/v3/projects/9dbbf8af0631466ea29321a186498bda/users/aad68dd6c58e425d9489a9423a9708f2/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:39.587099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.611996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654db14b-7cf2-40f1-a1ad-06909ebc87c8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.671952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6c319-5e19-413c-aa84-bd8dfa9453a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.672634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6c319-5e19-413c-aa84-bd8dfa9453a3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.672914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6c319-5e19-413c-aa84-bd8dfa9453a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.673226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6c319-5e19-413c-aa84-bd8dfa9453a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.674395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6c319-5e19-413c-aa84-bd8dfa9453a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.676377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6c319-5e19-413c-aa84-bd8dfa9453a3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.686736 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1927/3908] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:39.690899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.702167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df1ffb-cab3-44ed-8ff6-2da1bc59f17b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.707366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.708349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.708719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.709075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] PATH_INFO: `/v3/projects/9dbbf8af0631466ea29321a186498bda/users/aad68dd6c58e425d9489a9423a9708f2/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.711137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbbf8af0631466ea29321a186498bda, user_id=aad68dd6c58e425d9489a9423a9708f2, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.713894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.734584 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1982/3909] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:39 2022] PUT /identity/v3/projects/9dbbf8af0631466ea29321a186498bda/users/aad68dd6c58e425d9489a9423a9708f2/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:39.736561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5847a-e4b6-4f55-b94e-855eeeed57eb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.736846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5847a-e4b6-4f55-b94e-855eeeed57eb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.737164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5847a-e4b6-4f55-b94e-855eeeed57eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.765943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4fa5847a-e4b6-4f55-b94e-855eeeed57eb None None] MFA Rules not processed for user `aad68dd6c58e425d9489a9423a9708f2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:39.767184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4fa5847a-e4b6-4f55-b94e-855eeeed57eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:39.842137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1928/3910] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:39.846987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.858676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38b19b-94a1-4f5b-8fd0-f93a290fee2c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.863757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.864789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.865162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.865499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.866501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.867641 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:39.867641 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:39.867641 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:39.868629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.887018 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1983/3911] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Apr 9 21:07:39 2022] POST /identity/v3/domains => generated 275 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:39.891203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5847a-e4b6-4f55-b94e-855eeeed57eb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.900500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5847a-e4b6-4f55-b94e-855eeeed57eb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:39.955722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:39.956394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:39.956692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:39.956952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:39.957729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:39.958758 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:39.958758 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:39.958758 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:39.959638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:39.976289 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1929/3912] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Apr 9 21:07:39 2022] POST /identity/v3/domains => generated 275 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:39.980438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:39.991568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01e6b-59eb-40cf-8e5d-d55d9114d291 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:40.051759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:40.052456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:40.052867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:40.053178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:40.053920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:40.055560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:40.072977 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1984/3913] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Apr 9 21:07:39 2022] POST /identity/v3/domains => generated 276 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:40.077228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:40.088178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a700de-6129-45d4-9693-83254ca3bf9a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:40.163563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:40.164344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:40.164695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:40.165070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:40.165910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:40.167619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:40.192611 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1930/3914] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Apr 9 21:07:40 2022] POST /identity/v3/domains => generated 278 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:40.197183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:40.208052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0455a-31d5-4adf-8ef7-16774a8b49ea tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:40.319029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:40.320007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:40.320614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:40.320943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/e749d4edca2249e3bfc4aac02b4479a8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:40.353829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e749d4edca2249e3bfc4aac02b4479a8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:40.358132 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:40.358132 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:40.358132 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:40.359450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:40.388965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.396213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.479830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8', 'request_id': 'req-ec863392-513a-414b-9f9b-a49361eaa5b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.485732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8', 'request_id': 'req-ec863392-513a-414b-9f9b-a49361eaa5b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.499809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8', 'request_id': 'req-ec863392-513a-414b-9f9b-a49361eaa5b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.540715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] The token cache is being invalidate because project e749d4edca2249e3bfc4aac02b4479a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:40.541136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.542166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.562483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8', 'request_id': 'req-ec863392-513a-414b-9f9b-a49361eaa5b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.567696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8', 'request_id': 'req-ec863392-513a-414b-9f9b-a49361eaa5b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.568556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e749d4edca2249e3bfc4aac02b4479a8', 'request_id': 'req-ec863392-513a-414b-9f9b-a49361eaa5b4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.583398 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1985/3915] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:40 2022] DELETE /identity/v3/domains/e749d4edca2249e3bfc4aac02b4479a8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:40.587298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:40.589374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:40.611602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:40.611959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fff688-f984-4b52-8fad-6e858037ae38 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:40.614718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:40.733538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:40.734793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:40.735401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:40.736078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:40.738249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:40.740297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:40.763917 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1931/3916] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:07:40 2022] POST /identity/v3/domains => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:40.768368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:40.856323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec863392-513a-414b-9f9b-a49361eaa5b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:40.902992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95e0fd-385e-453c-b643-65b1f735a500 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:40.908837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:40.910082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:40.910368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:40.910648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/7720e798a21b481dbf7f51c7237115d3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:40.927847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7720e798a21b481dbf7f51c7237115d3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:40.929316 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:40.929316 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:40.929316 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:40.931104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:40.973489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7720e798a21b481dbf7f51c7237115d3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.975250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7720e798a21b481dbf7f51c7237115d3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:40.995747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:40.997565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:40.997851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:40.998565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:41.006092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:41.036620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:41.042269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:41.067464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7720e798a21b481dbf7f51c7237115d3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.068963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7720e798a21b481dbf7f51c7237115d3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.084962 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1932/3917] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:40 2022] PATCH /identity/v3/domains/7720e798a21b481dbf7f51c7237115d3 => generated 250 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:41.094589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1986/3918] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:41.098096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:41.101306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:41.287925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bfc2-0193-4ac9-a390-3cb7859ca3b4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:41.296942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:41.298169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:41.298586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:41.298961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/7720e798a21b481dbf7f51c7237115d3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:41.317113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7720e798a21b481dbf7f51c7237115d3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:41.318714 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:41.318714 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:41.318714 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:41.319896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:41.363246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7720e798a21b481dbf7f51c7237115d3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.375433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7720e798a21b481dbf7f51c7237115d3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.471386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7720e798a21b481dbf7f51c7237115d3', 'request_id': 'req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.478124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7720e798a21b481dbf7f51c7237115d3', 'request_id': 'req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.489825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7720e798a21b481dbf7f51c7237115d3', 'request_id': 'req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.512266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] The token cache is being invalidate because project 7720e798a21b481dbf7f51c7237115d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:41.512578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.513243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.523935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7720e798a21b481dbf7f51c7237115d3', 'request_id': 'req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.525146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7720e798a21b481dbf7f51c7237115d3', 'request_id': 'req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.530970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7720e798a21b481dbf7f51c7237115d3', 'request_id': 'req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.547594 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1933/3919] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:41 2022] DELETE /identity/v3/domains/7720e798a21b481dbf7f51c7237115d3 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:41.547809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:41.547809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:41.561130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1201a5-254d-484a-8180-a0fb21d07fc9 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:41.634036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:41.634737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:41.635017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:41.635293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:41.636031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:41.638765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:41.658363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1987/3920] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:07:41 2022] POST /identity/v3/domains => generated 279 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:41.659657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:41.661232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:41.676061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeacff9-ae8a-4e3f-99fd-791c2e3c8612 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:41.737998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:41.739247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:41.739673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:41.739951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/215910dfd39041f7a085dd09d7446520` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:41.755303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=215910dfd39041f7a085dd09d7446520)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:41.759900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:41.827635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '215910dfd39041f7a085dd09d7446520'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.828354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '215910dfd39041f7a085dd09d7446520'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.881502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '215910dfd39041f7a085dd09d7446520'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.882526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '215910dfd39041f7a085dd09d7446520'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:41.885223 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1934/3921] 10.222.0.30 () {60 vars in 1249 bytes} [Sat Apr 9 21:07:41 2022] PATCH /identity/v3/domains/215910dfd39041f7a085dd09d7446520 => generated 278 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:41.889629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:41.891474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:41.909127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a567191-5d5f-4e78-bb61-f1f67e0ace04 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:41.985514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:41.986678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:41.987386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:41.987938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/215910dfd39041f7a085dd09d7446520` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.010834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=215910dfd39041f7a085dd09d7446520)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.014664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:42.016976 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1988/3922] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:07:41 2022] GET /identity/v3/domains/215910dfd39041f7a085dd09d7446520 => generated 278 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:42.021189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.035098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962a09f-0089-4fb1-bbe4-50f72c285175 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.040378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.041428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.041734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.042008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/215910dfd39041f7a085dd09d7446520` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.043508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=215910dfd39041f7a085dd09d7446520)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.051253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:42.118459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '215910dfd39041f7a085dd09d7446520'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.124343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '215910dfd39041f7a085dd09d7446520'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.175277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215910dfd39041f7a085dd09d7446520', 'request_id': 'req-ea475399-dedb-472f-bcd6-e5258a618618'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.180626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215910dfd39041f7a085dd09d7446520', 'request_id': 'req-ea475399-dedb-472f-bcd6-e5258a618618'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.204733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215910dfd39041f7a085dd09d7446520', 'request_id': 'req-ea475399-dedb-472f-bcd6-e5258a618618'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.227291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] The token cache is being invalidate because project 215910dfd39041f7a085dd09d7446520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:42.227602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.228287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.236239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '215910dfd39041f7a085dd09d7446520', 'request_id': 'req-ea475399-dedb-472f-bcd6-e5258a618618'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.236889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '215910dfd39041f7a085dd09d7446520', 'request_id': 'req-ea475399-dedb-472f-bcd6-e5258a618618'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.240730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '215910dfd39041f7a085dd09d7446520', 'request_id': 'req-ea475399-dedb-472f-bcd6-e5258a618618'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.249323 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1935/3923] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:42 2022] DELETE /identity/v3/domains/215910dfd39041f7a085dd09d7446520 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:42.253201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.255238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:42.268560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021292-c18d-4a2d-b740-253b565e107d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.331829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.332493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.332923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.333402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.334108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.336194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:42.355133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1989/3924] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 21:07:42 2022] GET /identity/v3/domains => generated 1344 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:42.359508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.370236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea475399-dedb-472f-bcd6-e5258a618618 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.375335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.376080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.376362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.376641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/215910dfd39041f7a085dd09d7446520` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.386012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:07:42.395870 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find domain: 215910dfd39041f7a085dd09d7446520.: keystone.exception.DomainNotFound: Could not find domain: 215910dfd39041f7a085dd09d7446520. Apr 09 21:07:42.401586 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1936/3925] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:42 2022] PATCH /identity/v3/domains/215910dfd39041f7a085dd09d7446520 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:07:42.402739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.412794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a1734-dcd4-4a42-bebc-1fe3085ec66a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.418524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ae1f4-ca28-48d6-b759-7cfe6aa2015d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.419426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae1f4-ca28-48d6-b759-7cfe6aa2015d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.419791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae1f4-ca28-48d6-b759-7cfe6aa2015d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.420122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae1f4-ca28-48d6-b759-7cfe6aa2015d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.420989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ae1f4-ca28-48d6-b759-7cfe6aa2015d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.422800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ae1f4-ca28-48d6-b759-7cfe6aa2015d tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:42.475115 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1990/3926] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:07:42 2022] POST /identity/v3/domains => generated 276 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:42.476185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.496723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd483359-51e7-4163-b15f-93a1659daa3b tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.498248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea683-aff0-40ae-a154-d7f6a246e54b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.498610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea683-aff0-40ae-a154-d7f6a246e54b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.499180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea683-aff0-40ae-a154-d7f6a246e54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.517804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-882ea683-aff0-40ae-a154-d7f6a246e54b None None] MFA Rules not processed for user `4719eac69a2f4f25bbb1abfb3ef7c980`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:42.519047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-882ea683-aff0-40ae-a154-d7f6a246e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:42.557360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.558569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.558905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.559220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.559936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.562905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:42.585490 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1991/3927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:42.616735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ea683-aff0-40ae-a154-d7f6a246e54b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.624201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1937/3928] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:42 2022] POST /identity/v3/users => generated 346 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:42.630047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ea683-aff0-40ae-a154-d7f6a246e54b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.634967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.635722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.636005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.636289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.637263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.638313 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:42.638313 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:42.638313 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:42.640118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:42.665140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1992/3929] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:42 2022] POST /identity/v3/groups => generated 323 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:42.666622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.677280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436c25-12a6-4894-a3b7-e7fa59b55fa5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.682257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.683141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.683426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.683706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/eaf9b2e12d3147a5a012b9249b60c805` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.685076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=eaf9b2e12d3147a5a012b9249b60c805)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.686798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:42.706393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.707151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.732938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.733685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:42.736749 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1938/3930] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:42 2022] PATCH /identity/v3/domains/eaf9b2e12d3147a5a012b9249b60c805 => generated 277 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:42.740781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:42.743438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:42.756604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f4e4f-66d8-46d8-9781-c6ab82a617f5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:42.823473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:42.824358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:42.824631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:42.824897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/eaf9b2e12d3147a5a012b9249b60c805` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:42.836772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=eaf9b2e12d3147a5a012b9249b60c805)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:42.838496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.000678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.003966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.097145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.099442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:43.161570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4915c3c1edc460eaf171f002261d059'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.162239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4915c3c1edc460eaf171f002261d059'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.165287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb572a95-0563-4b3c-8930-c97ea8d4321c tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.169707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4915c3c1edc460eaf171f002261d059'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.181260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4915c3c1edc460eaf171f002261d059'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.181868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4915c3c1edc460eaf171f002261d059'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.219824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.220532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.220803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.221099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.223050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:43.234574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.236334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.243563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805', 'request_id': 'req-6f6d5e4f-fe8b-4551-9527-76558616ed54'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.246377 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1939/3931] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:43.248796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805', 'request_id': 'req-6f6d5e4f-fe8b-4551-9527-76558616ed54'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.263976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805', 'request_id': 'req-6f6d5e4f-fe8b-4551-9527-76558616ed54'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.275057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] The token cache is being invalidate because project eaf9b2e12d3147a5a012b9249b60c805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:43.275342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.275976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.284885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805', 'request_id': 'req-6f6d5e4f-fe8b-4551-9527-76558616ed54'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.288142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805', 'request_id': 'req-6f6d5e4f-fe8b-4551-9527-76558616ed54'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.288839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'eaf9b2e12d3147a5a012b9249b60c805', 'request_id': 'req-6f6d5e4f-fe8b-4551-9527-76558616ed54'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:43.294761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1993/3932] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:42 2022] DELETE /identity/v3/domains/eaf9b2e12d3147a5a012b9249b60c805 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:43.298703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.300163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:43.370461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12337e1c-4b74-49b1-a8bf-b06907c5460a service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.435148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.436134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.436411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.436682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/eaf9b2e12d3147a5a012b9249b60c805` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.448740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=eaf9b2e12d3147a5a012b9249b60c805)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.451761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.476098 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find domain: eaf9b2e12d3147a5a012b9249b60c805.: keystone.exception.DomainNotFound: Could not find domain: eaf9b2e12d3147a5a012b9249b60c805. Apr 09 21:07:43.478006 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1940/3933] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:07:43 2022] GET /identity/v3/domains/eaf9b2e12d3147a5a012b9249b60c805 => generated 112 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:07:43.481789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.483259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:43.497744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5e4f-fe8b-4551-9527-76558616ed54 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.504039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.504946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.505256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.505528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/users/c4915c3c1edc460eaf171f002261d059` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.514422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:get_user(user_id=c4915c3c1edc460eaf171f002261d059)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.516060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.532781 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find user: c4915c3c1edc460eaf171f002261d059.: keystone.exception.UserNotFound: Could not find user: c4915c3c1edc460eaf171f002261d059. Apr 09 21:07:43.534219 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1994/3934] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:07:43 2022] GET /identity/v3/users/c4915c3c1edc460eaf171f002261d059 => generated 110 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:07:43.538201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.550648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0186-d72a-416f-ba7d-7ed6b2b5edd7 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.556560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.558206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.558206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.558206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/groups/e2566273eb404c68a4f316db36af596b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.564517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:get_group(group_id=e2566273eb404c68a4f316db36af596b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.564517 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:43.564517 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:43.564517 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:43.565336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.578594 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find group: e2566273eb404c68a4f316db36af596b.: keystone.exception.GroupNotFound: Could not find group: e2566273eb404c68a4f316db36af596b. Apr 09 21:07:43.580437 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1941/3935] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:43 2022] GET /identity/v3/groups/e2566273eb404c68a4f316db36af596b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:07:43.583904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.603659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e82984-50dd-4336-b884-8e195d6e5c68 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.609552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.610432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.610751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.611064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/groups/e2566273eb404c68a4f316db36af596b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.616619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:07:43.625404 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find group: e2566273eb404c68a4f316db36af596b.: keystone.exception.GroupNotFound: Could not find group: e2566273eb404c68a4f316db36af596b. Apr 09 21:07:43.626959 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1995/3936] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:07:43 2022] DELETE /identity/v3/groups/e2566273eb404c68a4f316db36af596b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:07:43.631098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.643838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74cc23-2a1d-451b-882f-873cb5049098 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.649335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.650699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.651268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.652549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/users/c4915c3c1edc460eaf171f002261d059` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.665298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c4915c3c1edc460eaf171f002261d059)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.667324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.684713 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find user: c4915c3c1edc460eaf171f002261d059.: keystone.exception.UserNotFound: Could not find user: c4915c3c1edc460eaf171f002261d059. Apr 09 21:07:43.687129 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1942/3937] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:43 2022] DELETE /identity/v3/users/c4915c3c1edc460eaf171f002261d059 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:07:43.691317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.702743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a2b12-6258-4bec-8bdc-63675ca59607 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.710622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.711766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.712043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.712354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/eaf9b2e12d3147a5a012b9249b60c805` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.721328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:07:43.745127 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find domain: eaf9b2e12d3147a5a012b9249b60c805.: keystone.exception.DomainNotFound: Could not find domain: eaf9b2e12d3147a5a012b9249b60c805. Apr 09 21:07:43.750922 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1996/3938] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:43 2022] PATCH /identity/v3/domains/eaf9b2e12d3147a5a012b9249b60c805 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:07:43.752363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.764837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529bb0-65fc-4bee-a1c1-c51bab37fffd tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.771365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.772036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.772321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.773174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.773885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.775951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.796718 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1943/3939] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 21:07:43 2022] GET /identity/v3/domains => generated 1344 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:43.803225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.823374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b5b6f-c775-4438-b30a-934b59e287d6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.828684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.829416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.829700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.829979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.830698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:43.831007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.832676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.857208 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1997/3940] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:43 2022] GET /identity/v3/domains?enabled=True => generated 1092 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:43.858108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.869453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47e2b9-2f5e-43e4-89c9-0d12a95a8caf tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.875631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.876370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.876715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.877239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.878162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-969331074) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:43.878665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:43.880930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:43.911580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.925318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1944/3941] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Apr 9 21:07:43 2022] GET /identity/v3/domains?name=tempest-test_domain-969331074 => generated 406 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:43.928932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33efeae-22db-4c38-8ae3-d29b1705233f tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.939206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.941690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.942758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.943140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/eaf9b2e12d3147a5a012b9249b60c805` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:43.952130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:07:43.962039 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Could not find domain: eaf9b2e12d3147a5a012b9249b60c805.: keystone.exception.DomainNotFound: Could not find domain: eaf9b2e12d3147a5a012b9249b60c805. Apr 09 21:07:43.963469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1998/3942] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:43 2022] PATCH /identity/v3/domains/eaf9b2e12d3147a5a012b9249b60c805 => generated 112 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:07:43.968170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:43.981274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386b812-c30c-4ec1-bd1f-f63f955e111a tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:43.987617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:43.988805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:43.989252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:43.989560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/762fe321f5e4438284facfe304d1c5fd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:44.007532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=762fe321f5e4438284facfe304d1c5fd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:44.011999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:44.079569 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1945/3943] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:43 2022] PATCH /identity/v3/domains/762fe321f5e4438284facfe304d1c5fd => generated 276 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:44.083242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:44.096406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb938-dc21-484b-ade3-47f8ae073ff0 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:44.102120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:44.103118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:44.103472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:44.103900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/762fe321f5e4438284facfe304d1c5fd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:44.116574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=762fe321f5e4438284facfe304d1c5fd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:44.118384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:44.146356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '762fe321f5e4438284facfe304d1c5fd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.150294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '762fe321f5e4438284facfe304d1c5fd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.219629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762fe321f5e4438284facfe304d1c5fd', 'request_id': 'req-55b4e954-1e56-4080-a9a4-9e11780fd7d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.225437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762fe321f5e4438284facfe304d1c5fd', 'request_id': 'req-55b4e954-1e56-4080-a9a4-9e11780fd7d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.240619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762fe321f5e4438284facfe304d1c5fd', 'request_id': 'req-55b4e954-1e56-4080-a9a4-9e11780fd7d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.258107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] The token cache is being invalidate because project 762fe321f5e4438284facfe304d1c5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:44.258756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.259443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.269336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '762fe321f5e4438284facfe304d1c5fd', 'request_id': 'req-55b4e954-1e56-4080-a9a4-9e11780fd7d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.272745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '762fe321f5e4438284facfe304d1c5fd', 'request_id': 'req-55b4e954-1e56-4080-a9a4-9e11780fd7d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.273664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '762fe321f5e4438284facfe304d1c5fd', 'request_id': 'req-55b4e954-1e56-4080-a9a4-9e11780fd7d5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.280153 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 1999/3944] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:44 2022] DELETE /identity/v3/domains/762fe321f5e4438284facfe304d1c5fd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:44.286675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:44.289174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:44.303085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc808-06fe-419b-b474-925c2b6433c6 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:44.381524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:44.382424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:44.382702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:44.385374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/a1622e0b0eab41099f726588d59cbb94` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:44.405577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a1622e0b0eab41099f726588d59cbb94)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:44.409506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:44.446595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.452642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.491055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.491748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.495239 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1946/3945] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:44 2022] PATCH /identity/v3/domains/a1622e0b0eab41099f726588d59cbb94 => generated 276 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:44.498702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:44.513744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4e954-1e56-4080-a9a4-9e11780fd7d5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:44.641648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:44.642896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:44.643385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:44.643941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/a1622e0b0eab41099f726588d59cbb94` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:44.659797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a1622e0b0eab41099f726588d59cbb94)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:44.661795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:44.692005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.696349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.757325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94', 'request_id': 'req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.764723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94', 'request_id': 'req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.777700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94', 'request_id': 'req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.794770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] The token cache is being invalidate because project a1622e0b0eab41099f726588d59cbb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:44.795222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.795932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.807899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94', 'request_id': 'req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.812716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94', 'request_id': 'req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.813691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a1622e0b0eab41099f726588d59cbb94', 'request_id': 'req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:44.826302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2000/3946] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:44 2022] DELETE /identity/v3/domains/a1622e0b0eab41099f726588d59cbb94 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:44.830326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:44.831829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:44.850529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd79c8-b339-4bc3-bd77-3d1150273ba5 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:44.966189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:44.967948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:44.968352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:44.968665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/5ea6707a96ca4fb79d19da9d696d3134` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:44.990758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5ea6707a96ca4fb79d19da9d696d3134)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:44.997009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:45.020778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.021625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.060178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.060859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.064581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1947/3947] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:44 2022] PATCH /identity/v3/domains/5ea6707a96ca4fb79d19da9d696d3134 => generated 276 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:45.069710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:45.071692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:45.091735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4d45-2e10-43c8-88bf-9b11e0df81d4 tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:45.176618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad68dd6c58e425d9489a9423a9708f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbbf8af0631466ea29321a186498bda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:45.177614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:45.177903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:45.178177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] PATH_INFO: `/v3/domains/5ea6707a96ca4fb79d19da9d696d3134` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:45.190284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5ea6707a96ca4fb79d19da9d696d3134)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:45.192522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:45.215919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.219911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.335198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134', 'request_id': 'req-250df30a-4abd-44a6-af37-6ca954ef8c8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.344370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134', 'request_id': 'req-250df30a-4abd-44a6-af37-6ca954ef8c8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.357385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134', 'request_id': 'req-250df30a-4abd-44a6-af37-6ca954ef8c8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.374088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] The token cache is being invalidate because project 5ea6707a96ca4fb79d19da9d696d3134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:45.374539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.375297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.386573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134', 'request_id': 'req-250df30a-4abd-44a6-af37-6ca954ef8c8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.393577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134', 'request_id': 'req-250df30a-4abd-44a6-af37-6ca954ef8c8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.394377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-250df30a-4abd-44a6-af37-6ca954ef8c8e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5ea6707a96ca4fb79d19da9d696d3134', 'request_id': 'req-250df30a-4abd-44a6-af37-6ca954ef8c8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.404346 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2001/3948] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:45 2022] DELETE /identity/v3/domains/5ea6707a96ca4fb79d19da9d696d3134 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:45.408976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:45.411137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:45.569259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c78f8-1e77-40c9-b863-869cdbf0c82e tempest-DomainsTestJSON-1951135230 tempest-DomainsTestJSON-1951135230-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:45.639523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:45.641001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:45.641366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:45.641742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] PATH_INFO: `/v3/users/7e6c6e40f8404713a06f2dc648da0f5b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:45.643636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6c6e40f8404713a06f2dc648da0f5b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:45.645409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:45.728492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6c6e40f8404713a06f2dc648da0f5b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.733228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6c6e40f8404713a06f2dc648da0f5b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.755111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6c6e40f8404713a06f2dc648da0f5b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.757757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6c6e40f8404713a06f2dc648da0f5b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.780110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6c6e40f8404713a06f2dc648da0f5b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:45.808408 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1948/3949] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:45 2022] DELETE /identity/v3/users/7e6c6e40f8404713a06f2dc648da0f5b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:45.810457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:45.810808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:45.811086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:45.843739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:45.846194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:45.932479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2002/3950] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:45.946232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:45.949346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:46.052403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75bb96-1149-4c62-8c68-51a33b5ce9eb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:46.056189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:46.056854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:46.057172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:46.057452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:46.076010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:46.077605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:46.102319 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1949/3951] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:46.797221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:46.798762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:46.816087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7f78b-aeeb-4210-b3e6-5fe2250fc1a7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:46.821672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:46.822721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:46.823098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:46.823556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] PATH_INFO: `/v3/projects/aa11c45bb6014b27957d6f3ae6f66288` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:46.826170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa11c45bb6014b27957d6f3ae6f66288)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:46.828899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:46.899877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa11c45bb6014b27957d6f3ae6f66288', 'request_id': 'req-a59b508d-b1a2-4d05-98c2-18127d785a4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:46.912583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa11c45bb6014b27957d6f3ae6f66288', 'request_id': 'req-a59b508d-b1a2-4d05-98c2-18127d785a4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:46.923402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa11c45bb6014b27957d6f3ae6f66288', 'request_id': 'req-a59b508d-b1a2-4d05-98c2-18127d785a4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:46.938195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] The token cache is being invalidate because project aa11c45bb6014b27957d6f3ae6f66288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:46.938195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:46.939176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:46.941788 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2003/3952] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:46 2022] DELETE /identity/v3/projects/aa11c45bb6014b27957d6f3ae6f66288 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:46.947346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:46.969939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08923ab5-2983-444e-8cf0-dd99a19c32c6 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:47.053791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:47.055117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:47.055658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:47.056031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] PATH_INFO: `/v3/users/aad68dd6c58e425d9489a9423a9708f2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:47.058225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad68dd6c58e425d9489a9423a9708f2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:47.060696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:47.123937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad68dd6c58e425d9489a9423a9708f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:47.124588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad68dd6c58e425d9489a9423a9708f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:47.137373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad68dd6c58e425d9489a9423a9708f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:47.153805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad68dd6c58e425d9489a9423a9708f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:47.177246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad68dd6c58e425d9489a9423a9708f2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:47.217845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1950/3953] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:46 2022] DELETE /identity/v3/users/aad68dd6c58e425d9489a9423a9708f2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:47.954734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:47.956964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:47.989600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b508d-b1a2-4d05-98c2-18127d785a4b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.100766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.104204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.118423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.119302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.119709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.119981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] PATH_INFO: `/v3/projects/9dbbf8af0631466ea29321a186498bda` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.121416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbbf8af0631466ea29321a186498bda)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.123401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.175580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bcea5-0c6e-4d0e-b6dc-473f98de55ab admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.188570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbbf8af0631466ea29321a186498bda', 'request_id': 'req-f9ad0a73-79e4-4473-bf9c-7177a4202d38'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.197549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbbf8af0631466ea29321a186498bda', 'request_id': 'req-f9ad0a73-79e4-4473-bf9c-7177a4202d38'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.207937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbbf8af0631466ea29321a186498bda', 'request_id': 'req-f9ad0a73-79e4-4473-bf9c-7177a4202d38'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.222588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] The token cache is being invalidate because project 9dbbf8af0631466ea29321a186498bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:48.222588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.223230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f9ad0a73-79e4-4473-bf9c-7177a4202d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.224791 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2004/3954] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:47 2022] DELETE /identity/v3/projects/9dbbf8af0631466ea29321a186498bda => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:48.229735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e2079-c138-47b0-b3a8-0e7357e269f7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.230104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e2079-c138-47b0-b3a8-0e7357e269f7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.230436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e2079-c138-47b0-b3a8-0e7357e269f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.242549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.243522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.244399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.244399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] PATH_INFO: `/v3/users/0f54a88615644f5da8173e9bade66599` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.245903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f54a88615644f5da8173e9bade66599)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.247903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.251488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bc5e2079-c138-47b0-b3a8-0e7357e269f7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:48.253087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc5e2079-c138-47b0-b3a8-0e7357e269f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.274698 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2005/3955] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:48.282243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaf667-1e84-4c19-8e8c-e0a80a7b755f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.282608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaf667-1e84-4c19-8e8c-e0a80a7b755f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.282952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaf667-1e84-4c19-8e8c-e0a80a7b755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.305422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5abaf667-1e84-4c19-8e8c-e0a80a7b755f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:48.306730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5abaf667-1e84-4c19-8e8c-e0a80a7b755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.314440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f54a88615644f5da8173e9bade66599'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.315182 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2006/3956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:48.317652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f54a88615644f5da8173e9bade66599'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.319427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaf667-1e84-4c19-8e8c-e0a80a7b755f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.326398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f54a88615644f5da8173e9bade66599'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.327203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f54a88615644f5da8173e9bade66599'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.329874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaf667-1e84-4c19-8e8c-e0a80a7b755f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.335324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.336025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f54a88615644f5da8173e9bade66599'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.336144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.336309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.336570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.337541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:48.338005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.344095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.355858 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1951/3957] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:48 2022] DELETE /identity/v3/users/0f54a88615644f5da8173e9bade66599 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:48.364796 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2007/3958] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:48.369854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.372038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.444167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05836094-66e3-4094-93dc-17bf9d5359c2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.454016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.455256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.455256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.455256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.456429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.458517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.500187 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1952/3959] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:48.504233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.520226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ff0c-7f3e-4611-bede-80ae3f8ac77b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.586573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.588788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.619593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.619944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.620414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.620857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.622076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.625757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.661724 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2008/3960] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:48.664707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.680365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3c45f-578c-42ec-ab53-7e373ff1d4fa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.687594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.688661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.689142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.689674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.690914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.693595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.697245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d657-d353-4ee1-9d37-43d97a5b6de5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.704329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.705596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.705956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.710406 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2009/3961] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:48.710541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] PATH_INFO: `/v3/projects/b4603cd745c848eba3a1645f624e590e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.710541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4603cd745c848eba3a1645f624e590e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.711810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.711941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.723420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2589-f18a-45f0-a2e7-a70385340b7d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.727981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.728668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.728942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.729241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.729951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.731612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.742589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2010/3962] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:48.746893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.756794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0d6d3-6ab3-4a6d-899e-73b13abb7712 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.761227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4603cd745c848eba3a1645f624e590e', 'request_id': 'req-6289850a-c221-4fa1-b09d-a02d07888516'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.766751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4603cd745c848eba3a1645f624e590e', 'request_id': 'req-6289850a-c221-4fa1-b09d-a02d07888516'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.775107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4603cd745c848eba3a1645f624e590e', 'request_id': 'req-6289850a-c221-4fa1-b09d-a02d07888516'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.786618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] The token cache is being invalidate because project b4603cd745c848eba3a1645f624e590e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:48.786899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.787621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6289850a-c221-4fa1-b09d-a02d07888516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:48.789383 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1953/3963] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:48 2022] DELETE /identity/v3/projects/b4603cd745c848eba3a1645f624e590e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:48.794281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe348d-3e23-4a20-b0f2-1cb904fde3c8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.794570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe348d-3e23-4a20-b0f2-1cb904fde3c8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.794845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe348d-3e23-4a20-b0f2-1cb904fde3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.814408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bdea5-4dad-43ee-b46f-389aca28009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.814408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bdea5-4dad-43ee-b46f-389aca28009c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.814730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bdea5-4dad-43ee-b46f-389aca28009c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.815086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bdea5-4dad-43ee-b46f-389aca28009c admin admin] PATH_INFO: `/v3/projects/40677c2ac4154153a80e200eba043496/users/35cbae27b3e448f28d72e0a505cc6aed/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.816029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c5fe348d-3e23-4a20-b0f2-1cb904fde3c8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:48.817453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c5fe348d-3e23-4a20-b0f2-1cb904fde3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.826099 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1954/3964] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:48.831271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bdea5-4dad-43ee-b46f-389aca28009c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40677c2ac4154153a80e200eba043496, user_id=35cbae27b3e448f28d72e0a505cc6aed, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.833989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bdea5-4dad-43ee-b46f-389aca28009c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.834368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836407-cb58-4f24-a860-a0b4b90177e3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.834665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836407-cb58-4f24-a860-a0b4b90177e3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.834938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836407-cb58-4f24-a860-a0b4b90177e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.854236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2011/3965] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:48 2022] PUT /identity/v3/projects/40677c2ac4154153a80e200eba043496/users/35cbae27b3e448f28d72e0a505cc6aed/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:48.860974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c1836407-cb58-4f24-a860-a0b4b90177e3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:48.862275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c1836407-cb58-4f24-a860-a0b4b90177e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.864651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.864957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.865259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.893945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] MFA Rules not processed for user `35cbae27b3e448f28d72e0a505cc6aed`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:48.895199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.937492 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1955/3966] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:48.943537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1836407-cb58-4f24-a860-a0b4b90177e3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.953261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1836407-cb58-4f24-a860-a0b4b90177e3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.958646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.958822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.959010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.959306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.959979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:48.960285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:48.961955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:48.969169 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2012/3967] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:48.975132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1956/3968] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:48.975537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.976905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:48.980471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:48.991129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44766-b67c-45b7-a0c4-3d18203008ad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.991921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb884c-2663-445c-88b4-4242ed5a7fe6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:48.996392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:48.997268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:48.997620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:48.997959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:48.998820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.000255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.001065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.001352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.001805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.002278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.003992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.006442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.034199 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2013/3969] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:49.037865 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1957/3970] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:48 2022] POST /identity/v3/projects => generated 397 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:49.038327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.041612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.111081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946848ab-db88-475c-8c3f-9b420ac69823 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.116525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.117240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.117524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.117650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca167263-48c1-439b-9bba-f216f135a749 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.117829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.118489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.120468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.122460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.123270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.123530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.123729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.124445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.126411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.142359 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1958/3971] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:49.149234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.155647 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2014/3972] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:49.158942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb8413-2774-4fa1-b19d-06b5e75aa54c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.159218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.163612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.164275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.164548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.164816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.165603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.167186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.169143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bf99b-c8c1-4c5d-9b86-7e70aeaa72d4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.174093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.174749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.175030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.175299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.176017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.180089 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1959/3973] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:49.180225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.181921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.187695 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2015/3974] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:49.191559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.191763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abe9a0-3fca-4040-b4a5-0c5ad1722d07 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.196593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.197274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.197558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.197841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.198550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.200163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.200874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5c456-b668-4245-8a14-39f157e2a457 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.205558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.206441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.206714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.206977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] PATH_INFO: `/v3/projects/45b229cb96a64b2aa019d97f651deea6/users/923e66c17845494e90cfff14af4b35e1/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.210975 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1960/3975] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:49.215111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.224108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b229cb96a64b2aa019d97f651deea6, user_id=923e66c17845494e90cfff14af4b35e1, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.225068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f660-05a4-4068-9e53-8247f5c74a64 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.226777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.229676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e686-843e-4d75-9501-89fdeb8c1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.230555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e686-843e-4d75-9501-89fdeb8c1232 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.230860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e686-843e-4d75-9501-89fdeb8c1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.231114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e686-843e-4d75-9501-89fdeb8c1232 admin admin] PATH_INFO: `/v3/projects/0cd5ee978c6040a685a6b6050bc8981b/users/afc264d561b0437386836b0c8207b581/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.240071 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2016/3976] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:49 2022] PUT /identity/v3/projects/45b229cb96a64b2aa019d97f651deea6/users/923e66c17845494e90cfff14af4b35e1/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:49.244087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.246311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e686-843e-4d75-9501-89fdeb8c1232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd5ee978c6040a685a6b6050bc8981b, user_id=afc264d561b0437386836b0c8207b581, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.249130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e686-843e-4d75-9501-89fdeb8c1232 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.263273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1961/3977] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:49 2022] PUT /identity/v3/projects/0cd5ee978c6040a685a6b6050bc8981b/users/afc264d561b0437386836b0c8207b581/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:49.274655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542793b-b6ed-4623-b19d-8508c2b20ae9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.274950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542793b-b6ed-4623-b19d-8508c2b20ae9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.275231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542793b-b6ed-4623-b19d-8508c2b20ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.300384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0542793b-b6ed-4623-b19d-8508c2b20ae9 None None] MFA Rules not processed for user `afc264d561b0437386836b0c8207b581`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:49.301653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0542793b-b6ed-4623-b19d-8508c2b20ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.304023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6b55-9a8c-4dc6-85a7-4529fb264144 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.359650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.360338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.360682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.360959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.361740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.363355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.366009 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1962/3978] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:49.376186 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2017/3979] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:49.377182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea07986-8470-4667-982a-306c3a51904d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.377477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea07986-8470-4667-982a-306c3a51904d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.377769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea07986-8470-4667-982a-306c3a51904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.380092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.389475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d33aa-e0ea-48c6-8f90-060ef6cdfdad admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.394142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf82aa-818c-4cac-a645-53152dd19c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.394959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6ea07986-8470-4667-982a-306c3a51904d None None] MFA Rules not processed for user `afc264d561b0437386836b0c8207b581`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:49.395086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf82aa-818c-4cac-a645-53152dd19c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.395275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf82aa-818c-4cac-a645-53152dd19c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.395541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf82aa-818c-4cac-a645-53152dd19c3a admin admin] PATH_INFO: `/v3/projects/45b229cb96a64b2aa019d97f651deea6/users/923e66c17845494e90cfff14af4b35e1/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.396172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6ea07986-8470-4667-982a-306c3a51904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.397607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf82aa-818c-4cac-a645-53152dd19c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b229cb96a64b2aa019d97f651deea6, user_id=923e66c17845494e90cfff14af4b35e1, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.400228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf82aa-818c-4cac-a645-53152dd19c3a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.403527 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1963/3980] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:49.410948 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2018/3981] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:49 2022] PUT /identity/v3/projects/45b229cb96a64b2aa019d97f651deea6/users/923e66c17845494e90cfff14af4b35e1/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:49.415545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea07986-8470-4667-982a-306c3a51904d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.416897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6ea07986-8470-4667-982a-306c3a51904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.422116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2bb8a-1e78-47b2-8a62-cd7bde42abc2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.422340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2bb8a-1e78-47b2-8a62-cd7bde42abc2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.423025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2bb8a-1e78-47b2-8a62-cd7bde42abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.450604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dce2bb8a-1e78-47b2-8a62-cd7bde42abc2 None None] MFA Rules not processed for user `923e66c17845494e90cfff14af4b35e1`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:49.451657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dce2bb8a-1e78-47b2-8a62-cd7bde42abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.490781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea07986-8470-4667-982a-306c3a51904d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.524297 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2019/3982] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:49.529107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2bb8a-1e78-47b2-8a62-cd7bde42abc2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.542059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2bb8a-1e78-47b2-8a62-cd7bde42abc2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.548576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.549413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.549710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.550144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.550990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.552147 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.552147 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:49.552147 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:49.553435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.570439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e249c-53d0-40a9-ab5b-f050c7f73954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.571227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e249c-53d0-40a9-ab5b-f050c7f73954 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.571516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e249c-53d0-40a9-ab5b-f050c7f73954 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.571928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e249c-53d0-40a9-ab5b-f050c7f73954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.575111 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2020/3983] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/services => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:49.579794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.600894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ffff9-9f3d-499e-988f-857e49b2f949 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.606900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.607670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.607955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.608234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.608977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.610126 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.610126 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:49.610126 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:49.610949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.629344 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2021/3984] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:49.630899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.646058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d886-2d9f-4396-8bf8-fc3e93ddd136 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.653321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e249c-53d0-40a9-ab5b-f050c7f73954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.655132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e249c-53d0-40a9-ab5b-f050c7f73954 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.655374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.656094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.656404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.656736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.658105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.659976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.667791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1964/3985] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:49.682924 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2022/3986] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/services => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:49.693501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.694155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0518b-3cdf-493f-bdf0-81f9dde7b31c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.694449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0518b-3cdf-493f-bdf0-81f9dde7b31c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.694729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0518b-3cdf-493f-bdf0-81f9dde7b31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.713864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e9d0518b-3cdf-493f-bdf0-81f9dde7b31c None None] MFA Rules not processed for user `afc264d561b0437386836b0c8207b581`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:49.715737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e9d0518b-3cdf-493f-bdf0-81f9dde7b31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.726084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5610-72cf-47c7-9b26-3814d21020e5 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.731177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643e605-b9bc-46d2-9002-89ab40190782 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.731936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643e605-b9bc-46d2-9002-89ab40190782 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.732529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643e605-b9bc-46d2-9002-89ab40190782 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.732884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643e605-b9bc-46d2-9002-89ab40190782 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.734289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643e605-b9bc-46d2-9002-89ab40190782 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.735923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643e605-b9bc-46d2-9002-89ab40190782 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.749195 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1965/3987] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3529 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:49.749444 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2023/3988] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:49.754148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0518b-3cdf-493f-bdf0-81f9dde7b31c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.770476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3d1cf-a266-440e-b91f-f05286cc9206 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.770757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3d1cf-a266-440e-b91f-f05286cc9206 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.770947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0518b-3cdf-493f-bdf0-81f9dde7b31c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.771169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3d1cf-a266-440e-b91f-f05286cc9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.775738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.776335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.776618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.777110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.777825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.778864 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.778864 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:49.778864 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:49.779807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.786675 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1966/3989] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:49.790721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.791813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b6d3d1cf-a266-440e-b91f-f05286cc9206 None None] MFA Rules not processed for user `afc264d561b0437386836b0c8207b581`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:49.793084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6d3d1cf-a266-440e-b91f-f05286cc9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.800481 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2024/3990] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3529 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:49.800634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bf72f-06cb-46e5-ba81-43d4d74d6d46 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.805190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162c444-9da9-449a-93a9-116b72be8cd1 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.806037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c444-9da9-449a-93a9-116b72be8cd1 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.806311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c444-9da9-449a-93a9-116b72be8cd1 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.806637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c444-9da9-449a-93a9-116b72be8cd1 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.807294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162c444-9da9-449a-93a9-116b72be8cd1 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=8655cd172a4d4677b96b68c00f1bfa9a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.808297 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-7162c444-9da9-449a-93a9-116b72be8cd1 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.808297 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:49.808297 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:49.809191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162c444-9da9-449a-93a9-116b72be8cd1 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.817219 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1967/3991] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a => generated 333 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:49.819466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3d1cf-a266-440e-b91f-f05286cc9206 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.822742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e94a-58f0-49da-b352-32eeea98a14e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.823037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e94a-58f0-49da-b352-32eeea98a14e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.823310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e94a-58f0-49da-b352-32eeea98a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.831624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3d1cf-a266-440e-b91f-f05286cc9206 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.836486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.838003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.838401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.838708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.839394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=8655cd172a4d4677b96b68c00f1bfa9a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.840441 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.840441 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:49.840441 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:49.840834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3ff8e94a-58f0-49da-b352-32eeea98a14e None None] MFA Rules not processed for user `afc264d561b0437386836b0c8207b581`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:49.841486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.842047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ff8e94a-58f0-49da-b352-32eeea98a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.851746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2025/3992] 10.222.0.30 () {58 vars in 1290 bytes} [Sat Apr 9 21:07:49 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a => generated 0 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:49.851887 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1968/3993] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3529 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:49.853084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.863094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52656b74-4d86-43d3-8ddf-e5c34e196548 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.871032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.871815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.872098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.872371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.873027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8655cd172a4d4677b96b68c00f1bfa9a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.873459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6715-279f-487c-8dac-69374a505515 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.873754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6715-279f-487c-8dac-69374a505515 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.874035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6715-279f-487c-8dac-69374a505515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.874133 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.874133 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:49.874133 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:49.875011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.889336 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2026/3994] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:07:49 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:49.893257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.894016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-679d6715-279f-487c-8dac-69374a505515 None None] MFA Rules not processed for user `afc264d561b0437386836b0c8207b581`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:49.895240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-679d6715-279f-487c-8dac-69374a505515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:49.903444 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1969/3995] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3529 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:49.904342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771a1a7-e425-43dc-8fb7-9c7f41d5c4a9 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.912174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.912913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.913208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.913491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.914198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.915291 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.915291 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:49.915291 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:49.919324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.920908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6715-279f-487c-8dac-69374a505515 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.924790 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2027/3996] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Apr 9 21:07:49 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:49.928878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.940865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5ade-1fc9-4834-a7e9-ef041d01f867 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.946172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.947044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.947328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.947672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.948337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8655cd172a4d4677b96b68c00f1bfa9a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.950054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.962624 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Could not find Endpoint Group: 8655cd172a4d4677b96b68c00f1bfa9a.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 8655cd172a4d4677b96b68c00f1bfa9a. Apr 09 21:07:49.964163 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2028/3997] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:07:49 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8655cd172a4d4677b96b68c00f1bfa9a => generated 120 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:07:49.968484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:49.979007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bddea4-6c23-49eb-9dcf-224d83f9865d tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:49.984330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:49.985221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:49.985508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:49.985850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services/ece4ccde01474c1b8d1cd918f673a4b5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:49.986461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ece4ccde01474c1b8d1cd918f673a4b5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:49.987496 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:49.987496 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:49.987496 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:49.988384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:49.998214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6715-279f-487c-8dac-69374a505515 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.003795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.004777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.005094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.005381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] PATH_INFO: `/v3/users/afc264d561b0437386836b0c8207b581` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.006949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc264d561b0437386836b0c8207b581)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.008753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.015164 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2029/3998] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:49 2022] DELETE /identity/v3/services/ece4ccde01474c1b8d1cd918f673a4b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:50.022243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.047394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c612bc-d36b-4ce4-bb30-1b5e4fd609d4 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.052774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.053485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.053821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.054098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.054921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.056541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.075593 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2030/3999] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:50 2022] POST /identity/v3/services => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:50.080015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.106270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cc9eb-daec-47a8-a3a5-3551974ac665 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.109559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc264d561b0437386836b0c8207b581'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.110382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc264d561b0437386836b0c8207b581'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.112188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.113175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.113561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.113940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.114782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.116955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.118783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc264d561b0437386836b0c8207b581'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.120087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc264d561b0437386836b0c8207b581'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.128850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-208b4bb1-1225-4db8-b50f-270d7293a1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc264d561b0437386836b0c8207b581'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.130236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2031/4000] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Apr 9 21:07:50 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:50.140244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.143659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:50.153350 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1970/4001] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:49 2022] DELETE /identity/v3/users/afc264d561b0437386836b0c8207b581 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:50.158013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.158377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.158749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.169719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be6ea2-6295-47e2-8194-55ae57d70b9a tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.179569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:50.180900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:50.235285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.235979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.236265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.236539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.237312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.238977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.258387 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2032/4002] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:50 2022] POST /identity/v3/services => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:50.260393 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1971/4003] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3495 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:50.261139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.270966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.272345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:50.289123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5b97-796f-445d-9b02-a5d367a117e0 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.294124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.295050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.295329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.295599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d985b68b1b7849ff9f3ce1250b99c15d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.296330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=d985b68b1b7849ff9f3ce1250b99c15d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.297397 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:50.297397 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:50.297397 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:50.298277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.316157 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2033/4004] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Apr 9 21:07:50 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/d985b68b1b7849ff9f3ce1250b99c15d => generated 335 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:50.327943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.346549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ae05-94cf-4062-b374-c5d440d14340 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.360098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.361912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.362278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.362681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services/6c09a8975df5417ab1320b7b1398b7a7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.363503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6c09a8975df5417ab1320b7b1398b7a7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.365826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.400328 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2034/4005] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:50 2022] DELETE /identity/v3/services/6c09a8975df5417ab1320b7b1398b7a7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:50.405179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba197e55-0abe-435f-ae5b-51248414e56f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.406036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.429266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.429926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.430231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.430529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.440919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.442807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.448587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b1c21-35ab-4b8d-9dc3-0ab23ed14c92 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.457524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.458489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.458833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.459285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d985b68b1b7849ff9f3ce1250b99c15d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.460008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=d985b68b1b7849ff9f3ce1250b99c15d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.461773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.465339 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1972/4006] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:50 2022] GET /identity/v3/auth/tokens => generated 3495 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:50.472627 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2035/4007] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:07:50 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/d985b68b1b7849ff9f3ce1250b99c15d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:50.477486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.488257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a882e7-4e07-4950-8bff-6df7553d1e07 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.493485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.494490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.494894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.495174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services/0f7e1207bcc348b1ab2a7427ad62d1ca` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.495825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0f7e1207bcc348b1ab2a7427ad62d1ca)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.496869 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:50.496869 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:50.496869 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:50.497809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.526705 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1973/4008] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:50 2022] DELETE /identity/v3/services/0f7e1207bcc348b1ab2a7427ad62d1ca => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:50.532104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.542300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a61fc-8c30-48e5-8797-0d295b6acde3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.559026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.559898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.560178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.560455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/372504332f0a458b9b0427c39c0fd5a8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.561314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=372504332f0a458b9b0427c39c0fd5a8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.563130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.574491 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2036/4009] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:07:50 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/372504332f0a458b9b0427c39c0fd5a8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:50.579420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.589934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d789d-07aa-469c-8047-285ffdd0fef3 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.595534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923e66c17845494e90cfff14af4b35e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45b229cb96a64b2aa019d97f651deea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.596438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.596715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.596987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] PATH_INFO: `/v3/services/1a688b2fa40e4e8d928320fc70289435` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.597676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1a688b2fa40e4e8d928320fc70289435)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.599272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.622738 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1974/4010] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:50 2022] DELETE /identity/v3/services/1a688b2fa40e4e8d928320fc70289435 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:50.627428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.630025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:50.658014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5df1af-317c-44ca-93e7-e199860f13c2 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.672980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.673912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.674390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.674668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] PATH_INFO: `/v3/users/35cbae27b3e448f28d72e0a505cc6aed` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.676089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cbae27b3e448f28d72e0a505cc6aed)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.678138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.725668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cbae27b3e448f28d72e0a505cc6aed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.726421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cbae27b3e448f28d72e0a505cc6aed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.735508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cbae27b3e448f28d72e0a505cc6aed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.743349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cbae27b3e448f28d72e0a505cc6aed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.744653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0d90849-e208-4c35-b831-926d8f98ffec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cbae27b3e448f28d72e0a505cc6aed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.756963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.758755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:50.772576 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2037/4011] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:50 2022] DELETE /identity/v3/users/35cbae27b3e448f28d72e0a505cc6aed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:50.777008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.777008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.777399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.784049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a73f76-7121-45e1-a765-f75adb90cf82 tempest-EndPointGroupsTest-1125572748 tempest-EndPointGroupsTest-1125572748-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.809685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:50.810945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:50.842185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:50.843400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.843672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.843945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] PATH_INFO: `/v3/projects/0cd5ee978c6040a685a6b6050bc8981b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.845177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd5ee978c6040a685a6b6050bc8981b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:50.847176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:50.871843 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2038/4012] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:50.884855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:50.886500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:50.903776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd5ee978c6040a685a6b6050bc8981b', 'request_id': 'req-81b4b613-d757-4669-b72d-b68ddef1aeeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.911883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd5ee978c6040a685a6b6050bc8981b', 'request_id': 'req-81b4b613-d757-4669-b72d-b68ddef1aeeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.921549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd5ee978c6040a685a6b6050bc8981b', 'request_id': 'req-81b4b613-d757-4669-b72d-b68ddef1aeeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.932630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] The token cache is being invalidate because project 0cd5ee978c6040a685a6b6050bc8981b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:50.932914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.933670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81b4b613-d757-4669-b72d-b68ddef1aeeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:50.935449 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1975/4013] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:50 2022] DELETE /identity/v3/projects/0cd5ee978c6040a685a6b6050bc8981b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:50.944916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef553824-14f0-4b71-aaf2-28cca5c06808 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:50.945325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef553824-14f0-4b71-aaf2-28cca5c06808 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:50.945669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef553824-14f0-4b71-aaf2-28cca5c06808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:50.964725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d91e3-b3db-4939-9d7a-37c18ca7ec56 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:50.965220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ef553824-14f0-4b71-aaf2-28cca5c06808 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:50.966463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ef553824-14f0-4b71-aaf2-28cca5c06808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.012815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.013504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.013787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.014077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.016062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.030805 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1976/4014] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:51.089277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.091478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.103185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2039/4015] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:51.108556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1efc4a-1221-450e-a2a3-b15ee0694af4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.108839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1efc4a-1221-450e-a2a3-b15ee0694af4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.109141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1efc4a-1221-450e-a2a3-b15ee0694af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.129863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0d1efc4a-1221-450e-a2a3-b15ee0694af4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:51.131104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0d1efc4a-1221-450e-a2a3-b15ee0694af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.140574 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1977/4016] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:51.145251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.155889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de14bba-ca82-4cdd-b946-eeda712dc561 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.161017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.161727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.162004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.162252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.163002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:51.163275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.164914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.177869 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2040/4017] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:51.182870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1efc4a-1221-450e-a2a3-b15ee0694af4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.192257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1efc4a-1221-450e-a2a3-b15ee0694af4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.197099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.197779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.198051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.198316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.199014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.201118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.232575 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1978/4018] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:51 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:51.233965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.244098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e9f48-9d3d-4998-b72e-34214ffa953d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.308278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.309293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.309630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.310015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.310792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.312886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.339939 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2041/4019] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:51 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:51.350358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.362344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e184c1-4fea-4b40-a280-fe0c7d8f8a6f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.373522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.374211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.374504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.374846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.375681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.378859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.386593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.388399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.391916 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1979/4020] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:51.398167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.409261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d06f-c1e6-43b2-856e-3050ed77efd3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.414510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e44db-df99-42c3-b5ed-bc7ac97477d2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.416641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.418016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.418650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.419076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] PATH_INFO: `/v3/projects/40677c2ac4154153a80e200eba043496` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.419803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.420678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40677c2ac4154153a80e200eba043496)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.421971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.422079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.422284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.424069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.433809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.441341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.474049 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1980/4021] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:51.478500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.489018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64efab-6973-4a60-8d20-75c9b8469ac6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.504929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40677c2ac4154153a80e200eba043496', 'request_id': 'req-3171c82a-2b6d-4629-9330-4bdb8f366b94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.514852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40677c2ac4154153a80e200eba043496', 'request_id': 'req-3171c82a-2b6d-4629-9330-4bdb8f366b94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.525505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40677c2ac4154153a80e200eba043496', 'request_id': 'req-3171c82a-2b6d-4629-9330-4bdb8f366b94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.539942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] The token cache is being invalidate because project 40677c2ac4154153a80e200eba043496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:51.540227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.540894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.542797 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2042/4022] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:51 2022] DELETE /identity/v3/projects/40677c2ac4154153a80e200eba043496 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:51.546928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.548459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.560092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a83f-20c2-4faf-ae99-e002d36bcbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.561216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a83f-20c2-4faf-ae99-e002d36bcbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.561506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a83f-20c2-4faf-ae99-e002d36bcbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.561784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a83f-20c2-4faf-ae99-e002d36bcbe6 admin admin] PATH_INFO: `/v3/projects/c9f995113d394d2fa8d8f8a6b69fdf80/users/dfc0efaed98343d59dd81317352938e6/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.607947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a83f-20c2-4faf-ae99-e002d36bcbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f995113d394d2fa8d8f8a6b69fdf80, user_id=dfc0efaed98343d59dd81317352938e6, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.610683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a83f-20c2-4faf-ae99-e002d36bcbe6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.635817 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1981/4023] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:51 2022] PUT /identity/v3/projects/c9f995113d394d2fa8d8f8a6b69fdf80/users/dfc0efaed98343d59dd81317352938e6/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:51.645830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.646299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.646382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171c82a-2b6d-4629-9330-4bdb8f366b94 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.646813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.680913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:51.682249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.721347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.722533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.722812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.723087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] PATH_INFO: `/v3/users/923e66c17845494e90cfff14af4b35e1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.727887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] RBAC: Authorizing `identity:delete_user(user_id=923e66c17845494e90cfff14af4b35e1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.729932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:51.761116 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1982/4024] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:51.770686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:51.772093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.785343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923e66c17845494e90cfff14af4b35e1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.786669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923e66c17845494e90cfff14af4b35e1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.795900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923e66c17845494e90cfff14af4b35e1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.805332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923e66c17845494e90cfff14af4b35e1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.806227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923e66c17845494e90cfff14af4b35e1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:51.826745 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2043/4025] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:51 2022] DELETE /identity/v3/users/923e66c17845494e90cfff14af4b35e1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:51.838253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1b6bd-e018-4c59-a71d-a46d273bf41f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:51.892097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed909c9-5eef-46a9-9958-30a756a34584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:51.892790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed909c9-5eef-46a9-9958-30a756a34584 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:51.893164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed909c9-5eef-46a9-9958-30a756a34584 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:51.893439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed909c9-5eef-46a9-9958-30a756a34584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:51.895806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bed909c9-5eef-46a9-9958-30a756a34584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:51.989115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed909c9-5eef-46a9-9958-30a756a34584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:51.991011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed909c9-5eef-46a9-9958-30a756a34584 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.003533 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1983/4026] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:52.242370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.243897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:52.257964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abe051-89e0-431e-8fb1-c8e0bcf5309e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:52.263642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:52.265317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.265599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.265872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] PATH_INFO: `/v3/projects/45b229cb96a64b2aa019d97f651deea6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.267419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b229cb96a64b2aa019d97f651deea6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:52.269713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.338513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b229cb96a64b2aa019d97f651deea6', 'request_id': 'req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:52.344783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b229cb96a64b2aa019d97f651deea6', 'request_id': 'req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:52.354730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b229cb96a64b2aa019d97f651deea6', 'request_id': 'req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:52.368795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] The token cache is being invalidate because project 45b229cb96a64b2aa019d97f651deea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:52.369514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:52.370347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6bfa73ae-226e-48cb-90f9-c69c49e2b1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:52.372329 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2044/4027] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:52 2022] DELETE /identity/v3/projects/45b229cb96a64b2aa019d97f651deea6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:52.377852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e02f42-e5f8-4c69-bb14-a2f513f05efd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.378372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e02f42-e5f8-4c69-bb14-a2f513f05efd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.378505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e02f42-e5f8-4c69-bb14-a2f513f05efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.398976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-05e02f42-e5f8-4c69-bb14-a2f513f05efd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:52.400195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-05e02f42-e5f8-4c69-bb14-a2f513f05efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:52.469953 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1984/4028] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:52.477711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db939-cfed-44b5-9127-64d6e6a26330 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.478328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db939-cfed-44b5-9127-64d6e6a26330 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.478843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db939-cfed-44b5-9127-64d6e6a26330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.501073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-900db939-cfed-44b5-9127-64d6e6a26330 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:52.502428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-900db939-cfed-44b5-9127-64d6e6a26330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:52.512373 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2045/4029] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:52.516768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e02f42-e5f8-4c69-bb14-a2f513f05efd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.529329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e02f42-e5f8-4c69-bb14-a2f513f05efd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:52.534183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:52.534881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.535163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.535439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.536174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:52.536480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:52.538162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.550260 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1985/4030] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:52.554784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db939-cfed-44b5-9127-64d6e6a26330 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.564050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db939-cfed-44b5-9127-64d6e6a26330 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:52.568880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:52.569625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.569905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.570174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.570856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:52.572773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.603085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2046/4031] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:52 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:52.604224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.616728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62cb3-9af9-402d-9ce3-3de8a60de9a1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:52.682762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:52.683624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.684001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.684368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.685184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:52.687327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.714967 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1986/4032] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:52 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:52.716545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.729865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38a42-3e56-4998-add5-0edd83de620b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:52.735421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:52.736301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.736977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.737374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.738630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:52.740183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.762117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2047/4033] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:52.764068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.776009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7730d4-10cd-45a5-a4f7-3bb8bc4dd008 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:52.785270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb48e-b1f5-430d-955d-fd793e53a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:52.786104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb48e-b1f5-430d-955d-fd793e53a3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.786414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb48e-b1f5-430d-955d-fd793e53a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.786691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb48e-b1f5-430d-955d-fd793e53a3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.787410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb48e-b1f5-430d-955d-fd793e53a3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:52.789150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb48e-b1f5-430d-955d-fd793e53a3b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.812942 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1987/4034] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:52.816712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.831135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce6309-7d2c-403d-a45e-fef0d98c0aa8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:52.843219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.843513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.843859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.850279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ada6e0-56b7-41fd-9514-a11f71a9299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:52.852047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada6e0-56b7-41fd-9514-a11f71a9299e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.852297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada6e0-56b7-41fd-9514-a11f71a9299e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.852572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada6e0-56b7-41fd-9514-a11f71a9299e admin admin] PATH_INFO: `/v3/projects/935394d68d4444d9baba9b8f2970626e/users/6419ab06282f44a2b88d0335c51f6771/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.880790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] MFA Rules not processed for user `dfc0efaed98343d59dd81317352938e6`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:52.882022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:52.887518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ada6e0-56b7-41fd-9514-a11f71a9299e admin admin] RBAC: Authorizing `identity:create_grant(project_id=935394d68d4444d9baba9b8f2970626e, user_id=6419ab06282f44a2b88d0335c51f6771, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:52.901215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ada6e0-56b7-41fd-9514-a11f71a9299e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:52.930893 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2048/4035] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:52 2022] PUT /identity/v3/projects/935394d68d4444d9baba9b8f2970626e/users/6419ab06282f44a2b88d0335c51f6771/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:52.934025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d9c4-be05-4df8-986a-44f57b81640e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:52.934421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d9c4-be05-4df8-986a-44f57b81640e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:52.934941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d9c4-be05-4df8-986a-44f57b81640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:52.977272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fbc3d9c4-be05-4df8-986a-44f57b81640e None None] MFA Rules not processed for user `6419ab06282f44a2b88d0335c51f6771`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:52.978243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fbc3d9c4-be05-4df8-986a-44f57b81640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:52.978520 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1988/4036] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:52.989445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:52.990870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:53.045649 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2049/4037] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:53.050036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d9c4-be05-4df8-986a-44f57b81640e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.093060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635503e0-cc2e-48f9-9b3d-e3cfade6020a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.111508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d9c4-be05-4df8-986a-44f57b81640e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.116433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.117143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.117426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.117824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.118522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.120452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.153256 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2050/4038] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:53.157551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.162386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.163129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.163483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.163855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.220409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aff55-57e9-4675-b16c-870f61f1b859 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.222699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.224510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.225362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.226126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.226500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.226850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.227677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.229657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.234101 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1989/4039] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:53.252648 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2051/4040] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:53.256754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.269751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614fd3-ed9f-4aab-b1b3-1fd84e4eae1c service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.275145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.275856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.276143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.276548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.277328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.278955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.293015 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1990/4041] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:53.297140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.307710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f05fb-d303-4039-a72c-50c40925565f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.313707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.314682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.314958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.315233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] PATH_INFO: `/v3/projects/c5a50a63767d461788f9314ecb947229/users/010e0860b26247ef8066af9cd62c9410/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.331867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a50a63767d461788f9314ecb947229, user_id=010e0860b26247ef8066af9cd62c9410, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.334645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.349083 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2052/4042] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:53 2022] PUT /identity/v3/projects/c5a50a63767d461788f9314ecb947229/users/010e0860b26247ef8066af9cd62c9410/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:53.352873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.363452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ea08a-25a1-480d-b89e-1f95b1ce2d0a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.421727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487853e-ceb8-4d7c-a699-e93d9e8f61c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.422507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487853e-ceb8-4d7c-a699-e93d9e8f61c3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.422837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487853e-ceb8-4d7c-a699-e93d9e8f61c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.423074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487853e-ceb8-4d7c-a699-e93d9e8f61c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.423804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487853e-ceb8-4d7c-a699-e93d9e8f61c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.425534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487853e-ceb8-4d7c-a699-e93d9e8f61c3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.436518 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1991/4043] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:53.445010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.462271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da0b8f-00de-47c8-bc33-bc20163b0afa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.467598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.468983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.469305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.469577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] PATH_INFO: `/v3/projects/c5a50a63767d461788f9314ecb947229/users/010e0860b26247ef8066af9cd62c9410/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.471595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a50a63767d461788f9314ecb947229, user_id=010e0860b26247ef8066af9cd62c9410, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.474326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.485193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2053/4044] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:53 2022] PUT /identity/v3/projects/c5a50a63767d461788f9314ecb947229/users/010e0860b26247ef8066af9cd62c9410/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:53.496340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b481622-3661-4b62-9e83-bd52cc940143 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.496629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b481622-3661-4b62-9e83-bd52cc940143 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.496907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b481622-3661-4b62-9e83-bd52cc940143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.523206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2b481622-3661-4b62-9e83-bd52cc940143 None None] MFA Rules not processed for user `010e0860b26247ef8066af9cd62c9410`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:53.525194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2b481622-3661-4b62-9e83-bd52cc940143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:53.596199 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1992/4045] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:53.597449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.615296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3277be6-74ce-43d0-8c27-dc7a9e8cbad8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.623807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.624690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.624974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.625291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.626380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.628330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.652778 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2054/4046] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/domains => generated 276 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:53.657267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b481622-3661-4b62-9e83-bd52cc940143 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.668394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b481622-3661-4b62-9e83-bd52cc940143 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.741051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.741767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.742053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.742331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.743033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.744972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.790261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1993/4047] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:53.795104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.807010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c6e8-ca2b-4813-8705-cf07207d17fc tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.896626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.897334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.897619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.897892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.898580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.900504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.923323 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2055/4048] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/groups => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:53.926938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.940578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528d75-2afe-4e80-b122-006751b9523d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.947735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.948588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.948999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.949421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.950918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.953314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:53.975093 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1994/4049] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/users => generated 445 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:53.979610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:53.990012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcecd4c-d5bd-4675-b86c-5405b707351b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:53.994738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:53.995435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:53.995719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:53.995997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:53.996765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:53.997859 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:53.997859 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:53.997859 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:53.998835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.014720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2056/4050] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:07:53 2022] POST /identity/v3/roles => generated 239 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:54.019263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.030376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd34c95-05be-4467-aa3f-bd53e5877d07 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.035653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.036644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.037001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.037383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/groups/13a95935d4f8475cbc63487332b8fb0d/roles/87a68b07b5104c51b566c5336a1093cf/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.053491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, group_id=13a95935d4f8475cbc63487332b8fb0d, role_id=87a68b07b5104c51b566c5336a1093cf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.056581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.070936 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1995/4051] 10.222.0.30 () {60 vars in 1584 bytes} [Sat Apr 9 21:07:54 2022] PUT /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/groups/13a95935d4f8475cbc63487332b8fb0d/roles/87a68b07b5104c51b566c5336a1093cf/inherited_to_projects => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:54.075440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.086459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf43be-c40b-4ef0-bbc1-88cb23a76b59 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.144971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.145904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.146183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.146460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/groups/13a95935d4f8475cbc63487332b8fb0d/roles/87a68b07b5104c51b566c5336a1093cf/inherited_to_projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.148713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, group_id=13a95935d4f8475cbc63487332b8fb0d, role_id=87a68b07b5104c51b566c5336a1093cf)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.149814 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:54.149814 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:54.149814 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:54.151755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.159875 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2057/4052] 10.222.0.30 () {58 vars in 1566 bytes} [Sat Apr 9 21:07:54 2022] HEAD /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/groups/13a95935d4f8475cbc63487332b8fb0d/roles/87a68b07b5104c51b566c5336a1093cf/inherited_to_projects => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:54.164295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.174971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4bf58-079b-4548-975d-75afe9ab6000 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.180035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.180895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.181228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.181509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/groups/13a95935d4f8475cbc63487332b8fb0d/roles/87a68b07b5104c51b566c5336a1093cf/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.184033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, group_id=13a95935d4f8475cbc63487332b8fb0d, role_id=87a68b07b5104c51b566c5336a1093cf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.185109 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:54.185109 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:54.185109 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:54.187157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.194537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 87a68b07b5104c51b566c5336a1093cf was removed from group 13a95935d4f8475cbc63487332b8fb0d on project 8ccc875e4f044f7cbf34192d8a3e0569. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:54.194828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.195553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.210855 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1996/4053] 10.222.0.30 () {58 vars in 1568 bytes} [Sat Apr 9 21:07:54 2022] DELETE /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/groups/13a95935d4f8475cbc63487332b8fb0d/roles/87a68b07b5104c51b566c5336a1093cf/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:54.215146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.217130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:54.230592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092bcb-0a94-4c99-9bec-33bdadf92d73 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.296070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.297071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.297271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.297545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles/87a68b07b5104c51b566c5336a1093cf` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.299315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_role(role_id=87a68b07b5104c51b566c5336a1093cf)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.300947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.340997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 87a68b07b5104c51b566c5336a1093cf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:54.341619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.342463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.345134 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2058/4054] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:54 2022] DELETE /identity/v3/roles/87a68b07b5104c51b566c5336a1093cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:54.351157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.362905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf90e-ff25-402c-be70-d6fe5d477be4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.439746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.440329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.440572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.440849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.441646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.443711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.467286 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1997/4055] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:07:54 2022] POST /identity/v3/roles => generated 240 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:54.469950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.471723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:54.487222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8cb5-4815-4958-8957-be3f33d8d056 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.493561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.494571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.494928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.495401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/303f08205be3450e84e0e12c3ac6da38/inherited_to_projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.511523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=303f08205be3450e84e0e12c3ac6da38)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.514829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.530712 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2059/4056] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Apr 9 21:07:54 2022] PUT /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/303f08205be3450e84e0e12c3ac6da38/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:54.535075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.546771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32806c-495a-4c24-a054-c55347cc925b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.585872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.587891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:54.625213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.626330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.626941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.627480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/303f08205be3450e84e0e12c3ac6da38/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.630134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=303f08205be3450e84e0e12c3ac6da38)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.631242 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:54.631242 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:54.631242 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:54.633402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.641571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1998/4057] 10.222.0.30 () {58 vars in 1563 bytes} [Sat Apr 9 21:07:54 2022] HEAD /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/303f08205be3450e84e0e12c3ac6da38/inherited_to_projects => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:54.645460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.662438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0932d-4b53-412a-9f79-6e5f5a81b4a5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.669379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.670369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.670778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.671142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/303f08205be3450e84e0e12c3ac6da38/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.674166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=303f08205be3450e84e0e12c3ac6da38)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.676938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.686873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 303f08205be3450e84e0e12c3ac6da38 was removed from user 8244b447bd554b58ba9cf3703072a87e on project 8ccc875e4f044f7cbf34192d8a3e0569. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:54.687227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.690300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.702539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c1e08-589a-45c1-a9a1-c32d86558164 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.711286 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 1999/4058] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Apr 9 21:07:54 2022] DELETE /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/303f08205be3450e84e0e12c3ac6da38/inherited_to_projects => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:54.712668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.714181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:54.782901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.783996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.784337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.784708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] PATH_INFO: `/v3/users/dfc0efaed98343d59dd81317352938e6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.786161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc0efaed98343d59dd81317352938e6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.786301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cabe8b-c17c-4d0d-b0b6-e5121300f81b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.788573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.791528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.792687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.793477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.793477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles/303f08205be3450e84e0e12c3ac6da38` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.794818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_role(role_id=303f08205be3450e84e0e12c3ac6da38)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.796825 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:54.796825 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:54.796825 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:54.797777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:54.840083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 303f08205be3450e84e0e12c3ac6da38 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:54.840375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.841067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.843368 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2000/4059] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:54 2022] DELETE /identity/v3/roles/303f08205be3450e84e0e12c3ac6da38 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:54.848260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:54.849772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:54.852532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc0efaed98343d59dd81317352938e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.853203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc0efaed98343d59dd81317352938e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.860071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc0efaed98343d59dd81317352938e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.868558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc0efaed98343d59dd81317352938e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.869200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc0efaed98343d59dd81317352938e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:54.885645 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2060/4060] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:54 2022] DELETE /identity/v3/users/dfc0efaed98343d59dd81317352938e6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:54.913552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d893b-7e22-40d2-a374-f9db35696170 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:54.978103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:54.978799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:54.979200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:54.979535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:54.980706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:54.982233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.001625 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2001/4061] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:07:54 2022] POST /identity/v3/roles => generated 240 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:55.006699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.009273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.022890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d7b39-e161-48a1-9562-738e63bf93ab admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.027770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.028664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.028948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.029339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/7b8be26ebfe4476a86810ac71b6e691c/inherited_to_projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.031632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, group_id=13a95935d4f8475cbc63487332b8fb0d, role_id=7b8be26ebfe4476a86810ac71b6e691c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.034360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.048777 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2061/4062] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Apr 9 21:07:55 2022] PUT /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/7b8be26ebfe4476a86810ac71b6e691c/inherited_to_projects => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:55.053220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.064220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af588-e047-4e86-b552-1d71d7c0e6c9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.065830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.067816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.133491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.134323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.134600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.134870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.136551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6926911e5b784bdb9e82ea8711e188ff, group_id=13a95935d4f8475cbc63487332b8fb0d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.137615 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:55.137615 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:55.137615 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:55.139461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.141626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff206123-4db8-4666-9a2c-d9a8ac54b300 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.146173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.147052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.147350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.147620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] PATH_INFO: `/v3/projects/c9f995113d394d2fa8d8f8a6b69fdf80` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.148986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f995113d394d2fa8d8f8a6b69fdf80)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.150804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.155035 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2002/4063] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Apr 9 21:07:55 2022] GET /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/inherited_to_projects => generated 448 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:55.156133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.166126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fa6a-a7be-4abc-b8ef-cb37f2bcf0fd tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.170837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.171675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.171957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.172232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/7b8be26ebfe4476a86810ac71b6e691c/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.174498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, group_id=13a95935d4f8475cbc63487332b8fb0d, role_id=7b8be26ebfe4476a86810ac71b6e691c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.177238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.183615 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2003/4064] 10.222.0.30 () {58 vars in 1563 bytes} [Sat Apr 9 21:07:55 2022] HEAD /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/7b8be26ebfe4476a86810ac71b6e691c/inherited_to_projects => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:55.187629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.197255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34720cf5-34f0-4fec-b5ef-bf44e1d3391b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.199474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f995113d394d2fa8d8f8a6b69fdf80', 'request_id': 'req-5e654aaa-b3c2-492f-8768-d187f3c8ea41'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.205255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f995113d394d2fa8d8f8a6b69fdf80', 'request_id': 'req-5e654aaa-b3c2-492f-8768-d187f3c8ea41'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.215261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f995113d394d2fa8d8f8a6b69fdf80', 'request_id': 'req-5e654aaa-b3c2-492f-8768-d187f3c8ea41'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.226875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] The token cache is being invalidate because project c9f995113d394d2fa8d8f8a6b69fdf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:55.227157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.227793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e654aaa-b3c2-492f-8768-d187f3c8ea41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.229504 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2062/4065] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:55 2022] DELETE /identity/v3/projects/c9f995113d394d2fa8d8f8a6b69fdf80 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:55.234845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5dba7-8b3f-4010-aea1-d292ec829147 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.235129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5dba7-8b3f-4010-aea1-d292ec829147 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.235414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5dba7-8b3f-4010-aea1-d292ec829147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.252684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5ff5dba7-8b3f-4010-aea1-d292ec829147 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:55.253175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.253917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ff5dba7-8b3f-4010-aea1-d292ec829147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.254028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.254301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.254575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/7b8be26ebfe4476a86810ac71b6e691c/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.256772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, group_id=13a95935d4f8475cbc63487332b8fb0d, role_id=7b8be26ebfe4476a86810ac71b6e691c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.259485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.264633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 7b8be26ebfe4476a86810ac71b6e691c was removed from group 13a95935d4f8475cbc63487332b8fb0d on domain 6926911e5b784bdb9e82ea8711e188ff. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:55.264921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.265637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.279218 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2004/4066] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Apr 9 21:07:55 2022] DELETE /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/groups/13a95935d4f8475cbc63487332b8fb0d/roles/7b8be26ebfe4476a86810ac71b6e691c/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:55.283557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.284937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.312206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2063/4067] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:55.319933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f196-b05b-4070-a112-6cf304ae9231 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.320392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f196-b05b-4070-a112-6cf304ae9231 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.320781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f196-b05b-4070-a112-6cf304ae9231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.340080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0e93f196-b05b-4070-a112-6cf304ae9231 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:55.341372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0e93f196-b05b-4070-a112-6cf304ae9231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.348397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb684b6-8877-4780-abbd-1686fc337e3a tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.353162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.354037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.354328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.354588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles/7b8be26ebfe4476a86810ac71b6e691c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.356082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b8be26ebfe4476a86810ac71b6e691c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.357800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.393310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 7b8be26ebfe4476a86810ac71b6e691c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:55.393581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.394272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.396104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2005/4068] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:55 2022] DELETE /identity/v3/roles/7b8be26ebfe4476a86810ac71b6e691c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:55.401066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.402415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.406818 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2064/4069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:55.407764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93f196-b05b-4070-a112-6cf304ae9231 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.416855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93f196-b05b-4070-a112-6cf304ae9231 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.472733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040b6d0-4cb4-421e-bedf-4dcde6abab77 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.474815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.475597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.475878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.476156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.476910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:55.477251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.477605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.478274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.478555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.478827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.478957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.479564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.481582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.490828 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2065/4070] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:55.495021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.497916 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2006/4071] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:07:55 2022] POST /identity/v3/roles => generated 239 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:55.501908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.508847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb6e7e-87a7-47e8-843b-fb44d7177d72 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.513744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686b8d1-56db-4ffe-990f-f2bd4f2d1ad4 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.517350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.518220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.518655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.519080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.520068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.520298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.521336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.521620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.521900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/2a47449b34da470e917034fe5f53c66a/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.523527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.524433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=2a47449b34da470e917034fe5f53c66a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.528627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.545745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2007/4072] 10.222.0.30 () {60 vars in 1578 bytes} [Sat Apr 9 21:07:55 2022] PUT /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/2a47449b34da470e917034fe5f53c66a/inherited_to_projects => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:55.549916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.559200 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2066/4073] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:55 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:55.560236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.624512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc55cd-f50c-4a58-8d42-d542a84439fa tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.642500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899723a3-4b63-4885-b6e4-58570922d0fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.651308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.653186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.653471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.653788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.654585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.656626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.698802 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2067/4074] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:07:55 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:55.703855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.709683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.710530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.710821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.711195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.713314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6926911e5b784bdb9e82ea8711e188ff, user_id=8244b447bd554b58ba9cf3703072a87e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.716338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.728597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abefe78-c7e6-4f3a-bb76-2a83ab209a6e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.731687 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2008/4075] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Apr 9 21:07:55 2022] GET /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/inherited_to_projects => generated 446 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:55.736849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.737090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.737819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.738134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.738496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.739320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.741180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.748385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5810f84-88f3-4981-bfcf-b201a87a971e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.752664 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2068/4076] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:55 2022] GET /identity/v3/roles => generated 1650 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:07:55.754069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.755327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.755614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.756073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/2a47449b34da470e917034fe5f53c66a/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.756927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.758508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=2a47449b34da470e917034fe5f53c66a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.761616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.769347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d418fc-f379-4e83-8e6d-c22ca5f01337 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.772845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2009/4077] 10.222.0.30 () {58 vars in 1560 bytes} [Sat Apr 9 21:07:55 2022] HEAD /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/2a47449b34da470e917034fe5f53c66a/inherited_to_projects => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:55.774231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.775088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.775846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.776196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.779347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.780445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.783418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.785942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd881d1d-5a23-464c-b18e-472286e278ab tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.793380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.794262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.794543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.794838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/2a47449b34da470e917034fe5f53c66a/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.799640 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2069/4078] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:07:55 2022] GET /identity/v3/roles => generated 1650 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:07:55.804608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.805810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=2a47449b34da470e917034fe5f53c66a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.808503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.821447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 2a47449b34da470e917034fe5f53c66a was removed from user 8244b447bd554b58ba9cf3703072a87e on domain 6926911e5b784bdb9e82ea8711e188ff. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:55.821741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.823474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:55.825863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf424202-a599-4071-b6a9-0b18467c9452 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:55.836074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355e278-61f9-4570-b9ab-98cea25f9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:55.836991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355e278-61f9-4570-b9ab-98cea25f9b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.837310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355e278-61f9-4570-b9ab-98cea25f9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.837585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355e278-61f9-4570-b9ab-98cea25f9b8e admin admin] PATH_INFO: `/v3/projects/535d9672c979478f9aac7df36e55fc72/users/be8710e814d542608427c3386a09708a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.852704 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2010/4079] 10.222.0.30 () {58 vars in 1562 bytes} [Sat Apr 9 21:07:55 2022] DELETE /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/2a47449b34da470e917034fe5f53c66a/inherited_to_projects => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:55.856761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:55.858419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.876517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355e278-61f9-4570-b9ab-98cea25f9b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=535d9672c979478f9aac7df36e55fc72, user_id=be8710e814d542608427c3386a09708a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:55.879365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355e278-61f9-4570-b9ab-98cea25f9b8e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:55.919921 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2070/4080] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:07:55 2022] PUT /identity/v3/projects/535d9672c979478f9aac7df36e55fc72/users/be8710e814d542608427c3386a09708a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:55.924914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:55.925310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:55.925739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:55.970090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:55.975243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:55.980338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefdf6d-0937-49f9-a328-0cf4f6869abf tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.082608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.083836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.084376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.084853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles/2a47449b34da470e917034fe5f53c66a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.088219 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2071/4081] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:56.091075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2a47449b34da470e917034fe5f53c66a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.093446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.097587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.099143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:56.146049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 2a47449b34da470e917034fe5f53c66a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:56.146049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:56.153651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:56.157663 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2011/4082] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:55 2022] DELETE /identity/v3/roles/2a47449b34da470e917034fe5f53c66a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:56.162861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.165531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:56.188698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8fe23-0cfd-4368-b6e5-8a673de9de41 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.246389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.246635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.246818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.247108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.249672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:56.252914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777a227-8c38-40d0-ba7c-8e9eca748f2b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.258691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.259575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.260112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.260481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.261465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.263313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.288255 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2012/4083] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:07:56 2022] POST /identity/v3/roles => generated 240 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:56.292247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.305081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478509ba-2f48-4ef7-9d11-179c323e2388 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.310512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.312314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.312695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.313268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.314467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.316523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.331427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.333201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.344324 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2072/4084] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:56.360809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2013/4085] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:56 2022] POST /identity/v3/projects => generated 410 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:07:56.365539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.378241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229f6d0-3d74-455b-bb41-9b6dd5f021c2 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.445330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.446350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.446699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.447842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/f02ae5fd681f4b20accf6db1af2facd0/inherited_to_projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.450332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=f02ae5fd681f4b20accf6db1af2facd0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.452904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.468973 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2073/4086] 10.222.0.30 () {60 vars in 1578 bytes} [Sat Apr 9 21:07:56 2022] PUT /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/f02ae5fd681f4b20accf6db1af2facd0/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:56.473644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.484083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039b4b3-022e-4c82-85a4-b81cc45604fb tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.549980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.550780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.551072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.551349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.552178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Adding query filter params (scope.project.id=8ccc875e4f044f7cbf34192d8a3e0569, user.id=8244b447bd554b58ba9cf3703072a87e) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:56.552504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.553547 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:56.553547 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:07:56.553547 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:07:56.554701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.611633 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2014/4087] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:07:56 2022] GET /identity/v3/role_assignments?scope.project.id=8ccc875e4f044f7cbf34192d8a3e0569&user.id=8244b447bd554b58ba9cf3703072a87e&effective => generated 648 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:56.616052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.627980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2fc2-acdc-4565-b298-11704529b250 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.633025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.633865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.634149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.634426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.635252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Adding query filter params (scope.project.id=49565e5687ec49ce850c1122b8412343, user.id=8244b447bd554b58ba9cf3703072a87e) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:56.635565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.636606 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:56.636606 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:56.636606 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:56.637979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.713005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.714789 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2074/4088] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:07:56 2022] GET /identity/v3/role_assignments?scope.project.id=49565e5687ec49ce850c1122b8412343&user.id=8244b447bd554b58ba9cf3703072a87e&effective => generated 648 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:56.727386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa1614-ef27-476a-a04d-50517193835d tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.735902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.737501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.737872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.738770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/f02ae5fd681f4b20accf6db1af2facd0/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.742043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6926911e5b784bdb9e82ea8711e188ff, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=f02ae5fd681f4b20accf6db1af2facd0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.746466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:56.753427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role f02ae5fd681f4b20accf6db1af2facd0 was removed from user 8244b447bd554b58ba9cf3703072a87e on domain 6926911e5b784bdb9e82ea8711e188ff. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:56.753838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:56.754789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:56.774226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2015/4089] 10.222.0.30 () {58 vars in 1562 bytes} [Sat Apr 9 21:07:56 2022] DELETE /identity/v3/OS-INHERIT/domains/6926911e5b784bdb9e82ea8711e188ff/users/8244b447bd554b58ba9cf3703072a87e/roles/f02ae5fd681f4b20accf6db1af2facd0/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:56.778794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:56.781317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:56.795576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a111d-a642-4cc9-b25a-52490071b216 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:56.917997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26425a50-476e-411c-b9dc-f7277ea9eae8 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:56.918810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26425a50-476e-411c-b9dc-f7277ea9eae8 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:56.919090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26425a50-476e-411c-b9dc-f7277ea9eae8 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:56.919412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26425a50-476e-411c-b9dc-f7277ea9eae8 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:56.931698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26425a50-476e-411c-b9dc-f7277ea9eae8 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Adding query filter params (scope.project.id=8ccc875e4f044f7cbf34192d8a3e0569, user.id=8244b447bd554b58ba9cf3703072a87e) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:56.932145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26425a50-476e-411c-b9dc-f7277ea9eae8 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:56.942629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26425a50-476e-411c-b9dc-f7277ea9eae8 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.001255 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2075/4090] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:07:56 2022] GET /identity/v3/role_assignments?scope.project.id=8ccc875e4f044f7cbf34192d8a3e0569&user.id=8244b447bd554b58ba9cf3703072a87e&effective => generated 228 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:57.002617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.033666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819512-e2e9-4977-b0e8-aac9d3856882 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.039322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.040014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.040363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.040726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.041597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Adding query filter params (scope.project.id=49565e5687ec49ce850c1122b8412343, user.id=8244b447bd554b58ba9cf3703072a87e) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:57.041911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.044139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.093564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.093861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.094144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.150570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2016/4091] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:07:57 2022] GET /identity/v3/role_assignments?scope.project.id=49565e5687ec49ce850c1122b8412343&user.id=8244b447bd554b58ba9cf3703072a87e&effective => generated 228 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:57.154406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.166609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc9e7-5973-4f71-82e1-2fda751559f3 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.167040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] MFA Rules not processed for user `be8710e814d542608427c3386a09708a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:57.168719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:57.172944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.174784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.175197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.175613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/projects/49565e5687ec49ce850c1122b8412343` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.177313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49565e5687ec49ce850c1122b8412343)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.179657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.241081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49565e5687ec49ce850c1122b8412343', 'request_id': 'req-262ffe25-76dd-438c-ab70-3b3def3aa052'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.250117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49565e5687ec49ce850c1122b8412343', 'request_id': 'req-262ffe25-76dd-438c-ab70-3b3def3aa052'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.264566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49565e5687ec49ce850c1122b8412343', 'request_id': 'req-262ffe25-76dd-438c-ab70-3b3def3aa052'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.279434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] The token cache is being invalidate because project 49565e5687ec49ce850c1122b8412343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:57.279812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.280930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.286050 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2017/4092] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:57 2022] DELETE /identity/v3/projects/49565e5687ec49ce850c1122b8412343 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:57.286911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.288732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:57.296234 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2076/4093] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:57.373919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ffe25-76dd-438c-ab70-3b3def3aa052 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.378648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.379619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.379963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.380326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles/f02ae5fd681f4b20accf6db1af2facd0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.382054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f02ae5fd681f4b20accf6db1af2facd0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.383736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.416038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.417647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:57.425244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role f02ae5fd681f4b20accf6db1af2facd0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:57.425539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.426386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.428530 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2018/4094] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:57 2022] DELETE /identity/v3/roles/f02ae5fd681f4b20accf6db1af2facd0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:57.437193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.438607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:57.496266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892185e-94a2-4500-843b-36a478bf76ff None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.517426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb81e9-93b9-4cd7-8f99-0f5de7a78319 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.523761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.524456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.524739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.525076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.525800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.527425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.545203 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2019/4095] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:07:57 2022] POST /identity/v3/roles => generated 240 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:57.548999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.558920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc535b-8f68-44ac-b194-95655bedfd12 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.564122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.565005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.565318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.565589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.566283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.568164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.573500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.574367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.574745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.575028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.577023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:57.611728 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2020/4096] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:07:57 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:07:57.613023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.639546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.641529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.652768 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2077/4097] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:07:57.699939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657bea5-c291-43f9-a810-e45579f56dc6 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.707924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.709968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.710262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.710743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/2c248281af2a440e8786770042ca4406/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.714685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=2c248281af2a440e8786770042ca4406)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.719550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.738746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2021/4098] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Apr 9 21:07:57 2022] PUT /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/2c248281af2a440e8786770042ca4406/inherited_to_projects => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:57.743262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.758179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bd26b-f44e-4e16-bd34-ea43860331cb service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.825432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.826425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.826723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.826999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.827837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Adding query filter params (scope.project.id=16c2746a62e7471b96c57ccb1b40afe4, user.id=8244b447bd554b58ba9cf3703072a87e) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:57.828145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.831004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.905999 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2078/4099] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:07:57 2022] GET /identity/v3/role_assignments?scope.project.id=16c2746a62e7471b96c57ccb1b40afe4&user.id=8244b447bd554b58ba9cf3703072a87e&effective => generated 649 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:57.911732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.929960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bf56f-b64b-4131-b1db-49f0db9aa730 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:57.937793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:57.938802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:57.939233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:57.939546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/2c248281af2a440e8786770042ca4406/inherited_to_projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:57.942472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ccc875e4f044f7cbf34192d8a3e0569, user_id=8244b447bd554b58ba9cf3703072a87e, role_id=2c248281af2a440e8786770042ca4406)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:57.945959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:57.954595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 2c248281af2a440e8786770042ca4406 was removed from user 8244b447bd554b58ba9cf3703072a87e on project 8ccc875e4f044f7cbf34192d8a3e0569. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:57.955132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.955749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:57.981160 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2022/4100] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Apr 9 21:07:57 2022] DELETE /identity/v3/OS-INHERIT/projects/8ccc875e4f044f7cbf34192d8a3e0569/users/8244b447bd554b58ba9cf3703072a87e/roles/2c248281af2a440e8786770042ca4406/inherited_to_projects => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:57.986193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:57.988373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:58.004199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243b5b9-f24f-459a-955f-9d40df9749f5 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:58.099963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf22a-661b-4013-a071-23ba8a8222e2 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:58.100654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf22a-661b-4013-a071-23ba8a8222e2 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:58.101466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf22a-661b-4013-a071-23ba8a8222e2 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:58.101768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf22a-661b-4013-a071-23ba8a8222e2 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:58.102610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf22a-661b-4013-a071-23ba8a8222e2 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Adding query filter params (scope.project.id=16c2746a62e7471b96c57ccb1b40afe4, user.id=8244b447bd554b58ba9cf3703072a87e) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:07:58.102922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf22a-661b-4013-a071-23ba8a8222e2 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:58.105300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf22a-661b-4013-a071-23ba8a8222e2 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:58.188146 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2079/4101] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:07:57 2022] GET /identity/v3/role_assignments?scope.project.id=16c2746a62e7471b96c57ccb1b40afe4&user.id=8244b447bd554b58ba9cf3703072a87e&effective => generated 228 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:07:58.193652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:58.215698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222bbf-249b-44aa-a6e0-e216fe40bb49 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:58.221579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:58.222512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:58.222796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:58.223068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/projects/16c2746a62e7471b96c57ccb1b40afe4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:58.224558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16c2746a62e7471b96c57ccb1b40afe4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:58.226673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:58.251601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:58.251896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:58.252175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:58.282108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:58.283539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:58.299663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c2746a62e7471b96c57ccb1b40afe4', 'request_id': 'req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.305242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c2746a62e7471b96c57ccb1b40afe4', 'request_id': 'req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.315798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c2746a62e7471b96c57ccb1b40afe4', 'request_id': 'req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.330932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] The token cache is being invalidate because project 16c2746a62e7471b96c57ccb1b40afe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:58.331217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.332002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.334307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2023/4102] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:58 2022] DELETE /identity/v3/projects/16c2746a62e7471b96c57ccb1b40afe4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:58.338185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:58.340597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:58.367518 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2080/4103] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:07:58.368514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:58.369992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:58.426425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cec7cf-7027-4118-81ff-3d16e4c99eb9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:58.431621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:58.432988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:58.433500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:58.433930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/roles/2c248281af2a440e8786770042ca4406` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:58.435518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2c248281af2a440e8786770042ca4406)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:58.437270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:58.484988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86734c5c-cfcb-47f6-a1bb-129ca1621220 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:58.488862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invalidating the token cache because role 2c248281af2a440e8786770042ca4406 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:58.489188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.489897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.491412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:58.492194 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2024/4104] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:58 2022] DELETE /identity/v3/roles/2c248281af2a440e8786770042ca4406 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:58.492332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:58.492517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:58.492686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:58.495921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:58.496896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:58.498364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:58.516961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:58.520852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:58.533357 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2081/4105] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:07:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:58.600965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec861a-fd02-4ef1-a445-d5fb642e55f9 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:58.607266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:58.608388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:58.608666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:58.608941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/users/8244b447bd554b58ba9cf3703072a87e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:58.610242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8244b447bd554b58ba9cf3703072a87e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:58.613700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:58.688723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8244b447bd554b58ba9cf3703072a87e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.690293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8244b447bd554b58ba9cf3703072a87e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.721726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8244b447bd554b58ba9cf3703072a87e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.730650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8244b447bd554b58ba9cf3703072a87e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.753157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8244b447bd554b58ba9cf3703072a87e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:58.779175 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2025/4106] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:58 2022] DELETE /identity/v3/users/8244b447bd554b58ba9cf3703072a87e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:07:58.783171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:58.799861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ca1fb-c3c1-4a55-8364-2455a7c3a902 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:58.906408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec62377-5104-4211-9789-2279b83fda9e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:58.907310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62377-5104-4211-9789-2279b83fda9e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:58.909106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62377-5104-4211-9789-2279b83fda9e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:58.909106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62377-5104-4211-9789-2279b83fda9e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/groups/13a95935d4f8475cbc63487332b8fb0d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:58.912862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec62377-5104-4211-9789-2279b83fda9e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_group(group_id=13a95935d4f8475cbc63487332b8fb0d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:58.913978 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-8ec62377-5104-4211-9789-2279b83fda9e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:07:58.913978 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:07:58.913978 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:07:58.915191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec62377-5104-4211-9789-2279b83fda9e tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:59.020869 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2082/4107] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:07:58 2022] DELETE /identity/v3/groups/13a95935d4f8475cbc63487332b8fb0d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:59.026520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:59.028893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:59.076681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513d80e-8e49-44c4-abdf-4eb44d26c907 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:59.195750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:59.197327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:59.197608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:59.197885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/projects/8ccc875e4f044f7cbf34192d8a3e0569` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:59.199464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ccc875e4f044f7cbf34192d8a3e0569)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:59.201705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:59.290090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ccc875e4f044f7cbf34192d8a3e0569', 'request_id': 'req-75f56643-e47a-4976-93b7-1e97cd741894'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.305731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ccc875e4f044f7cbf34192d8a3e0569', 'request_id': 'req-75f56643-e47a-4976-93b7-1e97cd741894'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.319516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ccc875e4f044f7cbf34192d8a3e0569', 'request_id': 'req-75f56643-e47a-4976-93b7-1e97cd741894'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.342301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] The token cache is being invalidate because project 8ccc875e4f044f7cbf34192d8a3e0569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:59.342610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.344222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.344899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35a43-4c89-4054-8f92-95329f935021 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:59.345283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35a43-4c89-4054-8f92-95329f935021 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:59.345649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35a43-4c89-4054-8f92-95329f935021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:59.346604 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2026/4108] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:07:59 2022] DELETE /identity/v3/projects/8ccc875e4f044f7cbf34192d8a3e0569 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:59.350531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:59.351983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:59.383121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1cc35a43-4c89-4054-8f92-95329f935021 None None] MFA Rules not processed for user `be8710e814d542608427c3386a09708a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:07:59.384372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1cc35a43-4c89-4054-8f92-95329f935021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:07:59.470114 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2083/4109] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:07:59.471667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f56643-e47a-4976-93b7-1e97cd741894 tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:59.478371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:59.479437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:59.479793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:59.480139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/domains/6926911e5b784bdb9e82ea8711e188ff` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:59.481589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6926911e5b784bdb9e82ea8711e188ff)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:59.483798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:59.509358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.510206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.560432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.561121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.568180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc35a43-4c89-4054-8f92-95329f935021 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:59.568698 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2027/4110] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:07:59 2022] PATCH /identity/v3/domains/6926911e5b784bdb9e82ea8711e188ff => generated 277 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:07:59.580728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc35a43-4c89-4054-8f92-95329f935021 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:07:59.698989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '010e0860b26247ef8066af9cd62c9410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5a50a63767d461788f9314ecb947229', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:07:59.700113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:07:59.700496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:07:59.700871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] PATH_INFO: `/v3/domains/6926911e5b784bdb9e82ea8711e188ff` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:07:59.719044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6926911e5b784bdb9e82ea8711e188ff)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:07:59.721542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:07:59.756551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.761474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.853133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff', 'request_id': 'req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.862660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff', 'request_id': 'req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.880803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff', 'request_id': 'req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.900090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] The token cache is being invalidate because project 6926911e5b784bdb9e82ea8711e188ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:07:59.900377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.901674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.910953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff', 'request_id': 'req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.914352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff', 'request_id': 'req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.915095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6926911e5b784bdb9e82ea8711e188ff', 'request_id': 'req-5bd93e5e-5891-4a13-ad83-9adb95b2e1af'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:07:59.926158 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2084/4111] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:07:59 2022] DELETE /identity/v3/domains/6926911e5b784bdb9e82ea8711e188ff => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:07:59.927270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:07:59.929014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:00.031616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbd571-6154-4088-9bfe-174fa013d69b tempest-InheritsV3TestJSON-1312668812 tempest-InheritsV3TestJSON-1312668812-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:00.117966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:00.118785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:00.119064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:00.119331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] PATH_INFO: `/v3/users/6419ab06282f44a2b88d0335c51f6771` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:00.121078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6419ab06282f44a2b88d0335c51f6771)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:00.123009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:00.185752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6419ab06282f44a2b88d0335c51f6771'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:00.186777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6419ab06282f44a2b88d0335c51f6771'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:00.195246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6419ab06282f44a2b88d0335c51f6771'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:00.196506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6419ab06282f44a2b88d0335c51f6771'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:00.208618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6419ab06282f44a2b88d0335c51f6771'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:00.245309 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2028/4112] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:07:59 2022] DELETE /identity/v3/users/6419ab06282f44a2b88d0335c51f6771 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:00.250622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:00.251780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:00.251780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:00.302541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:00.304896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:00.419359 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2085/4113] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:00.433320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:00.433743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:00.521355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73727357-87b3-467e-9137-cf4c71115828 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:00.525384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:00.526417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:00.526700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:00.526971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:00.537186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:00.538772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:00.554687 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2029/4114] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:01.067048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:01.068601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:01.092361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802afc67-56e9-4e11-b52c-6b9c54bdc6be None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:01.111440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:01.114310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:01.114602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:01.114888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] PATH_INFO: `/v3/projects/935394d68d4444d9baba9b8f2970626e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:01.116338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935394d68d4444d9baba9b8f2970626e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:01.119115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:01.202835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935394d68d4444d9baba9b8f2970626e', 'request_id': 'req-6ff23280-3754-48cf-874d-dc6d59112e39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.210043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935394d68d4444d9baba9b8f2970626e', 'request_id': 'req-6ff23280-3754-48cf-874d-dc6d59112e39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.223707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935394d68d4444d9baba9b8f2970626e', 'request_id': 'req-6ff23280-3754-48cf-874d-dc6d59112e39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.243991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] The token cache is being invalidate because project 935394d68d4444d9baba9b8f2970626e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:01.244553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.245219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.247276 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2086/4115] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:01 2022] DELETE /identity/v3/projects/935394d68d4444d9baba9b8f2970626e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:01.250925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:01.264275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c246-ce84-48b4-83eb-98cd44f1d3c8 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:01.380916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:01.382602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:01.383051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:01.383549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] PATH_INFO: `/v3/users/010e0860b26247ef8066af9cd62c9410` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:01.386177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] RBAC: Authorizing `identity:delete_user(user_id=010e0860b26247ef8066af9cd62c9410)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:01.388332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:01.494647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010e0860b26247ef8066af9cd62c9410'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.495210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010e0860b26247ef8066af9cd62c9410'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.502684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010e0860b26247ef8066af9cd62c9410'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.503540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010e0860b26247ef8066af9cd62c9410'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.515175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010e0860b26247ef8066af9cd62c9410'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:01.546003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:01.547505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:01.558381 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2030/4116] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:01 2022] DELETE /identity/v3/users/010e0860b26247ef8066af9cd62c9410 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:01.683077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff23280-3754-48cf-874d-dc6d59112e39 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:01.755087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2fece-984c-426f-a43e-31a6a69324b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:01.756358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2fece-984c-426f-a43e-31a6a69324b8 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:01.757368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2fece-984c-426f-a43e-31a6a69324b8 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:01.758495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2fece-984c-426f-a43e-31a6a69324b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:01.760971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-29c2fece-984c-426f-a43e-31a6a69324b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:01.776300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2fece-984c-426f-a43e-31a6a69324b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:01.778272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2fece-984c-426f-a43e-31a6a69324b8 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:01.792250 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2087/4117] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:08:02.142160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:02.143755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:02.242549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8df08-ed21-4f2c-a7a5-3cb768e254da admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:02.255211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:02.256119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:02.256394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:02.256668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] PATH_INFO: `/v3/projects/c5a50a63767d461788f9314ecb947229` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:02.260187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a50a63767d461788f9314ecb947229)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:02.260187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:02.360384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a50a63767d461788f9314ecb947229', 'request_id': 'req-4ed437dd-4f62-4f7a-a43c-23ed763503a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:02.374981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a50a63767d461788f9314ecb947229', 'request_id': 'req-4ed437dd-4f62-4f7a-a43c-23ed763503a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:02.399289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a50a63767d461788f9314ecb947229', 'request_id': 'req-4ed437dd-4f62-4f7a-a43c-23ed763503a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:02.414282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] The token cache is being invalidate because project c5a50a63767d461788f9314ecb947229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:02.414857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:02.415695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ed437dd-4f62-4f7a-a43c-23ed763503a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:02.417951 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2031/4118] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:02 2022] DELETE /identity/v3/projects/c5a50a63767d461788f9314ecb947229 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:02.424902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e180-d0df-4559-8291-c5c0af5dabd3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:02.426003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e180-d0df-4559-8291-c5c0af5dabd3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:02.426452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e180-d0df-4559-8291-c5c0af5dabd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:02.450630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4085e180-d0df-4559-8291-c5c0af5dabd3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:02.453507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4085e180-d0df-4559-8291-c5c0af5dabd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:02.609933 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2088/4119] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:02.618293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de536f-8f65-4d0a-b16e-f6d1b5195b80 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:02.618579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de536f-8f65-4d0a-b16e-f6d1b5195b80 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:02.618867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de536f-8f65-4d0a-b16e-f6d1b5195b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:02.649470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-35de536f-8f65-4d0a-b16e-f6d1b5195b80 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:02.650819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-35de536f-8f65-4d0a-b16e-f6d1b5195b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:02.674700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2032/4120] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:02.678584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085e180-d0df-4559-8291-c5c0af5dabd3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:02.689670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085e180-d0df-4559-8291-c5c0af5dabd3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:02.696161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:02.697154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:02.698102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:02.698542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:02.700070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:02.700605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:02.702512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:02.728572 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2089/4121] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:02.733023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de536f-8f65-4d0a-b16e-f6d1b5195b80 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:02.743445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de536f-8f65-4d0a-b16e-f6d1b5195b80 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:02.748489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:02.749263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:02.749609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:02.749945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:02.750701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:02.752700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:02.800737 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2033/4122] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:02 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:02.804929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:02.818524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea6382-fb16-47cb-bc7c-c1b309be8be3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:02.901726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:02.902473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:02.902796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:02.903458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:02.904446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:02.906592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:02.933515 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2090/4123] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:02 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:02.935182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:02.946384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb20f3-0cbc-4d68-a4e5-ed160833e472 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:02.951939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:02.952674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:02.953024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:02.953414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:02.954407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:02.956180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:02.978105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:02.987192 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2034/4124] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:03.006844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8282660-6d40-414c-bc4a-147117d64e0b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:03.015696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0c115-9478-4456-a9a6-173aa17b079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:03.016453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0c115-9478-4456-a9a6-173aa17b079e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:03.017502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0c115-9478-4456-a9a6-173aa17b079e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:03.017903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0c115-9478-4456-a9a6-173aa17b079e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:03.018657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0c115-9478-4456-a9a6-173aa17b079e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:03.020605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0c115-9478-4456-a9a6-173aa17b079e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:03.053630 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2091/4125] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:08:03.057813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:03.072521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ef29-dafb-4442-8b74-40d5d5b1eb73 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:03.081022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:03.082133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:03.082702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:03.083083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] PATH_INFO: `/v3/projects/82c99444d86e43de81a01ac0a6d06f60/users/b8af398941a04c9a9a0ec3e306d22efd/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:03.111076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c99444d86e43de81a01ac0a6d06f60, user_id=b8af398941a04c9a9a0ec3e306d22efd, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:03.123001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:03.145841 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2035/4126] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:03 2022] PUT /identity/v3/projects/82c99444d86e43de81a01ac0a6d06f60/users/b8af398941a04c9a9a0ec3e306d22efd/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:03.160070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7087-c647-418d-832c-eec286dcafa2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:03.160357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7087-c647-418d-832c-eec286dcafa2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:03.160636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7087-c647-418d-832c-eec286dcafa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:03.195466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ae0b7087-c647-418d-832c-eec286dcafa2 None None] MFA Rules not processed for user `b8af398941a04c9a9a0ec3e306d22efd`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:03.196816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ae0b7087-c647-418d-832c-eec286dcafa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:03.297391 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2092/4127] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:03.301805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:03.473295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8519bc-8c35-48c7-b64d-bcc46f739727 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:03.495747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:03.496444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:03.496724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:03.496998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:03.497734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:03.499736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:03.555245 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2036/4128] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:03 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:03.555758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7087-c647-418d-832c-eec286dcafa2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:03.571075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7087-c647-418d-832c-eec286dcafa2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:03.662100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:03.662808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:03.663251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:03.663519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:03.664262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:03.666373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:03.697851 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2093/4129] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:03 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:03.703160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:03.728766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8783164-97fd-4ef4-9ecf-02ceb6e4730a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:03.736394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:03.737625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:03.737903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:03.738184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:03.739044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:03.741872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:03.799751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:03.800488 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2037/4130] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:03.812445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93e73-ae2c-424b-9f6a-5b859391d521 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:03.818277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:03.819307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:03.819654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:03.820022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] PATH_INFO: `/v3/projects/99fc6e8697cb4ca0b503389420cf438f/users/62be2b0c2a364208b777e8572c2dcc4e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:03.839744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fc6e8697cb4ca0b503389420cf438f, user_id=62be2b0c2a364208b777e8572c2dcc4e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:03.848744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:03.877206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2094/4131] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:03 2022] PUT /identity/v3/projects/99fc6e8697cb4ca0b503389420cf438f/users/62be2b0c2a364208b777e8572c2dcc4e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:03.879485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:03.900432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4333f-c9d6-4ff8-afa4-7b718a9b708a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.001249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eccb31-e6bb-4c3d-8cb9-4f007f171624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.001956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eccb31-e6bb-4c3d-8cb9-4f007f171624 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.002312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eccb31-e6bb-4c3d-8cb9-4f007f171624 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.002598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eccb31-e6bb-4c3d-8cb9-4f007f171624 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.003339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eccb31-e6bb-4c3d-8cb9-4f007f171624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.017388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eccb31-e6bb-4c3d-8cb9-4f007f171624 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.047330 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2038/4132] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:04.052667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.079695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268d019-ed87-49f9-831d-0e67462a511c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.084602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.085649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.085938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.086303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] PATH_INFO: `/v3/projects/99fc6e8697cb4ca0b503389420cf438f/users/62be2b0c2a364208b777e8572c2dcc4e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.089352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fc6e8697cb4ca0b503389420cf438f, user_id=62be2b0c2a364208b777e8572c2dcc4e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.100336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.132876 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2095/4133] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:04 2022] PUT /identity/v3/projects/99fc6e8697cb4ca0b503389420cf438f/users/62be2b0c2a364208b777e8572c2dcc4e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:04.134089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.134089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.134243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.178678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] MFA Rules not processed for user `62be2b0c2a364208b777e8572c2dcc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:04.183133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:04.304509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.314635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2039/4134] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:04.321796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21028f7-d5d6-4920-ba41-6b2d5954aba7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.336237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.337318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.337834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.342646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.346406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:04.360605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.363942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.367828 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:04.367828 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:04.367828 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:04.370004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.427306 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2096/4135] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:08:04 2022] POST /identity/v3/regions => generated 223 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:04.428764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.456776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f792-af3e-4dd3-b6a5-c520c45b6dbf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.469950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5384bd0-6aa4-4d5f-9224-e5209789e65c tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.487642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.488345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.488624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.488897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.489992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.491636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.494827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.496091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.496518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.497386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] PATH_INFO: `/v3/users/4719eac69a2f4f25bbb1abfb3ef7c980` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.500288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4719eac69a2f4f25bbb1abfb3ef7c980)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.503742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.537276 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2097/4136] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:08:04 2022] POST /identity/v3/regions => generated 224 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:04.542843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.589011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449e939-4b1e-4dba-a062-78f2a6a89a8a tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.611770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.613459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.613991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.614542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/0732582a-74fa-427d-9f4d-908c980769a9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.615521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:create_region(region_id=0732582a-74fa-427d-9f4d-908c980769a9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.617723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.648270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2098/4137] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Apr 9 21:08:04 2022] PUT /identity/v3/regions/0732582a-74fa-427d-9f4d-908c980769a9 => generated 232 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:04.652248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.681594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49f951-e13a-4c4d-8420-420b433e8b74 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.688725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.690561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.691060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.691643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/0732582a-74fa-427d-9f4d-908c980769a9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.692586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0732582a-74fa-427d-9f4d-908c980769a9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.694407 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:04.694407 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:04.694407 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:04.696089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.731852 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2099/4138] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:08:04 2022] DELETE /identity/v3/regions/0732582a-74fa-427d-9f4d-908c980769a9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:04.738285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.784775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88060708-3f98-4277-af43-a8d5b8787fb0 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:04.806528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:04.807643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:04.808162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:04.808653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:04.810683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:04.814241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:04.828594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4719eac69a2f4f25bbb1abfb3ef7c980'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:04.829374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4719eac69a2f4f25bbb1abfb3ef7c980'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:04.848534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4719eac69a2f4f25bbb1abfb3ef7c980'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:04.853289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4719eac69a2f4f25bbb1abfb3ef7c980'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:04.865864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4719eac69a2f4f25bbb1abfb3ef7c980'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:04.869657 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2100/4139] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Apr 9 21:08:04 2022] POST /identity/v3/regions => generated 254 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:04.873846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:04.876892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:04.904018 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2040/4140] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:04 2022] DELETE /identity/v3/users/4719eac69a2f4f25bbb1abfb3ef7c980 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:04.946546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8315d-3ca3-4c47-8961-42d1c58c845f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.068661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.070723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.072164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.072465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/414203a1a39b4377bddba7190b8069ed` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.075077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:update_region(region_id=414203a1a39b4377bddba7190b8069ed)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.077796 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:05.077796 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:05.077796 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:05.080265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.130689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2101/4141] 10.222.0.30 () {60 vars in 1249 bytes} [Sat Apr 9 21:08:04 2022] PATCH /identity/v3/regions/414203a1a39b4377bddba7190b8069ed => generated 254 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:08:05.131925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.147521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a697-52f0-4b0f-b597-25848198bab1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.175863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.179640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.179640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.179640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/414203a1a39b4377bddba7190b8069ed` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.179640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:get_region(region_id=414203a1a39b4377bddba7190b8069ed)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.179640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.180771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.183060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:05.210464 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2041/4142] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:08:05 2022] GET /identity/v3/regions/414203a1a39b4377bddba7190b8069ed => generated 254 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:08:05.211576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.232229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32b27f-0d68-4d5a-825d-b288a2325c90 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.245056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.250063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.250341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.250603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/414203a1a39b4377bddba7190b8069ed` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.251274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=414203a1a39b4377bddba7190b8069ed)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.252314 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:05.252314 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:08:05.252314 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:08:05.253234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.301420 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2042/4143] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:05 2022] DELETE /identity/v3/regions/414203a1a39b4377bddba7190b8069ed => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:05.306169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.324744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367e10b-c25c-4f16-a5c5-6f4ce7d5ad3f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.334860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997e69-f11d-4ce7-b8ed-83c3b2631d97 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.343505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.344541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.344947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.345527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.345708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.346005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.346335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] PATH_INFO: `/v3/projects/0f4ad084f5dd44c2b99960f4df5cb0e8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.346720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.347624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.347812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4ad084f5dd44c2b99960f4df5cb0e8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.349313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.350449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.366705 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2043/4144] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 21:08:05 2022] GET /identity/v3/regions => generated 669 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:05.372015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.385757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff6dfa-9f75-4d0a-907f-0e11885c8628 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.392718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.393960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.395010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.396190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/414203a1a39b4377bddba7190b8069ed` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.397132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=414203a1a39b4377bddba7190b8069ed)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.399575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.412485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'request_id': 'req-4664a296-a988-4966-8256-91e6b38c202b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:05.419456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'request_id': 'req-4664a296-a988-4966-8256-91e6b38c202b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:05.430629 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Could not find region: 414203a1a39b4377bddba7190b8069ed.: keystone.exception.RegionNotFound: Could not find region: 414203a1a39b4377bddba7190b8069ed. Apr 09 21:08:05.432629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2044/4145] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:05 2022] DELETE /identity/v3/regions/414203a1a39b4377bddba7190b8069ed => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:08:05.448379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.464340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'request_id': 'req-4664a296-a988-4966-8256-91e6b38c202b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:05.478038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0116-61b9-46c0-a280-9ce4af02e9f9 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.490160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] The token cache is being invalidate because project 0f4ad084f5dd44c2b99960f4df5cb0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:05.490447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:05.491110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4664a296-a988-4966-8256-91e6b38c202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:05.495805 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2102/4146] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:05 2022] DELETE /identity/v3/projects/0f4ad084f5dd44c2b99960f4df5cb0e8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:05.501155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481c5aa-5f7c-4af5-adfb-736f1bba6290 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.501768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481c5aa-5f7c-4af5-adfb-736f1bba6290 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.502495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481c5aa-5f7c-4af5-adfb-736f1bba6290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.528867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e481c5aa-5f7c-4af5-adfb-736f1bba6290 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:05.530655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e481c5aa-5f7c-4af5-adfb-736f1bba6290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:05.601373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.601983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.602450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.602748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.603431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.604566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.613455 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2103/4147] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:05.625445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1580633-7e10-490e-9c92-933a3744fb37 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.626124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1580633-7e10-490e-9c92-933a3744fb37 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.626621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1580633-7e10-490e-9c92-933a3744fb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.626799 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2045/4148] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 21:08:05 2022] GET /identity/v3/regions => generated 669 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:05.627741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.629621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:05.647250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6926-96f4-4419-a7cb-6da4a4a0403f tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.658887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.659677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.660029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.660375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.661294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.662462 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:05.662462 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:08:05.662462 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:08:05.663836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.664818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b1580633-7e10-490e-9c92-933a3744fb37 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:05.666167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b1580633-7e10-490e-9c92-933a3744fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:05.680949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2104/4149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:05.686187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1580633-7e10-490e-9c92-933a3744fb37 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.700056 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2046/4150] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Apr 9 21:08:05 2022] POST /identity/v3/regions => generated 253 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:05.702305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.703531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1580633-7e10-490e-9c92-933a3744fb37 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.728038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.729639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.730012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.730395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.731217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:05.731612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.732188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357f154-2e48-4ddf-8b8d-594857174fa1 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.733816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.737755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.738453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.738742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.739018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.739795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Adding query filter params (parent_region_id=3b792a37f53548fcb0152e9b1cad9122) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:05.740207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.741675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.748270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2047/4151] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:08:05 2022] GET /identity/v3/regions?parent_region_id=3b792a37f53548fcb0152e9b1cad9122 => generated 399 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:05.749758 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2105/4152] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:05.755363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.757072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.780314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b5ef-acb4-46bd-b47f-6fa450074ba5 tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.783539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0085fb7-aaba-4a0f-9e54-c0c0cccf1d97 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.787331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.788230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.788638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.789064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.790243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.793185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:05.793596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.793844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:05.794133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:05.794409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/d71d60038a104da08070fb60efb8cd80` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:05.795185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d71d60038a104da08070fb60efb8cd80)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:05.800039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:05.837266 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2106/4153] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:05 2022] DELETE /identity/v3/regions/d71d60038a104da08070fb60efb8cd80 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:05.838599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.840331 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2048/4154] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:05 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:05.844678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:05.890060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d36ea-bb72-4e2d-a623-3cee4d28406d tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:05.987602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823bc0-a484-4de3-82f2-c72225acf6b4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.019325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.020208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.020481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.020748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/2c8e433470684e84959267601a17e91e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.021434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2c8e433470684e84959267601a17e91e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.024187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.026261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.027606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.027887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.028159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.028866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.030951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.085332 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2107/4155] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:05 2022] DELETE /identity/v3/regions/2c8e433470684e84959267601a17e91e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:06.085332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:06.099646 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2049/4156] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:05 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:06.101955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:06.136480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56ae59-afd1-4916-bbe1-eb88c9c8d019 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.143825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633074c-9cd3-4cbb-a695-5caaa522bddb tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.150967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62be2b0c2a364208b777e8572c2dcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99fc6e8697cb4ca0b503389420cf438f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.151773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.152051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.152316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] PATH_INFO: `/v3/regions/3b792a37f53548fcb0152e9b1cad9122` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.152968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=3b792a37f53548fcb0152e9b1cad9122)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.153105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.153883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.154258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.154696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.155940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.156468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.157872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.173079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2050/4157] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:06.179396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:06.189269 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2108/4158] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:06 2022] DELETE /identity/v3/regions/3b792a37f53548fcb0152e9b1cad9122 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:06.193182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:06.194943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:06.195234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee042da-3d9b-4fc3-8e41-69fdd96b83af admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.215575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.216309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.216588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.216886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.218038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.220265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.229694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a763f-8133-4b47-abc8-e37ecd30e0ff tempest-RegionsTestJSON-1929938199 tempest-RegionsTestJSON-1929938199-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.234680 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2051/4159] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:06.237823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.239144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.239424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.239692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] PATH_INFO: `/v3/users/b8af398941a04c9a9a0ec3e306d22efd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.242488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:06.243029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8af398941a04c9a9a0ec3e306d22efd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.244487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.256357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f93199-8537-402f-b83f-d75b5a29b25d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.262492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551db80-2cff-4a72-8b95-0ba829a2122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.263651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551db80-2cff-4a72-8b95-0ba829a2122e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.264069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551db80-2cff-4a72-8b95-0ba829a2122e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.264351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551db80-2cff-4a72-8b95-0ba829a2122e admin admin] PATH_INFO: `/v3/projects/76d0c33645544aac925f571c5572f115/users/f591cadcc8564d51a4433748e0f84638/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.280685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551db80-2cff-4a72-8b95-0ba829a2122e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d0c33645544aac925f571c5572f115, user_id=f591cadcc8564d51a4433748e0f84638, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.283464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551db80-2cff-4a72-8b95-0ba829a2122e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.303074 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2052/4160] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:06 2022] PUT /identity/v3/projects/76d0c33645544aac925f571c5572f115/users/f591cadcc8564d51a4433748e0f84638/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:06.314868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f11636-e0bd-4e00-b6de-3b78e9f01ea9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.315280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f11636-e0bd-4e00-b6de-3b78e9f01ea9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.315615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f11636-e0bd-4e00-b6de-3b78e9f01ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.321980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8af398941a04c9a9a0ec3e306d22efd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:06.322909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8af398941a04c9a9a0ec3e306d22efd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:06.333814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8af398941a04c9a9a0ec3e306d22efd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:06.348381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8af398941a04c9a9a0ec3e306d22efd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:06.350268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17effc71-857b-419e-bb1c-d0683ac4b75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8af398941a04c9a9a0ec3e306d22efd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:06.354968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-96f11636-e0bd-4e00-b6de-3b78e9f01ea9 None None] MFA Rules not processed for user `f591cadcc8564d51a4433748e0f84638`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:06.356347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-96f11636-e0bd-4e00-b6de-3b78e9f01ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:06.406470 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2109/4161] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:06 2022] DELETE /identity/v3/users/b8af398941a04c9a9a0ec3e306d22efd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:06.411443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.412558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.412947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.452527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:06.454686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:06.545378 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2053/4162] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:06.548892 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2110/4163] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:06.557203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.557496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.557778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.560009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:06.561606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:06.578173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] MFA Rules not processed for user `f591cadcc8564d51a4433748e0f84638`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:06.579391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:06.641002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3f8b-6e09-4a81-aee9-d23c1ca17ece None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.645976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.646881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.647231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.647574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.653356 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2054/4164] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:06.660129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:06.661469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:06.675158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.681909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.713949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2111/4165] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:08:06.769617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3ecb7-4cd0-4f01-ad22-161c1e0008de None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:06.778926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:06.780303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:06.780656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:06.781009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:06.791865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:06.794000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:06.809122 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2055/4166] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:07.170992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:07.172565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:07.213106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f33dd4-7aff-4929-8f37-08eacee8f3c5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:07.235380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:07.236720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:07.237311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:07.239235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] PATH_INFO: `/v3/projects/82c99444d86e43de81a01ac0a6d06f60` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:07.241246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c99444d86e43de81a01ac0a6d06f60)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:07.249222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:07.352261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c99444d86e43de81a01ac0a6d06f60', 'request_id': 'req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.372240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c99444d86e43de81a01ac0a6d06f60', 'request_id': 'req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.391120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c99444d86e43de81a01ac0a6d06f60', 'request_id': 'req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.410346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] The token cache is being invalidate because project 82c99444d86e43de81a01ac0a6d06f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:07.410773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.411548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.413546 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2112/4167] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:07 2022] DELETE /identity/v3/projects/82c99444d86e43de81a01ac0a6d06f60 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:07.417538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:07.433502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af71c-f0d5-44ad-8ae2-70706563c3cd service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:07.581683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:07.584124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:07.586746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:07.587300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] PATH_INFO: `/v3/users/62be2b0c2a364208b777e8572c2dcc4e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:07.595608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] RBAC: Authorizing `identity:delete_user(user_id=62be2b0c2a364208b777e8572c2dcc4e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:07.598066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:07.724805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62be2b0c2a364208b777e8572c2dcc4e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.725603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62be2b0c2a364208b777e8572c2dcc4e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.739319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62be2b0c2a364208b777e8572c2dcc4e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.740763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62be2b0c2a364208b777e8572c2dcc4e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.757911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b8ae86b1-ac52-4542-afd3-93164a39019f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62be2b0c2a364208b777e8572c2dcc4e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:07.786831 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2056/4168] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:07 2022] DELETE /identity/v3/users/62be2b0c2a364208b777e8572c2dcc4e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:08.298643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:08.301848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:08.354395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e8dc-8fc6-4eb3-a4ab-ed74cdc64a88 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:08.503644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:08.506054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:08.506054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:08.506054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] PATH_INFO: `/v3/projects/99fc6e8697cb4ca0b503389420cf438f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:08.508436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fc6e8697cb4ca0b503389420cf438f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:08.511591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:08.612158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fc6e8697cb4ca0b503389420cf438f', 'request_id': 'req-468abc8a-f7ef-4334-8649-d49ae8242759'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:08.621122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fc6e8697cb4ca0b503389420cf438f', 'request_id': 'req-468abc8a-f7ef-4334-8649-d49ae8242759'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:08.633673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fc6e8697cb4ca0b503389420cf438f', 'request_id': 'req-468abc8a-f7ef-4334-8649-d49ae8242759'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:08.660978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] The token cache is being invalidate because project 99fc6e8697cb4ca0b503389420cf438f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:08.661312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:08.662600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-468abc8a-f7ef-4334-8649-d49ae8242759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:08.664548 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2113/4169] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:08 2022] DELETE /identity/v3/projects/99fc6e8697cb4ca0b503389420cf438f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:08.669475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf653f4-8471-4e38-9a89-2e9c0eb40ae0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:08.670439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf653f4-8471-4e38-9a89-2e9c0eb40ae0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:08.671570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf653f4-8471-4e38-9a89-2e9c0eb40ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:08.704913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cdf653f4-8471-4e38-9a89-2e9c0eb40ae0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:08.706263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cdf653f4-8471-4e38-9a89-2e9c0eb40ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:08.797301 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2057/4170] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:08.803017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f8d7-c559-417e-b604-c0f6f54c5b34 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:08.803017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f8d7-c559-417e-b604-c0f6f54c5b34 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:08.803017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f8d7-c559-417e-b604-c0f6f54c5b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:08.832961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f9e8f8d7-c559-417e-b604-c0f6f54c5b34 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:08.835004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f9e8f8d7-c559-417e-b604-c0f6f54c5b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:08.844950 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2114/4171] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:08.849461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf653f4-8471-4e38-9a89-2e9c0eb40ae0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:08.870205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf653f4-8471-4e38-9a89-2e9c0eb40ae0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:08.876455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:08.878664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:08.879238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:08.880315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:08.881351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:08.881884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:08.883717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:08.913699 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2058/4172] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:08.918105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f8d7-c559-417e-b604-c0f6f54c5b34 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:08.929979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f8d7-c559-417e-b604-c0f6f54c5b34 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:08.937220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:08.937925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:08.938205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:08.938479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:08.939183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:08.941344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:09.008490 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2115/4173] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:08 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:09.008979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:09.031807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6e6b-cb8e-48a4-a5a0-0218eb8849b4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:09.170664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:09.171936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:09.172699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:09.173194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:09.174073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:09.176519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:09.208430 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2059/4174] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:09 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:09.213452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:09.256834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cdee-69fd-4baa-8e7a-ad396ff94a11 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:09.287387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:09.288191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:09.288543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:09.288887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:09.289861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:09.291517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:09.320149 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2116/4175] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:09.324102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:09.344470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60abe50-4796-4875-a3a8-5b89f8672967 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:09.353663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89903-c045-4c2c-8340-b54c230be89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:09.354730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89903-c045-4c2c-8340-b54c230be89d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:09.355278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89903-c045-4c2c-8340-b54c230be89d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:09.355752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89903-c045-4c2c-8340-b54c230be89d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:09.356711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e89903-c045-4c2c-8340-b54c230be89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:09.358722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e89903-c045-4c2c-8340-b54c230be89d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:09.378700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2060/4176] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:09.380249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:09.398759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0829-fa89-4a94-92ab-2d42543b8b5d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:09.403706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:09.404659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:09.404944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:09.405480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] PATH_INFO: `/v3/projects/670cdb531b424d11a72743ef6cf52641/users/1b1c7a4f4c714812a7f0de565d59806b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:09.421968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670cdb531b424d11a72743ef6cf52641, user_id=1b1c7a4f4c714812a7f0de565d59806b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:09.425708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:09.464602 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2117/4177] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:09 2022] PUT /identity/v3/projects/670cdb531b424d11a72743ef6cf52641/users/1b1c7a4f4c714812a7f0de565d59806b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:09.477348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae861-a04d-47a3-91e0-33f39ae8a92e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:09.477514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae861-a04d-47a3-91e0-33f39ae8a92e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:09.477680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae861-a04d-47a3-91e0-33f39ae8a92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:09.523464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0a3ae861-a04d-47a3-91e0-33f39ae8a92e None None] MFA Rules not processed for user `1b1c7a4f4c714812a7f0de565d59806b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:09.525253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0a3ae861-a04d-47a3-91e0-33f39ae8a92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:09.709731 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2061/4178] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:09.710636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:09.892908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ddbce-b71c-4c47-8981-b9d890eb14d4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:09.907091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:09.907807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:09.908091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:09.908370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:09.910745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:09.912719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:10.018303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2118/4179] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:09 2022] POST /identity/v3/projects => generated 365 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:10.019151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ae861-a04d-47a3-91e0-33f39ae8a92e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:10.040161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ae861-a04d-47a3-91e0-33f39ae8a92e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:10.177933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:10.178647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:10.178926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:10.179380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:10.180237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:10.182387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:10.222972 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2062/4180] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:10 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:10.226902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:10.243152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7181d-09c1-4420-ab3a-8223953a5237 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:10.268643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:10.270689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:10.272372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:10.272663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:10.273442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:10.275099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:10.305055 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2119/4181] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:10.305652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:10.317494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3b19b-de85-422e-9135-4239b5fc53c0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:10.340934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:10.341896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:10.342207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:10.342495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] PATH_INFO: `/v3/projects/67b187c259f34f0e9412dfea6872f717/users/8f690d5d7c834bea817a8bfe4e031b79/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:10.371437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b187c259f34f0e9412dfea6872f717, user_id=8f690d5d7c834bea817a8bfe4e031b79, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:10.378300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:10.427362 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2063/4182] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:10 2022] PUT /identity/v3/projects/67b187c259f34f0e9412dfea6872f717/users/8f690d5d7c834bea817a8bfe4e031b79/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:10.430097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:10.457635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b927151-f044-420a-9619-c62357c48b26 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:10.528080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82765f27-1987-4d78-b7d4-0de0d9444f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:10.528808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765f27-1987-4d78-b7d4-0de0d9444f47 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:10.529112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765f27-1987-4d78-b7d4-0de0d9444f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:10.529400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765f27-1987-4d78-b7d4-0de0d9444f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:10.530199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82765f27-1987-4d78-b7d4-0de0d9444f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:10.531854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82765f27-1987-4d78-b7d4-0de0d9444f47 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:10.547917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:10.559549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf0a25-a6c6-4a56-b559-8208fc403d1e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:10.560591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2120/4183] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:10.578329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:10.579354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:10.579653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:10.580125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] PATH_INFO: `/v3/projects/67b187c259f34f0e9412dfea6872f717/users/8f690d5d7c834bea817a8bfe4e031b79/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:10.583545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b187c259f34f0e9412dfea6872f717, user_id=8f690d5d7c834bea817a8bfe4e031b79, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:10.586281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:10.616420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a57a-1c2c-48a5-87f2-73edb4c91230 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:10.616709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a57a-1c2c-48a5-87f2-73edb4c91230 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:10.618128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a57a-1c2c-48a5-87f2-73edb4c91230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:10.620082 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2064/4184] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:10 2022] PUT /identity/v3/projects/67b187c259f34f0e9412dfea6872f717/users/8f690d5d7c834bea817a8bfe4e031b79/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:10.656547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e9e4a57a-1c2c-48a5-87f2-73edb4c91230 None None] MFA Rules not processed for user `8f690d5d7c834bea817a8bfe4e031b79`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:10.658355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e9e4a57a-1c2c-48a5-87f2-73edb4c91230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:10.777794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:10.786079 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2121/4185] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:10.790131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3f9dc-fb87-4a6e-98a6-af3e21156d56 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:10.805208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:10.805855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:10.806136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:10.807466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:10.808324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:10.810280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:10.887822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a57a-1c2c-48a5-87f2-73edb4c91230 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:10.898181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a57a-1c2c-48a5-87f2-73edb4c91230 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:10.902272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2065/4186] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:10 2022] POST /identity/v3/projects => generated 360 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:11.079820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:11.081065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:11.081357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:11.081630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:11.082334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:11.084227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:11.085563 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.common [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 09 21:08:11.137191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2122/4187] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:10 2022] POST /identity/v3/users => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:11.141085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:11.170013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d500a-3665-4172-ada2-23ca2db1963f tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:11.177293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:11.178741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:11.179185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:11.179679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/9dd64f3db1e54b5682dc1c9aa9df98e6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:11.207299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:get_user(user_id=9dd64f3db1e54b5682dc1c9aa9df98e6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:11.210057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:11.213367 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2066/4188] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:08:11 2022] GET /identity/v3/users/9dd64f3db1e54b5682dc1c9aa9df98e6 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:11.217993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:11.228862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721660b-7f4a-4e17-b50c-f383c45f1e42 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:11.250780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:11.251713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:11.252037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:11.252316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/9dd64f3db1e54b5682dc1c9aa9df98e6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:11.257178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9dd64f3db1e54b5682dc1c9aa9df98e6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:11.259677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:11.451661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd64f3db1e54b5682dc1c9aa9df98e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.452906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd64f3db1e54b5682dc1c9aa9df98e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.462358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd64f3db1e54b5682dc1c9aa9df98e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.476627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd64f3db1e54b5682dc1c9aa9df98e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.482125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd64f3db1e54b5682dc1c9aa9df98e6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.510033 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2123/4189] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:11 2022] DELETE /identity/v3/users/9dd64f3db1e54b5682dc1c9aa9df98e6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:11.511870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:11.514167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:11.530046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73a55-5326-4c62-aa41-21cc2b5a64b7 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:11.635553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:11.636456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:11.636735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:11.637205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/56166677ad2f447ab219d81fd253dc68` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:11.639574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56166677ad2f447ab219d81fd253dc68)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:11.642156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:11.756247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56166677ad2f447ab219d81fd253dc68', 'request_id': 'req-fcfe862d-a262-4c18-a2de-81eeec02d944'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.801716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56166677ad2f447ab219d81fd253dc68', 'request_id': 'req-fcfe862d-a262-4c18-a2de-81eeec02d944'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.835209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56166677ad2f447ab219d81fd253dc68', 'request_id': 'req-fcfe862d-a262-4c18-a2de-81eeec02d944'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.855461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] The token cache is being invalidate because project 56166677ad2f447ab219d81fd253dc68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:11.855746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.858616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:11.867203 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2067/4190] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:11 2022] DELETE /identity/v3/projects/56166677ad2f447ab219d81fd253dc68 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:11.868039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:11.896611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fff6a4-74eb-4133-b065-44733bb0eb14 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:11.995285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:11.995968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:11.998178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:11.998178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:11.998178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:11.999221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.055807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.057154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:12.058662 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2124/4191] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:11 2022] POST /identity/v3/projects => generated 359 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:12.079941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe862d-a262-4c18-a2de-81eeec02d944 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.151209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.151906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.152182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.152469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.155264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.157269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.211497 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2068/4192] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:12 2022] POST /identity/v3/users => generated 414 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:12.212866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.228873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c14d1-f6be-4482-b904-959a136fd9dc tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.256171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.257184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.257845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.258387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.259286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.261566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.292129 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2125/4193] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:08:12 2022] POST /identity/v3/roles => generated 239 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:12.297672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.309305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be5f8e-4293-4651-8b0a-bb9225197e2c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.315718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.318447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.318738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.319017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/9ca1c866821e4396afa41666336d9ef1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.346450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:get_user(user_id=9ca1c866821e4396afa41666336d9ef1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.348981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.352186 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2069/4194] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:08:12 2022] GET /identity/v3/users/9ca1c866821e4396afa41666336d9ef1 => generated 414 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:12.357279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.374040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e912a6-8d62-4dfb-9fbf-7df5d9109671 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.379812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.380924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.381407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.381817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/roles/f5d6cb090694470dad69879e86854e16` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.384121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:get_role(role_id=f5d6cb090694470dad69879e86854e16)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.386086 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:12.386086 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:12.386086 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:12.387042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.389111 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2126/4195] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:08:12 2022] GET /identity/v3/roles/f5d6cb090694470dad69879e86854e16 => generated 239 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:12.392758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.407114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ef3f0-2a11-4dea-8d46-d5c744d5ef99 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.412580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.413803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.414297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.414755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.415669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.418500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.481018 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2070/4196] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:12 2022] POST /identity/v3/projects => generated 356 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:12.490203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.511656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1938d-a7c9-4f61-bafe-7e67d6229a73 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.618009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.618812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.619105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.619499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/8f7c030593df41ad8f3a0f3f8d5da550` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.620606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f7c030593df41ad8f3a0f3f8d5da550)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.622733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.624812 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2127/4197] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:12 2022] GET /identity/v3/projects/8f7c030593df41ad8f3a0f3f8d5da550 => generated 356 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:12.632483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.646824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5f97-22f1-41d2-8db2-72f9ee23a09c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.654029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.655104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.655636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.655957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/8f7c030593df41ad8f3a0f3f8d5da550/users/9ca1c866821e4396afa41666336d9ef1/roles/f5d6cb090694470dad69879e86854e16` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.661486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8f7c030593df41ad8f3a0f3f8d5da550, user_id=9ca1c866821e4396afa41666336d9ef1, role_id=f5d6cb090694470dad69879e86854e16)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.666155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.684689 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2071/4198] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:12 2022] PUT /identity/v3/projects/8f7c030593df41ad8f3a0f3f8d5da550/users/9ca1c866821e4396afa41666336d9ef1/roles/f5d6cb090694470dad69879e86854e16 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:12.688731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.699145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87059-8b5a-4c0b-901f-4fb008fafb7c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:12.845565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:12.846477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:12.847142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:12.847539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:12.848559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:12.850717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:12.952545 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2128/4199] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:12 2022] POST /identity/v3/projects => generated 360 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:12.956320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:12.985733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f42c8-88aa-4301-9909-f4bea2d4dd6e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:13.206491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:13.207392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:13.207677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:13.207954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/4895cbff4e1d49c3b38a85c9c1af89af` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:13.211045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:get_project(project_id=4895cbff4e1d49c3b38a85c9c1af89af)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:13.214990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:13.220888 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2072/4200] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:12 2022] GET /identity/v3/projects/4895cbff4e1d49c3b38a85c9c1af89af => generated 360 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:08:13.223150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:13.250998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043f6a-1a5c-4007-bfe3-e523ed5fe5b3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:13.275380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:13.276426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:13.276777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:13.277147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/4895cbff4e1d49c3b38a85c9c1af89af/users/9ca1c866821e4396afa41666336d9ef1/roles/f5d6cb090694470dad69879e86854e16` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:13.281675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4895cbff4e1d49c3b38a85c9c1af89af, user_id=9ca1c866821e4396afa41666336d9ef1, role_id=f5d6cb090694470dad69879e86854e16)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:13.284648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:13.316952 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2129/4201] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:13 2022] PUT /identity/v3/projects/4895cbff4e1d49c3b38a85c9c1af89af/users/9ca1c866821e4396afa41666336d9ef1/roles/f5d6cb090694470dad69879e86854e16 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:13.321389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:13.335403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61777be-b8a8-42df-abe9-050cea6eeab5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:13.472517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:13.474447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:13.474918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:13.475360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/9ca1c866821e4396afa41666336d9ef1/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:13.476844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=9ca1c866821e4396afa41666336d9ef1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:13.480056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:13.619156 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2073/4202] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:08:13 2022] GET /identity/v3/users/9ca1c866821e4396afa41666336d9ef1/projects => generated 840 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:13.624059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:13.638924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a4a31-04ba-43ee-abd6-287f1a2bde78 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:13.652519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:13.653575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:13.653918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:13.654253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/4895cbff4e1d49c3b38a85c9c1af89af` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:13.656867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4895cbff4e1d49c3b38a85c9c1af89af)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:13.658778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:13.777722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4895cbff4e1d49c3b38a85c9c1af89af', 'request_id': 'req-ba8217cc-aa2a-4775-bf00-e0ace3953334'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:13.784889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4895cbff4e1d49c3b38a85c9c1af89af', 'request_id': 'req-ba8217cc-aa2a-4775-bf00-e0ace3953334'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:13.810360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4895cbff4e1d49c3b38a85c9c1af89af', 'request_id': 'req-ba8217cc-aa2a-4775-bf00-e0ace3953334'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:13.864154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] The token cache is being invalidate because project 4895cbff4e1d49c3b38a85c9c1af89af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:13.864484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:13.866116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:13.876582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2130/4203] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:13 2022] DELETE /identity/v3/projects/4895cbff4e1d49c3b38a85c9c1af89af => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:13.877662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:13.880670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:13.902070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac916c-0149-4f92-adb8-d64dd8e1667a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:14.067093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:14.067987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:14.068268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:14.068540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/8f7c030593df41ad8f3a0f3f8d5da550` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:14.069789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f7c030593df41ad8f3a0f3f8d5da550)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:14.073770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:14.184169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7c030593df41ad8f3a0f3f8d5da550', 'request_id': 'req-e0f5006c-fc04-4420-83e4-3599d0dfba38'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.191872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7c030593df41ad8f3a0f3f8d5da550', 'request_id': 'req-e0f5006c-fc04-4420-83e4-3599d0dfba38'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.205394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7c030593df41ad8f3a0f3f8d5da550', 'request_id': 'req-e0f5006c-fc04-4420-83e4-3599d0dfba38'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.230212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] The token cache is being invalidate because project 8f7c030593df41ad8f3a0f3f8d5da550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:14.230708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.231644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.233845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2074/4204] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:13 2022] DELETE /identity/v3/projects/8f7c030593df41ad8f3a0f3f8d5da550 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:14.243705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:14.250928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8217cc-aa2a-4775-bf00-e0ace3953334 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:14.385451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:14.386663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:14.389736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:14.390330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/roles/f5d6cb090694470dad69879e86854e16` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:14.392460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f5d6cb090694470dad69879e86854e16)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:14.395885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:14.467706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invalidating the token cache because role f5d6cb090694470dad69879e86854e16 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:14.468137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.469347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-db6e8595-e829-4c23-a82d-3ba2726589c9 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.472628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2131/4205] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:14 2022] DELETE /identity/v3/roles/f5d6cb090694470dad69879e86854e16 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:14.476538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:14.480643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:14.508896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5006c-fc04-4420-83e4-3599d0dfba38 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:14.556138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:14.556759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:14.558119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:14.602904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] MFA Rules not processed for user `38f474d5daf947ff9f632424e909390a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:14.605013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:14.632706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:14.640490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:14.641257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:14.641905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/9ca1c866821e4396afa41666336d9ef1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:14.643940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9ca1c866821e4396afa41666336d9ef1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:14.646620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:14.722707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca1c866821e4396afa41666336d9ef1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.723383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca1c866821e4396afa41666336d9ef1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.731017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca1c866821e4396afa41666336d9ef1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.731695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca1c866821e4396afa41666336d9ef1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.744591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca1c866821e4396afa41666336d9ef1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.754949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2132/4206] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:14.775887 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2075/4207] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:14 2022] DELETE /identity/v3/users/9ca1c866821e4396afa41666336d9ef1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:14.780313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:14.781959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:14.800584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2af04-9add-44ba-812f-9f802eb34000 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:14.900414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:14.902243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:14.902611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:14.902987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/17d0590f706647658d0a526cd9932ab0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:14.904380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17d0590f706647658d0a526cd9932ab0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:14.906553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:14.978236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d0590f706647658d0a526cd9932ab0', 'request_id': 'req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.985686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d0590f706647658d0a526cd9932ab0', 'request_id': 'req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:14.997102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d0590f706647658d0a526cd9932ab0', 'request_id': 'req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.023725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] The token cache is being invalidate because project 17d0590f706647658d0a526cd9932ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:15.024100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.025479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ebf83f5-c0ed-465a-9d47-bf966934c4a5 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.031503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2133/4208] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:14 2022] DELETE /identity/v3/projects/17d0590f706647658d0a526cd9932ab0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:15.033338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:15.034785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:15.048321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334c193-7885-407a-b5dc-88faa109dbd8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:15.111698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:15.113016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.113331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.113621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/1b1c7a4f4c714812a7f0de565d59806b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.115361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:update_user(user_id=1b1c7a4f4c714812a7f0de565d59806b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:15.116396 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:15.116396 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:08:15.116396 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:08:15.117834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:15.164147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.177573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invalidating the token cache because user 1b1c7a4f4c714812a7f0de565d59806b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:15.178502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.179297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.181259 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2076/4209] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Apr 9 21:08:15 2022] PATCH /identity/v3/users/1b1c7a4f4c714812a7f0de565d59806b => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:15.185716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06ece-727b-41b8-b58c-8082b0b91cba None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.186560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06ece-727b-41b8-b58c-8082b0b91cba None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.187075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06ece-727b-41b8-b58c-8082b0b91cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.223155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bee06ece-727b-41b8-b58c-8082b0b91cba None None] MFA Rules not processed for user `1b1c7a4f4c714812a7f0de565d59806b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:15.225121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bee06ece-727b-41b8-b58c-8082b0b91cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:15.232369 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2134/4210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:15 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:15.233922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:15.235742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:15.266084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f18e0-2a69-48e7-ad25-38db02379ebb tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:15.286215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:15.287138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.287421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.287696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/1b1c7a4f4c714812a7f0de565d59806b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.289533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:update_user(user_id=1b1c7a4f4c714812a7f0de565d59806b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:15.291896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:15.336035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.348574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invalidating the token cache because user 1b1c7a4f4c714812a7f0de565d59806b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:15.349276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.350312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-570828ea-a596-413b-969d-7275a617499d tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.354623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2077/4211] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Apr 9 21:08:15 2022] PATCH /identity/v3/users/1b1c7a4f4c714812a7f0de565d59806b => generated 297 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:15.358385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee06ece-727b-41b8-b58c-8082b0b91cba None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:15.375139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee06ece-727b-41b8-b58c-8082b0b91cba None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:15.381604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:15.382815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.383294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.383795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/1b1c7a4f4c714812a7f0de565d59806b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.400246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:update_user(user_id=1b1c7a4f4c714812a7f0de565d59806b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:15.402176 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:15.402176 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:15.402176 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:15.403828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:15.474693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.493487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invalidating the token cache because user 1b1c7a4f4c714812a7f0de565d59806b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:15.493898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.494660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.496820 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2135/4212] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Apr 9 21:08:15 2022] PATCH /identity/v3/users/1b1c7a4f4c714812a7f0de565d59806b => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:08:15.501548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907b38b-0500-41a1-ad6a-51401095e51a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.502458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907b38b-0500-41a1-ad6a-51401095e51a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.502899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907b38b-0500-41a1-ad6a-51401095e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.538282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a907b38b-0500-41a1-ad6a-51401095e51a None None] MFA Rules not processed for user `1b1c7a4f4c714812a7f0de565d59806b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:15.539812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a907b38b-0500-41a1-ad6a-51401095e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:15.544122 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2078/4213] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:15 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:15.548023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:15.549887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:15.562896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eafad9-cf44-4654-9d9b-0959f5ab9c5a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:15.568656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:15.569754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.570044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.570321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/1b1c7a4f4c714812a7f0de565d59806b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.571674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:update_user(user_id=1b1c7a4f4c714812a7f0de565d59806b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:15.573680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:15.628629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.646462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invalidating the token cache because user 1b1c7a4f4c714812a7f0de565d59806b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:15.647035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.647776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.650369 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2136/4214] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Apr 9 21:08:15 2022] PATCH /identity/v3/users/1b1c7a4f4c714812a7f0de565d59806b => generated 297 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:15.657536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907b38b-0500-41a1-ad6a-51401095e51a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:15.690857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907b38b-0500-41a1-ad6a-51401095e51a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:15.699795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda7480-ff49-4c44-8847-7834e4f8966a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:15.700499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7480-ff49-4c44-8847-7834e4f8966a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.700783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7480-ff49-4c44-8847-7834e4f8966a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.701173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7480-ff49-4c44-8847-7834e4f8966a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.701915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda7480-ff49-4c44-8847-7834e4f8966a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:15.704102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda7480-ff49-4c44-8847-7834e4f8966a tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:15.760333 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2079/4215] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:08:15 2022] POST /identity/v3/users => generated 265 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:15.763030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:15.764853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:15.783141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24568d8-d834-44b1-9466-3cd3c5f14e50 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:15.799165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5c08-05d3-4623-9cc8-3b8467a7b82e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:15.800325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5c08-05d3-4623-9cc8-3b8467a7b82e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:15.800616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5c08-05d3-4623-9cc8-3b8467a7b82e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:15.801490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5c08-05d3-4623-9cc8-3b8467a7b82e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/c4fca3a1ff8a468f8f3c0cf171925e01/password` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:15.907148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0aba5c08-05d3-4623-9cc8-3b8467a7b82e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c4fca3a1ff8a468f8f3c0cf171925e01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:15.924054 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2137/4216] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:15 2022] POST /identity/v3/users/c4fca3a1ff8a468f8f3c0cf171925e01/password => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:16.932177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dd72-4ee2-4179-8dd8-567bdabf6b0c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:16.932773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dd72-4ee2-4179-8dd8-567bdabf6b0c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:16.932773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dd72-4ee2-4179-8dd8-567bdabf6b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:16.974115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2cb1dd72-4ee2-4179-8dd8-567bdabf6b0c None None] MFA Rules not processed for user `c4fca3a1ff8a468f8f3c0cf171925e01`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:16.976390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2cb1dd72-4ee2-4179-8dd8-567bdabf6b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:16.986209 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2080/4217] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:16 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:16.990734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5c08-05d3-4623-9cc8-3b8467a7b82e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:17.008033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5c08-05d3-4623-9cc8-3b8467a7b82e tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:17.032096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:17.032801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:17.033111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:17.033388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:17.061502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:17.070708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:17.095283 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2138/4218] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Apr 9 21:08:16 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:17.102272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1dd72-4ee2-4179-8dd8-567bdabf6b0c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:17.146415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1dd72-4ee2-4179-8dd8-567bdabf6b0c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:17.162299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:17.163309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:17.163662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:17.163946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/c4fca3a1ff8a468f8f3c0cf171925e01` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:17.165369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c4fca3a1ff8a468f8f3c0cf171925e01)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:17.171655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:17.259743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fca3a1ff8a468f8f3c0cf171925e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:17.261289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fca3a1ff8a468f8f3c0cf171925e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:17.273891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fca3a1ff8a468f8f3c0cf171925e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:17.275141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fca3a1ff8a468f8f3c0cf171925e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:17.289626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fca3a1ff8a468f8f3c0cf171925e01'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:17.319910 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2081/4219] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:17 2022] DELETE /identity/v3/users/c4fca3a1ff8a468f8f3c0cf171925e01 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:17.320176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:17.332460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32753e-4eaa-49ae-bfcb-6fe4f3f74f8c tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:17.469583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:17.470731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:17.470731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:17.470937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:17.473101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:17.474143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:17.539850 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2139/4220] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:17 2022] POST /identity/v3/users => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:17.545983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:17.547623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:17.569529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf3921-79ad-4958-8eb2-05d0e7f63a84 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:17.582322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:17.584391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:17.598139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:17.600726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:17.601551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:17.605691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:17.678992 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2082/4221] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:17 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:17.680750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:17.697914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4210a1f-6a6c-4639-b2af-6813ea1714f3 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:17.847291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:17.848227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:17.848518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:17.848787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/ab27379012bb4848bd0e96c86e8f641d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:17.880467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:update_user(user_id=ab27379012bb4848bd0e96c86e8f641d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:17.884913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:17.936421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:17.948286 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2140/4222] 10.222.0.30 () {60 vars in 1243 bytes} [Sat Apr 9 21:08:17 2022] PATCH /identity/v3/users/ab27379012bb4848bd0e96c86e8f641d => generated 520 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:17.955789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1173-9fec-421c-9f89-5a72a3efa6c8 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:17.969996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:17.971220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:17.971509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:17.971794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/ab27379012bb4848bd0e96c86e8f641d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:18.001950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:get_user(user_id=ab27379012bb4848bd0e96c86e8f641d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:18.004204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:18.012884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:18.025234 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2083/4223] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:08:17 2022] GET /identity/v3/users/ab27379012bb4848bd0e96c86e8f641d => generated 387 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:08:18.028086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74d36a-d359-46a1-9d1a-2bcde7aca553 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:18.046679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:18.047587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:18.048060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:18.048490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/projects/60374b0222bc4f9b8a52895f6d8cab09` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:18.052175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60374b0222bc4f9b8a52895f6d8cab09)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:18.055136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:18.206651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60374b0222bc4f9b8a52895f6d8cab09', 'request_id': 'req-01bd600e-b208-4791-83e2-7f1077ea2749'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.217804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60374b0222bc4f9b8a52895f6d8cab09', 'request_id': 'req-01bd600e-b208-4791-83e2-7f1077ea2749'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.235611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60374b0222bc4f9b8a52895f6d8cab09', 'request_id': 'req-01bd600e-b208-4791-83e2-7f1077ea2749'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.259819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] The token cache is being invalidate because project 60374b0222bc4f9b8a52895f6d8cab09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:18.260110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.261592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.267395 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2141/4224] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:18 2022] DELETE /identity/v3/projects/60374b0222bc4f9b8a52895f6d8cab09 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:18.271454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:18.273682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:18.300150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c1dfa-b5bd-4886-8edc-9737130aa926 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:18.454702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f690d5d7c834bea817a8bfe4e031b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67b187c259f34f0e9412dfea6872f717', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:18.456123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:18.456418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:18.456709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] PATH_INFO: `/v3/users/ab27379012bb4848bd0e96c86e8f641d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:18.461912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ab27379012bb4848bd0e96c86e8f641d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:18.461912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:18.561911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab27379012bb4848bd0e96c86e8f641d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.563117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab27379012bb4848bd0e96c86e8f641d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.571755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab27379012bb4848bd0e96c86e8f641d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.573830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab27379012bb4848bd0e96c86e8f641d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.591454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ef0701c3-21dd-4d85-81ac-6ca8b9496c31 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab27379012bb4848bd0e96c86e8f641d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.623174 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2084/4225] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:18 2022] DELETE /identity/v3/users/ab27379012bb4848bd0e96c86e8f641d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:18.628106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:18.629838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:18.707390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd600e-b208-4791-83e2-7f1077ea2749 tempest-UsersV3TestJSON-736584816 tempest-UsersV3TestJSON-736584816-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:18.798046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:18.798681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:18.798961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:18.799235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] PATH_INFO: `/v3/users/1b1c7a4f4c714812a7f0de565d59806b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:18.823720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1c7a4f4c714812a7f0de565d59806b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:18.826529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:18.892003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.893464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.899905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.910143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.910932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1c7a4f4c714812a7f0de565d59806b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:18.930874 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2142/4226] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:18 2022] DELETE /identity/v3/users/1b1c7a4f4c714812a7f0de565d59806b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:18.935550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:18.936214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:18.936699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:18.962568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:18.962568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:19.069139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:19.069746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2085/4227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:19.071418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:19.086361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997ebc-eae7-437f-b91a-457015724005 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:19.093363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:19.094628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:19.094910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:19.095182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] PATH_INFO: `/v3/users/f591cadcc8564d51a4433748e0f84638` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:19.099521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:19.100558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f591cadcc8564d51a4433748e0f84638)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:19.101101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:19.102606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:19.183023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f591cadcc8564d51a4433748e0f84638'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:19.184277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f591cadcc8564d51a4433748e0f84638'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:19.193672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f591cadcc8564d51a4433748e0f84638'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:19.204633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f591cadcc8564d51a4433748e0f84638'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:19.205348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8388c117-42a1-4c2f-8d30-74100056decc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f591cadcc8564d51a4433748e0f84638'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:19.217677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9211e-febb-4c92-8834-681c89316cd5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:19.228392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:19.229286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:19.229572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:19.229851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:19.231869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:19.233147 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2143/4228] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:19 2022] DELETE /identity/v3/users/f591cadcc8564d51a4433748e0f84638 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:19.237294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:19.237978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:19.238470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:19.255656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:19.262892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:19.266543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:19.268017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:19.287623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2086/4229] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:19.355489 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2144/4230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:19.386630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:19.388172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:19.401701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29bb89-43b7-42c6-837a-fe178044e839 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:19.521481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:19.522307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:19.522790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:19.522989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:19.537161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:19.539418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:19.585549 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2087/4231] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:08:20.574819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:20.576245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:20.590404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c7a62-6efe-425e-8c7f-2888e0f82bcf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:20.596306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:20.597552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:20.597873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:20.598140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] PATH_INFO: `/v3/projects/670cdb531b424d11a72743ef6cf52641` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:20.599797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670cdb531b424d11a72743ef6cf52641)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:20.615078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:20.705110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:20.707463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:20.715649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670cdb531b424d11a72743ef6cf52641', 'request_id': 'req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:20.724502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670cdb531b424d11a72743ef6cf52641', 'request_id': 'req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:20.727034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3efa4e-fb8a-47fe-9b84-4f24650b56be service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:20.751258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670cdb531b424d11a72743ef6cf52641', 'request_id': 'req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:20.772836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] The token cache is being invalidate because project 670cdb531b424d11a72743ef6cf52641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:20.780002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:20.780874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:20.791537 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2145/4232] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:20 2022] DELETE /identity/v3/projects/670cdb531b424d11a72743ef6cf52641 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:20.792636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:20.804668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:20.875604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:20.884444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:20.885260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:20.885879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] PATH_INFO: `/v3/projects/76d0c33645544aac925f571c5572f115` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:20.888302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d0c33645544aac925f571c5572f115)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:20.890698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:20.916257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c73d-e3ec-4f2c-b3cb-1a09c0e10588 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:20.922753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:20.923849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:20.924310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:20.926187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] PATH_INFO: `/v3/users/8f690d5d7c834bea817a8bfe4e031b79` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:20.927910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f690d5d7c834bea817a8bfe4e031b79)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:20.930369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:20.994655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d0c33645544aac925f571c5572f115', 'request_id': 'req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.002479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d0c33645544aac925f571c5572f115', 'request_id': 'req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.013578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d0c33645544aac925f571c5572f115', 'request_id': 'req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.016497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f690d5d7c834bea817a8bfe4e031b79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.017628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f690d5d7c834bea817a8bfe4e031b79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.032523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] The token cache is being invalidate because project 76d0c33645544aac925f571c5572f115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:21.033165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.034177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.042142 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2088/4233] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:20 2022] DELETE /identity/v3/projects/76d0c33645544aac925f571c5572f115 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:21.042142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.042457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f690d5d7c834bea817a8bfe4e031b79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.044799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:21.054860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f690d5d7c834bea817a8bfe4e031b79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.056478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7c3849a6-0a4f-46e0-b1c6-6c342c6a4b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f690d5d7c834bea817a8bfe4e031b79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.118479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2146/4234] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:20 2022] DELETE /identity/v3/users/8f690d5d7c834bea817a8bfe4e031b79 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:21.123937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c26d4-216a-4f9f-bec9-8e01d1c8dede None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.125994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c26d4-216a-4f9f-bec9-8e01d1c8dede None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.126251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c26d4-216a-4f9f-bec9-8e01d1c8dede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.164520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ed1c26d4-216a-4f9f-bec9-8e01d1c8dede None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:21.166613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ed1c26d4-216a-4f9f-bec9-8e01d1c8dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:21.202907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eceedb-3d6b-4cb0-a3eb-7dcec3493dfc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.280036 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2147/4235] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:21.290849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11389-9728-4ee2-b716-acca9324410c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.291290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11389-9728-4ee2-b716-acca9324410c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.293170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11389-9728-4ee2-b716-acca9324410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.304803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.305831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.306112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.306378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] PATH_INFO: `/v3/users/33ea3acc687d49a9868219b4c9fa34dc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.307807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ea3acc687d49a9868219b4c9fa34dc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.310055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.337274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-15f11389-9728-4ee2-b716-acca9324410c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:21.338755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-15f11389-9728-4ee2-b716-acca9324410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:21.365246 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2148/4236] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:21.366184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11389-9728-4ee2-b716-acca9324410c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.380855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11389-9728-4ee2-b716-acca9324410c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.386340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.387091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.387553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.387684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.388567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:21.388868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.390892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.397686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ea3acc687d49a9868219b4c9fa34dc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.407459 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2149/4237] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:21.407655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ea3acc687d49a9868219b4c9fa34dc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.408634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.419407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ea3acc687d49a9868219b4c9fa34dc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.420080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ea3acc687d49a9868219b4c9fa34dc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.429359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1f96d-b228-4ba2-abaa-bf69c59a612f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.433885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f093b798-e73d-4d1d-b30f-95b9fe1d8dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ea3acc687d49a9868219b4c9fa34dc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:21.437616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.438687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.439292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.439780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.444048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.447818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.453511 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2089/4238] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:21 2022] DELETE /identity/v3/users/33ea3acc687d49a9868219b4c9fa34dc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:21.471109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05c42a-897f-46e7-b024-334a3a7db1f6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.471916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05c42a-897f-46e7-b024-334a3a7db1f6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.473104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05c42a-897f-46e7-b024-334a3a7db1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.504625 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2150/4239] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:21 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:21.509771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.511939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:21.515290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6c05c42a-897f-46e7-b024-334a3a7db1f6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:21.517745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c05c42a-897f-46e7-b024-334a3a7db1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:21.617711 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2090/4240] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:21.663594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361966-ec17-4539-8a2b-b97bebc1a73d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.669792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.670793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.671158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.671540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.672342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.675537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.704663 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2151/4241] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:21 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:21.709107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05c42a-897f-46e7-b024-334a3a7db1f6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.714394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.716726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:21.724616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05c42a-897f-46e7-b024-334a3a7db1f6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.736732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.738405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.738691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.739058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.742925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.744370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.765573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2091/4242] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:08:21.767789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.797277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2184-7103-4369-a58a-f2c3a87b4432 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.808256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.809704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.809704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.809704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.810354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.814209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.834824 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2092/4243] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:21.836823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.854111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7a3bb-f5a5-4816-8fd3-19be92cc2f63 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.875231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.877755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.878201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.878312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa6b31-15e7-4a30-a6d2-ef1e3e0ac976 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.878878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.893132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26ed4-431e-4b19-b3d4-d0339a5ede4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:21.894070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26ed4-431e-4b19-b3d4-d0339a5ede4c admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.894338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26ed4-431e-4b19-b3d4-d0339a5ede4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.894610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26ed4-431e-4b19-b3d4-d0339a5ede4c admin admin] PATH_INFO: `/v3/projects/9ef722f37add412d995982bf015f8b75/users/1ad067bf99a94e85a0e932643ed1cbf1/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.896619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.902080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.920814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26ed4-431e-4b19-b3d4-d0339a5ede4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef722f37add412d995982bf015f8b75, user_id=1ad067bf99a94e85a0e932643ed1cbf1, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:21.921984 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2152/4244] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:21.922854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:21.924328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26ed4-431e-4b19-b3d4-d0339a5ede4c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:21.924525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:21.943290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01355c-995a-4400-a44a-a172ff52c4dd service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:21.949452 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2093/4245] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:21 2022] PUT /identity/v3/projects/9ef722f37add412d995982bf015f8b75/users/1ad067bf99a94e85a0e932643ed1cbf1/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:21.955205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:21.955486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:21.956044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:21.999039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] MFA Rules not processed for user `1ad067bf99a94e85a0e932643ed1cbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:22.001366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:22.101741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:22.102658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:22.102937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:22.103209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] PATH_INFO: `/v3/users/918209191d2a40e5a996bb469bc26b4f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:22.111121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=918209191d2a40e5a996bb469bc26b4f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:22.113144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:22.141637 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2094/4246] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:22.221991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918209191d2a40e5a996bb469bc26b4f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:22.222807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918209191d2a40e5a996bb469bc26b4f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:22.233838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918209191d2a40e5a996bb469bc26b4f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:22.253675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918209191d2a40e5a996bb469bc26b4f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:22.254686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41b6b546-f483-41f0-ae2f-ecd07895c9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918209191d2a40e5a996bb469bc26b4f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:22.274672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:22.276354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:22.284334 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2153/4247] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:21 2022] DELETE /identity/v3/users/918209191d2a40e5a996bb469bc26b4f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:22.408910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc26eb-b862-410c-a1b4-7668282c6019 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:22.486687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:22.487668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:22.488123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:22.488553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:22.491687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:22.566331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:22.568477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:22.587745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2095/4248] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:22.611698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836991b5-fb7d-4186-a28c-1cf054178433 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:22.612306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836991b5-fb7d-4186-a28c-1cf054178433 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:22.612829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836991b5-fb7d-4186-a28c-1cf054178433 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:22.616231 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2154/4249] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:08:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:08:22.622624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:08:22.624637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:22.647474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836991b5-fb7d-4186-a28c-1cf054178433 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:22.649498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-836991b5-fb7d-4186-a28c-1cf054178433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:22.664777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:22.695782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f9de-b396-4986-af55-ef75a1799d7f service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:22.707576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927130c6-d584-45aa-bf64-8bd36151a65c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad067bf99a94e85a0e932643ed1cbf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef722f37add412d995982bf015f8b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:22.709826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927130c6-d584-45aa-bf64-8bd36151a65c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:22.710374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927130c6-d584-45aa-bf64-8bd36151a65c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:22.710374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927130c6-d584-45aa-bf64-8bd36151a65c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] PATH_INFO: `/v3/projects/9ef722f37add412d995982bf015f8b75` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:22.714840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927130c6-d584-45aa-bf64-8bd36151a65c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorizing `identity:get_project(project_id=9ef722f37add412d995982bf015f8b75)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:22.720557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927130c6-d584-45aa-bf64-8bd36151a65c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:22.740369 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2096/4250] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:08:22 2022] GET /identity/v3/projects/9ef722f37add412d995982bf015f8b75 => generated 363 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:22.777162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ee6a1-cdd4-4c48-a936-7e7ca437a14c None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:22.777748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ee6a1-cdd4-4c48-a936-7e7ca437a14c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:22.778124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ee6a1-cdd4-4c48-a936-7e7ca437a14c None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:22.781379 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2097/4251] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:08:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:08:22.787961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ee6a1-cdd4-4c48-a936-7e7ca437a14c None None] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:08:22.791965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b5ee6a1-cdd4-4c48-a936-7e7ca437a14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:22.830871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836991b5-fb7d-4186-a28c-1cf054178433 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:22.841768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:22.841768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:22.842080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:22.842157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] PATH_INFO: `/v3/projects/67b187c259f34f0e9412dfea6872f717` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:22.844318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b187c259f34f0e9412dfea6872f717)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:22.846593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:22.891484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ee6a1-cdd4-4c48-a936-7e7ca437a14c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:22.921626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ee6a1-cdd4-4c48-a936-7e7ca437a14c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:22.949179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b187c259f34f0e9412dfea6872f717', 'request_id': 'req-7310020b-00e2-4e32-aa06-065ac664db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:22.967054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b187c259f34f0e9412dfea6872f717', 'request_id': 'req-7310020b-00e2-4e32-aa06-065ac664db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:22.987663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b187c259f34f0e9412dfea6872f717', 'request_id': 'req-7310020b-00e2-4e32-aa06-065ac664db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.025153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] The token cache is being invalidate because project 67b187c259f34f0e9412dfea6872f717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:23.025546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.027014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.035935 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2155/4252] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:22 2022] DELETE /identity/v3/projects/67b187c259f34f0e9412dfea6872f717 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:23.043301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62129c7a-4479-45d8-87e3-0ed7efb88cb4 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad067bf99a94e85a0e932643ed1cbf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef722f37add412d995982bf015f8b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.044206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129c7a-4479-45d8-87e3-0ed7efb88cb4 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.044466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129c7a-4479-45d8-87e3-0ed7efb88cb4 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.044739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129c7a-4479-45d8-87e3-0ed7efb88cb4 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] PATH_INFO: `/v3/projects/9ef722f37add412d995982bf015f8b75` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.045762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62129c7a-4479-45d8-87e3-0ed7efb88cb4 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorizing `identity:get_project(project_id=9ef722f37add412d995982bf015f8b75)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.047554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62129c7a-4479-45d8-87e3-0ed7efb88cb4 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.047864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.049472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.049611 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2098/4253] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:08:22 2022] GET /identity/v3/projects/9ef722f37add412d995982bf015f8b75 => generated 363 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:23.054998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.055283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.055556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.099136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:23.113855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.244820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310020b-00e2-4e32-aa06-065ac664db4e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:23.256529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.257570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.257907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.258243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] PATH_INFO: `/v3/projects/c950fe626e0b4d1a88be8c0943fe3965` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.261214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c950fe626e0b4d1a88be8c0943fe3965)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.263487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.268062 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2099/4254] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:23.268062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.278850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.300979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9893c-f767-4e9e-80c2-0d88c389c66e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:23.310828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.311888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.312055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.312305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] PATH_INFO: `/v3/projects/9c7578f9ead04b7384247947593935dd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.314962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7578f9ead04b7384247947593935dd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.316948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.341255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c950fe626e0b4d1a88be8c0943fe3965', 'request_id': 'req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.349265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c950fe626e0b4d1a88be8c0943fe3965', 'request_id': 'req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.360627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c950fe626e0b4d1a88be8c0943fe3965', 'request_id': 'req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.376949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] The token cache is being invalidate because project c950fe626e0b4d1a88be8c0943fe3965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:23.377484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.378208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6428658c-d4dc-4bd9-8179-d5fbb78c0eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.380099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2156/4255] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:23 2022] DELETE /identity/v3/projects/c950fe626e0b4d1a88be8c0943fe3965 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:23.381382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa3c5-6749-44ad-a221-407ee1371c62 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.381728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa3c5-6749-44ad-a221-407ee1371c62 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.382102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa3c5-6749-44ad-a221-407ee1371c62 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.384026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2157/4256] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:08:23.384792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa3c5-6749-44ad-a221-407ee1371c62 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.387224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-412fa3c5-6749-44ad-a221-407ee1371c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.403478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7578f9ead04b7384247947593935dd', 'request_id': 'req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.410512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7578f9ead04b7384247947593935dd', 'request_id': 'req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.422300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7578f9ead04b7384247947593935dd', 'request_id': 'req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.446613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] The token cache is being invalidate because project 9c7578f9ead04b7384247947593935dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:23.446903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.447936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc002477-70dd-4eb5-bc08-b98a2b0b2fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:23.454604 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2100/4257] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:23 2022] DELETE /identity/v3/projects/9c7578f9ead04b7384247947593935dd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:23.456274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885d92-c3e5-4858-9d8d-61ca259e3237 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.456398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885d92-c3e5-4858-9d8d-61ca259e3237 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.456633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885d92-c3e5-4858-9d8d-61ca259e3237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.481932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-04885d92-c3e5-4858-9d8d-61ca259e3237 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:23.483972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-04885d92-c3e5-4858-9d8d-61ca259e3237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.488932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa3c5-6749-44ad-a221-407ee1371c62 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:23.494189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.494874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.495201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.495476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.499307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.588842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2101/4258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:23.590119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b026a7-443c-4a97-a0bf-c213ef8b6119 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.590684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b026a7-443c-4a97-a0bf-c213ef8b6119 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.590972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b026a7-443c-4a97-a0bf-c213ef8b6119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.604191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.605987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.619940 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2158/4259] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:23.620612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a7b026a7-443c-4a97-a0bf-c213ef8b6119 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:23.621766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:08:23.622374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a7b026a7-443c-4a97-a0bf-c213ef8b6119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.623839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.637189 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2102/4260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:23.638799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9379-8f75-458d-95b0-5f5698c5ae4a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.639092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9379-8f75-458d-95b0-5f5698c5ae4a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.639490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9379-8f75-458d-95b0-5f5698c5ae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.640197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.642019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.693868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b0ce9379-8f75-458d-95b0-5f5698c5ae4a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:23.695336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b0ce9379-8f75-458d-95b0-5f5698c5ae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.711669 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2103/4261] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:23.711669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9379-8f75-458d-95b0-5f5698c5ae4a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.718007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9379-8f75-458d-95b0-5f5698c5ae4a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:23.723827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12562015-c8ff-4a56-afef-70444148a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.724736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562015-c8ff-4a56-afef-70444148a638 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.725111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562015-c8ff-4a56-afef-70444148a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.725454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562015-c8ff-4a56-afef-70444148a638 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.726289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12562015-c8ff-4a56-afef-70444148a638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:23.726655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12562015-c8ff-4a56-afef-70444148a638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.728561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12562015-c8ff-4a56-afef-70444148a638 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.729058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79f067-821d-42ad-a28a-34eabdd312cf service glance] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:23.733648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea9fbe-48d8-4995-b602-ab3e39805b6c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad067bf99a94e85a0e932643ed1cbf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef722f37add412d995982bf015f8b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.734686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea9fbe-48d8-4995-b602-ab3e39805b6c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.734972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea9fbe-48d8-4995-b602-ab3e39805b6c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.735249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea9fbe-48d8-4995-b602-ab3e39805b6c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] PATH_INFO: `/v3/projects/9ef722f37add412d995982bf015f8b75` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.737471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea9fbe-48d8-4995-b602-ab3e39805b6c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorizing `identity:get_project(project_id=9ef722f37add412d995982bf015f8b75)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.739980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea9fbe-48d8-4995-b602-ab3e39805b6c tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.741736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2159/4262] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:08:23 2022] GET /identity/v3/projects/9ef722f37add412d995982bf015f8b75 => generated 363 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:23.743300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.743657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.744001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.748748 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2104/4263] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:23.748748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20c6aa-c0ed-4463-8794-eb21a00fd207 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.748748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20c6aa-c0ed-4463-8794-eb21a00fd207 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.748748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20c6aa-c0ed-4463-8794-eb21a00fd207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.765137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:23.766514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.776243 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2160/4264] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:23.777062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.780199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.780413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0a20c6aa-c0ed-4463-8794-eb21a00fd207 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:23.781606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0a20c6aa-c0ed-4463-8794-eb21a00fd207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.803934 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2105/4265] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:23.804534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20c6aa-c0ed-4463-8794-eb21a00fd207 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.815683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20c6aa-c0ed-4463-8794-eb21a00fd207 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:23.822304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.822984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.823269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.823546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.824414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.827285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.858953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc5205-9d60-4a1c-8c4d-3d5fd0eedb45 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:23.863909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06e82-2ce3-4aa8-b231-213afe205fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:23.864594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06e82-2ce3-4aa8-b231-213afe205fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.864894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06e82-2ce3-4aa8-b231-213afe205fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.865279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06e82-2ce3-4aa8-b231-213afe205fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.869920 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2106/4266] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:23 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:23.870071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-95e06e82-2ce3-4aa8-b231-213afe205fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:23.870155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.883480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06e82-2ce3-4aa8-b231-213afe205fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:23.884961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06e82-2ce3-4aa8-b231-213afe205fc4 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:23.895099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2161/4267] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:23.896606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10edc0-82d0-45af-bd10-a1f34c275c6c None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:23.896896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10edc0-82d0-45af-bd10-a1f34c275c6c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:23.897303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10edc0-82d0-45af-bd10-a1f34c275c6c None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:23.898982 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2162/4268] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:08:23.899747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10edc0-82d0-45af-bd10-a1f34c275c6c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:23.970948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ada9c-d6ca-47ba-a044-22511849cf5f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.003182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.003887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.004170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.004448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.005213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:24.005526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.007170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.020220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10edc0-82d0-45af-bd10-a1f34c275c6c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.037802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.038653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.038945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.039223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.042761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:24.042929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.044500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.060772 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2107/4269] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:24.061752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.075626 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2163/4270] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:24.076517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:08:24.082655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861c3c9-f9dd-46b1-88bc-8d74b88f3389 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.089663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.090421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.091390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.091677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.092634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.095909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.133551 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2108/4271] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:24 2022] POST /identity/v3/users => generated 296 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:24.135604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.158813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a38da8-099b-49d4-868b-1c0d96b2d75d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.166223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.167195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.167484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.167761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.169571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.172470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.202026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.224045 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2109/4272] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:24 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:24.224909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.301001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef837-8cc3-446e-9a27-0e23558eb22f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.356425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229efec-fa84-42c4-ab35-4e67d99e9ea3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.362394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.363644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.363938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.364563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.365271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.367228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.399878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad067bf99a94e85a0e932643ed1cbf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef722f37add412d995982bf015f8b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.401359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.401784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.402446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] PATH_INFO: `/v3/projects/9ef722f37add412d995982bf015f8b75` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.403850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorizing `identity:get_project(project_id=9ef722f37add412d995982bf015f8b75)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.406855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.416947 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2110/4273] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:24 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:24.417853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.425990 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2164/4274] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:08:24 2022] GET /identity/v3/projects/9ef722f37add412d995982bf015f8b75 => generated 363 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:24.427353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.464868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0b58a-5588-47a7-84ab-9afe101ab05d tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.556498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.557514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.558168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.558168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.560221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.562187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd77d8-2139-45f4-83cd-6563bf1f7b26 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.564042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.573813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.574917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.574917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.575130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.584813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:24.602738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2165/4275] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:24.604381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.623181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ecef-ed7b-436c-8fab-b58efa0c5869 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.629656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.631139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.631627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.631818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.633017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.637029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.674290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2166/4276] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:24 2022] POST /identity/v3/users => generated 300 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:24.677021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.702599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd176944-ea53-48b0-a219-48aca691f2cb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.720326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d5d0d-08d8-468c-a01e-485498899806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.721774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5d0d-08d8-468c-a01e-485498899806 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.722337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5d0d-08d8-468c-a01e-485498899806 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.722812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5d0d-08d8-468c-a01e-485498899806 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.724219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d5d0d-08d8-468c-a01e-485498899806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.727982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d5d0d-08d8-468c-a01e-485498899806 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.755499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.758826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.777057 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2167/4277] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:24 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:24.783223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4ac1a-94f9-43c4-b20e-1b387c070d73 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.783821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4ac1a-94f9-43c4-b20e-1b387c070d73 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.784316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4ac1a-94f9-43c4-b20e-1b387c070d73 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.786539 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2168/4278] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:08:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:08:24.790807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4ac1a-94f9-43c4-b20e-1b387c070d73 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.805387 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2111/4279] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:24.807144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.830212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f0cae-2295-4ed6-998a-2755e64b8ab0 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.833909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4ac1a-94f9-43c4-b20e-1b387c070d73 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.841467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.842622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.843052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.843704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.844927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.847083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.852946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.853514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.854135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.854415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.855153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.857451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.864855 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2169/4280] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:24.866508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.878808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4913f-9845-4cad-8499-39c4f2aeb020 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.884635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2112/4281] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:24.887204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.887868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.889561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.889909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.891339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.892560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:08:24.894781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:24.910432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.917555 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2170/4282] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:24.918583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:24.934368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a781bf-4ef0-49cc-8c82-de3f30cf3449 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:24.944080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:24.945526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:24.946007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:24.946501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] PATH_INFO: `/v3/projects/8ffe552f26bc4f09b378c8d8f5ceaabf/users/d4b9c576341145668d9d2e9b219ea072/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:24.969697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffe552f26bc4f09b378c8d8f5ceaabf, user_id=d4b9c576341145668d9d2e9b219ea072, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:24.976279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.009627 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2171/4283] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:24 2022] PUT /identity/v3/projects/8ffe552f26bc4f09b378c8d8f5ceaabf/users/d4b9c576341145668d9d2e9b219ea072/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:25.009627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.087593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fa8c5-103d-4944-add9-64b8b3d661a0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.157171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c7fff-7ebc-4af1-b8fa-b778f5a908d4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.162153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.162847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.163131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.163405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.164183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.166025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.180686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78880f1b-53ec-43c8-a988-a55928946d41 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad067bf99a94e85a0e932643ed1cbf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef722f37add412d995982bf015f8b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.180805 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2172/4284] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:25.181666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78880f1b-53ec-43c8-a988-a55928946d41 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.181785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.181949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78880f1b-53ec-43c8-a988-a55928946d41 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.182349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78880f1b-53ec-43c8-a988-a55928946d41 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] PATH_INFO: `/v3/projects/9ef722f37add412d995982bf015f8b75` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.183387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78880f1b-53ec-43c8-a988-a55928946d41 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorizing `identity:get_project(project_id=9ef722f37add412d995982bf015f8b75)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.186793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78880f1b-53ec-43c8-a988-a55928946d41 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.198717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01531e-f82d-4004-a1a0-47a9cced7bca admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.203018 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2113/4285] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:08:24 2022] GET /identity/v3/projects/9ef722f37add412d995982bf015f8b75 => generated 363 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:25.204587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.205767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.205889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.206060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.206308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.206430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.206642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.207453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.209620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.224815 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2173/4286] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:25.224815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.235741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547eb88-17f2-40c9-a190-ca95c92f90a3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.242707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.242707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.242707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.242936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] PATH_INFO: `/v3/projects/bfb1a94e7e044a6390e09032a39366f8/users/6ea522ee568943d6afe754d6c86668f6/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.256888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] MFA Rules not processed for user `d4b9c576341145668d9d2e9b219ea072`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:25.258682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.262425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb1a94e7e044a6390e09032a39366f8, user_id=6ea522ee568943d6afe754d6c86668f6, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.266587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.291917 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2174/4287] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:25 2022] PUT /identity/v3/projects/bfb1a94e7e044a6390e09032a39366f8/users/6ea522ee568943d6afe754d6c86668f6/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:25.296735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.359791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2114/4288] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:25.361575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.364040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.383479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f74c98-2f50-4dae-a776-cebbbf63f8a3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.385843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42209-08a3-44e8-b1d3-02a9cdd67653 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.390361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1580d-7251-4a93-9d0c-24a24d514c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.391548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1580d-7251-4a93-9d0c-24a24d514c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.391765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1580d-7251-4a93-9d0c-24a24d514c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.392042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1580d-7251-4a93-9d0c-24a24d514c68 admin admin] PATH_INFO: `/v3/projects/b0a1102e4f4e441b947116441b3e330d/users/f2809b3bcbea4d2eb9ab6b360669fc67/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.393450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.394456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.394771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.395114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] PATH_INFO: `/v3/users/1ad067bf99a94e85a0e932643ed1cbf1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.396326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad067bf99a94e85a0e932643ed1cbf1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.398551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.422122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1580d-7251-4a93-9d0c-24a24d514c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a1102e4f4e441b947116441b3e330d, user_id=f2809b3bcbea4d2eb9ab6b360669fc67, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.428531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1580d-7251-4a93-9d0c-24a24d514c68 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.455397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2175/4289] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:25 2022] PUT /identity/v3/projects/b0a1102e4f4e441b947116441b3e330d/users/f2809b3bcbea4d2eb9ab6b360669fc67/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:25.457344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb14b-a76c-4e96-b712-7f66b433da1f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.457638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb14b-a76c-4e96-b712-7f66b433da1f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.459795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb14b-a76c-4e96-b712-7f66b433da1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.487653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d7bcb14b-a76c-4e96-b712-7f66b433da1f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:25.489156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7bcb14b-a76c-4e96-b712-7f66b433da1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.494411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad067bf99a94e85a0e932643ed1cbf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:25.495079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad067bf99a94e85a0e932643ed1cbf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:25.503703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad067bf99a94e85a0e932643ed1cbf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:25.504449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad067bf99a94e85a0e932643ed1cbf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:25.517684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad067bf99a94e85a0e932643ed1cbf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:25.547918 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2115/4290] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:25 2022] DELETE /identity/v3/users/1ad067bf99a94e85a0e932643ed1cbf1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:25.550878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.552900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.564252 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2176/4291] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:25.565930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987c1f-0c71-430e-bb24-e6d71be0de9c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.566315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987c1f-0c71-430e-bb24-e6d71be0de9c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.566688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987c1f-0c71-430e-bb24-e6d71be0de9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.591568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cf987c1f-0c71-430e-bb24-e6d71be0de9c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:25.593193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cf987c1f-0c71-430e-bb24-e6d71be0de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.646555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e8f6-e704-49c2-8a1a-af00c42b767f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.658433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.659357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.659640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.659918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.660669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:create_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.661878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.665263 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2177/4292] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:25.666812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.667019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.667289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.699274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:25.701463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.711928 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2178/4293] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:25.713634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.715919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.820070 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2116/4294] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Apr 9 21:08:25 2022] POST /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 788 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:25.822779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.826222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:25.840629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da4fce-d67b-4ebc-be3e-d9c8cf0a9606 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.845145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.845303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d6a7-b278-43b7-8cf4-765a3d14d26e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.846427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.847071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.847614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.850689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.851488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.851818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.852132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.860878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.862758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.863446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.865015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.875528 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2179/4295] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:25.876594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.877923 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2117/4296] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:25.878770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:25.888348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8190219-8157-42ee-a786-3701325f19fa service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.888570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832eb33-934d-48e4-8838-940596f3c57c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:25.892704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bdc61-9b42-460c-af76-99c49dd001fa tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.893478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:25.893740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bdc61-9b42-460c-af76-99c49dd001fa tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.894020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bdc61-9b42-460c-af76-99c49dd001fa tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.894289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bdc61-9b42-460c-af76-99c49dd001fa tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/c2d669cb3ed547249dc58766ff2f9a78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.894406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.895693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.896128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.909305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bdc61-9b42-460c-af76-99c49dd001fa tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:get_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=c2d669cb3ed547249dc58766ff2f9a78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.911145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bdc61-9b42-460c-af76-99c49dd001fa tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.913135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:25.915475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:25.916731 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2118/4297] 10.222.0.30 () {58 vars in 1391 bytes} [Sat Apr 9 21:08:25 2022] GET /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/c2d669cb3ed547249dc58766ff2f9a78 => generated 688 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:25.919831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:25.920051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:25.920610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:25.939156 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2180/4298] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:25.945425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] MFA Rules not processed for user `d4b9c576341145668d9d2e9b219ea072`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:25.947028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:26.108738 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2119/4299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3414 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 09 21:08:26.109590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.120067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc6d1-8c0e-487c-9639-297ac378e6c5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.122995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.124701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.125062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:26.125981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.126278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.126556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/c2d669cb3ed547249dc58766ff2f9a78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.128012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=c2d669cb3ed547249dc58766ff2f9a78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.129741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:26.159367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8b110-1107-470c-b7ee-0d8ad7b4e4b6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.169210 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2181/4300] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:08:26 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/c2d669cb3ed547249dc58766ff2f9a78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:26.169970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.169970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.169970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.170766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.171387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] PATH_INFO: `/v3/users/be8710e814d542608427c3386a09708a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.177051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8710e814d542608427c3386a09708a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.179702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:26.188837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248002f-26bb-47ce-8051-6643196063d1 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.201815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.202965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.203181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.203455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.204209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:create_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.207369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:26.281002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8710e814d542608427c3386a09708a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:26.282228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8710e814d542608427c3386a09708a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:26.294665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8710e814d542608427c3386a09708a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:26.296655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8710e814d542608427c3386a09708a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:26.315588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8710e814d542608427c3386a09708a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:26.360469 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2120/4301] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:26 2022] DELETE /identity/v3/users/be8710e814d542608427c3386a09708a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:26.400661 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2182/4302] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Apr 9 21:08:26 2022] POST /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 920 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:26.404523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.406266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:26.498814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb82f0-5c98-4a8f-ba27-5293251fb449 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.504290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.505474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.505917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.506369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/391908da516349fbb1e1c1a4dcc66a89` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.535058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=391908da516349fbb1e1c1a4dcc66a89)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.538556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:26.577001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2121/4303] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:08:26 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/391908da516349fbb1e1c1a4dcc66a89 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:26.584077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.595951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931add2-1f0c-4ba7-8e31-b2803c3e3795 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.604276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.604276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.604276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.604899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.605291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:create_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.607725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:26.735271 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2183/4304] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Apr 9 21:08:26 2022] POST /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 812 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:26.736564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.756394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184b33-15f9-477d-9602-5501e834d31f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.760920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.762233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.762356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.762638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/72d20d94c9e3454aaee23c94fc558aea` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.776882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=72d20d94c9e3454aaee23c94fc558aea)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.779106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:26.809224 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2122/4305] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:08:26 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/72d20d94c9e3454aaee23c94fc558aea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:26.810932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.831996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fbdfb-9302-439e-9d7f-7e34e6e9be20 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.847504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.849682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.850227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.850903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.852471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:create_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.854364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:26.945267 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2184/4306] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Apr 9 21:08:26 2022] POST /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 787 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:26.949356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:26.961270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f34bb-009b-4ae4-b2cb-c34066312fe4 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:26.967763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:26.969310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:26.970177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:26.970177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:26.970536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:create_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:26.972792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.050280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.057053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.072808 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2123/4307] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Apr 9 21:08:26 2022] POST /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 788 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:27.079537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.093342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2457-cb1c-4e55-a083-0021980c158f tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.137478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.138716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.138716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.139643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.139774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:list_application_credentials(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.141521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.170197 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2124/4308] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:08:27 2022] GET /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 1499 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:27.174465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.184486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece667-8cc9-4b05-ba38-db800b37655d tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.188769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.189828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.190109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.190383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/46c0cdef213d4a708705d0a02ee8f091` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.199724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=46c0cdef213d4a708705d0a02ee8f091)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.201380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.224856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24307f9-ddf8-4182-8c5a-759316446852 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.240243 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2125/4309] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:08:27 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/46c0cdef213d4a708705d0a02ee8f091 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:27.241403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.241573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.242523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.242975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.243363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] PATH_INFO: `/v3/projects/535d9672c979478f9aac7df36e55fc72` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.243632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.247665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] RBAC: Authorizing `identity:delete_project(project_id=535d9672c979478f9aac7df36e55fc72)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.254336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.270911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142226-21af-47de-9665-17cb708bd54a tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.277051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.277964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.278242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.278514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] PATH_INFO: `/v3/projects/9ef722f37add412d995982bf015f8b75` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.280179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef722f37add412d995982bf015f8b75)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.282218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.358116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535d9672c979478f9aac7df36e55fc72', 'request_id': 'req-d7bf3be9-a89a-4bfa-9606-27083212291f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.374189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535d9672c979478f9aac7df36e55fc72', 'request_id': 'req-d7bf3be9-a89a-4bfa-9606-27083212291f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.376627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef722f37add412d995982bf015f8b75', 'request_id': 'req-e23351e1-61f6-42d7-af8c-4d53737fa5ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.384625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef722f37add412d995982bf015f8b75', 'request_id': 'req-e23351e1-61f6-42d7-af8c-4d53737fa5ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.387515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535d9672c979478f9aac7df36e55fc72', 'request_id': 'req-d7bf3be9-a89a-4bfa-9606-27083212291f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.401147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] The token cache is being invalidate because project 535d9672c979478f9aac7df36e55fc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:27.401575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.402348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.404602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef722f37add412d995982bf015f8b75', 'request_id': 'req-e23351e1-61f6-42d7-af8c-4d53737fa5ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.411856 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2185/4310] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:27 2022] DELETE /identity/v3/projects/535d9672c979478f9aac7df36e55fc72 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:27.412971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.416561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.422091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] The token cache is being invalidate because project 9ef722f37add412d995982bf015f8b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:27.422494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.424522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e23351e1-61f6-42d7-af8c-4d53737fa5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:27.426422 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2126/4311] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:27 2022] DELETE /identity/v3/projects/9ef722f37add412d995982bf015f8b75 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:27.430555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc1e9-8a6a-4459-afc9-027b2d9a77ab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.430555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc1e9-8a6a-4459-afc9-027b2d9a77ab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.430852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc1e9-8a6a-4459-afc9-027b2d9a77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.471434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5dacc1e9-8a6a-4459-afc9-027b2d9a77ab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:27.475070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5dacc1e9-8a6a-4459-afc9-027b2d9a77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.537503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf3be9-a89a-4bfa-9606-27083212291f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.602379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33857f-208c-43ec-ac29-956721f5751e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.603630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33857f-208c-43ec-ac29-956721f5751e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.604075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33857f-208c-43ec-ac29-956721f5751e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.605397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33857f-208c-43ec-ac29-956721f5751e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/f644ca61d30d44e5b7a1b07a78c928d7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.634743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33857f-208c-43ec-ac29-956721f5751e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=f644ca61d30d44e5b7a1b07a78c928d7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.642623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2127/4312] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:27.646431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878417-5abe-4bff-a88f-508923c393b7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.647388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878417-5abe-4bff-a88f-508923c393b7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.647388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878417-5abe-4bff-a88f-508923c393b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.656492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33857f-208c-43ec-ac29-956721f5751e tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.677019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2f878417-5abe-4bff-a88f-508923c393b7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:27.678992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2f878417-5abe-4bff-a88f-508923c393b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.700291 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2128/4313] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:27.701980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.703693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.703693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.708090 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2186/4314] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:08:27 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/f644ca61d30d44e5b7a1b07a78c928d7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:27.711777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a6a0d-3528-48e7-9f53-3726d7f812d2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.711777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a6a0d-3528-48e7-9f53-3726d7f812d2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.713754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a6a0d-3528-48e7-9f53-3726d7f812d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.742614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:27.745403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.758935 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2129/4315] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:27.759898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.761327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.767048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f48a6a0d-3528-48e7-9f53-3726d7f812d2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:27.768317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f48a6a0d-3528-48e7-9f53-3726d7f812d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:27.777213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b1f42-23a4-4f3b-9916-84e98c19f3bd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.783139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.784061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.784851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.786900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.787672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:create_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.788882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.792581 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2187/4316] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:27.793615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a6a0d-3528-48e7-9f53-3726d7f812d2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.808699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a6a0d-3528-48e7-9f53-3726d7f812d2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.825817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.826523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.826837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.827112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.827925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:27.828234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.830080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.864683 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2188/4317] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:27.867077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.890528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84d085-8359-4822-96e3-f9b42ac14a01 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.904758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.905578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.905860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.906183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.906920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:27.907228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.911161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.914839 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2130/4318] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 788 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:27.915821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.931904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c634a-e061-45bd-95b4-15076f487a97 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.938542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.939231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.939513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.939788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.941064 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2189/4319] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:27.942073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:27.946754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.948903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.964497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e0b1a-be3d-424b-8294-f865f9b5ef5e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:27.973762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:27.974785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:27.975475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:27.975938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:27.977024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:create_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:27.978383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:27.993570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2131/4320] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:27.995119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.098555 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2190/4321] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials => generated 789 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:28.104083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.108844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28c1f-3c43-4285-8e62-4a3abacb4f54 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.121580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.122522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.122842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.123128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.124751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.127488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d6438-00c7-4b38-91d8-5fe29867e193 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.129509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.134217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.135126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.135407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.135683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.136564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.139067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.181496 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2191/4322] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:28 2022] POST /identity/v3/users => generated 297 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:28.181496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.210929 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2132/4323] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:27 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:28.212224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.309429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423017e-330b-47de-8942-3d0bcd9424e4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.316058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.316430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.317510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.317862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.319107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.321133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.343834 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2133/4324] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:28.345645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.366467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f7938-498c-4f1d-af4a-756f8d2d1785 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.368956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346b151-58d2-4367-a9ee-706d537cb3fc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.376468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.377562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.378001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.378423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.379312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.381518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.420053 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2134/4325] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:28 2022] POST /identity/v3/users => generated 284 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:28.421295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.433775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb4540-8a17-47cc-954f-1973a049a6f0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.444843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692b23d-2eda-4fa8-a8e7-3f3d732d6c06 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.445799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b23d-2eda-4fa8-a8e7-3f3d732d6c06 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.446219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b23d-2eda-4fa8-a8e7-3f3d732d6c06 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.446645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b23d-2eda-4fa8-a8e7-3f3d732d6c06 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.452386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692b23d-2eda-4fa8-a8e7-3f3d732d6c06 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Adding query filter params (name=tempest-application_credential-1850527635) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:28.452386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692b23d-2eda-4fa8-a8e7-3f3d732d6c06 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:list_application_credentials(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.452386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692b23d-2eda-4fa8-a8e7-3f3d732d6c06 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.454725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.455557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.455854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.456124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.456868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.459031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.464648 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2192/4326] 10.222.0.30 () {58 vars in 1385 bytes} [Sat Apr 9 21:08:28 2022] GET /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials?name=tempest-application_credential-1850527635 => generated 887 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:28.464648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28ed99-6516-44c9-811a-062cdc570db8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.464648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28ed99-6516-44c9-811a-062cdc570db8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.464648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28ed99-6516-44c9-811a-062cdc570db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.481561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2135/4327] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:28.482919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.496814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aaa58-33b8-4cf3-92b6-e6026d565cbc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.503964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.504759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.505189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.505558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.506383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.508263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.519640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5c28ed99-6516-44c9-811a-062cdc570db8 None None] MFA Rules not processed for user `6ea522ee568943d6afe754d6c86668f6`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:28.521655 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2136/4328] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:28.521877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5c28ed99-6516-44c9-811a-062cdc570db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:28.523020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.537360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5c40-8b41-4cdc-9936-46e503518f4d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.544819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.546189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.546574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.547614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/c495e4cea29743a38e7a01dba0a7218e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.561974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=c495e4cea29743a38e7a01dba0a7218e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.565997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.602986 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2137/4329] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:08:28 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/c495e4cea29743a38e7a01dba0a7218e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:28.604694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.621487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca293-7b81-47db-a041-32c2008c7f95 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.628166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.629175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.629458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.630590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] PATH_INFO: `/v3/projects/d475c8fbc1f74285a1c98fd75bd109f2/users/2abb09d2f7844f3ba0f7a20787d73e4b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.653826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d475c8fbc1f74285a1c98fd75bd109f2, user_id=2abb09d2f7844f3ba0f7a20787d73e4b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.658616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.682820 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2138/4330] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:28 2022] PUT /identity/v3/projects/d475c8fbc1f74285a1c98fd75bd109f2/users/2abb09d2f7844f3ba0f7a20787d73e4b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:28.683706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.707984 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2193/4331] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:28.709461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28ed99-6516-44c9-811a-062cdc570db8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.737733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28ed99-6516-44c9-811a-062cdc570db8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.781739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb352a6-9ea4-4ea9-9c82-ab9d128028e8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.795126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa299c-ffff-46dc-921d-fceab556e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.795938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa299c-ffff-46dc-921d-fceab556e718 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.796662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa299c-ffff-46dc-921d-fceab556e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.796779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa299c-ffff-46dc-921d-fceab556e718 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.798738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa299c-ffff-46dc-921d-fceab556e718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.803546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa299c-ffff-46dc-921d-fceab556e718 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.814594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b9c576341145668d9d2e9b219ea072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.816202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.816889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.817633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/ca77c942877d4bc2a8a1d81d05b269da` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.834306 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2139/4332] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:28.834306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e116-c313-4baa-82e2-68d5c4ae8863 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.834306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e116-c313-4baa-82e2-68d5c4ae8863 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.834769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e116-c313-4baa-82e2-68d5c4ae8863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.843537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d4b9c576341145668d9d2e9b219ea072, application_credential_id=ca77c942877d4bc2a8a1d81d05b269da)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.845888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:28.884386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-44e4e116-c313-4baa-82e2-68d5c4ae8863 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:28.885568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-44e4e116-c313-4baa-82e2-68d5c4ae8863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:28.905517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2140/4333] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:28.905517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.905517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.905517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.913278 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2194/4334] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:08:28 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072/application_credentials/ca77c942877d4bc2a8a1d81d05b269da => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:28.916563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:28.942148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] MFA Rules not processed for user `6ea522ee568943d6afe754d6c86668f6`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:28.943281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:28.947526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416466f8-508d-439d-bcec-937f11629377 tempest-ApplicationCredentialsV3Test-308088375 tempest-ApplicationCredentialsV3Test-308088375-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:28.960204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:28.962416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:28.962962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:28.963725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] PATH_INFO: `/v3/projects/d0191b5014da4a86ab5222b06297f56b/users/0284bafdc9784fc99edf39a9c4da1dad/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:28.986142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0191b5014da4a86ab5222b06297f56b, user_id=0284bafdc9784fc99edf39a9c4da1dad, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:28.989924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:29.012566 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2195/4335] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:28 2022] PUT /identity/v3/projects/d0191b5014da4a86ab5222b06297f56b/users/0284bafdc9784fc99edf39a9c4da1dad/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:29.013845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:29.017060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.059983 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2141/4336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:29.061763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:29.065250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.098529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc61c78-2947-4aab-a48b-4393f2c66069 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:29.148913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99715-aa7c-4fe3-b422-73ca10180313 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:29.155029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:29.156214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.157840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.158334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] PATH_INFO: `/v3/users/d4b9c576341145668d9d2e9b219ea072` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.160118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b9c576341145668d9d2e9b219ea072)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:29.162302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:29.218100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:29.219847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.220575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.221115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] PATH_INFO: `/v3/users/8844e9ec7bb34861aa23f38af40da479` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.222558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8844e9ec7bb34861aa23f38af40da479)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:29.225648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:29.252409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b9c576341145668d9d2e9b219ea072'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.253192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b9c576341145668d9d2e9b219ea072'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.267367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b9c576341145668d9d2e9b219ea072'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.286173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b9c576341145668d9d2e9b219ea072'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.286839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b9c576341145668d9d2e9b219ea072'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.306266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8844e9ec7bb34861aa23f38af40da479'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.306266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8844e9ec7bb34861aa23f38af40da479'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.333735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8844e9ec7bb34861aa23f38af40da479'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.334720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8844e9ec7bb34861aa23f38af40da479'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.350495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ae7888fe-80b2-4e75-b43d-506ffed8a70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8844e9ec7bb34861aa23f38af40da479'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:29.361665 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2196/4337] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:29 2022] DELETE /identity/v3/users/d4b9c576341145668d9d2e9b219ea072 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:29.361665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:29.361985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.394469 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2142/4338] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:29 2022] DELETE /identity/v3/users/8844e9ec7bb34861aa23f38af40da479 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:29.396481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.396977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.397494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.448795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] MFA Rules not processed for user `0284bafdc9784fc99edf39a9c4da1dad`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:29.450768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.471513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e7fde-b4df-4149-9ab2-dd72f7bf3502 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:29.549743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe173d-1cf0-411c-a704-c388704332f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:29.550618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe173d-1cf0-411c-a704-c388704332f6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.550950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe173d-1cf0-411c-a704-c388704332f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.551784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe173d-1cf0-411c-a704-c388704332f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.555957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3dfe173d-1cf0-411c-a704-c388704332f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.596479 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2143/4339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:29.596479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:29.602154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.665135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe173d-1cf0-411c-a704-c388704332f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:29.667321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe173d-1cf0-411c-a704-c388704332f6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:29.682592 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2197/4340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:29.684415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10a01-f35e-4479-bc62-5a40cd1b455d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.685606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10a01-f35e-4479-bc62-5a40cd1b455d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.686042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10a01-f35e-4479-bc62-5a40cd1b455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.711035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c09cd-976e-43bb-9425-2652b33334b5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:29.712454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-44c10a01-f35e-4479-bc62-5a40cd1b455d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:29.714401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-44c10a01-f35e-4479-bc62-5a40cd1b455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.736716 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2198/4341] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:29.736716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47415ac6-26c7-4550-bf88-016897a334d6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.736716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47415ac6-26c7-4550-bf88-016897a334d6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.736716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47415ac6-26c7-4550-bf88-016897a334d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.738787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d66a-911a-4b6a-9c89-5407a92962b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:29.739403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d66a-911a-4b6a-9c89-5407a92962b9 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.739690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d66a-911a-4b6a-9c89-5407a92962b9 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.741851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d66a-911a-4b6a-9c89-5407a92962b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.749624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-94b1d66a-911a-4b6a-9c89-5407a92962b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.756004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-47415ac6-26c7-4550-bf88-016897a334d6 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:29.757268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-47415ac6-26c7-4550-bf88-016897a334d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.857603 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2199/4342] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:29.863979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4667e8-c303-412e-99e9-ec046502449c None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.864369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4667e8-c303-412e-99e9-ec046502449c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.864562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4667e8-c303-412e-99e9-ec046502449c None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.868920 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2200/4343] 10.222.0.30 () {54 vars in 962 bytes} [Sat Apr 9 21:08:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:08:29.870799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4667e8-c303-412e-99e9-ec046502449c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:29.875337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8d4667e8-c303-412e-99e9-ec046502449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:29.909558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d66a-911a-4b6a-9c89-5407a92962b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:29.911478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d66a-911a-4b6a-9c89-5407a92962b9 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:29.912947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4667e8-c303-412e-99e9-ec046502449c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:29.926300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:29.926563 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2144/4344] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:29.927822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.928114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.928896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.940241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad644a6-7527-4d89-b096-37c5ec6cc883 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:29.940241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad644a6-7527-4d89-b096-37c5ec6cc883 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:29.940241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad644a6-7527-4d89-b096-37c5ec6cc883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:29.949878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:29.951918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:29.987987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2201/4345] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:29.988575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:29.989936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:30.018302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-aad644a6-7527-4d89-b096-37c5ec6cc883 None None] MFA Rules not processed for user `6504d578b1b64feb93ba69d947a971e9`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:30.019380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-aad644a6-7527-4d89-b096-37c5ec6cc883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:30.117626 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2145/4346] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Apr 9 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:30.127523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad644a6-7527-4d89-b096-37c5ec6cc883 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:30.130002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1db099-66e0-4fd6-83ec-c78853727f8a service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:30.143624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:30.144923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:30.145470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:30.145935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:30.146340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad644a6-7527-4d89-b096-37c5ec6cc883 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:30.151314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a9cf0-36cc-4e3a-baf5-459893c2dcdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:30.152282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a9cf0-36cc-4e3a-baf5-459893c2dcdf service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:30.152580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a9cf0-36cc-4e3a-baf5-459893c2dcdf service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:30.153862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a9cf0-36cc-4e3a-baf5-459893c2dcdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:30.157592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:30.159487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:30.168830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a9cf0-36cc-4e3a-baf5-459893c2dcdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:30.182432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a9cf0-36cc-4e3a-baf5-459893c2dcdf service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:30.193296 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2202/4347] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:08:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:30.205708 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2146/4348] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:08:30.209678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:30.222858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:30.286858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eb821-8eb5-43d7-aa4e-947196ff9fd2 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:30.303848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:30.305393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:30.308140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:30.309260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] PATH_INFO: `/v3/projects/be8cef49b0454f9bb34f7d52b7918a6c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:30.322141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8cef49b0454f9bb34f7d52b7918a6c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:30.327054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:30.545478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8cef49b0454f9bb34f7d52b7918a6c', 'request_id': 'req-cd1c52ec-728b-444d-8b7f-2579cf259223'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:30.588220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8cef49b0454f9bb34f7d52b7918a6c', 'request_id': 'req-cd1c52ec-728b-444d-8b7f-2579cf259223'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:30.616570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8cef49b0454f9bb34f7d52b7918a6c', 'request_id': 'req-cd1c52ec-728b-444d-8b7f-2579cf259223'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:30.676672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] The token cache is being invalidate because project be8cef49b0454f9bb34f7d52b7918a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:30.676964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:30.683910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cd1c52ec-728b-444d-8b7f-2579cf259223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:30.692210 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2203/4349] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:30 2022] DELETE /identity/v3/projects/be8cef49b0454f9bb34f7d52b7918a6c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:30.697467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a3a14-846a-4fcc-b738-932d23d14cab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:30.698323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a3a14-846a-4fcc-b738-932d23d14cab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:30.698872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a3a14-846a-4fcc-b738-932d23d14cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:30.740785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fb8a3a14-846a-4fcc-b738-932d23d14cab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:30.743075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fb8a3a14-846a-4fcc-b738-932d23d14cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:30.860706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2147/4350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:30.862357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf79c-b96b-4886-bfb5-78886939f151 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:30.862650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf79c-b96b-4886-bfb5-78886939f151 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:30.862927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf79c-b96b-4886-bfb5-78886939f151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:30.905098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-68ccf79c-b96b-4886-bfb5-78886939f151 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:30.918031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-68ccf79c-b96b-4886-bfb5-78886939f151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:30.970700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a3a14-846a-4fcc-b738-932d23d14cab None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:30.984135 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2204/4351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:30.987848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a3a14-846a-4fcc-b738-932d23d14cab None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:31.001956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:31.002785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.004998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.005527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.007085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:31.007534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:31.009320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:31.065023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf79c-b96b-4886-bfb5-78886939f151 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:31.077822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf79c-b96b-4886-bfb5-78886939f151 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:31.081135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2148/4352] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:31.104784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:31.106287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.107264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.107559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.109579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:31.111614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:31.187327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:31.199519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2205/4353] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:31 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:31.203528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a80e9-c098-400a-9d13-74bffffacc75 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:31.359088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:31.360761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.361952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.363402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.364528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:31.367788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:31.412875 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2149/4354] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:31 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:31.417415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:31.433717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eac557-71ec-489b-8408-41e76c20df45 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:31.451900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:31.452637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.456879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.457184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.460815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:31.462547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:31.499752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:31.506044 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2206/4355] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:31.513978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb9d3-e557-438a-b163-289be45a586c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:31.527813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7ca5-e38e-483e-8c65-978a1de5831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:31.528723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7ca5-e38e-483e-8c65-978a1de5831e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.530715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7ca5-e38e-483e-8c65-978a1de5831e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.531186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7ca5-e38e-483e-8c65-978a1de5831e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.532404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c7ca5-e38e-483e-8c65-978a1de5831e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:31.534155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c7ca5-e38e-483e-8c65-978a1de5831e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:31.570877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:31.578006 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2150/4356] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:31.585874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142bde3-19cd-4d21-b276-1d64d77a74a0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:31.599342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:31.600276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.600592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.600844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] PATH_INFO: `/v3/projects/78452efb7ef143efa0123d3bc4873b53/users/a340104b44ec49f98a5aec0d0ce5a015/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.634506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78452efb7ef143efa0123d3bc4873b53, user_id=a340104b44ec49f98a5aec0d0ce5a015, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:31.641552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:31.676253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2207/4357] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:31 2022] PUT /identity/v3/projects/78452efb7ef143efa0123d3bc4873b53/users/a340104b44ec49f98a5aec0d0ce5a015/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:31.680243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.681437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.681826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.714936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:31.718466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:31.879046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:31.882095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:31.895805 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2151/4358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:31.906271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fbe53-3946-49b8-aa17-e5af23e6f8a5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:31.919210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:31.920546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:31.921818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:31.923699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:31.925766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:31.932933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] PATH_INFO: `/v3/projects/8ffe552f26bc4f09b378c8d8f5ceaabf` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:31.939364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffe552f26bc4f09b378c8d8f5ceaabf)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:31.945999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:32.067977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'request_id': 'req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:32.088994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'request_id': 'req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:32.112857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffe552f26bc4f09b378c8d8f5ceaabf', 'request_id': 'req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:32.119918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853da604-d77b-4829-ac6f-2ecfb266a663 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:32.165653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] The token cache is being invalidate because project 8ffe552f26bc4f09b378c8d8f5ceaabf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:32.167884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:32.172236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a6f817c-edbf-4c2b-a690-19bb9b25fc9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:32.177363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2208/4359] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:31 2022] DELETE /identity/v3/projects/8ffe552f26bc4f09b378c8d8f5ceaabf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:32.183914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b4ba-3d86-47b0-96e7-65529362ad93 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:32.184706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b4ba-3d86-47b0-96e7-65529362ad93 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:32.185407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b4ba-3d86-47b0-96e7-65529362ad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:32.236903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7006b4ba-3d86-47b0-96e7-65529362ad93 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:32.238198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7006b4ba-3d86-47b0-96e7-65529362ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:32.358941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:32.360106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:32.360106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:32.360297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:32.367640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:32.368351 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2209/4360] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:32.377215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a13f-5c5f-417e-a5b6-974f06145dab None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:32.377511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a13f-5c5f-417e-a5b6-974f06145dab None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:32.377798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a13f-5c5f-417e-a5b6-974f06145dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:32.419795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:32.421591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:32.427492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d974a13f-5c5f-417e-a5b6-974f06145dab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:32.428816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d974a13f-5c5f-417e-a5b6-974f06145dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:32.454382 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2152/4361] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:32.489655 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2210/4362] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:32.490151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:32.510462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c714-2e22-40f1-9f3e-764ad0ef786e service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:32.521066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:32.521887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:32.522238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:32.523745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:32.524605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:32.527632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:32.544639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:32.604044 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2153/4363] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:32.607845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974a13f-5c5f-417e-a5b6-974f06145dab None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:32.632430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974a13f-5c5f-417e-a5b6-974f06145dab None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:32.641821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:32.643031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:32.649064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:32.649622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:32.650547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:32.655682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:32.723351 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2211/4364] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:32 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:32.723831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:32.738502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eec41e-0be5-40b5-b331-7fce5d778d24 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:32.888656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:32.889441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:32.889716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:32.890155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:32.891040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:32.893335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:32.942559 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2154/4365] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:32 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:32.946348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:32.964007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106316ec-f17a-497e-85be-b58522ebdd11 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:32.996607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:32.997904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:32.998364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:33.003197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:33.007013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:33.009215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:33.039849 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2212/4366] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:33.041488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:33.071355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793db6cd-9cb6-4b40-aecb-65a2fc0a1300 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:33.088835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7164171-0d52-4a90-a6bf-b1da7546d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:33.092731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164171-0d52-4a90-a6bf-b1da7546d7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:33.096830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164171-0d52-4a90-a6bf-b1da7546d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:33.098013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164171-0d52-4a90-a6bf-b1da7546d7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:33.100726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7164171-0d52-4a90-a6bf-b1da7546d7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:33.106813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7164171-0d52-4a90-a6bf-b1da7546d7c8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:33.139606 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2155/4367] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:33.142269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:33.158428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f11994-bf55-42d4-994f-0da2ec964037 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:33.178041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:33.186300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:33.187021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:33.187630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] PATH_INFO: `/v3/projects/1a60e377825e4686af695def2bb44554/users/49f60c211ecd4f99a537af034131f27c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:33.249705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a60e377825e4686af695def2bb44554, user_id=49f60c211ecd4f99a537af034131f27c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:33.258865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:33.300173 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2213/4368] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:33 2022] PUT /identity/v3/projects/1a60e377825e4686af695def2bb44554/users/49f60c211ecd4f99a537af034131f27c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:33.311493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23f5c-65bc-40c1-8d2c-887b7cbceadb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:33.311866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23f5c-65bc-40c1-8d2c-887b7cbceadb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:33.312226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23f5c-65bc-40c1-8d2c-887b7cbceadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:33.414402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b2b23f5c-65bc-40c1-8d2c-887b7cbceadb None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:33.417156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b2b23f5c-65bc-40c1-8d2c-887b7cbceadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:33.605951 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2156/4369] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:33.606275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:33.629462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bafbd-683c-4a19-998c-155626f4da57 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:33.664424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f582a3-5e78-4669-bdaa-12db598c909c tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:33.676082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f582a3-5e78-4669-bdaa-12db598c909c tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:33.678438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f582a3-5e78-4669-bdaa-12db598c909c tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:33.680208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f582a3-5e78-4669-bdaa-12db598c909c tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:33.803596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c5f582a3-5e78-4669-bdaa-12db598c909c tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:33.820014 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2214/4370] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:33 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:34.826213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cedd-5a53-46fb-b520-7cdfa818fe83 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:34.827921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cedd-5a53-46fb-b520-7cdfa818fe83 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:34.828359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cedd-5a53-46fb-b520-7cdfa818fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:34.861567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5da8cedd-5a53-46fb-b520-7cdfa818fe83 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:34.862801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5da8cedd-5a53-46fb-b520-7cdfa818fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:34.883522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab898d1-193c-416a-b797-fea44d932ef3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:34.884111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab898d1-193c-416a-b797-fea44d932ef3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:34.884824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab898d1-193c-416a-b797-fea44d932ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:34.886206 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2157/4371] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:34 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:34.918735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dab898d1-193c-416a-b797-fea44d932ef3 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:34.920035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dab898d1-193c-416a-b797-fea44d932ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:34.940847 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2215/4372] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:34.945302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cedd-5a53-46fb-b520-7cdfa818fe83 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:34.962111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cedd-5a53-46fb-b520-7cdfa818fe83 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:34.972962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6890f6-c549-47b5-9d5a-72f3435cfe0a tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:34.974295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6890f6-c549-47b5-9d5a-72f3435cfe0a tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:34.974748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6890f6-c549-47b5-9d5a-72f3435cfe0a tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:34.975164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6890f6-c549-47b5-9d5a-72f3435cfe0a tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:35.057623 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-3b6890f6-c549-47b5-9d5a-72f3435cfe0a tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 09 21:08:35.076490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab898d1-193c-416a-b797-fea44d932ef3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:35.089261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab898d1-193c-416a-b797-fea44d932ef3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:35.092085 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2158/4373] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:34 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 188 bytes in 147 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Apr 09 21:08:35.114503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c265e-a0b9-4186-8791-b5ae613351d7 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:35.115727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c265e-a0b9-4186-8791-b5ae613351d7 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:35.118345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c265e-a0b9-4186-8791-b5ae613351d7 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:35.121248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c265e-a0b9-4186-8791-b5ae613351d7 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:35.279579 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-ef5c265e-a0b9-4186-8791-b5ae613351d7 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 09 21:08:35.298623 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2216/4374] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:35 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 188 bytes in 225 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:08:35.300764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6890f6-c549-47b5-9d5a-72f3435cfe0a tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:35.334853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6890f6-c549-47b5-9d5a-72f3435cfe0a tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:35.362025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14450b34-4341-4698-ba66-5453d9de8d00 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:35.362783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14450b34-4341-4698-ba66-5453d9de8d00 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:35.363112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14450b34-4341-4698-ba66-5453d9de8d00 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:35.363344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14450b34-4341-4698-ba66-5453d9de8d00 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:35.555114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14450b34-4341-4698-ba66-5453d9de8d00 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:35.606558 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2159/4375] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:35 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:36.612288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54ea8-ad0f-45c2-ab34-16d525192303 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:36.613189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54ea8-ad0f-45c2-ab34-16d525192303 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:36.613625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54ea8-ad0f-45c2-ab34-16d525192303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:36.694656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ddd54ea8-ad0f-45c2-ab34-16d525192303 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:36.698303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ddd54ea8-ad0f-45c2-ab34-16d525192303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:36.716783 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2217/4376] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:36.722076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963f52-99d3-435c-940f-fd20c409f6df None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:36.723074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963f52-99d3-435c-940f-fd20c409f6df None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:36.723623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963f52-99d3-435c-940f-fd20c409f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:36.762029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-77963f52-99d3-435c-940f-fd20c409f6df None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:36.767302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-77963f52-99d3-435c-940f-fd20c409f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:36.780361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dad5c-fdde-417e-84b3-8054e20fa1c1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:36.780649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dad5c-fdde-417e-84b3-8054e20fa1c1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:36.780924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dad5c-fdde-417e-84b3-8054e20fa1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:36.798141 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2160/4377] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:36.800239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77963f52-99d3-435c-940f-fd20c409f6df None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:36.822704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77963f52-99d3-435c-940f-fd20c409f6df None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:36.837142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cd8bd-32d3-4440-b12e-7cb9f7f9c83f tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:36.838499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd8bd-32d3-4440-b12e-7cb9f7f9c83f tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:36.838952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd8bd-32d3-4440-b12e-7cb9f7f9c83f tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:36.839394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd8bd-32d3-4440-b12e-7cb9f7f9c83f tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:36.884846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b72dad5c-fdde-417e-84b3-8054e20fa1c1 None None] MFA Rules not processed for user `a340104b44ec49f98a5aec0d0ce5a015`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:36.886112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b72dad5c-fdde-417e-84b3-8054e20fa1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:36.932877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bd6cd8bd-32d3-4440-b12e-7cb9f7f9c83f tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:36.954472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2161/4378] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:36 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:37.104476 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2218/4379] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:37.114351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:37.114994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:37.115236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:37.146695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] MFA Rules not processed for user `a340104b44ec49f98a5aec0d0ce5a015`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:37.148164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:37.173206 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2162/4380] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:37.177388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f954-3716-4bf4-b001-2e94d66afc5f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:37.178148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f954-3716-4bf4-b001-2e94d66afc5f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:37.178602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f954-3716-4bf4-b001-2e94d66afc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:37.200238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7845f954-3716-4bf4-b001-2e94d66afc5f None None] MFA Rules not processed for user `a340104b44ec49f98a5aec0d0ce5a015`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:37.201852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7845f954-3716-4bf4-b001-2e94d66afc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:37.220530 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2219/4381] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:37.221523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:37.222837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:37.489811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04444722-2b9b-45c8-86ba-f334ef815089 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:37.511289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772eb078-25e4-4397-bf3b-0275d61d5446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:37.512166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eb078-25e4-4397-bf3b-0275d61d5446 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:37.512495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eb078-25e4-4397-bf3b-0275d61d5446 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:37.512780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eb078-25e4-4397-bf3b-0275d61d5446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:37.540382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772eb078-25e4-4397-bf3b-0275d61d5446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:37.542070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772eb078-25e4-4397-bf3b-0275d61d5446 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:37.566802 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2163/4382] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:37.960510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3366a-d1f4-4039-a60f-a70e065de511 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:37.962128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3366a-d1f4-4039-a60f-a70e065de511 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:37.962745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3366a-d1f4-4039-a60f-a70e065de511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:38.010769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-67a3366a-d1f4-4039-a60f-a70e065de511 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:38.013617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-67a3366a-d1f4-4039-a60f-a70e065de511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:38.019612 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2220/4383] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:37 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:38.028196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b370eb3-bea5-4e97-bf24-e8fc6ef524b8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:38.029391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b370eb3-bea5-4e97-bf24-e8fc6ef524b8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:38.030633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b370eb3-bea5-4e97-bf24-e8fc6ef524b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:38.092908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3b370eb3-bea5-4e97-bf24-e8fc6ef524b8 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:38.097288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3b370eb3-bea5-4e97-bf24-e8fc6ef524b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:38.123307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2164/4384] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:38.127461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3366a-d1f4-4039-a60f-a70e065de511 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:38.154560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3366a-d1f4-4039-a60f-a70e065de511 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:38.169527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29ed48-e6ed-4a2d-a454-b8dca33a149b tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:38.172749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ed48-e6ed-4a2d-a454-b8dca33a149b tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:38.174507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ed48-e6ed-4a2d-a454-b8dca33a149b tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:38.174906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ed48-e6ed-4a2d-a454-b8dca33a149b tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:38.307712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7f29ed48-e6ed-4a2d-a454-b8dca33a149b tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:38.327698 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2221/4385] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:38 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:38.874662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e036-2833-4661-bdf3-3beee5f9091d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:38.875269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e036-2833-4661-bdf3-3beee5f9091d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:38.875728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e036-2833-4661-bdf3-3beee5f9091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:38.921770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b423e036-2833-4661-bdf3-3beee5f9091d None None] MFA Rules not processed for user `a340104b44ec49f98a5aec0d0ce5a015`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:38.923383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b423e036-2833-4661-bdf3-3beee5f9091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:38.956314 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2165/4386] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:39.333608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29c8b-9616-4165-a4a9-c538ff4cef0f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:39.334882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29c8b-9616-4165-a4a9-c538ff4cef0f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:39.335388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29c8b-9616-4165-a4a9-c538ff4cef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:39.366506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-85b29c8b-9616-4165-a4a9-c538ff4cef0f None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:39.373587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85b29c8b-9616-4165-a4a9-c538ff4cef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:39.380120 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2222/4387] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:39 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:39.384563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1096-3921-411e-9ca1-b6fa13f7f0e4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:39.385787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1096-3921-411e-9ca1-b6fa13f7f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:39.386298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1096-3921-411e-9ca1-b6fa13f7f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:39.420964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d20c1096-3921-411e-9ca1-b6fa13f7f0e4 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:39.422598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d20c1096-3921-411e-9ca1-b6fa13f7f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:39.445623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2166/4388] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:39.454827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b29c8b-9616-4165-a4a9-c538ff4cef0f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:39.475809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b29c8b-9616-4165-a4a9-c538ff4cef0f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:39.485714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67fda9-dd51-4b95-8009-714f77504485 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:39.487153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67fda9-dd51-4b95-8009-714f77504485 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:39.487662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67fda9-dd51-4b95-8009-714f77504485 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:39.488157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67fda9-dd51-4b95-8009-714f77504485 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:39.619122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6e67fda9-dd51-4b95-8009-714f77504485 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:39.651745 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2223/4389] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:39 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:40.655916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52457fa-631f-4f8e-b240-3a14f11811e1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:40.656607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52457fa-631f-4f8e-b240-3a14f11811e1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:40.656718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52457fa-631f-4f8e-b240-3a14f11811e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:40.726570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a52457fa-631f-4f8e-b240-3a14f11811e1 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:40.733277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a52457fa-631f-4f8e-b240-3a14f11811e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:40.764660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2167/4390] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:40 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:41.612410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b0e9-9eda-47c0-859b-4a432c7e079c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:41.613237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b0e9-9eda-47c0-859b-4a432c7e079c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:41.613707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b0e9-9eda-47c0-859b-4a432c7e079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:41.662137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-17c6b0e9-9eda-47c0-859b-4a432c7e079c None None] MFA Rules not processed for user `a340104b44ec49f98a5aec0d0ce5a015`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:41.666504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-17c6b0e9-9eda-47c0-859b-4a432c7e079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:41.683057 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2224/4391] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:41.770689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c2f6-8ab8-444a-a57d-ddaf356a66a9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:41.772922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c2f6-8ab8-444a-a57d-ddaf356a66a9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:41.773427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c2f6-8ab8-444a-a57d-ddaf356a66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:41.814024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ca04c2f6-8ab8-444a-a57d-ddaf356a66a9 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:41.825480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ca04c2f6-8ab8-444a-a57d-ddaf356a66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:41.838149 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2168/4392] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:41.844957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e092-fe40-4e22-9eae-7be0ea7e3837 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:41.845338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e092-fe40-4e22-9eae-7be0ea7e3837 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:41.845685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e092-fe40-4e22-9eae-7be0ea7e3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:41.897795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3de9e092-fe40-4e22-9eae-7be0ea7e3837 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:41.899801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3de9e092-fe40-4e22-9eae-7be0ea7e3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:41.911033 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2225/4393] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:41 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 21:08:41.914448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47df07c-eacf-41e5-bf1c-9829aea2dfd7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:41.914808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47df07c-eacf-41e5-bf1c-9829aea2dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:41.915518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47df07c-eacf-41e5-bf1c-9829aea2dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:42.055046 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-b47df07c-eacf-41e5-bf1c-9829aea2dfd7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 09 21:08:42.057087 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2169/4394] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 143 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 09 21:08:42.061779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372105d9-45a0-4deb-aed5-716e949f8021 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:42.062317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372105d9-45a0-4deb-aed5-716e949f8021 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:42.063111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372105d9-45a0-4deb-aed5-716e949f8021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:42.248541 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-372105d9-45a0-4deb-aed5-716e949f8021 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 09 21:08:42.253154 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2226/4395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:42 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 190 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 09 21:08:42.255132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975938e1-d575-40d8-b089-8d6855d178db None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:42.255420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975938e1-d575-40d8-b089-8d6855d178db None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:42.255750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975938e1-d575-40d8-b089-8d6855d178db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:42.315443 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-975938e1-d575-40d8-b089-8d6855d178db None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 09 21:08:42.323126 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2170/4396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:42 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 69 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 09 21:08:46.016269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2e7d-d8a8-46e8-a05a-d86ecd54843c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:46.017390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2e7d-d8a8-46e8-a05a-d86ecd54843c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:46.017923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2e7d-d8a8-46e8-a05a-d86ecd54843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:46.125624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b67a2e7d-d8a8-46e8-a05a-d86ecd54843c None None] MFA Rules not processed for user `f2809b3bcbea4d2eb9ab6b360669fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:46.127470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b67a2e7d-d8a8-46e8-a05a-d86ecd54843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:46.361613 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2227/4397] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:46.498008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975938e1-d575-40d8-b089-8d6855d178db None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:46.530904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975938e1-d575-40d8-b089-8d6855d178db None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:46.552610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bc862-de43-4703-90a3-45c5f771d129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:46.554931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc862-de43-4703-90a3-45c5f771d129 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:46.555363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc862-de43-4703-90a3-45c5f771d129 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:46.555799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc862-de43-4703-90a3-45c5f771d129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:46.577257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc862-de43-4703-90a3-45c5f771d129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:46.584665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc862-de43-4703-90a3-45c5f771d129 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:46.610277 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2171/4398] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:08:49.016716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:49.017366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:49.017461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:49.077132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] MFA Rules not processed for user `2abb09d2f7844f3ba0f7a20787d73e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:49.079267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:49.301059 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2228/4399] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:49.313158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:49.313789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:49.313789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:49.370949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] MFA Rules not processed for user `2abb09d2f7844f3ba0f7a20787d73e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:49.374489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:49.409110 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2172/4400] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:49.466365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:49.473513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:49.482616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:49.484355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:49.520243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dd1a6-03df-4fc8-8917-b3fae3b5a6df None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:49.538722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f0334-34fc-46e6-877d-a8eda8cd7bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:49.539705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f0334-34fc-46e6-877d-a8eda8cd7bfb service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:49.540096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f0334-34fc-46e6-877d-a8eda8cd7bfb service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:49.540466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f0334-34fc-46e6-877d-a8eda8cd7bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:49.558349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f0334-34fc-46e6-877d-a8eda8cd7bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:49.561013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f0334-34fc-46e6-877d-a8eda8cd7bfb service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:49.593612 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2173/4401] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:08:49.622880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108b332-9ae8-4d88-b5b4-01bf29d7b11a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:49.629495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:49.631180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:49.631718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:49.632101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] PATH_INFO: `/v3/users/0284bafdc9784fc99edf39a9c4da1dad` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:49.633537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0284bafdc9784fc99edf39a9c4da1dad)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:49.635729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:49.749459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0284bafdc9784fc99edf39a9c4da1dad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:49.754680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0284bafdc9784fc99edf39a9c4da1dad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:49.776588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0284bafdc9784fc99edf39a9c4da1dad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:49.801423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0284bafdc9784fc99edf39a9c4da1dad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:49.802408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0284bafdc9784fc99edf39a9c4da1dad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:49.866432 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2229/4402] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:49 2022] DELETE /identity/v3/users/0284bafdc9784fc99edf39a9c4da1dad => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:49.870860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a4e8-3709-4982-8aac-601a194eb38a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:49.871149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a4e8-3709-4982-8aac-601a194eb38a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:49.871429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a4e8-3709-4982-8aac-601a194eb38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:49.903648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-07b9a4e8-3709-4982-8aac-601a194eb38a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:49.904684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-07b9a4e8-3709-4982-8aac-601a194eb38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:50.026737 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2174/4403] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:50.078356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:50.081197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:50.182112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d71e-138b-4c55-8e00-0c07ac467476 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:50.191070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91395924-4a40-479c-962a-1897429137a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:50.193125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395924-4a40-479c-962a-1897429137a2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:50.193270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395924-4a40-479c-962a-1897429137a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:50.193552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395924-4a40-479c-962a-1897429137a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:50.215913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91395924-4a40-479c-962a-1897429137a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:50.220679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91395924-4a40-479c-962a-1897429137a2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:50.247940 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2230/4404] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:08:52.652535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:52.653108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:52.653230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:52.703222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] MFA Rules not processed for user `2abb09d2f7844f3ba0f7a20787d73e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:52.704460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:52.899023 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2175/4405] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:53.337331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:53.338311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:53.338741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:53.375158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:53.377078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:53.429417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75454477-485f-4634-b6f6-0414e54d7ea3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:53.430983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:53.432377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:53.437673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2231/4406] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:53.438870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:53.445440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:53.446384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:53.450143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:53.455149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:53.455433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] PATH_INFO: `/v3/projects/d0191b5014da4a86ab5222b06297f56b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:53.458675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0191b5014da4a86ab5222b06297f56b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:53.461547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:53.496993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba3a72-fb85-4af9-a91b-4f9ba672bbfc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:53.507213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:53.508291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:53.508671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:53.509250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] PATH_INFO: `/v3/users/38f474d5daf947ff9f632424e909390a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:53.512763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f474d5daf947ff9f632424e909390a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:53.514998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:53.548838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0191b5014da4a86ab5222b06297f56b', 'request_id': 'req-91b7894c-9282-4eee-aecf-3d4043e86447'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.555078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0191b5014da4a86ab5222b06297f56b', 'request_id': 'req-91b7894c-9282-4eee-aecf-3d4043e86447'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.570767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0191b5014da4a86ab5222b06297f56b', 'request_id': 'req-91b7894c-9282-4eee-aecf-3d4043e86447'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.622704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] The token cache is being invalidate because project d0191b5014da4a86ab5222b06297f56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:53.624355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.625604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.629475 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2176/4407] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:53 2022] DELETE /identity/v3/projects/d0191b5014da4a86ab5222b06297f56b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:08:53.630710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:53.633129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f474d5daf947ff9f632424e909390a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.633946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:53.634337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f474d5daf947ff9f632424e909390a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.672919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f474d5daf947ff9f632424e909390a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.691999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f474d5daf947ff9f632424e909390a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.692861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22e5580a-c526-4e3c-b2d7-4cf2512b8dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f474d5daf947ff9f632424e909390a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:53.748437 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2232/4408] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:08:53 2022] DELETE /identity/v3/users/38f474d5daf947ff9f632424e909390a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:53.750125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6954-e69d-45f2-8b69-b6655a8e5559 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:53.751731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6954-e69d-45f2-8b69-b6655a8e5559 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:53.752023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6954-e69d-45f2-8b69-b6655a8e5559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:53.791989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-be4e6954-e69d-45f2-8b69-b6655a8e5559 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:53.793308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-be4e6954-e69d-45f2-8b69-b6655a8e5559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:53.815685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7894c-9282-4eee-aecf-3d4043e86447 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:53.947189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20b608-59fd-4660-9436-9bc963f8eeb3 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:53.948509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b608-59fd-4660-9436-9bc963f8eeb3 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:53.949016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b608-59fd-4660-9436-9bc963f8eeb3 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:53.949511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b608-59fd-4660-9436-9bc963f8eeb3 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:53.981722 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2233/4409] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:53.990174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230e99-a1d7-4e22-95d0-a268f44fec6e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:53.990471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230e99-a1d7-4e22-95d0-a268f44fec6e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:53.991134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230e99-a1d7-4e22-95d0-a268f44fec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.020709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-70230e99-a1d7-4e22-95d0-a268f44fec6e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:54.025935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-70230e99-a1d7-4e22-95d0-a268f44fec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:54.047505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4f20b608-59fd-4660-9436-9bc963f8eeb3 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:54.052999 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2234/4410] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:54.058639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70230e99-a1d7-4e22-95d0-a268f44fec6e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:54.071682 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2177/4411] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:53 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:54.086989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70230e99-a1d7-4e22-95d0-a268f44fec6e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:54.113277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:54.113988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:54.114275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:54.115201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.115953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:54.116259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:54.119418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:54.138465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2235/4412] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:54.142787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20b608-59fd-4660-9436-9bc963f8eeb3 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:54.160642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20b608-59fd-4660-9436-9bc963f8eeb3 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:54.184189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:54.186215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:54.186752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:54.187185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.188043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:54.190513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:54.229905 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2178/4413] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:54 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:54.234173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:54.245553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068414f3-19bc-4a4b-b4fe-5a8ad6448f7b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:54.443188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:54.445718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:54.446268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:54.446804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.447758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:54.453424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:54.506117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2236/4414] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:54 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:54.510095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:54.529665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c46ed4-52f4-4b19-8350-95f426652e9b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:54.540440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:54.541205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:54.541738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:54.542032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.542848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:54.546164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:54.564795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2179/4415] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:08:54.569190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:54.588477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec08b32-8971-46c3-9fff-64ce526377e3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:54.604844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac37bd-9766-4e0f-b1bc-e81c22dfbf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:54.606526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac37bd-9766-4e0f-b1bc-e81c22dfbf0c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:54.606825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac37bd-9766-4e0f-b1bc-e81c22dfbf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:54.607116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac37bd-9766-4e0f-b1bc-e81c22dfbf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.609841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac37bd-9766-4e0f-b1bc-e81c22dfbf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:54.611521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac37bd-9766-4e0f-b1bc-e81c22dfbf0c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:54.630023 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2237/4416] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:54.633842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:54.657190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b3df-d392-4a22-b514-132436fe2ac4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:54.673830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:54.680321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:54.681183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:54.682481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] PATH_INFO: `/v3/projects/3c42d0be389543f99c2a34395346cfac/users/92c8e10f283f4c718e121e0f9d94ddd9/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.730605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c42d0be389543f99c2a34395346cfac, user_id=92c8e10f283f4c718e121e0f9d94ddd9, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:54.733370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:54.762254 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2180/4417] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:54 2022] PUT /identity/v3/projects/3c42d0be389543f99c2a34395346cfac/users/92c8e10f283f4c718e121e0f9d94ddd9/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:54.774593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ac3c-0b77-49b1-a10d-068aa98e9803 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:54.774857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ac3c-0b77-49b1-a10d-068aa98e9803 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:54.775483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ac3c-0b77-49b1-a10d-068aa98e9803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:54.813569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6757ac3c-0b77-49b1-a10d-068aa98e9803 None None] MFA Rules not processed for user `92c8e10f283f4c718e121e0f9d94ddd9`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:54.820554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6757ac3c-0b77-49b1-a10d-068aa98e9803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:54.908363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2238/4418] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:54.912764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:55.042383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2f54-d748-46ec-abab-851eb0739f86 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:55.053020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:55.054188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.054469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.054903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.055826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:55.058689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:55.078844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee55fab-ec15-4b57-90dc-4750f17daf73 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.079111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee55fab-ec15-4b57-90dc-4750f17daf73 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.080181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee55fab-ec15-4b57-90dc-4750f17daf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.133538 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2181/4419] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:54 2022] POST /identity/v3/projects => generated 389 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:55.137681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:55.140178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2ee55fab-ec15-4b57-90dc-4750f17daf73 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:55.144194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2ee55fab-ec15-4b57-90dc-4750f17daf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:55.157768 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2239/4420] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:55 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:55.161574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e5009-42e7-4ee9-b13a-3d88ebaaeb68 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.164406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e5009-42e7-4ee9-b13a-3d88ebaaeb68 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.165367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e5009-42e7-4ee9-b13a-3d88ebaaeb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.171142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea6e5009-42e7-4ee9-b13a-3d88ebaaeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:55.358524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeddf99-d530-4c62-ab53-d9e2361547f5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:55.360861 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-ea6e5009-42e7-4ee9-b13a-3d88ebaaeb68 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 09 21:08:55.362373 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2240/4421] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:55 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 21:08:55.366866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ce6f7-e0d7-450d-a625-9821802ee21b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.367789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ce6f7-e0d7-450d-a625-9821802ee21b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.368349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ce6f7-e0d7-450d-a625-9821802ee21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.384085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:55.386118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.387990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.388399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.389999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:55.397587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:55.443812 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2182/4422] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:55 2022] POST /identity/v3/users => generated 301 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:55.448143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:55.465938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731d583-8ee0-449d-9c11-8139dd20e0c1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:55.480293 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a08ce6f7-e0d7-450d-a625-9821802ee21b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 09 21:08:55.486219 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2241/4423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 120 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 09 21:08:55.490548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd325a8c-676d-49be-ac39-9f2ebe3be03d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.490980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd325a8c-676d-49be-ac39-9f2ebe3be03d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.491078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:55.491185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd325a8c-676d-49be-ac39-9f2ebe3be03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.491986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.493473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.494187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.495455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:55.511027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:55.534197 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2183/4424] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:55.548008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:55.565395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e5d76-f8dc-4015-be70-d5ae9cd109f5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:55.594017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:55.595616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.596470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.596885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] PATH_INFO: `/v3/projects/01fb4c3d838b4a0a9f3d75a04c86ba87/users/3e3f036f37604e7d96a953784031f06a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.615130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bd325a8c-676d-49be-ac39-9f2ebe3be03d None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:55.616414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bd325a8c-676d-49be-ac39-9f2ebe3be03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:55.621655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fb4c3d838b4a0a9f3d75a04c86ba87, user_id=3e3f036f37604e7d96a953784031f06a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:55.639064 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2242/4425] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:55.640672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:55.657750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.658039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.660313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.671869 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2184/4426] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:55 2022] PUT /identity/v3/projects/01fb4c3d838b4a0a9f3d75a04c86ba87/users/3e3f036f37604e7d96a953784031f06a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:55.680301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:55.711607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] MFA Rules not processed for user `f2809b3bcbea4d2eb9ab6b360669fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:55.713856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:55.853920 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2243/4427] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:55.854766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:55.859981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:55.875167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f1d9e-dd96-4884-a9b8-94751e3462c0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:55.891364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042dd0b-b3fd-4d86-b97a-f74e3c5acdc5 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:55.892265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042dd0b-b3fd-4d86-b97a-f74e3c5acdc5 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:55.892547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042dd0b-b3fd-4d86-b97a-f74e3c5acdc5 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:55.892820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042dd0b-b3fd-4d86-b97a-f74e3c5acdc5 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:55.977095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8042dd0b-b3fd-4d86-b97a-f74e3c5acdc5 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:56.004113 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2185/4428] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:55 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:56.004113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042dd0b-b3fd-4d86-b97a-f74e3c5acdc5 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.023007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbd2f4-ce66-430d-863c-1098de7ec85f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.027662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042dd0b-b3fd-4d86-b97a-f74e3c5acdc5 tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.038571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.039489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.039792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.040174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] PATH_INFO: `/v3/projects/184d9189f1364fc1bdd88feff79103e6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.046132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.046603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.046888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.047213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.048228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.049966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.050651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184d9189f1364fc1bdd88feff79103e6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.052997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.075427 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2186/4429] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:56.090184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.110771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eef1d-d55b-415b-b409-74de7c18ddc3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.122052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3400a2-6ec7-4b6b-a763-e109db1d5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.123382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3400a2-6ec7-4b6b-a763-e109db1d5225 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.124191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3400a2-6ec7-4b6b-a763-e109db1d5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.124191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3400a2-6ec7-4b6b-a763-e109db1d5225 admin admin] PATH_INFO: `/v3/projects/01fb4c3d838b4a0a9f3d75a04c86ba87/users/3e3f036f37604e7d96a953784031f06a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.127458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3400a2-6ec7-4b6b-a763-e109db1d5225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fb4c3d838b4a0a9f3d75a04c86ba87, user_id=3e3f036f37604e7d96a953784031f06a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.132814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3400a2-6ec7-4b6b-a763-e109db1d5225 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.164655 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2187/4430] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:56 2022] PUT /identity/v3/projects/01fb4c3d838b4a0a9f3d75a04c86ba87/users/3e3f036f37604e7d96a953784031f06a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:56.166619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207121-752b-491e-82e7-645a8784ba21 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.166920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207121-752b-491e-82e7-645a8784ba21 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.167301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207121-752b-491e-82e7-645a8784ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.197257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184d9189f1364fc1bdd88feff79103e6', 'request_id': 'req-f64d6255-d7c7-413d-b72c-7f02be6e28c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:56.206905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184d9189f1364fc1bdd88feff79103e6', 'request_id': 'req-f64d6255-d7c7-413d-b72c-7f02be6e28c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:56.228874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184d9189f1364fc1bdd88feff79103e6', 'request_id': 'req-f64d6255-d7c7-413d-b72c-7f02be6e28c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:56.245933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] The token cache is being invalidate because project 184d9189f1364fc1bdd88feff79103e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:56.246531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:56.247592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f64d6255-d7c7-413d-b72c-7f02be6e28c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:56.248872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-de207121-752b-491e-82e7-645a8784ba21 None None] MFA Rules not processed for user `3e3f036f37604e7d96a953784031f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:56.250258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-de207121-752b-491e-82e7-645a8784ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:56.254876 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2244/4431] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:08:55 2022] DELETE /identity/v3/projects/184d9189f1364fc1bdd88feff79103e6 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:56.256847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e45b-1c4f-4ca6-aad8-8b377dd16115 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.257418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e45b-1c4f-4ca6-aad8-8b377dd16115 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.258094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e45b-1c4f-4ca6-aad8-8b377dd16115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.288683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9293e45b-1c4f-4ca6-aad8-8b377dd16115 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:56.290401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9293e45b-1c4f-4ca6-aad8-8b377dd16115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:56.413302 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2188/4432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:56.417132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207121-752b-491e-82e7-645a8784ba21 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.419885 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2245/4433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:56.429100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef301125-aa66-415c-a43a-c0cbf272d411 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.429660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef301125-aa66-415c-a43a-c0cbf272d411 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.430083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef301125-aa66-415c-a43a-c0cbf272d411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.436137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207121-752b-491e-82e7-645a8784ba21 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.454829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.456990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.458850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.459686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.462854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.466627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.483264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ef301125-aa66-415c-a43a-c0cbf272d411 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:56.485999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef301125-aa66-415c-a43a-c0cbf272d411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:56.510816 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2189/4434] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:08:56 2022] POST /identity/v3/domains => generated 276 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:56.512548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.517672 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2246/4435] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:56.521783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef301125-aa66-415c-a43a-c0cbf272d411 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.543397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef301125-aa66-415c-a43a-c0cbf272d411 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.614183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0909a5-52d2-4c29-a3a0-f3bd5a6ba8a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.623128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.625541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.626271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.626621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157/config` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.627467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=913ab68fd583424987508b60828b9157)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.629686 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:56.629686 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:08:56.629686 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:08:56.631702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.663962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.664791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.665253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.665611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.666531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:08:56.667079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.669221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.685582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2247/4436] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:56.690116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.697092 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2190/4437] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:56 2022] PUT /identity/v3/domains/913ab68fd583424987508b60828b9157/config => generated 138 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:56.703894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1dc18-9d65-4e36-b446-19b92a6196f3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.704913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.710095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.710971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.711528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.711901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.713861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.717193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776282e-af47-4389-b866-34886429f6ae tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.718245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.740050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.742764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.743236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.743836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157/config/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.745458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=913ab68fd583424987508b60828b9157, group=identity)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.748320 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:56.748320 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:08:56.748320 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:08:56.750858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.765872 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2191/4438] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:08:56 2022] GET /identity/v3/domains/913ab68fd583424987508b60828b9157/config/identity => generated 45 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:08:56.767391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.783105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4172f4-8770-49a9-ad4f-5f7f333503ef tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.791387 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2248/4439] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:08:56 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:56.795573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.899568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.901989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.902467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.903120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157/config/identity/driver` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.905499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=913ab68fd583424987508b60828b9157, group=identity, option=driver)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.908393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:56.925160 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2192/4440] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Apr 9 21:08:56 2022] GET /identity/v3/domains/913ab68fd583424987508b60828b9157/config/identity/driver => generated 31 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:08:56.927955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:56.953683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516aff9-d1e0-4875-ba1c-2495e838b667 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:56.985974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fc335-69ca-471f-89ca-596046b8e136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:56.988721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc335-69ca-471f-89ca-596046b8e136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:56.989019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc335-69ca-471f-89ca-596046b8e136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:56.989359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc335-69ca-471f-89ca-596046b8e136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157/config/ldap` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:56.991098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fc335-69ca-471f-89ca-596046b8e136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=913ab68fd583424987508b60828b9157, group=ldap)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:56.993929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fc335-69ca-471f-89ca-596046b8e136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.013516 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2193/4441] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:08:56 2022] GET /identity/v3/domains/913ab68fd583424987508b60828b9157/config/ldap => generated 106 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:57.015148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82385a8-dda4-4993-9bac-393d695fd796 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.015434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82385a8-dda4-4993-9bac-393d695fd796 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.015710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82385a8-dda4-4993-9bac-393d695fd796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.048277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d2473-6dde-46f7-903e-05d73d448869 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.064625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de7880-c702-456b-91ce-2a9a2f779ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.064625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7880-c702-456b-91ce-2a9a2f779ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.064625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7880-c702-456b-91ce-2a9a2f779ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.066636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7880-c702-456b-91ce-2a9a2f779ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.067527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de7880-c702-456b-91ce-2a9a2f779ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.077157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de7880-c702-456b-91ce-2a9a2f779ed3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.079842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f82385a8-dda4-4993-9bac-393d695fd796 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:57.081354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f82385a8-dda4-4993-9bac-393d695fd796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:57.096155 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2194/4442] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:57 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:57.096155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82385a8-dda4-4993-9bac-393d695fd796 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.137281 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2249/4443] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:08:56 2022] POST /identity/v3/users => generated 294 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:57.141671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e84f5-e98f-4a91-9a3b-09289fb93954 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.145692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e84f5-e98f-4a91-9a3b-09289fb93954 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.146469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e84f5-e98f-4a91-9a3b-09289fb93954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.148747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82385a8-dda4-4993-9bac-393d695fd796 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.190382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.191535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.191892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.192394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157/config/ldap/url` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.195248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=913ab68fd583424987508b60828b9157, group=ldap, option=url)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.200764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.217263 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2195/4444] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:08:57 2022] GET /identity/v3/domains/913ab68fd583424987508b60828b9157/config/ldap/url => generated 46 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:08:57.218442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.242494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bdd7e-d527-4938-937a-1bcb8ba85916 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.246428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ad8e84f5-e98f-4a91-9a3b-09289fb93954 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:57.247845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ad8e84f5-e98f-4a91-9a3b-09289fb93954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:57.266309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.267048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.267324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.267593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.268329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.269979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.305422 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2196/4445] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:57.306476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.322253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e946-8878-4f97-ad2d-8cafbf9452ab admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.326751 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2250/4446] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:57.326751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e84f5-e98f-4a91-9a3b-09289fb93954 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.330446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.331745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.332032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.332303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157/config/ldap/user_tree_dn` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.333700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=913ab68fd583424987508b60828b9157, group=ldap, option=user_tree_dn)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.335980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.338577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e84f5-e98f-4a91-9a3b-09289fb93954 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.343504 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2197/4447] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:08:57 2022] GET /identity/v3/domains/913ab68fd583424987508b60828b9157/config/ldap/user_tree_dn => generated 63 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:08:57.346267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.349878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.351154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.351648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.352129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.353145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.359493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.363560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff8d0a-f2f0-46db-8006-eec9d96b9406 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.368712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee378-8000-4e36-a1ee-a6f57421924e tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.369657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee378-8000-4e36-a1ee-a6f57421924e tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.369938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee378-8000-4e36-a1ee-a6f57421924e tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.370209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee378-8000-4e36-a1ee-a6f57421924e tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.373270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2251/4448] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:08:57.374492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.387085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663854e5-5dd5-4aae-97d1-f9378df68fb3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.396975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.398342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.398856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.399613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157/config` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.400761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=913ab68fd583424987508b60828b9157)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.402284 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:57.402284 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:57.402284 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:57.403604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.423572 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2252/4449] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:08:57 2022] DELETE /identity/v3/domains/913ab68fd583424987508b60828b9157/config => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:57.428858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.442841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba171b-7610-444d-978a-9b7849301bd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.456099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bce718-5876-4ad9-9dfd-905532f33aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.457344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bce718-5876-4ad9-9dfd-905532f33aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.457811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bce718-5876-4ad9-9dfd-905532f33aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.458625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-25eee378-8000-4e36-a1ee-a6f57421924e tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.459027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bce718-5876-4ad9-9dfd-905532f33aa5 admin admin] PATH_INFO: `/v3/projects/60eee2c55ed842f78ac0fa9e1b400fbf/users/e2b92cb8d21d42eea56146d7935a74e8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.478007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bce718-5876-4ad9-9dfd-905532f33aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eee2c55ed842f78ac0fa9e1b400fbf, user_id=e2b92cb8d21d42eea56146d7935a74e8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.479055 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2198/4450] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:57 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:57.479732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee378-8000-4e36-a1ee-a6f57421924e tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.482494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bce718-5876-4ad9-9dfd-905532f33aa5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.500363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee378-8000-4e36-a1ee-a6f57421924e tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.511073 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2253/4451] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:08:57 2022] PUT /identity/v3/projects/60eee2c55ed842f78ac0fa9e1b400fbf/users/e2b92cb8d21d42eea56146d7935a74e8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:57.516605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.516884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.517217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.562638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:57.568718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:57.623256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.624721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.625456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.625742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.627148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=913ab68fd583424987508b60828b9157)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.628965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.656180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '913ab68fd583424987508b60828b9157'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.661091 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2254/4452] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:57.662724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '913ab68fd583424987508b60828b9157'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.684329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.685945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:57.703377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '913ab68fd583424987508b60828b9157'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.704004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '913ab68fd583424987508b60828b9157'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.708105 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2199/4453] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:08:57 2022] PATCH /identity/v3/domains/913ab68fd583424987508b60828b9157 => generated 277 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:57.712107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:57.713768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:57.769681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692376b-78f5-44df-9bed-ab6a31c04915 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.796839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d73ad-2381-405b-8bae-f7f9cc710045 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:57.803847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.805347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.805788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.806132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.820547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=913ab68fd583424987508b60828b9157)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.823155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.841707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:57.842799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:57.843154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:57.843499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:57.848155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:57.860745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '913ab68fd583424987508b60828b9157'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.865057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '913ab68fd583424987508b60828b9157'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.925302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913ab68fd583424987508b60828b9157', 'request_id': 'req-62286809-4394-48fb-bb0d-752e084e6aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.933865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913ab68fd583424987508b60828b9157', 'request_id': 'req-62286809-4394-48fb-bb0d-752e084e6aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.951777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:57.953351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:57.955325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913ab68fd583424987508b60828b9157', 'request_id': 'req-62286809-4394-48fb-bb0d-752e084e6aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.965685 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2255/4454] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:08:57.984958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] The token cache is being invalidate because project 913ab68fd583424987508b60828b9157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:57.985686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.986575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.996824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '913ab68fd583424987508b60828b9157', 'request_id': 'req-62286809-4394-48fb-bb0d-752e084e6aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:57.997808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '913ab68fd583424987508b60828b9157', 'request_id': 'req-62286809-4394-48fb-bb0d-752e084e6aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:58.002168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '913ab68fd583424987508b60828b9157', 'request_id': 'req-62286809-4394-48fb-bb0d-752e084e6aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:58.018774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2200/4455] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:57 2022] DELETE /identity/v3/domains/913ab68fd583424987508b60828b9157 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:58.019064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.033896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e6143-c2c9-4b6b-9b0e-40499cc43cef service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.138593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.139567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.139859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.140310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.141195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.144841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.188630 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2256/4456] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:08:58 2022] POST /identity/v3/domains => generated 276 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:58.190492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.193466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:58.225350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286809-4394-48fb-bb0d-752e084e6aa4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.310818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf238a-c7cb-4c20-8ca6-f43b71bde1dd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.316122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf238a-c7cb-4c20-8ca6-f43b71bde1dd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.316841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf238a-c7cb-4c20-8ca6-f43b71bde1dd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.317370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf238a-c7cb-4c20-8ca6-f43b71bde1dd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437/config` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.318410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf238a-c7cb-4c20-8ca6-f43b71bde1dd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.320406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf238a-c7cb-4c20-8ca6-f43b71bde1dd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.397924 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2201/4457] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:58 2022] PUT /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437/config => generated 138 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:58.402134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.421134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae103-6a82-4e3f-8ad9-eaed40a0b60a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.464644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb430ab-73ed-43c2-9343-dcd169aa4f05 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.466268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb430ab-73ed-43c2-9343-dcd169aa4f05 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.469673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb430ab-73ed-43c2-9343-dcd169aa4f05 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.470454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb430ab-73ed-43c2-9343-dcd169aa4f05 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437/config` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.471894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb430ab-73ed-43c2-9343-dcd169aa4f05 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.476574 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-1eb430ab-73ed-43c2-9343-dcd169aa4f05 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:58.476574 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:58.476574 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:58.478295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb430ab-73ed-43c2-9343-dcd169aa4f05 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.484540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ce4f-ee7b-4209-8ce7-125354a88448 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.485330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ce4f-ee7b-4209-8ce7-125354a88448 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.485786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ce4f-ee7b-4209-8ce7-125354a88448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.516908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a6a9ce4f-ee7b-4209-8ce7-125354a88448 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:58.518045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a6a9ce4f-ee7b-4209-8ce7-125354a88448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:58.537629 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2257/4458] 10.222.0.30 () {60 vars in 1270 bytes} [Sat Apr 9 21:08:58 2022] PATCH /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437/config => generated 141 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:58.539858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f70fa-349e-418f-a6ff-a2c2081282a7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.540382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f70fa-349e-418f-a6ff-a2c2081282a7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.540841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f70fa-349e-418f-a6ff-a2c2081282a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.570583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d34f70fa-349e-418f-a6ff-a2c2081282a7 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:58.574457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d34f70fa-349e-418f-a6ff-a2c2081282a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:58.580303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2258/4459] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:58 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:58.587565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f70fa-349e-418f-a6ff-a2c2081282a7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.597244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2202/4460] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:08:58.599082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddede2be-dda2-4492-af16-96b8df8da034 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.599450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddede2be-dda2-4492-af16-96b8df8da034 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.599839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddede2be-dda2-4492-af16-96b8df8da034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.631247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ddede2be-dda2-4492-af16-96b8df8da034 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:08:58.632496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ddede2be-dda2-4492-af16-96b8df8da034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:58.634881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f70fa-349e-418f-a6ff-a2c2081282a7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.640132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.641011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.641338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.641961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437/config` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.643104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.644170 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:58.644170 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:58.644170 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:58.645089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.651541 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2259/4461] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:08:58 2022] GET /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437/config => generated 141 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:58.652729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.654706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:58.777699 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2203/4462] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:08:58.780861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddede2be-dda2-4492-af16-96b8df8da034 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.795160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3481-1517-49f7-ba61-18b9f6659136 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.801543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddede2be-dda2-4492-af16-96b8df8da034 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.802408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.803181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.803946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.803946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.810500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.811776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.811776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.811986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437/config` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.812603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.813857 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:58.813857 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:08:58.813857 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:08:58.815208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.819122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.823425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.835581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2204/4463] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:08:58 2022] DELETE /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437/config => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:58.836254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.859511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03a35-bc47-45ce-ba0c-6ff961c0ceb3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.863476 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2260/4464] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:08:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:58.864189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4e65-de07-47c4-b639-a015d131a1ba tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f60c211ecd4f99a537af034131f27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a60e377825e4686af695def2bb44554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.864477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.865758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4e65-de07-47c4-b639-a015d131a1ba tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.865758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4e65-de07-47c4-b639-a015d131a1ba tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.865947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4e65-de07-47c4-b639-a015d131a1ba tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c/password` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.886110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ab065-9cd6-4550-8d53-6947d87ece2e service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.893153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.894735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.895393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.895776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437/config` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.898337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.900150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.929409 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Could not find any options in domain configuration for domain 833f5df60b6e474fb5ce547d64e17437.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 833f5df60b6e474fb5ce547d64e17437. Apr 09 21:08:58.933231 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2261/4465] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:08:58 2022] GET /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437/config => generated 151 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:08:58.938164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.954172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238c887-5264-4bf9-a47b-bdf504930b21 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:58.969085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a10b4e65-de07-47c4-b639-a015d131a1ba tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:58.976481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:58.977464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:58.977724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:58.978004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437/config` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:58.979086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:58.980685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:58.982942 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2205/4466] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:58 2022] POST /identity/v3/users/49f60c211ecd4f99a537af034131f27c/password => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:58.995167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4e65-de07-47c4-b639-a015d131a1ba tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:58.995779 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2262/4467] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:08:58 2022] DELETE /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437/config => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:59.018722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4e65-de07-47c4-b639-a015d131a1ba tempest-IdentityV3UsersTest-787704673 tempest-IdentityV3UsersTest-787704673-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:59.032853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:59.033860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:59.034086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:59.034368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:59.038468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:59.040130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:59.078772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '833f5df60b6e474fb5ce547d64e17437'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.079547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '833f5df60b6e474fb5ce547d64e17437'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.113607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '833f5df60b6e474fb5ce547d64e17437'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.114558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '833f5df60b6e474fb5ce547d64e17437'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.118043 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2206/4468] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:08:58 2022] PATCH /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437 => generated 277 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:59.122133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:59.123918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:59.143383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528c8a-df5d-43fc-a9bb-83ae9b2cb429 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:59.237775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:59.238784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:59.239140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:59.239492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:59.265488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=833f5df60b6e474fb5ce547d64e17437)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:59.268350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:59.325759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '833f5df60b6e474fb5ce547d64e17437'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.336928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '833f5df60b6e474fb5ce547d64e17437'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.430111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833f5df60b6e474fb5ce547d64e17437', 'request_id': 'req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.436746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833f5df60b6e474fb5ce547d64e17437', 'request_id': 'req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.459649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833f5df60b6e474fb5ce547d64e17437', 'request_id': 'req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.477617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] The token cache is being invalidate because project 833f5df60b6e474fb5ce547d64e17437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:08:59.478259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.479492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.503143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '833f5df60b6e474fb5ce547d64e17437', 'request_id': 'req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.513506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '833f5df60b6e474fb5ce547d64e17437', 'request_id': 'req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.516125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '833f5df60b6e474fb5ce547d64e17437', 'request_id': 'req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:08:59.532074 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2263/4469] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:08:59 2022] DELETE /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:08:59.533011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:59.567874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310c7e4-7fd3-45de-9679-417f289e88c1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:59.717271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:59.718423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:59.718753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:59.719029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:59.719795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:59.724669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:59.751546 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2207/4470] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:08:59 2022] POST /identity/v3/domains => generated 276 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:08:59.752707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:59.754234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:08:59.771779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a1cd-51c7-4856-b2a2-fcaf2c799b86 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:59.837823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:59.838808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:59.839218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:59.839727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:59.840594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:59.841976 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:59.841976 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:08:59.841976 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:08:59.843220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:59.882902 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2264/4471] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Apr 9 21:08:59 2022] PUT /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config => generated 138 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:08:59.887768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:59.899963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abc91e-2c0b-46d7-888b-8e55c578d6a3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:59.904756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc1b28-45d4-4152-9fd3-d1b1d91df4d7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:59.905736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc1b28-45d4-4152-9fd3-d1b1d91df4d7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:59.906117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc1b28-45d4-4152-9fd3-d1b1d91df4d7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:59.906287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc1b28-45d4-4152-9fd3-d1b1d91df4d7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:59.907302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc1b28-45d4-4152-9fd3-d1b1d91df4d7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d, group=identity)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:59.908392 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-7bbc1b28-45d4-4152-9fd3-d1b1d91df4d7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:08:59.908392 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:08:59.908392 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:08:59.909322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc1b28-45d4-4152-9fd3-d1b1d91df4d7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:59.946689 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2208/4472] 10.222.0.30 () {60 vars in 1296 bytes} [Sat Apr 9 21:08:59 2022] PATCH /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity => generated 176 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:08:59.947967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:08:59.960020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ee0c9-6f59-4151-85e7-b6f3af7b4d38 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:08:59.964993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:08:59.966337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:59.966840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:59.967875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity/driver` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:08:59.968302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d, group=identity, option=driver)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:08:59.970680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:08:59.988396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6b1e-4d5f-4dd2-a08f-e70c441799a8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:08:59.988730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6b1e-4d5f-4dd2-a08f-e70c441799a8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:08:59.988962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6b1e-4d5f-4dd2-a08f-e70c441799a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.033951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-140b6b1e-4d5f-4dd2-a08f-e70c441799a8 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:00.035206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-140b6b1e-4d5f-4dd2-a08f-e70c441799a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:00.046395 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2209/4473] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:08:59 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 21:09:00.053140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2265/4474] 10.222.0.30 () {60 vars in 1317 bytes} [Sat Apr 9 21:08:59 2022] PATCH /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity/driver => generated 176 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:09:00.054320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b6b1e-4d5f-4dd2-a08f-e70c441799a8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:00.070750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b6b1e-4d5f-4dd2-a08f-e70c441799a8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:00.076705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:00.077877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:00.078200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:00.078481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity/driver` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.079250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d, group=identity, option=driver)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:00.081986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:00.129718 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2210/4475] 10.222.0.30 () {58 vars in 1298 bytes} [Sat Apr 9 21:09:00 2022] DELETE /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity/driver => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:00.134118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:00.148727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27604a4a-e462-4970-8eb9-aa66fb2cfcc6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:00.161206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:00.162614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:00.162906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:00.163185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity/driver` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.165404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d, group=identity, option=driver)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:00.171054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:00.199508 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Could not find option driver in group identity in domain configuration for domain 8b02808dd3e540e08338973a25e35f2d.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 8b02808dd3e540e08338973a25e35f2d. Apr 09 21:09:00.201097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2266/4476] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Apr 9 21:09:00 2022] GET /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity/driver => generated 171 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:09:00.205527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:00.217550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf1591-aa12-4592-a760-abd54016918f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:00.225370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:00.226626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:00.227179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:00.228397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.229865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d, group=identity)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:00.234854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:00.273410 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2211/4477] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Apr 9 21:09:00 2022] DELETE /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:00.274759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:00.287416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618710-242a-4eca-a6ab-6aaf960337d6 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:00.297481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:00.298423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:00.298706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:00.301233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.302562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d, group=identity)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:00.304199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:00.318961 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Could not find group identity in domain configuration for domain 8b02808dd3e540e08338973a25e35f2d.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 8b02808dd3e540e08338973a25e35f2d. Apr 09 21:09:00.320658 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2267/4478] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:09:00 2022] GET /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config/identity => generated 154 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:09:00.324612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:00.335306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee08e29-0a7f-4046-b708-65af6adc783e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:00.341019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:00.342581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:00.342920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:00.343196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d/config` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.343914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8b02808dd3e540e08338973a25e35f2d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:00.346391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:00.359573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2212/4479] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:09:00 2022] DELETE /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d/config => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:00.363910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:00.380780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694199-4057-46e1-8d64-f314080a3ae4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:00.387224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:00.388981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:00.389439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:00.389928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.392877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8b02808dd3e540e08338973a25e35f2d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:00.394832 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:00.394832 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:09:00.394832 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:09:00.396155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:00.424304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8b02808dd3e540e08338973a25e35f2d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.426478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8b02808dd3e540e08338973a25e35f2d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.503599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8b02808dd3e540e08338973a25e35f2d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.504460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8b02808dd3e540e08338973a25e35f2d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.508374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2268/4480] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:09:00 2022] PATCH /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d => generated 277 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:00.512416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:00.515105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:00.538099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f8da6-49c4-4045-9b94-90a50c551ce0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:00.708729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:00.713360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:00.714027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:00.714557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:00.758970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8b02808dd3e540e08338973a25e35f2d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:00.762572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:00.833025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8b02808dd3e540e08338973a25e35f2d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.836572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8b02808dd3e540e08338973a25e35f2d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.923197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b02808dd3e540e08338973a25e35f2d', 'request_id': 'req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.936008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b02808dd3e540e08338973a25e35f2d', 'request_id': 'req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.957939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b02808dd3e540e08338973a25e35f2d', 'request_id': 'req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.978579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] The token cache is being invalidate because project 8b02808dd3e540e08338973a25e35f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:00.978962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:00.980555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.002367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8b02808dd3e540e08338973a25e35f2d', 'request_id': 'req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.003165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8b02808dd3e540e08338973a25e35f2d', 'request_id': 'req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.011772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8b02808dd3e540e08338973a25e35f2d', 'request_id': 'req-d0a96745-26d7-4c19-8c9a-36e08bd9c36a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.030076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.030625 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2213/4481] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:09:00 2022] DELETE /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:01.042121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54688-7505-4c49-b696-80538d945142 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.052093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.052653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.052653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.100529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] MFA Rules not processed for user `49f60c211ecd4f99a537af034131f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:01.104441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:01.196640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.197391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.197742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.198268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.199116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.200446 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:01.200446 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:09:01.200446 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:09:01.201784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.215524 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2269/4482] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:01.217849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.220660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:01.232766 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2214/4483] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:01.239694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.241743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:01.244610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b67601-4a22-4bb2-8a5c-8e66299a4bfb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.254569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.255385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.255667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.256408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.257523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.260183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.264692 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2270/4484] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.266206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.285652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2a815-0be3-4e85-810a-97c286f1591a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.295894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.297367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.297650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.297925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.298752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.301351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.305737 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2271/4485] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.309076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.323805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff62d-848b-464a-b188-e045dcc87feb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.341461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.343570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.346016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.346742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.348433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.352055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.355040 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2272/4486] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.359768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.363176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c5cbd-0ae5-4747-bd91-31c846c4c468 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.378969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74779b8-e995-4682-b16e-67566b1dcccb tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.380223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.381323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.381602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.381877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] PATH_INFO: `/v3/users/49f60c211ecd4f99a537af034131f27c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.385798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f60c211ecd4f99a537af034131f27c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.387617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.387765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.388760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.389307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.390018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.391913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.394100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.396540 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2273/4487] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:01.401478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.421833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb8bf5-6837-42d0-926f-328bb5c50305 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.433822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.436253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.436588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.437106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.437978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.448138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.451054 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2274/4488] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.456975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.490863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11911139-09c3-4a0d-97be-f77968f2443e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.510097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.511817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.512104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.512380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.513076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.515278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.518003 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2275/4489] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.521606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.523276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.530813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.542777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.543597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.553244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9748c-0c1f-421c-b53c-9477c76dd9be tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.560428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.563447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd93ca5f-712c-4919-a8ad-aa22c07880bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f60c211ecd4f99a537af034131f27c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:01.566196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.573822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.576027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.579674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.588232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.595469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2276/4490] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.599437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.605537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:01.606357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2215/4491] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:01 2022] DELETE /identity/v3/users/49f60c211ecd4f99a537af034131f27c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:01.610820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b4a2b-c561-4f60-adaa-7f30aa08752b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.611451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b4a2b-c561-4f60-adaa-7f30aa08752b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.611829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b4a2b-c561-4f60-adaa-7f30aa08752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.637016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfa122-d700-499f-8557-b72492a66124 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.650711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-467b4a2b-c561-4f60-adaa-7f30aa08752b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:01.656402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-467b4a2b-c561-4f60-adaa-7f30aa08752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:01.765659 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2216/4492] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:01.772643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.773909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.774225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.774502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.775160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.776808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.778335 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2277/4493] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.783104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b4a2b-c561-4f60-adaa-7f30aa08752b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.801440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.802313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b4a2b-c561-4f60-adaa-7f30aa08752b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.804380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:01.809809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.811623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.812142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.812606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.813696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.815306 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:01.815306 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:09:01.815306 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:09:01.816573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.819780 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2217/4494] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.824562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.861645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9ee5-fc60-4bc1-8426-1a24292af7c2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.867731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.868739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.869125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.869476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.870284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.872892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.874905 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2218/4495] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.879712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.898158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319420-a908-4913-afaa-b40b31d081f1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.899057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488361-ad78-4845-91d6-c0f8ee0a77ec tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.907147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.908096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.908386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.908953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.909705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.911229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.912066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.913748 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2219/4496] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:01.914021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.914376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.914660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.917387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.929916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575b2d-5f14-4360-96d7-1113c874d56f tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.937632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.939017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.940140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.943814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.944276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.945309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.945427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.947749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.950137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2220/4497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:01.953811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:01.967678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7344c-8cf9-4037-a218-4c94a2f780e7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:01.968404 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2278/4498] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:09:01.974026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:01.975850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:01.976389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:01.977262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:01.978150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:01.981060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:01.983514 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2221/4499] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:01.987433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.005145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce92748-20f5-470f-b4c5-b9cb43d78b82 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.011138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.013170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.013439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.014214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.014560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.016313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.017953 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2279/4500] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:01 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.021841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.038235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f2e09-8268-4403-804c-f13979caae32 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.044606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.045608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.046729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.047133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.048036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.050667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.061843 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2222/4501] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:02.063967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.086198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f6d55-da7a-47a9-9f26-f9eab52cc39b tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.096184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.096184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.096510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.096725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.097454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.099539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.104851 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2280/4502] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.108883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.127069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f700-e2bc-4cac-83aa-a9b4943e324c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.136867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.137810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.138105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.138766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.139798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.141881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.144428 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2223/4503] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.148566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.165294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a908d-0bda-451e-81f6-4a09d5e532a7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.173418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.175675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.176133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.176516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.177394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.182514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.187944 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2281/4504] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.191469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.209344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52795c-db83-4d8b-a64f-ecaa28f146fa tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.229062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.230040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.231285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.231285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.231973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.236130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.243596 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2224/4505] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.244049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.263375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0dc1-bbca-4ef3-9703-ae2703c976a4 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.276722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.277609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.278044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.278332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.280148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.284731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.288133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2282/4506] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.292026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.319283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e8bb1-41cb-49ef-a335-6756ab7b6176 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.334430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.336619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.336909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.338561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.341374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.344038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.346440 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2225/4507] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.350960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.363875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312263-26f6-4c3b-864f-0646dc457c56 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.379412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.380313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.380604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.381473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.381592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.387854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.393107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2283/4508] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.397123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.410566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afcb2a-b83a-4139-aaa3-84d3c6c7d0f5 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.425449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.425944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.426024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.426234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.427558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.431280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.435045 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2226/4509] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.437525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.458498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e7a-d7f2-4ec3-8a2c-dd7c21a02348 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.474159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.475007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.475936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.476222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.476899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.478586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.483313 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2284/4510] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.487661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.505259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392febf9-6e62-4c70-9a08-98f84aaaaa7c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.520298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.521175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.521407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.521685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.522352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.523999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.525688 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2227/4511] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.529683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.545730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798b56-6307-4078-904e-393fd06bc421 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.560812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.562009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.562294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.569201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.569941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.571622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.575994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2285/4512] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.580543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.606904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15cb3b-cacf-4ced-b0f0-fb52d8cdc37a tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.616523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.617662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.617975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.618332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.619085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.620889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.622463 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2228/4513] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.626607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.651037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c7aa-6761-45eb-9ef4-fb49c2d648f8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.657824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.658953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.659395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.660014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.660855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.663118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.668738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2286/4514] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.671923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.682480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7a141-f024-42c7-90c6-757a2bfe49f0 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.688670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.689281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.689736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.690087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.690834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.692535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.697723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2229/4515] 10.222.0.30 () {58 vars in 1307 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.698371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.712011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7292-e4aa-4df0-8073-4547e900da72 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.722073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.722950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.723235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.724457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.725851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.727602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.728861 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2287/4516] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.734448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.736031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.737953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:02.747014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc5e67-583c-4b32-9b72-0ca3a36cc765 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.754836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04b48-7050-4c53-9780-2adbd8051963 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.758900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.760032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.760350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.760602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.760752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.761692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.761977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.762094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.762301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] PATH_INFO: `/v3/projects/1a60e377825e4686af695def2bb44554` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.763513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a60e377825e4686af695def2bb44554)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.763967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.765663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.774269 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2230/4517] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.778643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.798907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d5ac-3fda-460e-a5f2-5a7cf9f8b424 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.809901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.811538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.812195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.812384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.813756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.816927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.822156 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2231/4518] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.826306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.837971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08aa438-abb5-4944-b6df-75518f75c7f7 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.848690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a60e377825e4686af695def2bb44554', 'request_id': 'req-41dffc48-c25d-49b6-93f1-9e176d4e532d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:02.854542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a60e377825e4686af695def2bb44554', 'request_id': 'req-41dffc48-c25d-49b6-93f1-9e176d4e532d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:02.863828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a60e377825e4686af695def2bb44554', 'request_id': 'req-41dffc48-c25d-49b6-93f1-9e176d4e532d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:02.877677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] The token cache is being invalidate because project 1a60e377825e4686af695def2bb44554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:02.877955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:02.879211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41dffc48-c25d-49b6-93f1-9e176d4e532d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:02.884817 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2288/4519] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:02 2022] DELETE /identity/v3/projects/1a60e377825e4686af695def2bb44554 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:02.887342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3405ac-c4a7-4904-8e77-e4f80e6de04e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.887673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3405ac-c4a7-4904-8e77-e4f80e6de04e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.888134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3405ac-c4a7-4904-8e77-e4f80e6de04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.904152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.905180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.905516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.906010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.907286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.909066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.910617 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2232/4520] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:02.911190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ca3405ac-c4a7-4904-8e77-e4f80e6de04e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:02.912415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ca3405ac-c4a7-4904-8e77-e4f80e6de04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:02.914594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.916339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:02.931069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977055f8-331e-4af3-9c19-51bffbaae365 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.936788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.937717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.938094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.938439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.939447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.941250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.942926 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2233/4521] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.946538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.957408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ca062-8159-4ab5-ba2c-a89b8a6b427e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.963605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.964659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.964659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.964903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.965658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.967390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.980367 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2234/4522] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:02.980367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:02.983943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b253-ac96-4d04-9802-0cc84117bcf2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:02.989368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7def7-1694-499c-aa1e-b3456923d9e3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:02.990363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7def7-1694-499c-aa1e-b3456923d9e3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:02.990682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7def7-1694-499c-aa1e-b3456923d9e3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:02.990918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7def7-1694-499c-aa1e-b3456923d9e3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:02.991586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7def7-1694-499c-aa1e-b3456923d9e3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:02.992886 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2289/4523] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:02.993606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7def7-1694-499c-aa1e-b3456923d9e3 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:02.994996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2235/4524] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:02.999109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3405ac-c4a7-4904-8e77-e4f80e6de04e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.000948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdacb01-90f7-469b-b315-faa9e8e4daa5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.001290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdacb01-90f7-469b-b315-faa9e8e4daa5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.001573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdacb01-90f7-469b-b315-faa9e8e4daa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.015826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3405ac-c4a7-4904-8e77-e4f80e6de04e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.023149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.024123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.024490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.026219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.027165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.028844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.033086 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2290/4525] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:09:02 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:03.033296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3fdacb01-90f7-469b-b315-faa9e8e4daa5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:03.035578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3fdacb01-90f7-469b-b315-faa9e8e4daa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:03.036189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.047928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7dc76-e646-4a20-8057-1747fe622748 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.050416 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2236/4526] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:03.052255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdacb01-90f7-469b-b315-faa9e8e4daa5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.053953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.055004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.055356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.055699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.056445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.058187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.059665 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2291/4527] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.063748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdacb01-90f7-469b-b315-faa9e8e4daa5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.065480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.076269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c206f-fb82-41cf-a5a1-7f696e64fa39 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.081254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.082010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.082298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.082738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.083589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.085076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.085215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.085396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.085396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.089525 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2292/4528] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.089685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.089685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:03.089685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.091614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.091745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.110872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8cb14-14c2-40de-b236-b48056705346 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.111123 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2237/4529] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:03.111879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.113405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.114266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.114549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.114827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.115493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.117172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.118958 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2293/4530] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.122789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.128704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb15f47-d5f9-4cf2-b8a7-721be965cead admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.134862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.136736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.136899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50de50b-b7fb-4fea-95db-a0dfc7775878 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.137391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.137824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.138701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.141204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.144382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.145258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.145522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.145790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.146463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.148537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.155176 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2294/4531] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:03.156227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.169195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624da1c-dcf4-4e4a-a17f-df9da2f166a1 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.176282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.177176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.177465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.177735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.178395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.180493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.186217 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2295/4532] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.187638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.205717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf418b0-8934-491c-a3c4-b294b5d8f3de tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.212482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.213385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.213768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.213996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.214660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.216597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.221607 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2296/4533] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.229673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.235640 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2238/4534] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:03 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:03.237802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.272069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386bb57-497f-48a2-88c9-ee320f48705c tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.354650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c8e2-25df-48a0-aee4-371a3fb47aef admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.370935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.371646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.371930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.372208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.373112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.376810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.400671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.414043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.414452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.414748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.415793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.417005 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2239/4535] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:03 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:03.417745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.418150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.418761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2297/4536] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:03.438088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5f9c0-b272-4624-8c5d-2e96de86d57f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.438302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.457921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.458970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.459331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.459679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.460516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.461740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d95238-b20e-4298-bcec-11fcd22263a2 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.464268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.470822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.476932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.477208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.477489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.478443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.484270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.488406 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2298/4537] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.489359 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2240/4538] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:03.492519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.496716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.508981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3ec5c-a663-48f3-8922-5b144af4612e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.517316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.518624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.519061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.519677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.521483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.523665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.524318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d663-65a6-4a0a-a02c-b6a27e3de242 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.526028 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2241/4539] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.529656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.539095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.542620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.542916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.545067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.546105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.547558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee560fe-c190-4730-be92-71c474fa4fd8 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.548439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.552578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.553670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.553955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.554375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.555083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.569289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.569289 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2242/4540] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.569289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.575864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8570fa2-de51-4b5b-b96f-afe47463df8e tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.576742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2299/4541] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:03.580286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.582893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.583902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.584189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.584611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.585324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.587558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.594002 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2243/4542] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.595753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.607620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700144c-d668-4bee-8f16-3f27d7895e0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.612949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7065-d3bf-4f48-b8dc-ab9388305474 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.618560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a802c8c-0ce7-4c01-a561-28343da309bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.619536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802c8c-0ce7-4c01-a561-28343da309bf admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.619843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802c8c-0ce7-4c01-a561-28343da309bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.619955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.620121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802c8c-0ce7-4c01-a561-28343da309bf admin admin] PATH_INFO: `/v3/projects/51c02d879e224b7784e94c35d28978fa/users/ed877c637f014bc58747a6fccfeb4e34/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.620822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.621151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.621426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.622368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.624579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.630126 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2244/4543] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.631123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.649825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b9926-a573-4b52-a4c0-022e4b36efd9 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.652061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a802c8c-0ce7-4c01-a561-28343da309bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c02d879e224b7784e94c35d28978fa, user_id=ed877c637f014bc58747a6fccfeb4e34, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.655269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a802c8c-0ce7-4c01-a561-28343da309bf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.657020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.657931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.658287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.658530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.659350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.662054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.666865 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2245/4544] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.668067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.691991 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2300/4545] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:03 2022] PUT /identity/v3/projects/51c02d879e224b7784e94c35d28978fa/users/ed877c637f014bc58747a6fccfeb4e34/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:03.693814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ec7da-6160-4ba1-a040-513ba3eeaa71 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.694050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f476b9-8d87-4270-83d2-c0f6daa09805 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.694166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ec7da-6160-4ba1-a040-513ba3eeaa71 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.694418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ec7da-6160-4ba1-a040-513ba3eeaa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.728312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ea7ec7da-6160-4ba1-a040-513ba3eeaa71 None None] MFA Rules not processed for user `ed877c637f014bc58747a6fccfeb4e34`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:03.729962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea7ec7da-6160-4ba1-a040-513ba3eeaa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:03.777723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.778968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.780483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.780924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.789386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.791533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.793811 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2246/4546] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.797511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.817517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfbd96-2469-4386-91f9-c106a285e1fd tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.824327 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2301/4547] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:03.829959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.830786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.831064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.831337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.832168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.834154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.839465 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2247/4548] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 09 21:09:03.847330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ec7da-6160-4ba1-a040-513ba3eeaa71 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.847564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.850105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:03.870730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ec7da-6160-4ba1-a040-513ba3eeaa71 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.881295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.882148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.882428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.882701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.883368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.885781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:03.889590 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2302/4549] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:09:03.901500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.919547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454cc0b-04aa-46cf-bb33-11049bc73264 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.928587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.929833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.930649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.931087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/8b02808dd3e540e08338973a25e35f2d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.942281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:09:03.956725 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Could not find domain: 8b02808dd3e540e08338973a25e35f2d.: keystone.exception.DomainNotFound: Could not find domain: 8b02808dd3e540e08338973a25e35f2d. Apr 09 21:09:03.958236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500a25b-2f51-45d8-90cf-a363f5b3eaad tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.961996 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2303/4550] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:09:03 2022] PATCH /identity/v3/domains/8b02808dd3e540e08338973a25e35f2d => generated 112 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:09:03.963480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:03.968962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:03.971146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:03.972888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:03.974002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:03.992633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:03.992795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130159-f24b-4bcb-98b7-91184bb28dcf tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:03.994596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:04.000062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:04.001059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:04.001338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:04.001730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/833f5df60b6e474fb5ce547d64e17437` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:04.013737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:09:04.017508 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2248/4551] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:04.035843 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Could not find domain: 833f5df60b6e474fb5ce547d64e17437.: keystone.exception.DomainNotFound: Could not find domain: 833f5df60b6e474fb5ce547d64e17437. Apr 09 21:09:04.042716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:04.043982 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2304/4552] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:09:03 2022] PATCH /identity/v3/domains/833f5df60b6e474fb5ce547d64e17437 => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:09:04.069725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de286627-ae1a-4a32-9503-b008fcda561f service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:04.085757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a10e3-f594-4171-b622-040505a7f125 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3f036f37604e7d96a953784031f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:04.086694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a10e3-f594-4171-b622-040505a7f125 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:04.086976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a10e3-f594-4171-b622-040505a7f125 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:04.087249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a10e3-f594-4171-b622-040505a7f125 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] PATH_INFO: `/v3/domains/913ab68fd583424987508b60828b9157` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:04.108239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a10e3-f594-4171-b622-040505a7f125 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:09:04.119280 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-401a10e3-f594-4171-b622-040505a7f125 tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Could not find domain: 913ab68fd583424987508b60828b9157.: keystone.exception.DomainNotFound: Could not find domain: 913ab68fd583424987508b60828b9157. Apr 09 21:09:04.121112 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2249/4553] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:09:04 2022] PATCH /identity/v3/domains/913ab68fd583424987508b60828b9157 => generated 112 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:09:04.124732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:04.126676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:04.324386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f55b1-2cc7-459e-b1f1-3e49629e59ac tempest-DomainConfigurationTestJSON-358194221 tempest-DomainConfigurationTestJSON-358194221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:04.329865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:04.331581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:04.331581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:04.331581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] PATH_INFO: `/v3/users/92c8e10f283f4c718e121e0f9d94ddd9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:04.332897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c8e10f283f4c718e121e0f9d94ddd9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:04.335873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:04.337775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:04.338066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:04.338419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:04.404011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:04.423488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:04.454617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c8e10f283f4c718e121e0f9d94ddd9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:04.455776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c8e10f283f4c718e121e0f9d94ddd9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:04.476975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c8e10f283f4c718e121e0f9d94ddd9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:04.502669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c8e10f283f4c718e121e0f9d94ddd9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:04.503384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9b309bec-c220-4f6b-9e19-2475c2082cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c8e10f283f4c718e121e0f9d94ddd9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:04.551448 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2305/4554] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:04 2022] DELETE /identity/v3/users/92c8e10f283f4c718e121e0f9d94ddd9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:04.555745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:04.556353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:04.556840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:04.578000 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2250/4555] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:04.598889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:04.600655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:04.612286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:04.615777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:04.696173 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2306/4556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:04.711935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783188c-53f1-41ee-a160-8fd05a03a9e4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:04.775716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:04.777513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:04.818858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:04.820556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:04.821169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:04.822027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:04.859865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec904f78-2154-469d-a60c-2ff1e37441f0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:04.872591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e03aed-6dc1-405a-acae-eff756626960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:04.873488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03aed-6dc1-405a-acae-eff756626960 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:04.873966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03aed-6dc1-405a-acae-eff756626960 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:04.874390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03aed-6dc1-405a-acae-eff756626960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:04.893534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e03aed-6dc1-405a-acae-eff756626960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:04.899840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e03aed-6dc1-405a-acae-eff756626960 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:04.912734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:04.915214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:04.919537 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2307/4557] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:04.930309 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2251/4558] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:05.213392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f26c-1a51-4b2b-b012-2d8cd86ff5b6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:05.213898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f26c-1a51-4b2b-b012-2d8cd86ff5b6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:05.213997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f26c-1a51-4b2b-b012-2d8cd86ff5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:05.232983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-34f4f26c-1a51-4b2b-b012-2d8cd86ff5b6 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:05.233915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-34f4f26c-1a51-4b2b-b012-2d8cd86ff5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:05.242486 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2308/4559] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:05.255116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:05.266832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412893f-eb17-48f6-9372-e82c9477715a service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:05.275342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:05.276283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:05.276619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:05.276961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:05.285978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:05.288672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:05.298420 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2252/4560] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:05.559871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde8fc-fd24-4f80-913d-16f380d2b8c8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:05.560151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde8fc-fd24-4f80-913d-16f380d2b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:05.560419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde8fc-fd24-4f80-913d-16f380d2b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:05.579639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-21fde8fc-fd24-4f80-913d-16f380d2b8c8 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:05.580874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-21fde8fc-fd24-4f80-913d-16f380d2b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:05.589326 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2309/4561] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:05.602200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:05.614580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad7161-ce0a-4708-aa2f-7263c5fda211 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:05.620998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:05.621715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:05.622000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:05.622276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:05.631560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:05.633206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:05.641584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2253/4562] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:06.009322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c0063-aae1-42a5-abff-274d8c6a3193 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:06.009826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c0063-aae1-42a5-abff-274d8c6a3193 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:06.010250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c0063-aae1-42a5-abff-274d8c6a3193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:06.041701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-998c0063-aae1-42a5-abff-274d8c6a3193 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:06.043180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-998c0063-aae1-42a5-abff-274d8c6a3193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:06.052164 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2310/4563] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:06.066000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:06.080664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b731-ea46-43be-81e3-1553a89d2d54 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:06.090471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:06.091451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:06.092113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:06.092602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:06.105558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:06.112981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:06.126025 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2254/4564] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:06.478233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:06.478898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:06.479109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:06.503972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:06.505499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:06.514814 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2311/4565] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:06.542370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:06.566748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e05e31-0403-4821-b40d-7f66d2f57097 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:06.572393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce31c-afa2-49c5-8329-3cbc4eb4b9ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:06.573085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce31c-afa2-49c5-8329-3cbc4eb4b9ea service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:06.573368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce31c-afa2-49c5-8329-3cbc4eb4b9ea service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:06.573654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce31c-afa2-49c5-8329-3cbc4eb4b9ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:06.582986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce31c-afa2-49c5-8329-3cbc4eb4b9ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:06.584616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce31c-afa2-49c5-8329-3cbc4eb4b9ea service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:06.605628 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2255/4566] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:06.765355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:06.767305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:06.801684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8678a-cf90-4eb4-bcc7-63f079ef8d22 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:06.807520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:06.808578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:06.808911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:06.809524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] PATH_INFO: `/v3/projects/3c42d0be389543f99c2a34395346cfac` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:06.811114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c42d0be389543f99c2a34395346cfac)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:06.818656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:06.877217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c42d0be389543f99c2a34395346cfac', 'request_id': 'req-7aea06f0-453c-44c6-923a-8318032787dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:06.883317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:06.883631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:06.884088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:06.884442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c42d0be389543f99c2a34395346cfac', 'request_id': 'req-7aea06f0-453c-44c6-923a-8318032787dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:06.894348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c42d0be389543f99c2a34395346cfac', 'request_id': 'req-7aea06f0-453c-44c6-923a-8318032787dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:06.904979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:06.906248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:06.906511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] The token cache is being invalidate because project 3c42d0be389543f99c2a34395346cfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:06.907009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:06.907739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:06.909869 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2312/4567] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:06 2022] DELETE /identity/v3/projects/3c42d0be389543f99c2a34395346cfac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:06.913593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:06.914925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:06.975566 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2256/4568] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:06.988590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:06.990350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:06.999585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea06f0-453c-44c6-923a-8318032787dd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:07.004880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:07.005935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:07.006314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:07.006686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] PATH_INFO: `/v3/users/3e3f036f37604e7d96a953784031f06a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:07.009948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3f036f37604e7d96a953784031f06a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:07.012041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:07.071046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b030-bf08-439d-b2b5-741ca02c1d32 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:07.076987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:07.077759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:07.078083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:07.078362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:07.097624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3f036f37604e7d96a953784031f06a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.098842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:07.100544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:07.100891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3f036f37604e7d96a953784031f06a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.111600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2257/4569] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:07.119731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3f036f37604e7d96a953784031f06a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.133011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3f036f37604e7d96a953784031f06a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.133964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-832da99e-6d54-4ec0-b9de-88bb104ad642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3f036f37604e7d96a953784031f06a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.156820 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2313/4570] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:06 2022] DELETE /identity/v3/users/3e3f036f37604e7d96a953784031f06a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:07.609046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:07.628694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5296-9f96-4d9c-bc31-0455ef6d97f4 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:07.813890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:07.814804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:07.815086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:07.815361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] PATH_INFO: `/v3/projects/01fb4c3d838b4a0a9f3d75a04c86ba87` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:07.818083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fb4c3d838b4a0a9f3d75a04c86ba87)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:07.820011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:07.921679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'request_id': 'req-3b17e32f-0905-4f89-8077-ac0c5c301c51'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.936929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'request_id': 'req-3b17e32f-0905-4f89-8077-ac0c5c301c51'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.955459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fb4c3d838b4a0a9f3d75a04c86ba87', 'request_id': 'req-3b17e32f-0905-4f89-8077-ac0c5c301c51'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.977071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] The token cache is being invalidate because project 01fb4c3d838b4a0a9f3d75a04c86ba87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:07.977503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.978229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3b17e32f-0905-4f89-8077-ac0c5c301c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:07.986588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722985-ac00-4c75-a419-5d5ded5bf3ee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:07.987798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722985-ac00-4c75-a419-5d5ded5bf3ee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:07.988366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722985-ac00-4c75-a419-5d5ded5bf3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:07.990601 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2258/4571] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:07 2022] DELETE /identity/v3/projects/01fb4c3d838b4a0a9f3d75a04c86ba87 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:08.011650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c8722985-ac00-4c75-a419-5d5ded5bf3ee None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:08.013311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c8722985-ac00-4c75-a419-5d5ded5bf3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:08.142931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b088d-481f-4eea-93ff-0f2e9a259280 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.143348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b088d-481f-4eea-93ff-0f2e9a259280 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.143719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b088d-481f-4eea-93ff-0f2e9a259280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.145628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2314/4572] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:08.183584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a33b088d-481f-4eea-93ff-0f2e9a259280 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:08.184825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a33b088d-481f-4eea-93ff-0f2e9a259280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:08.206098 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2259/4573] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:08.210730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722985-ac00-4c75-a419-5d5ded5bf3ee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:08.223545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722985-ac00-4c75-a419-5d5ded5bf3ee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:08.236407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:08.238202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.238744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.239080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.240526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:08.240930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:08.246466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:08.277777 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2315/4574] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:08.279132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b088d-481f-4eea-93ff-0f2e9a259280 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:08.291256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b088d-481f-4eea-93ff-0f2e9a259280 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:08.297748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:08.299277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.299779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.300256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.301191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:08.304110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:08.373766 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2260/4575] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:08 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:08.377860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:08.392089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972eab1-0a9b-4a35-b5c2-17f853cb72a4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:08.490638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:08.492256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.492696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.493178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.496273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:08.499069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:08.541163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:08.542798 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2316/4576] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:08 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:08.556605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b574-6970-43c8-a5fb-01d7182bfe24 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:08.562354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:08.563393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.563827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.564252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.565300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:08.567314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:08.586685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:08.597441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2261/4577] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:08.600238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ca65a-88b5-4fbb-8c1a-e1ad5a7e3e5e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:08.606282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c84915-918d-45ff-94cb-c59b2e3c1d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:08.607563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c84915-918d-45ff-94cb-c59b2e3c1d14 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.608015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c84915-918d-45ff-94cb-c59b2e3c1d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.608563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c84915-918d-45ff-94cb-c59b2e3c1d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.609709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c84915-918d-45ff-94cb-c59b2e3c1d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:08.612236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c84915-918d-45ff-94cb-c59b2e3c1d14 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:08.631196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:08.631761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2317/4578] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:08.657075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a8bfe-07ee-4488-846b-e52024ffca43 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:08.682855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe73ed5-2ddd-4c63-acd2-212363f02edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:08.683784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73ed5-2ddd-4c63-acd2-212363f02edb admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.684060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73ed5-2ddd-4c63-acd2-212363f02edb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.684329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73ed5-2ddd-4c63-acd2-212363f02edb admin admin] PATH_INFO: `/v3/projects/908077e72b074d329cbadde4f81ad666/users/74a0858925594f46abe5b118d5b9cd5c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.723116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe73ed5-2ddd-4c63-acd2-212363f02edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=908077e72b074d329cbadde4f81ad666, user_id=74a0858925594f46abe5b118d5b9cd5c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:08.726265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe73ed5-2ddd-4c63-acd2-212363f02edb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:08.748315 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2262/4579] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:08 2022] PUT /identity/v3/projects/908077e72b074d329cbadde4f81ad666/users/74a0858925594f46abe5b118d5b9cd5c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:08.762179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5264f-1a56-4856-aa44-710e69f6b913 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.762649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5264f-1a56-4856-aa44-710e69f6b913 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.762957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5264f-1a56-4856-aa44-710e69f6b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.817852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-71f5264f-1a56-4856-aa44-710e69f6b913 None None] MFA Rules not processed for user `74a0858925594f46abe5b118d5b9cd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:08.819525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-71f5264f-1a56-4856-aa44-710e69f6b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:08.862204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:08.862876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:08.863164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:08.929587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:08.933862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:08.983622 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2318/4580] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:08.984927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5264f-1a56-4856-aa44-710e69f6b913 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:09.081282 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2263/4581] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:09.097120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:09.099912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5264f-1a56-4856-aa44-710e69f6b913 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:09.100812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:09.107933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:09.108927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.109530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.109879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.110743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:09.113897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:09.153353 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2319/4582] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:08 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:09.156906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:09.237174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559381cd-c766-477e-bb30-7a6874dbebad None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:09.259916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a622d-b7ab-4e7c-92e5-3fb7d435f41d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:09.267436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:09.268482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.268952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.269502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.271757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:09.274789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:09.316224 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2320/4583] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:09 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:09.319843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:09.336505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:09.337549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.338077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.338552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.340186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01f85a-9175-4d8d-8e5b-f38a05c55966 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:09.354544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:09.355461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.356068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.356422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.357377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:09.360040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:09.383234 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2321/4584] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:09.386092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:09.410516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483635a3-39b9-4b2b-a6b6-67a9dccb431c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:09.424753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87b4a5-c8f1-455b-ad29-8cdeedced229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:09.425836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b4a5-c8f1-455b-ad29-8cdeedced229 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.426219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b4a5-c8f1-455b-ad29-8cdeedced229 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.426594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b4a5-c8f1-455b-ad29-8cdeedced229 admin admin] PATH_INFO: `/v3/projects/03a7dc1801724ff7b8cba8101743fa7e/users/0abd5ca4e5c741d4b1984c4fd2f89c81/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.455321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:09.457583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:09.468737 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2264/4585] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:09.480504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b4a5-c8f1-455b-ad29-8cdeedced229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a7dc1801724ff7b8cba8101743fa7e, user_id=0abd5ca4e5c741d4b1984c4fd2f89c81, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:09.483263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b4a5-c8f1-455b-ad29-8cdeedced229 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:09.513397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2322/4586] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:09 2022] PUT /identity/v3/projects/03a7dc1801724ff7b8cba8101743fa7e/users/0abd5ca4e5c741d4b1984c4fd2f89c81/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:09.517498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:09.548314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7d81b-f9a7-4c3a-8828-f5524f764c7f service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:09.680757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115f73-8d46-43fa-8651-0f17986b03a5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.681285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115f73-8d46-43fa-8651-0f17986b03a5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.681660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115f73-8d46-43fa-8651-0f17986b03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.690276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:09.690964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.691248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.691524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.692258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:09.693902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:09.712452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8b115f73-8d46-43fa-8651-0f17986b03a5 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:09.715785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8b115f73-8d46-43fa-8651-0f17986b03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:09.719042 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2265/4587] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:09.723880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:09.750016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57cb01-20da-4539-8462-2931531a6f96 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:09.760655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba628ca-70d6-4d28-948e-0bb3dc6d326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:09.763286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba628ca-70d6-4d28-948e-0bb3dc6d326e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.763638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba628ca-70d6-4d28-948e-0bb3dc6d326e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.764007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba628ca-70d6-4d28-948e-0bb3dc6d326e admin admin] PATH_INFO: `/v3/projects/03a7dc1801724ff7b8cba8101743fa7e/users/0abd5ca4e5c741d4b1984c4fd2f89c81/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.768073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba628ca-70d6-4d28-948e-0bb3dc6d326e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a7dc1801724ff7b8cba8101743fa7e, user_id=0abd5ca4e5c741d4b1984c4fd2f89c81, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:09.775485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba628ca-70d6-4d28-948e-0bb3dc6d326e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:09.809132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2266/4588] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:09 2022] PUT /identity/v3/projects/03a7dc1801724ff7b8cba8101743fa7e/users/0abd5ca4e5c741d4b1984c4fd2f89c81/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:09.815063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77852d9-4aa5-4062-887c-4240229827c7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:09.815063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77852d9-4aa5-4062-887c-4240229827c7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:09.815397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77852d9-4aa5-4062-887c-4240229827c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:09.850602 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2323/4589] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:09.852549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e77852d9-4aa5-4062-887c-4240229827c7 None None] MFA Rules not processed for user `0abd5ca4e5c741d4b1984c4fd2f89c81`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:09.853831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e77852d9-4aa5-4062-887c-4240229827c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:09.868090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b115f73-8d46-43fa-8651-0f17986b03a5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.031762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b115f73-8d46-43fa-8651-0f17986b03a5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.055927 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2267/4590] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:10.057170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77852d9-4aa5-4062-887c-4240229827c7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.082028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77852d9-4aa5-4062-887c-4240229827c7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.094742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.096913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.097392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.097675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.098835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.102705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.118886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.120067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.120592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.120966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.134206 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2268/4591] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:09:10 2022] POST /identity/v3/domains => generated 274 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:10.143236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.269927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.271778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.302068 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2324/4592] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:09:10.311399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c523-d113-4050-bbf0-2fa60e043eae tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.316581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.317420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.317879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.318218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.319101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.321677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.387505 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2269/4593] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:10 2022] POST /identity/v3/users => generated 348 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:10.391664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.405163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e1dfe-85f3-421a-a73c-ba30fbad88ae service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.415697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e5793-4070-4659-80b5-21c6e1e68599 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.418147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5793-4070-4659-80b5-21c6e1e68599 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.418508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5793-4070-4659-80b5-21c6e1e68599 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.418794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5793-4070-4659-80b5-21c6e1e68599 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.419914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e5793-4070-4659-80b5-21c6e1e68599 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.424149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e5793-4070-4659-80b5-21c6e1e68599 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.491177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.499551 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2325/4594] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:10 2022] POST /identity/v3/users => generated 324 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:10.512148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8147329-ff35-4ff5-bae2-3abfa4ac6e96 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.519346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.520588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.520775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.521666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users/41e9c151c702423a8f5f775792d541ca` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.542987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce551-2e2b-47f0-8e10-5b1f188e789f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.544258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce551-2e2b-47f0-8e10-5b1f188e789f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.544748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce551-2e2b-47f0-8e10-5b1f188e789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.561901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:get_user(user_id=41e9c151c702423a8f5f775792d541ca)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.569759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.574283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2270/4595] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:09:10 2022] GET /identity/v3/users/41e9c151c702423a8f5f775792d541ca => generated 348 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:10.578697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.584584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-11bce551-2e2b-47f0-8e10-5b1f188e789f None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:10.588338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-11bce551-2e2b-47f0-8e10-5b1f188e789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:10.598867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3058-0291-4d37-89c1-3f7c33787d79 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.610228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.611926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.613105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.615557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.616627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Adding query filter params (domain_id=dcc405bb1ddc448fb1b946c9b152f158) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:10.617936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.619654 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:10.619654 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:09:10.619654 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:09:10.622921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.659576 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2271/4596] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Apr 9 21:09:10 2022] GET /identity/v3/users?domain_id=dcc405bb1ddc448fb1b946c9b152f158 => generated 485 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:09:10.660863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.672722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9425e9-2698-4fb4-8412-2c29d2e0f722 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.679071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.680448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.680943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.681452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.682439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.684714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.699081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2326/4597] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:10.715417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce551-2e2b-47f0-8e10-5b1f188e789f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.756834 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2272/4598] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:10 2022] GET /identity/v3/users => generated 8322 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:10.763846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.777719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d472d-4eec-48f2-bf6e-c60668488932 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.784274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.785260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.785688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.786967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.787959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1288928097) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:10.788693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.791100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.822660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2273/4599] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Apr 9 21:09:10 2022] GET /identity/v3/users?name=tempest-test_user-1288928097 => generated 476 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:10.832045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.856825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c09ed6-462a-4e91-9826-6e5e0a4959e1 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.866621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.868293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.868578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.869289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.871434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:10.871748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.874007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.876768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce551-2e2b-47f0-8e10-5b1f188e789f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.884159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39cf2d-f88d-4f9c-a0ab-a340acdb457c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.885517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cf2d-f88d-4f9c-a0ab-a340acdb457c service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.885893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cf2d-f88d-4f9c-a0ab-a340acdb457c service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.886284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cf2d-f88d-4f9c-a0ab-a340acdb457c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:10.902279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39cf2d-f88d-4f9c-a0ab-a340acdb457c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:10.906568 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2274/4600] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:09:10 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:10.908691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:10.908941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39cf2d-f88d-4f9c-a0ab-a340acdb457c service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:10.926616 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2327/4601] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:10.947767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045414-4858-4111-96cb-ae957d61faa8 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:10.960500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:10.961607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:10.961892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:10.962166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users/6b4e2f43de144f97abd19cee2187cd8f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.004599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6b4e2f43de144f97abd19cee2187cd8f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:11.007773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:11.036019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6fb08-ed70-410e-a535-afd428e46330 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:11.036750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6fb08-ed70-410e-a535-afd428e46330 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:11.037585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6fb08-ed70-410e-a535-afd428e46330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.091255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-37a6fb08-ed70-410e-a535-afd428e46330 None None] MFA Rules not processed for user `e2b92cb8d21d42eea56146d7935a74e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:11.092772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-37a6fb08-ed70-410e-a535-afd428e46330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.119229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4e2f43de144f97abd19cee2187cd8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.122558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4e2f43de144f97abd19cee2187cd8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.164835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4e2f43de144f97abd19cee2187cd8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.167625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4e2f43de144f97abd19cee2187cd8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.185353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4e2f43de144f97abd19cee2187cd8f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.229937 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2275/4602] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:10 2022] DELETE /identity/v3/users/6b4e2f43de144f97abd19cee2187cd8f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:11.231405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:11.232822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.246897 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2328/4603] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:11.248314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:11.249408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:11.249583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.273047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:11.275112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.343792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecce62b-217e-4999-8efd-ec83bfe4e82b tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:11.352268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:11.353432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:11.353723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:11.354189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/users/41e9c151c702423a8f5f775792d541ca` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.356478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=41e9c151c702423a8f5f775792d541ca)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:11.359562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:11.366423 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2329/4604] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:11.367503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:11.369024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.488826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38319fb6-03af-4d01-afe7-788317fea62e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:11.494322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:11.495132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:11.495495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:11.495867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.496691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:11.500089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:11.506843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e9c151c702423a8f5f775792d541ca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.508188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e9c151c702423a8f5f775792d541ca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.521444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e9c151c702423a8f5f775792d541ca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.522258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e9c151c702423a8f5f775792d541ca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.535493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e9c151c702423a8f5f775792d541ca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.566494 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2330/4605] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:11 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:11.567799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:11.569122 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2276/4606] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:11 2022] DELETE /identity/v3/users/41e9c151c702423a8f5f775792d541ca => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:11.570106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:11.571413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.574120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.674589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19cd2b-54c1-4002-84fb-7207f2909e65 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:11.680910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:11.682427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:11.683331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:11.684135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.685942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:11.689393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:11.708686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362bd15-3d11-47f4-a550-ef99372da312 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:11.723976 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2277/4607] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:11 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:11.723976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:11.724280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.804985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d2cee-0d9a-4640-886e-2f267382f674 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:11.816225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:11.817766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:11.818213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:11.818492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/domains/dcc405bb1ddc448fb1b946c9b152f158` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.820018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dcc405bb1ddc448fb1b946c9b152f158)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:11.821693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:11.832947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:11.834533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:11.840068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:11.840512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:11.843068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.869975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.876251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.922477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.923069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:11.925859 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2278/4608] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:09:11 2022] PATCH /identity/v3/domains/dcc405bb1ddc448fb1b946c9b152f158 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:11.926503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:11.927798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:11.936824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:11.938825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:11.999552 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2331/4609] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:12.000710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:12.023216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7243-7b2e-4269-8367-2554f6e7cdea service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:12.121432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912826-e93b-4cc7-b548-3aa61af91724 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:12.132280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:12.132984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.133353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.133625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.134365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:12.136004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:12.164597 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2279/4610] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:12.173698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:12.200175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0823-68fb-491f-9a0d-5432759e87a3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:12.217696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0abd5ca4e5c741d4b1984c4fd2f89c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a7dc1801724ff7b8cba8101743fa7e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:12.220724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.221340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.222353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] PATH_INFO: `/v3/domains/dcc405bb1ddc448fb1b946c9b152f158` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.235614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46bdb-5a12-4396-a0b8-d951616880eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:12.243573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46bdb-5a12-4396-a0b8-d951616880eb admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.243573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46bdb-5a12-4396-a0b8-d951616880eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.243573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46bdb-5a12-4396-a0b8-d951616880eb admin admin] PATH_INFO: `/v3/projects/4d6801916c224eb9adffbc6ac35c6e54/users/68fbae6daff840b9a7c1e1473c798064/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.278675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dcc405bb1ddc448fb1b946c9b152f158)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:12.283563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:12.294216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae46bdb-5a12-4396-a0b8-d951616880eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6801916c224eb9adffbc6ac35c6e54, user_id=68fbae6daff840b9a7c1e1473c798064, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:12.302046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae46bdb-5a12-4396-a0b8-d951616880eb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:12.332498 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2280/4611] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:12 2022] PUT /identity/v3/projects/4d6801916c224eb9adffbc6ac35c6e54/users/68fbae6daff840b9a7c1e1473c798064/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:12.333865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29011361-773a-4279-8fb0-c25326e61e91 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.334328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29011361-773a-4279-8fb0-c25326e61e91 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.334753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29011361-773a-4279-8fb0-c25326e61e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.362087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.376134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.386659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-29011361-773a-4279-8fb0-c25326e61e91 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:12.387879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-29011361-773a-4279-8fb0-c25326e61e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:12.465822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158', 'request_id': 'req-1f620811-0aee-4ef0-9668-ec2f3959a846'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.481151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158', 'request_id': 'req-1f620811-0aee-4ef0-9668-ec2f3959a846'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.493583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158', 'request_id': 'req-1f620811-0aee-4ef0-9668-ec2f3959a846'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.498607 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2281/4612] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:12.501841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29011361-773a-4279-8fb0-c25326e61e91 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:12.545416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] The token cache is being invalidate because project dcc405bb1ddc448fb1b946c9b152f158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:12.545942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.547004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.569560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158', 'request_id': 'req-1f620811-0aee-4ef0-9668-ec2f3959a846'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.578067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158', 'request_id': 'req-1f620811-0aee-4ef0-9668-ec2f3959a846'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.578908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dcc405bb1ddc448fb1b946c9b152f158', 'request_id': 'req-1f620811-0aee-4ef0-9668-ec2f3959a846'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.591551 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2332/4613] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:09:11 2022] DELETE /identity/v3/domains/dcc405bb1ddc448fb1b946c9b152f158 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:12.592672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:12.594652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:12.634606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29011361-773a-4279-8fb0-c25326e61e91 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:12.698937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620811-0aee-4ef0-9668-ec2f3959a846 tempest-UsersV3TestJSON-1109888943 tempest-UsersV3TestJSON-1109888943-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:12.708021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:12.708711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.709327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.709693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.712205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:12.713911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:12.714765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.715272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.715635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.716456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:12.718347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:12.732078 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2282/4614] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:12.733576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:12.735701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:12.750269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398feb55-6f08-4444-9d4e-1388dbc445a0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:12.757712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:12.759280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.759623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.760037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] PATH_INFO: `/v3/users/74a0858925594f46abe5b118d5b9cd5c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.761552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a0858925594f46abe5b118d5b9cd5c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:12.763840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:12.822516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:12.825984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:12.848105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a0858925594f46abe5b118d5b9cd5c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.852545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a0858925594f46abe5b118d5b9cd5c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.867718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a0858925594f46abe5b118d5b9cd5c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.868766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a0858925594f46abe5b118d5b9cd5c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.885929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-119dc63a-c5c1-4235-b891-75672365c56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a0858925594f46abe5b118d5b9cd5c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:12.887810 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2333/4615] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:12.889721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:12.891235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:12.937638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665dcc-3b09-4181-ac58-b4dd8dcf6878 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:12.953909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce22073-4eab-496b-a587-60186a00464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:12.955442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22073-4eab-496b-a587-60186a00464c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.955878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22073-4eab-496b-a587-60186a00464c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.956646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22073-4eab-496b-a587-60186a00464c admin admin] PATH_INFO: `/v3/projects/4d6801916c224eb9adffbc6ac35c6e54/users/68fbae6daff840b9a7c1e1473c798064/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:12.965149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce22073-4eab-496b-a587-60186a00464c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6801916c224eb9adffbc6ac35c6e54, user_id=68fbae6daff840b9a7c1e1473c798064, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:12.974039 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2283/4616] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:12 2022] DELETE /identity/v3/users/74a0858925594f46abe5b118d5b9cd5c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:12.977188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce22073-4eab-496b-a587-60186a00464c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:12.986761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:12.987053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:12.987332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:13.008469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2334/4617] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:12 2022] PUT /identity/v3/projects/4d6801916c224eb9adffbc6ac35c6e54/users/68fbae6daff840b9a7c1e1473c798064/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:13.053398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:13.060704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:13.224911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:13.225757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:13.226190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:13.265272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2284/4618] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:13.282171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:13.283592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:13.298562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:13.300249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:13.444445 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2335/4619] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:13.445707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6db48-768a-4634-b5be-f327a77d2dfe None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:13.457755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:13.460077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:13.469315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:13.470642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:13.471099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:13.472672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:13.496207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:13.502364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:13.536995 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2285/4620] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:13.602071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04917-6ba9-4472-a40a-0b39942dcc63 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:13.619790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a737eb3-58ca-48a6-bc61-3bb155ba1415 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:13.620618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737eb3-58ca-48a6-bc61-3bb155ba1415 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:13.620949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737eb3-58ca-48a6-bc61-3bb155ba1415 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:13.621557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737eb3-58ca-48a6-bc61-3bb155ba1415 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:13.639665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a737eb3-58ca-48a6-bc61-3bb155ba1415 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:13.641690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a737eb3-58ca-48a6-bc61-3bb155ba1415 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:13.660147 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2336/4621] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:13.847817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:13.849315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:13.874858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db478b-475f-4183-a672-66c7eb095622 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:13.886736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:13.887660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:13.888067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:13.888349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] PATH_INFO: `/v3/users/ed877c637f014bc58747a6fccfeb4e34` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:13.890340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed877c637f014bc58747a6fccfeb4e34)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:13.892316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:14.006863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed877c637f014bc58747a6fccfeb4e34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.009518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed877c637f014bc58747a6fccfeb4e34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.025743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed877c637f014bc58747a6fccfeb4e34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.026687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed877c637f014bc58747a6fccfeb4e34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.044743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed877c637f014bc58747a6fccfeb4e34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.078392 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2286/4622] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:13 2022] DELETE /identity/v3/users/ed877c637f014bc58747a6fccfeb4e34 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:14.080147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:14.080437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:14.080959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:14.110773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:14.112118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:14.140014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:14.141591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:14.356741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ce9d2-9ae5-443a-92b4-3d4c401ea12c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:14.371369 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2337/4623] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:14.372017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:14.374124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:14.374924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:14.377233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] PATH_INFO: `/v3/projects/908077e72b074d329cbadde4f81ad666` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:14.379036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908077e72b074d329cbadde4f81ad666)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:14.380472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:14.383951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:14.384796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:14.539563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43dc3d-66b4-4b9e-a9d6-68eba690c4fb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:14.555348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908077e72b074d329cbadde4f81ad666', 'request_id': 'req-eeb5bcf2-0499-4fbe-be72-749fb37555a9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.582027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908077e72b074d329cbadde4f81ad666', 'request_id': 'req-eeb5bcf2-0499-4fbe-be72-749fb37555a9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.610118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908077e72b074d329cbadde4f81ad666', 'request_id': 'req-eeb5bcf2-0499-4fbe-be72-749fb37555a9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.640693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] The token cache is being invalidate because project 908077e72b074d329cbadde4f81ad666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:14.641989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.643573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.648674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2287/4624] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:14 2022] DELETE /identity/v3/projects/908077e72b074d329cbadde4f81ad666 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:14.654989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:14.665085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:14.745518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:14.746395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:14.747149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:14.747651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:14.756007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:14.826063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5bcf2-0499-4fbe-be72-749fb37555a9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:14.831398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:14.832306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:14.833735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:14.834023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] PATH_INFO: `/v3/users/0abd5ca4e5c741d4b1984c4fd2f89c81` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:14.835302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abd5ca4e5c741d4b1984c4fd2f89c81)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:14.837734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:14.917264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abd5ca4e5c741d4b1984c4fd2f89c81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.918098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abd5ca4e5c741d4b1984c4fd2f89c81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.931171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abd5ca4e5c741d4b1984c4fd2f89c81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.933410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abd5ca4e5c741d4b1984c4fd2f89c81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.946585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:14.952721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:14.964046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abd5ca4e5c741d4b1984c4fd2f89c81'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:14.974092 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2338/4625] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:14.991457 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2288/4626] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:14 2022] DELETE /identity/v3/users/0abd5ca4e5c741d4b1984c4fd2f89c81 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:15.929231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:15.931051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:15.944664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940a75-9dbf-4414-9c39-a5746f8ecd70 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:16.072655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:16.073629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:16.074121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:16.074576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] PATH_INFO: `/v3/users/6ea522ee568943d6afe754d6c86668f6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:16.076131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea522ee568943d6afe754d6c86668f6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:16.078711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:16.146178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea522ee568943d6afe754d6c86668f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.147101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea522ee568943d6afe754d6c86668f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.156796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea522ee568943d6afe754d6c86668f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.208139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea522ee568943d6afe754d6c86668f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.210304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea522ee568943d6afe754d6c86668f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.276742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2339/4627] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:15 2022] DELETE /identity/v3/users/6ea522ee568943d6afe754d6c86668f6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:16.586286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:16.592672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:16.621788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e99e9-a722-4ac2-8f30-fdba7cbf5e2e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:16.707768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:16.708813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:16.709271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:16.709647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] PATH_INFO: `/v3/projects/51c02d879e224b7784e94c35d28978fa` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:16.711772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c02d879e224b7784e94c35d28978fa)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:16.717015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:16.800377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c02d879e224b7784e94c35d28978fa', 'request_id': 'req-c1fa17f1-7120-48eb-8692-9069008f72c0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.807408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c02d879e224b7784e94c35d28978fa', 'request_id': 'req-c1fa17f1-7120-48eb-8692-9069008f72c0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.816809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:16.818367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:16.829959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c02d879e224b7784e94c35d28978fa', 'request_id': 'req-c1fa17f1-7120-48eb-8692-9069008f72c0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.841394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c43165-22bc-4a75-a3dc-69a7a15d8ae7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:16.861785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] The token cache is being invalidate because project 51c02d879e224b7784e94c35d28978fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:16.862109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.865825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c1fa17f1-7120-48eb-8692-9069008f72c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:16.880700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2289/4628] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:16 2022] DELETE /identity/v3/projects/51c02d879e224b7784e94c35d28978fa => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:16.883485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ced98-8928-46f6-9d01-570b27c9214b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:16.883893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ced98-8928-46f6-9d01-570b27c9214b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:16.884717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ced98-8928-46f6-9d01-570b27c9214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:16.921846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c61ced98-8928-46f6-9d01-570b27c9214b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:16.923417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c61ced98-8928-46f6-9d01-570b27c9214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:16.933368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:16.934262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:16.934538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:16.934808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] PATH_INFO: `/v3/projects/03a7dc1801724ff7b8cba8101743fa7e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:16.936095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a7dc1801724ff7b8cba8101743fa7e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:16.938119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.039497 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2290/4629] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:17.041473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a7dc1801724ff7b8cba8101743fa7e', 'request_id': 'req-efa01a3c-c547-4f41-a15f-de13e7ea0a90'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.042366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d70ac-71df-4f68-a06c-e5f22169a65d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.042843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d70ac-71df-4f68-a06c-e5f22169a65d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.043302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d70ac-71df-4f68-a06c-e5f22169a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.053413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a7dc1801724ff7b8cba8101743fa7e', 'request_id': 'req-efa01a3c-c547-4f41-a15f-de13e7ea0a90'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.067806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-020d70ac-71df-4f68-a06c-e5f22169a65d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:17.071600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a7dc1801724ff7b8cba8101743fa7e', 'request_id': 'req-efa01a3c-c547-4f41-a15f-de13e7ea0a90'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.072842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-020d70ac-71df-4f68-a06c-e5f22169a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:17.098897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] The token cache is being invalidate because project 03a7dc1801724ff7b8cba8101743fa7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:17.099548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.101736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-efa01a3c-c547-4f41-a15f-de13e7ea0a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.106505 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2340/4630] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:16 2022] DELETE /identity/v3/projects/03a7dc1801724ff7b8cba8101743fa7e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:17.112259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0ad5-2a99-4d4e-a90a-e3b4fc0be3c8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.112611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0ad5-2a99-4d4e-a90a-e3b4fc0be3c8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.112960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0ad5-2a99-4d4e-a90a-e3b4fc0be3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.153319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-46dc0ad5-2a99-4d4e-a90a-e3b4fc0be3c8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:17.155463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46dc0ad5-2a99-4d4e-a90a-e3b4fc0be3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:17.210810 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2291/4631] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:17.213766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d70ac-71df-4f68-a06c-e5f22169a65d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.250605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d70ac-71df-4f68-a06c-e5f22169a65d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.274222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.274908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.275192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.275464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.276208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:17.276520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.283303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.321128 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2292/4632] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:17.322135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.330599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:17.341481 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2341/4633] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:17.342380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc0ad5-2a99-4d4e-a90a-e3b4fc0be3c8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.371385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc0ad5-2a99-4d4e-a90a-e3b4fc0be3c8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.372841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa852c5-e53f-4fda-9d15-cfb8c863ca63 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.388395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.389284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513ff1-dbe2-494e-a046-d3d65f1a75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.394411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513ff1-dbe2-494e-a046-d3d65f1a75ac admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.395059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513ff1-dbe2-494e-a046-d3d65f1a75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.395792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.396237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513ff1-dbe2-494e-a046-d3d65f1a75ac admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.396709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.397631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513ff1-dbe2-494e-a046-d3d65f1a75ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.398081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] PATH_INFO: `/v3/projects/bfb1a94e7e044a6390e09032a39366f8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.401800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb1a94e7e044a6390e09032a39366f8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.405206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513ff1-dbe2-494e-a046-d3d65f1a75ac admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.408870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.513953 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2342/4634] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:17.514407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c11b-63b5-4bd2-bfc9-20cdee028191 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.514963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c11b-63b5-4bd2-bfc9-20cdee028191 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.515327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c11b-63b5-4bd2-bfc9-20cdee028191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.538339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb1a94e7e044a6390e09032a39366f8', 'request_id': 'req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.567659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb1a94e7e044a6390e09032a39366f8', 'request_id': 'req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.590741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-95b9c11b-63b5-4bd2-bfc9-20cdee028191 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:17.590741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-95b9c11b-63b5-4bd2-bfc9-20cdee028191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:17.597073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb1a94e7e044a6390e09032a39366f8', 'request_id': 'req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.620865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] The token cache is being invalidate because project bfb1a94e7e044a6390e09032a39366f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:17.621218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.622154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:17.624153 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2293/4635] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:17 2022] DELETE /identity/v3/projects/bfb1a94e7e044a6390e09032a39366f8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:17.625058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.629616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:17.736659 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2343/4636] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:17.738986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58cf7c-18b3-476f-b9f8-7a26329a720e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.739270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58cf7c-18b3-476f-b9f8-7a26329a720e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.739542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58cf7c-18b3-476f-b9f8-7a26329a720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.749178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c5ad4-8ead-4966-a72f-c1aa6f2dff22 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.760889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8f58cf7c-18b3-476f-b9f8-7a26329a720e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:17.761136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b378-7075-4dd8-af5b-4f96a5ba1485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.762246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8f58cf7c-18b3-476f-b9f8-7a26329a720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:17.762395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b378-7075-4dd8-af5b-4f96a5ba1485 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.762581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b378-7075-4dd8-af5b-4f96a5ba1485 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.762976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b378-7075-4dd8-af5b-4f96a5ba1485 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.763686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b378-7075-4dd8-af5b-4f96a5ba1485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.768014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b378-7075-4dd8-af5b-4f96a5ba1485 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.781022 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2344/4637] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:17.782226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58cf7c-18b3-476f-b9f8-7a26329a720e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.799690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58cf7c-18b3-476f-b9f8-7a26329a720e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.804603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.805314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.805590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.805860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.806592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:17.807072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.809635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.818671 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2294/4638] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:17.820319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065a24-0e57-4e6d-897c-ea55f45c5f64 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.820703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065a24-0e57-4e6d-897c-ea55f45c5f64 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.821055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065a24-0e57-4e6d-897c-ea55f45c5f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.830312 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2345/4639] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:17.831284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.842718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afffd-a057-42df-bf6d-8f91e4f8c4ea admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.846403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fb065a24-0e57-4e6d-897c-ea55f45c5f64 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:17.847943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fb065a24-0e57-4e6d-897c-ea55f45c5f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:17.850732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.851434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.851791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.852111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.852924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.864595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2295/4640] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:17.865615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065a24-0e57-4e6d-897c-ea55f45c5f64 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.868360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.877799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065a24-0e57-4e6d-897c-ea55f45c5f64 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.884399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.884778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.885643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.885643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.886512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.890774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.898666 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2346/4641] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:17.898666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.917056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8198547-fa8d-4e0f-a2d3-82dc027d5736 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:17.922978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:17.923882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:17.924161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:17.924482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:17.925253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:17.925557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:17.925670 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2296/4642] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:17.926552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.928390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:17.976875 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2347/4643] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:17.976875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:17.991414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b5d0-e1a2-4e6b-b67d-05da8a647011 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.029355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f08b1-a780-4604-9f2c-bddb09709c41 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.036596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.037312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.037560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.038689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.039447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.041590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.059070 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2297/4644] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:18.059737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.075682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56180916-b935-48b5-93bf-3bdfaba2ffdb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.082813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.084933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.085232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.085512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.086737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.088497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.091734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.092976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.093509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.094060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.095267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.098007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.128804 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2348/4645] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:17 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:18.130441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.135157 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2298/4646] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:18 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:18.136534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.148456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003cbf9-876b-48ac-856f-4359a16ab008 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.234603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.236437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.236929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.237332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] PATH_INFO: `/v3/projects/a26e39efdcff44dfa8dc48847980d082/users/2d83159c33ef41dd98376449d9648b54/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.247918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32b38-7a51-4a62-84ba-bc5fb19ad352 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.254950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.256017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.257125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.257424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.258474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.259046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26e39efdcff44dfa8dc48847980d082, user_id=2d83159c33ef41dd98376449d9648b54, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.263809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.265946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.295282 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2299/4647] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:18.299476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.302020 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2349/4648] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:18 2022] PUT /identity/v3/projects/a26e39efdcff44dfa8dc48847980d082/users/2d83159c33ef41dd98376449d9648b54/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:18.303512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.325108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd1ec2-5095-41fb-9d09-f71b62af4f42 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.485414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f50937-43ed-4d18-ba5f-608cf2da638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.486664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50937-43ed-4d18-ba5f-608cf2da638a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.487206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50937-43ed-4d18-ba5f-608cf2da638a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.487875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50937-43ed-4d18-ba5f-608cf2da638a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.493657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f50937-43ed-4d18-ba5f-608cf2da638a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.497828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f50937-43ed-4d18-ba5f-608cf2da638a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.524389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c79e8-887a-4bed-ad75-3bd11e48f2be admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.539386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.540014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.540292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.540560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.541335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.543006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.550561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2300/4649] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:18 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:18.560799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad478-e26e-4720-b8f9-8bcb66137f38 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.560799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad478-e26e-4720-b8f9-8bcb66137f38 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.560799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad478-e26e-4720-b8f9-8bcb66137f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.572562 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2350/4650] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:18.573546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.593974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075a9f8-7861-4a6d-ae31-e623ce09e9fd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.608454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.609199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.609905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.610182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.610920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.611368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-62fad478-e26e-4720-b8f9-8bcb66137f38 None None] MFA Rules not processed for user `2d83159c33ef41dd98376449d9648b54`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:18.612558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.612683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62fad478-e26e-4720-b8f9-8bcb66137f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:18.629496 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2351/4651] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:18.630903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.654121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0a7c-adfe-4a57-83fe-684445ea5780 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.660099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.661302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.661583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.661853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] PATH_INFO: `/v3/projects/e2dca73848814ebd9b8de59672a8f61d/users/de2ef580d1d441d29a9a59630a00e7b1/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.685249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dca73848814ebd9b8de59672a8f61d, user_id=de2ef580d1d441d29a9a59630a00e7b1, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.689973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.712517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2352/4652] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:18 2022] PUT /identity/v3/projects/e2dca73848814ebd9b8de59672a8f61d/users/de2ef580d1d441d29a9a59630a00e7b1/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:18.713521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.724340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2301/4653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:18.726160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673eef5-8770-4ca3-9058-e7056f6cb5bc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.726444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673eef5-8770-4ca3-9058-e7056f6cb5bc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.726715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673eef5-8770-4ca3-9058-e7056f6cb5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.779495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a673eef5-8770-4ca3-9058-e7056f6cb5bc None None] MFA Rules not processed for user `de2ef580d1d441d29a9a59630a00e7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:18.781831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a673eef5-8770-4ca3-9058-e7056f6cb5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:18.795185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad781-9345-4a26-8e27-64b5dd1a0f11 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.808199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.808897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.809233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.809501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.810227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.813461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.839478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2353/4654] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:18.839478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.843008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:18.894419 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2302/4655] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:18.895865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673eef5-8770-4ca3-9058-e7056f6cb5bc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:18.910664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673eef5-8770-4ca3-9058-e7056f6cb5bc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.918542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:18.919900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:18.920437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:18.920929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] PATH_INFO: `/v3/projects/05f4a6d024fc4c758fe434c42500712f/users/391775bcb52b46c58b0fb0957a4f9f40/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:18.940021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f4a6d024fc4c758fe434c42500712f, user_id=391775bcb52b46c58b0fb0957a4f9f40, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:18.944599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:18.958408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9c711-03fd-4974-9c91-3550a64169eb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:18.969635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2303/4656] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:18 2022] PUT /identity/v3/projects/05f4a6d024fc4c758fe434c42500712f/users/391775bcb52b46c58b0fb0957a4f9f40/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:18.971367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.038332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.040648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.040928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.041245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.071298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e58496-e12f-4ae0-8d52-2dcf0bcc5c03 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.077167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddd130-5c15-43c0-9296-dbe461f36c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.077895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddd130-5c15-43c0-9296-dbe461f36c1b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.078167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddd130-5c15-43c0-9296-dbe461f36c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.078448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddd130-5c15-43c0-9296-dbe461f36c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.079159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddd130-5c15-43c0-9296-dbe461f36c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.081161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddd130-5c15-43c0-9296-dbe461f36c1b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.127426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2304/4657] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:18 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:19.129475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.130002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.130493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.147321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.148796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.150521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:19.151981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:19.159033 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2354/4658] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:19.159871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.172479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2938d1-e6ae-4168-99f7-ee417302cffd service glance] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.235223 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2305/4659] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:19.244969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.246902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:19.250151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.250854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.251132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.251435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.252131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.254952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.299313 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2355/4660] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:19 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:19.300464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.320719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3757-8e37-4ca7-9bb2-c08ebf755c94 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.327314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.328015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.328296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.328722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.329496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.331600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.340041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e7410-3110-48f7-aec6-8a66779b18fa None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.348036 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2356/4661] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:19.351502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.352716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.354026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.354494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.354977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.365950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c5f5-e8d4-4f64-bbc2-c3a131acb769 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.369964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.374482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.375868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.377979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.379030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.379030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] PATH_INFO: `/v3/projects/cf7f62c8b7834f2fa455bea84afd57c2/users/31d17a973e8f47138084605ec733409e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.396263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7f62c8b7834f2fa455bea84afd57c2, user_id=31d17a973e8f47138084605ec733409e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.397603 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2306/4662] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:09:19.399705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.420903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.425575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2357/4663] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:19 2022] PUT /identity/v3/projects/cf7f62c8b7834f2fa455bea84afd57c2/users/31d17a973e8f47138084605ec733409e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:19.430609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.434477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05f95-ebe4-4e99-86b9-f932be72d3f3 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.534609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.535796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.536082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.536514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] PATH_INFO: `/v3/users/2d83159c33ef41dd98376449d9648b54` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.537931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d83159c33ef41dd98376449d9648b54)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.540989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.549745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a82a2-b973-453a-aaef-eaf8121412f3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.566097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.566965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.567447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.567731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.568552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.570166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.599218 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2358/4664] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:19.602263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.624424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c0ed-2419-4491-8ac0-e7039fbb7cce admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.633130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fe9e1-bfb8-477d-b2a7-14795d903990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.634181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe9e1-bfb8-477d-b2a7-14795d903990 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.634533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe9e1-bfb8-477d-b2a7-14795d903990 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.634874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe9e1-bfb8-477d-b2a7-14795d903990 admin admin] PATH_INFO: `/v3/projects/cf7f62c8b7834f2fa455bea84afd57c2/users/31d17a973e8f47138084605ec733409e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.637343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe9e1-bfb8-477d-b2a7-14795d903990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7f62c8b7834f2fa455bea84afd57c2, user_id=31d17a973e8f47138084605ec733409e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.640361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe9e1-bfb8-477d-b2a7-14795d903990 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.640660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d83159c33ef41dd98376449d9648b54'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:19.641418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d83159c33ef41dd98376449d9648b54'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:19.649667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d83159c33ef41dd98376449d9648b54'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:19.650259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d83159c33ef41dd98376449d9648b54'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:19.655415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2359/4665] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:19 2022] PUT /identity/v3/projects/cf7f62c8b7834f2fa455bea84afd57c2/users/31d17a973e8f47138084605ec733409e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:19.664408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5013-f28e-4d65-ac8d-028ef701a47b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.665176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5013-f28e-4d65-ac8d-028ef701a47b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.665176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5013-f28e-4d65-ac8d-028ef701a47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.668307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f3232ae2-e6d0-4fd4-8951-19bc0d17e28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d83159c33ef41dd98376449d9648b54'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:19.693840 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2307/4666] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:19 2022] DELETE /identity/v3/users/2d83159c33ef41dd98376449d9648b54 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:19.698560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.698919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.699321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.729193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:19.733547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:19.751043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-34ac5013-f28e-4d65-ac8d-028ef701a47b None None] MFA Rules not processed for user `31d17a973e8f47138084605ec733409e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:19.752415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-34ac5013-f28e-4d65-ac8d-028ef701a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:19.836693 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2308/4667] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:19.853853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.855417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:19.922123 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2360/4668] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:19.926711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5013-f28e-4d65-ac8d-028ef701a47b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:19.949663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5013-f28e-4d65-ac8d-028ef701a47b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.954775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a65f67-1597-4e2b-8dae-96145d9b61c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:19.956737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.957642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.959394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.959784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.961499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.964595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:19.966088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:19.966578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.968997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:19.969403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:19.986486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:19.993001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:19.996356 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2361/4669] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:09:19 2022] POST /identity/v3/services => generated 240 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:19.998486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.012711 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2309/4670] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:20.023703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b694f-b7bc-4173-96c1-6800edcfc2af tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.029570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.030490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.030776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.031054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/dc3a1a7157764d55aa49cbb25e297a66` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.031750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dc3a1a7157764d55aa49cbb25e297a66)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.033517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.068951 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2362/4671] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:19 2022] DELETE /identity/v3/services/dc3a1a7157764d55aa49cbb25e297a66 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:20.070267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.084418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440806a6-60a7-4821-a67a-c23a98273e63 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.109051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.111501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.113428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.115781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.116642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.118028 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:20.118028 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:09:20.118028 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:09:20.119519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.153347 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2310/4672] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:20 2022] POST /identity/v3/services => generated 287 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:20.154977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.166958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19010b-1483-4e04-b9bb-9a2e116737ef tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.185133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.186712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.187693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.188189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/b806d002e04c48b78881c00bd40aef9e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.189927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:update_service(service_id=b806d002e04c48b78881c00bd40aef9e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.192085 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:20.192085 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:09:20.192085 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:09:20.193548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.222912 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2363/4673] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Apr 9 21:09:20 2022] PATCH /identity/v3/services/b806d002e04c48b78881c00bd40aef9e => generated 280 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:20.224626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.241453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517858f9-d974-4c34-8216-9ec4d87c82c5 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.267111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.269051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.269476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.270249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/b806d002e04c48b78881c00bd40aef9e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.270445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:get_service(service_id=b806d002e04c48b78881c00bd40aef9e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.272306 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:20.272306 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:09:20.272306 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:09:20.273435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.292995 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2311/4674] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:09:20 2022] GET /identity/v3/services/b806d002e04c48b78881c00bd40aef9e => generated 280 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:20.294686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.309163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147921-59ba-4e32-b62a-7118460fe6ff tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.316537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.319447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.319447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.319447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/b806d002e04c48b78881c00bd40aef9e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.319447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b806d002e04c48b78881c00bd40aef9e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.321370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.356324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.356569 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2364/4675] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:20 2022] DELETE /identity/v3/services/b806d002e04c48b78881c00bd40aef9e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:20.374050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8bf95-06ce-4754-9b91-27cebc08a28e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.395262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.396380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.397832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.398428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/b806d002e04c48b78881c00bd40aef9e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.399177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:get_service(service_id=b806d002e04c48b78881c00bd40aef9e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.402711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.418769 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Could not find service: b806d002e04c48b78881c00bd40aef9e.: keystone.exception.ServiceNotFound: Could not find service: b806d002e04c48b78881c00bd40aef9e. Apr 09 21:09:20.427484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.445215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2312/4676] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:09:20 2022] GET /identity/v3/services/b806d002e04c48b78881c00bd40aef9e => generated 113 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:09:20.452876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b330e-2def-4dbb-9602-041fe12ddbbb tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.454462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.455173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.456001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.456343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.458304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.459954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.502260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.513750 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2365/4677] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:20 2022] POST /identity/v3/services => generated 273 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:20.518568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f768610-c6ba-466b-b50c-5eecf06cb0ec tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.559135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.562376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.562376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.564459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.565178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.566846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.594434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.611345 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2313/4678] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:20 2022] POST /identity/v3/services => generated 274 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:20.612611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ae89-eed2-4523-bc3e-342d9158adb0 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.638709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.639622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.640139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.640432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.641210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.643016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.660069 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2366/4679] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:20 2022] POST /identity/v3/services => generated 273 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:20.664203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.676404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f26719-0d5a-476d-b93f-7d3fb186e512 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.701233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.702642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.702943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.703259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.704375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.705181 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:20.705181 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:09:20.705181 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:09:20.706136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.716461 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2314/4680] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:09:20 2022] GET /identity/v3/services => generated 2975 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:20.721596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.740049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f0e06-81d9-48b8-bdd2-876ed19f7ee1 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.795788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.796267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.796547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.796834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.797202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.797863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-526191627) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:20.798171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.798280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:20.799209 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:20.799209 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:09:20.799209 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:09:20.800107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deae0cf-aeef-4f8c-840e-333b5b1a425c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.821303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2367/4681] 10.222.0.30 () {58 vars in 1219 bytes} [Sat Apr 9 21:09:20 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-526191627 => generated 415 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:20.821303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3e53-8454-4510-8bbe-ac78b1bc4669 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.821303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3e53-8454-4510-8bbe-ac78b1bc4669 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.821303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3e53-8454-4510-8bbe-ac78b1bc4669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.854887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde11be8-4887-4a0e-9b9b-c9fca3be410e tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:20.860323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7d0e3e53-8454-4510-8bbe-ac78b1bc4669 None None] MFA Rules not processed for user `391775bcb52b46c58b0fb0957a4f9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:20.861433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7d0e3e53-8454-4510-8bbe-ac78b1bc4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:20.862579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:20.863695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:20.863989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:20.864263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] PATH_INFO: `/v3/projects/a26e39efdcff44dfa8dc48847980d082` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:20.865565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26e39efdcff44dfa8dc48847980d082)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:20.868856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:20.965649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26e39efdcff44dfa8dc48847980d082', 'request_id': 'req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:20.966278 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2368/4682] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:20.967799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e3e53-8454-4510-8bbe-ac78b1bc4669 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:20.986198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26e39efdcff44dfa8dc48847980d082', 'request_id': 'req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:20.987565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e3e53-8454-4510-8bbe-ac78b1bc4669 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.001852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26e39efdcff44dfa8dc48847980d082', 'request_id': 'req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.025903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] The token cache is being invalidate because project a26e39efdcff44dfa8dc48847980d082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:21.026362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.030169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eacbca6d-5086-47ad-a0f5-120d0cf1caa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.033683 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2315/4683] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:20 2022] DELETE /identity/v3/projects/a26e39efdcff44dfa8dc48847980d082 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:21.035292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.035579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.035853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.079553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] MFA Rules not processed for user `391775bcb52b46c58b0fb0957a4f9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:21.080809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.085401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e206b-0c4d-46ba-8bd1-d36b04aa7a19 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.089762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e206b-0c4d-46ba-8bd1-d36b04aa7a19 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.090308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e206b-0c4d-46ba-8bd1-d36b04aa7a19 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.090807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e206b-0c4d-46ba-8bd1-d36b04aa7a19 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.091819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e206b-0c4d-46ba-8bd1-d36b04aa7a19 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-639661603) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:21.092338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e206b-0c4d-46ba-8bd1-d36b04aa7a19 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.094501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e206b-0c4d-46ba-8bd1-d36b04aa7a19 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.101245 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2369/4684] 10.222.0.30 () {58 vars in 1219 bytes} [Sat Apr 9 21:09:20 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-639661603 => generated 416 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:21.102733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c57b-56a2-4ef1-b443-1bf61f23c616 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.103088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c57b-56a2-4ef1-b443-1bf61f23c616 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.103430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c57b-56a2-4ef1-b443-1bf61f23c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.129354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e5f9c57b-56a2-4ef1-b443-1bf61f23c616 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:21.130689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e5f9c57b-56a2-4ef1-b443-1bf61f23c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.156014 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2316/4685] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:21.157411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.159547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.178406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45542b-095b-4281-9108-f492bbd9e35a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.183911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.184594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.184873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.185383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.186338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-237238208) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:21.186711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.188315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.194295 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2317/4686] 10.222.0.30 () {58 vars in 1219 bytes} [Sat Apr 9 21:09:21 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-237238208 => generated 415 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:21.198056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.208577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2d54-19ac-4ddb-811d-13c7e8810826 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.209919 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2370/4687] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3728 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:21.213418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.214284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.214560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.214826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/f0020d8151034f4ea54bb68ccc4f2dc6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.215471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f0020d8151034f4ea54bb68ccc4f2dc6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.217578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.218493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09fc5-531e-4520-a71d-c50ab80f4f6a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.219022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09fc5-531e-4520-a71d-c50ab80f4f6a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.219191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09fc5-531e-4520-a71d-c50ab80f4f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.238980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cbb09fc5-531e-4520-a71d-c50ab80f4f6a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:21.240384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cbb09fc5-531e-4520-a71d-c50ab80f4f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.242207 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2318/4688] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:21 2022] DELETE /identity/v3/services/f0020d8151034f4ea54bb68ccc4f2dc6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:21.246001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.262145 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2371/4689] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3562 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:21.267144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb09fc5-531e-4520-a71d-c50ab80f4f6a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.269639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fe428-feb9-4f51-b933-7e4a7b73eb7c tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.277815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.279385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.279698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.279812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb09fc5-531e-4520-a71d-c50ab80f4f6a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.279974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/7f37a91a4b9f4f46a0b15240f975482d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.280698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7f37a91a4b9f4f46a0b15240f975482d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.282366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.285670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.286348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.287180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.287594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.288335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:21.288645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.290326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.305654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2372/4690] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:21.310286 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2319/4691] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:21 2022] DELETE /identity/v3/services/7f37a91a4b9f4f46a0b15240f975482d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:21.310615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.314476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.323898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03fee-8362-45d2-a043-60509f560b03 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.343132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a27a-0c72-4bf5-a315-f9987dc97022 tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.344143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.344990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.345761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.346088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.347099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.349820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.350782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d17a973e8f47138084605ec733409e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f62c8b7834f2fa455bea84afd57c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.352175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.352622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.353132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] PATH_INFO: `/v3/services/32f5511a7e2849158a524f8eee2610dc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.354175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorizing `identity:delete_service(service_id=32f5511a7e2849158a524f8eee2610dc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.356267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.392967 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2373/4692] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:21 2022] POST /identity/v3/projects => generated 361 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:21.397065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.397783 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2320/4693] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:21 2022] DELETE /identity/v3/services/32f5511a7e2849158a524f8eee2610dc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:21.398780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.404367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.423147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088fbd6-8f8c-4e8c-8c6f-a60aa4f64c3d tempest-ServicesTestJSON-113628053 tempest-ServicesTestJSON-113628053-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.499456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.500146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.500428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.500700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.501432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.503439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.524258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed952-e287-4863-b529-fbbde00913eb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.532629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2321/4694] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:21 2022] POST /identity/v3/users => generated 281 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:21.532629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.532629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.544082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1840725-95c6-41a1-ac8e-25f0eea5ff01 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.546615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828a9b-caaa-47df-a875-947f190da6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.547414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828a9b-caaa-47df-a875-947f190da6b1 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.547916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828a9b-caaa-47df-a875-947f190da6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.548197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828a9b-caaa-47df-a875-947f190da6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.550016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f3828a9b-caaa-47df-a875-947f190da6b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.551206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.552117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.553082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.553459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] PATH_INFO: `/v3/users/de2ef580d1d441d29a9a59630a00e7b1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.554823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2ef580d1d441d29a9a59630a00e7b1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.556997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.629335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2ef580d1d441d29a9a59630a00e7b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.630712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2ef580d1d441d29a9a59630a00e7b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.632284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828a9b-caaa-47df-a875-947f190da6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.634183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828a9b-caaa-47df-a875-947f190da6b1 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.639758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2ef580d1d441d29a9a59630a00e7b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.641343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2ef580d1d441d29a9a59630a00e7b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.656443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2ef580d1d441d29a9a59630a00e7b1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:21.682899 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2322/4695] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:21 2022] DELETE /identity/v3/users/de2ef580d1d441d29a9a59630a00e7b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:21.683872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.685596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.686907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2374/4696] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:21.691498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064630d7-c063-420e-aef2-b2ce553e1123 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.691800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064630d7-c063-420e-aef2-b2ce553e1123 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.692081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064630d7-c063-420e-aef2-b2ce553e1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.767805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-064630d7-c063-420e-aef2-b2ce553e1123 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:21.768945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-064630d7-c063-420e-aef2-b2ce553e1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:21.842721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f719a-1abe-4c45-b815-d0fe495fcf5f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.849532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.851381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.852141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.852577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.853607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.872491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.891616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2323/4697] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:21.896933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.904026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2375/4698] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:21.913953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f8c83-b916-4adb-a62a-98cb83379d20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.919310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029600b-9465-4474-a899-384d386a791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.920282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029600b-9465-4474-a899-384d386a791f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.920822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029600b-9465-4474-a899-384d386a791f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.921328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029600b-9465-4474-a899-384d386a791f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.922260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029600b-9465-4474-a899-384d386a791f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.924086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029600b-9465-4474-a899-384d386a791f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.937949 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2324/4699] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:21.939306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064630d7-c063-420e-aef2-b2ce553e1123 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.953177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064630d7-c063-420e-aef2-b2ce553e1123 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:21.961485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f8e7-4d74-4c94-8a97-90366fe25788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:21.962523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f8e7-4d74-4c94-8a97-90366fe25788 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:21.963299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f8e7-4d74-4c94-8a97-90366fe25788 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:21.963591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f8e7-4d74-4c94-8a97-90366fe25788 admin admin] PATH_INFO: `/v3/projects/9e79f6656aec406fb1d9beb8123c47bf/users/fc2b13a9a1224800a0822a914f8b8f4b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:21.981973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f8e7-4d74-4c94-8a97-90366fe25788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e79f6656aec406fb1d9beb8123c47bf, user_id=fc2b13a9a1224800a0822a914f8b8f4b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:21.984908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f8e7-4d74-4c94-8a97-90366fe25788 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:21.989141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029600b-9465-4474-a899-384d386a791f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:21.991448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b029600b-9465-4474-a899-384d386a791f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:22.006981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2376/4700] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:21 2022] PUT /identity/v3/projects/9e79f6656aec406fb1d9beb8123c47bf/users/fc2b13a9a1224800a0822a914f8b8f4b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:22.018654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5167-d36b-45ad-aff9-f872a76b8c1b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:22.019244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5167-d36b-45ad-aff9-f872a76b8c1b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:22.019706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5167-d36b-45ad-aff9-f872a76b8c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:22.080053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c4bb5167-d36b-45ad-aff9-f872a76b8c1b None None] MFA Rules not processed for user `fc2b13a9a1224800a0822a914f8b8f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:22.081090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c4bb5167-d36b-45ad-aff9-f872a76b8c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:22.081728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029600b-9465-4474-a899-384d386a791f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:22.140042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7242b6c-5c28-40bc-8464-5536d662317c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:22.141434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7242b6c-5c28-40bc-8464-5536d662317c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:22.141717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7242b6c-5c28-40bc-8464-5536d662317c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:22.141994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7242b6c-5c28-40bc-8464-5536d662317c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:22.226026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2377/4701] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:22.242726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5167-d36b-45ad-aff9-f872a76b8c1b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:22.267185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7242b6c-5c28-40bc-8464-5536d662317c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:22.269486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7242b6c-5c28-40bc-8464-5536d662317c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:22.292053 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2325/4702] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:09:22.336433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5167-d36b-45ad-aff9-f872a76b8c1b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:22.342381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:22.344406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:22.344902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:22.345228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] PATH_INFO: `/v3/users/fc2b13a9a1224800a0822a914f8b8f4b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:22.347359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2b13a9a1224800a0822a914f8b8f4b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:22.350472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:22.430951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2b13a9a1224800a0822a914f8b8f4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:22.431823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2b13a9a1224800a0822a914f8b8f4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:22.472581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2b13a9a1224800a0822a914f8b8f4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:22.493178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2b13a9a1224800a0822a914f8b8f4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:22.496788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2b13a9a1224800a0822a914f8b8f4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:22.551614 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2378/4703] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:22 2022] DELETE /identity/v3/users/fc2b13a9a1224800a0822a914f8b8f4b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:22.556561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:22.557516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:22.557997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:22.590774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:22.592193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:22.725076 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2326/4704] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:22.769569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:22.771478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:22.912356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc55969-bccb-4548-af42-22bc766a25bd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:22.923441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:22.927332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:22.927942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:22.928478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:22.943310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:22.945211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:22.957588 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2379/4705] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:23.399748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:23.401267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:23.428388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ba4cb-8f98-41c3-a341-ecb9176f73a9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:23.442328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:23.444156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:23.446548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:23.447169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] PATH_INFO: `/v3/projects/e2dca73848814ebd9b8de59672a8f61d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:23.450446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dca73848814ebd9b8de59672a8f61d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:23.457527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:23.572368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dca73848814ebd9b8de59672a8f61d', 'request_id': 'req-db90b683-3c1f-42c4-90a5-9f18d09361cd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.584737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dca73848814ebd9b8de59672a8f61d', 'request_id': 'req-db90b683-3c1f-42c4-90a5-9f18d09361cd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.598353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dca73848814ebd9b8de59672a8f61d', 'request_id': 'req-db90b683-3c1f-42c4-90a5-9f18d09361cd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.623413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] The token cache is being invalidate because project e2dca73848814ebd9b8de59672a8f61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:23.624365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.625526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.630398 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2327/4706] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:23 2022] DELETE /identity/v3/projects/e2dca73848814ebd9b8de59672a8f61d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:23.634916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:23.654915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d55b2-faf4-4f90-8d85-651b759c9c3b service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:23.728353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:23.729429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:23.729828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:23.730193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] PATH_INFO: `/v3/users/31d17a973e8f47138084605ec733409e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:23.732756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d17a973e8f47138084605ec733409e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:23.734631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:23.877018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d17a973e8f47138084605ec733409e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.878795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d17a973e8f47138084605ec733409e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.895014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d17a973e8f47138084605ec733409e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.905228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:23.906762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:23.921562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d17a973e8f47138084605ec733409e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.922507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45bb574b-de27-4b7e-aaa1-ae15621fd5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d17a973e8f47138084605ec733409e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:23.928983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b683-3c1f-42c4-90a5-9f18d09361cd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:23.945899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:23.946819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:23.947111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:23.947389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] PATH_INFO: `/v3/projects/9e79f6656aec406fb1d9beb8123c47bf` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:23.948742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e79f6656aec406fb1d9beb8123c47bf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:23.950812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:23.962972 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2380/4707] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:23 2022] DELETE /identity/v3/users/31d17a973e8f47138084605ec733409e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:24.051729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e79f6656aec406fb1d9beb8123c47bf', 'request_id': 'req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:24.068596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e79f6656aec406fb1d9beb8123c47bf', 'request_id': 'req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:24.082444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e79f6656aec406fb1d9beb8123c47bf', 'request_id': 'req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:24.100438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] The token cache is being invalidate because project 9e79f6656aec406fb1d9beb8123c47bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:24.100728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:24.102550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b0ddb1fd-6f61-453b-83b5-3b7a1d96949f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:24.105376 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2328/4708] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:23 2022] DELETE /identity/v3/projects/9e79f6656aec406fb1d9beb8123c47bf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:24.110533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100a410-75ae-4ad9-bd90-5b5f6c809d1f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.111285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100a410-75ae-4ad9-bd90-5b5f6c809d1f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.111940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100a410-75ae-4ad9-bd90-5b5f6c809d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.168990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f100a410-75ae-4ad9-bd90-5b5f6c809d1f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:24.170940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f100a410-75ae-4ad9-bd90-5b5f6c809d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:24.325117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2381/4709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:24.330204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484b0e-c977-492d-89fe-3d8fe9d90257 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.330490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484b0e-c977-492d-89fe-3d8fe9d90257 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.330802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484b0e-c977-492d-89fe-3d8fe9d90257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.361021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a8484b0e-c977-492d-89fe-3d8fe9d90257 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:24.362650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a8484b0e-c977-492d-89fe-3d8fe9d90257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:24.380557 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2329/4710] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:24.386179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100a410-75ae-4ad9-bd90-5b5f6c809d1f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:24.404879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100a410-75ae-4ad9-bd90-5b5f6c809d1f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:24.422525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:24.423301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.423579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.423845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.424596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:24.424885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:24.426744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:24.443572 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2382/4711] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:24.448146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484b0e-c977-492d-89fe-3d8fe9d90257 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:24.465867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484b0e-c977-492d-89fe-3d8fe9d90257 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:24.473978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:24.474802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.475181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.475563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.476625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:24.478670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:24.542921 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2330/4712] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:24 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:24.547407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:24.559809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaaaa7-4758-4898-9061-b9d68f02afc2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:24.668859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:24.669807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.670179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.670548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.671425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:24.674112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:24.707686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:24.707932 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2383/4713] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:24 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:24.718782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97568302-685c-42c5-88cf-aa6f4e72c595 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:24.739665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:24.740645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.741424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.741884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.742893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:24.744758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:24.758069 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2331/4714] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:24.761984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:24.774838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca8a05-e11f-4abc-ade7-aac1ed5c624c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:24.783677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c02bf-d901-4bec-a679-b97738a0a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:24.785118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c02bf-d901-4bec-a679-b97738a0a167 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.785598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c02bf-d901-4bec-a679-b97738a0a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.786029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c02bf-d901-4bec-a679-b97738a0a167 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.786924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c02bf-d901-4bec-a679-b97738a0a167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:24.788985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c02bf-d901-4bec-a679-b97738a0a167 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:24.804787 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2384/4715] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:24.808856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:24.827870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b685b-5aa7-4fec-a58a-8b6e1babcc9d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:24.835089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bdc53-b265-4a46-b0a6-ed217f15ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:24.837275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bdc53-b265-4a46-b0a6-ed217f15ef4d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.837804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bdc53-b265-4a46-b0a6-ed217f15ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.838813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bdc53-b265-4a46-b0a6-ed217f15ef4d admin admin] PATH_INFO: `/v3/projects/4a94302830a44583bf2297a0898711e9/users/3ded00a7449c429baae75eedaab29850/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.867788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bdc53-b265-4a46-b0a6-ed217f15ef4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a94302830a44583bf2297a0898711e9, user_id=3ded00a7449c429baae75eedaab29850, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:24.871423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bdc53-b265-4a46-b0a6-ed217f15ef4d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:24.905279 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2332/4716] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:24 2022] PUT /identity/v3/projects/4a94302830a44583bf2297a0898711e9/users/3ded00a7449c429baae75eedaab29850/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:24.907026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2d828-2e76-4093-967c-81f826aea515 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.907324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2d828-2e76-4093-967c-81f826aea515 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.907616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2d828-2e76-4093-967c-81f826aea515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.948413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:24.948708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:24.949335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:24.959618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d4b2d828-2e76-4093-967c-81f826aea515 None None] MFA Rules not processed for user `3ded00a7449c429baae75eedaab29850`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:24.960909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d4b2d828-2e76-4093-967c-81f826aea515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:24.980168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] MFA Rules not processed for user `68fbae6daff840b9a7c1e1473c798064`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:24.981449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:25.056352 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2385/4717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:25.061240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2d828-2e76-4093-967c-81f826aea515 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.106333 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2333/4718] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:25.119500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.120987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:25.157834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2d828-2e76-4093-967c-81f826aea515 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.164078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.169931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.170228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.170510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.171308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.173533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.213020 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2386/4719] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:25 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:25.216945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.235968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554b315-cf76-467e-b5b0-a26f0dbd8f60 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.331126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c284-23e7-423b-b74c-f94dbaa4c527 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.338296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.339202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.340081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.340575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.342833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.346795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.351157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.352249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.352765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.353351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.355608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:25.379523 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2387/4720] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:25 2022] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:25.383921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.399793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb540ea-8a7b-400e-90f7-fb85600a590f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.405121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.405859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.406134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.406437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.407145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.408759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.429286 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2388/4721] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:25.430902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.450299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96933b68-8c79-4a50-b907-9cfb19f2f21a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.458360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.458360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.458640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.458847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] PATH_INFO: `/v3/projects/8ad9f816a8b34e6aa6e4620a5a4ff8fa/users/e45cc10ebea14103bf370795bd7dd123/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.474496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.476769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.479869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad9f816a8b34e6aa6e4620a5a4ff8fa, user_id=e45cc10ebea14103bf370795bd7dd123, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.483006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.511265 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2389/4722] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:25 2022] PUT /identity/v3/projects/8ad9f816a8b34e6aa6e4620a5a4ff8fa/users/e45cc10ebea14103bf370795bd7dd123/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:25.515032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.520718 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2334/4723] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:09:25.521987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.526594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:25.548999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04189-4a81-429b-854e-c521b6a58296 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.629695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b774d-05b5-4958-a67e-7c70998ea668 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.636688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.637680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.638022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.638359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] PATH_INFO: `/v3/projects/cf7f62c8b7834f2fa455bea84afd57c2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.639805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7f62c8b7834f2fa455bea84afd57c2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.642214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.656087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.657574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.657864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.658135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.658877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.660654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.704604 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2335/4724] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:25.709006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:25.709226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7f62c8b7834f2fa455bea84afd57c2', 'request_id': 'req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:25.719277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7f62c8b7834f2fa455bea84afd57c2', 'request_id': 'req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:25.734272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf51b-e8e4-4820-9785-648b47fc48ad admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:25.736295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7f62c8b7834f2fa455bea84afd57c2', 'request_id': 'req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:25.755892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] The token cache is being invalidate because project cf7f62c8b7834f2fa455bea84afd57c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:25.758290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:25.761377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ac8b4e4f-19af-47da-9bc4-b6ff7f2bb60b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:25.766761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2390/4725] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:25 2022] DELETE /identity/v3/projects/cf7f62c8b7834f2fa455bea84afd57c2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:25.773078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27e02c-9b61-4caa-b3c0-dfbd3147cc20 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.773506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27e02c-9b61-4caa-b3c0-dfbd3147cc20 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.773877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27e02c-9b61-4caa-b3c0-dfbd3147cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.802780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7f27e02c-9b61-4caa-b3c0-dfbd3147cc20 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:25.804101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7f27e02c-9b61-4caa-b3c0-dfbd3147cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:25.845433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4833-33f9-403e-96e9-db3e038621ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:25.847123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4833-33f9-403e-96e9-db3e038621ca admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.847615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4833-33f9-403e-96e9-db3e038621ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.847983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4833-33f9-403e-96e9-db3e038621ca admin admin] PATH_INFO: `/v3/projects/8ad9f816a8b34e6aa6e4620a5a4ff8fa/users/e45cc10ebea14103bf370795bd7dd123/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.850621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4833-33f9-403e-96e9-db3e038621ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad9f816a8b34e6aa6e4620a5a4ff8fa, user_id=e45cc10ebea14103bf370795bd7dd123, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:25.854441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4833-33f9-403e-96e9-db3e038621ca admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:25.900221 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2336/4726] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:25 2022] PUT /identity/v3/projects/8ad9f816a8b34e6aa6e4620a5a4ff8fa/users/e45cc10ebea14103bf370795bd7dd123/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:25.903978 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2391/4727] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:25.906280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.906762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.906844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.924603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dcd62-7129-4f91-95a8-77e40b0f8a9d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:25.924894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dcd62-7129-4f91-95a8-77e40b0f8a9d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:25.925199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dcd62-7129-4f91-95a8-77e40b0f8a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:25.955921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] MFA Rules not processed for user `e45cc10ebea14103bf370795bd7dd123`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:25.957728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:25.959536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d03dcd62-7129-4f91-95a8-77e40b0f8a9d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:25.962122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d03dcd62-7129-4f91-95a8-77e40b0f8a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:26.095997 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2392/4728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:26.097188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dcd62-7129-4f91-95a8-77e40b0f8a9d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.104594 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2337/4729] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:26.114825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.117761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dcd62-7129-4f91-95a8-77e40b0f8a9d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.118538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:26.136466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.136466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.136466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.140785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.142664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:26.143303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:26.147314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:26.173667 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2393/4730] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:26.177781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.193686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0bcc-7067-46bd-a8a1-40a8f2443e6c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.207863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.208713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.209126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.209647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.210452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:26.213078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:26.248158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee134cb-97cb-4be5-8461-11b5c79b82b1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.253113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.253839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.255497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.255497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.260003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:26.265916 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2394/4731] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:26 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:26.270412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.365616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:26.367529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:26.380699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9b14-8cc9-447e-a6ad-6fdc403cae88 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.381678 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2338/4732] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:26.387579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.388094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.388430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.388717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.389842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:26.392220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:26.429880 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2395/4733] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:26 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:26.431870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.450038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed8688-43f2-44a3-a9db-1c3ab1f9d44c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.460593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.462315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.462747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.463292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.464249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:26.466323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:26.506901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2339/4734] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:26.508002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.527217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8c70-eafb-4b10-b546-3cec8de7700f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.538105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c675cb-05b9-4305-9b4c-3d6496ec1bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.540278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c675cb-05b9-4305-9b4c-3d6496ec1bff admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.540562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c675cb-05b9-4305-9b4c-3d6496ec1bff admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.544340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c675cb-05b9-4305-9b4c-3d6496ec1bff admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.546066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c675cb-05b9-4305-9b4c-3d6496ec1bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:26.553418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c675cb-05b9-4305-9b4c-3d6496ec1bff admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:26.588135 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2396/4735] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:26.591707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.608929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293069c5-9583-4522-868e-8c7186e41da5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.620308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.622297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.622609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.623588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] PATH_INFO: `/v3/projects/ca8e8c724aac446c8a1de77129b10539/users/3b9797ba10ec45f296a8f21cc4866c16/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.666235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8e8c724aac446c8a1de77129b10539, user_id=3b9797ba10ec45f296a8f21cc4866c16, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:26.669099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:26.699650 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2340/4736] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:26 2022] PUT /identity/v3/projects/ca8e8c724aac446c8a1de77129b10539/users/3b9797ba10ec45f296a8f21cc4866c16/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:26.785948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba646c-f075-4303-ae8c-d1bdca5199e6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.786960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba646c-f075-4303-ae8c-d1bdca5199e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.787426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba646c-f075-4303-ae8c-d1bdca5199e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.833211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dbba646c-f075-4303-ae8c-d1bdca5199e6 None None] MFA Rules not processed for user `3b9797ba10ec45f296a8f21cc4866c16`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:26.835009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dbba646c-f075-4303-ae8c-d1bdca5199e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:26.961798 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2397/4737] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:26.966417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:26.989737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1825-e18f-429b-a75e-ea57d9003475 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:26.995667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55f18e-7c84-450a-a4bc-68bddcd30ad0 tempest-DefaultDomainTestJSON-1090804952 tempest-DefaultDomainTestJSON-1090804952-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9797ba10ec45f296a8f21cc4866c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e8c724aac446c8a1de77129b10539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:26.997170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f18e-7c84-450a-a4bc-68bddcd30ad0 tempest-DefaultDomainTestJSON-1090804952 tempest-DefaultDomainTestJSON-1090804952-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:26.997480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f18e-7c84-450a-a4bc-68bddcd30ad0 tempest-DefaultDomainTestJSON-1090804952 tempest-DefaultDomainTestJSON-1090804952-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:26.997751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f18e-7c84-450a-a4bc-68bddcd30ad0 tempest-DefaultDomainTestJSON-1090804952 tempest-DefaultDomainTestJSON-1090804952-project] PATH_INFO: `/v3/domains/default` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:26.999152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55f18e-7c84-450a-a4bc-68bddcd30ad0 tempest-DefaultDomainTestJSON-1090804952 tempest-DefaultDomainTestJSON-1090804952-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:27.002547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55f18e-7c84-450a-a4bc-68bddcd30ad0 tempest-DefaultDomainTestJSON-1090804952 tempest-DefaultDomainTestJSON-1090804952-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:27.008332 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2341/4738] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:09:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:27.009638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba646c-f075-4303-ae8c-d1bdca5199e6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:27.127747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba646c-f075-4303-ae8c-d1bdca5199e6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:27.156944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:27.159301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:27.160418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:27.163284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] PATH_INFO: `/v3/users/3b9797ba10ec45f296a8f21cc4866c16` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:27.165411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9797ba10ec45f296a8f21cc4866c16)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:27.170679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:27.283725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9797ba10ec45f296a8f21cc4866c16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:27.284792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9797ba10ec45f296a8f21cc4866c16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:27.295396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9797ba10ec45f296a8f21cc4866c16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:27.306375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9797ba10ec45f296a8f21cc4866c16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:27.307494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9797ba10ec45f296a8f21cc4866c16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:27.370580 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2398/4739] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:27 2022] DELETE /identity/v3/users/3b9797ba10ec45f296a8f21cc4866c16 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:27.375202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:27.375759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:27.376138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:27.412532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:27.413906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:27.502261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2342/4740] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:27.516949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:27.519375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:27.608235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526836ac-e750-4253-9820-5f1ae1defc5c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:27.616535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c69ba-018a-4be6-a744-1fedad6862a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:27.618179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c69ba-018a-4be6-a744-1fedad6862a7 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:27.618877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c69ba-018a-4be6-a744-1fedad6862a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:27.619264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c69ba-018a-4be6-a744-1fedad6862a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:27.632931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c69ba-018a-4be6-a744-1fedad6862a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:27.635049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c69ba-018a-4be6-a744-1fedad6862a7 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:27.650571 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2399/4741] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:29.268057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:29.270547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:29.283920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6ac3-f22f-4d46-b4de-2baa857c866b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:29.299987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:29.301565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:29.301998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:29.302427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] PATH_INFO: `/v3/projects/ca8e8c724aac446c8a1de77129b10539` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:29.315248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8e8c724aac446c8a1de77129b10539)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:29.317501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:29.432314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8e8c724aac446c8a1de77129b10539', 'request_id': 'req-87837ef3-cbd2-43a1-84a7-c674d220ddda'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:29.461740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8e8c724aac446c8a1de77129b10539', 'request_id': 'req-87837ef3-cbd2-43a1-84a7-c674d220ddda'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:29.513507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8e8c724aac446c8a1de77129b10539', 'request_id': 'req-87837ef3-cbd2-43a1-84a7-c674d220ddda'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:29.557682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] The token cache is being invalidate because project ca8e8c724aac446c8a1de77129b10539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:29.562522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:29.563520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-87837ef3-cbd2-43a1-84a7-c674d220ddda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:29.568215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2343/4742] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:29 2022] DELETE /identity/v3/projects/ca8e8c724aac446c8a1de77129b10539 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:29.574207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405b2a0-cccc-4d46-9768-cfea7a7b5e7e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:29.574861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405b2a0-cccc-4d46-9768-cfea7a7b5e7e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:29.580338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405b2a0-cccc-4d46-9768-cfea7a7b5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:29.646174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7405b2a0-cccc-4d46-9768-cfea7a7b5e7e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:29.647524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7405b2a0-cccc-4d46-9768-cfea7a7b5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:29.830048 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2400/4743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:29.837726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5981ba-1ca8-4b45-bcb1-24029651eb86 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:29.838043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5981ba-1ca8-4b45-bcb1-24029651eb86 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:29.838366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5981ba-1ca8-4b45-bcb1-24029651eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:29.870702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7c5981ba-1ca8-4b45-bcb1-24029651eb86 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:29.871965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7c5981ba-1ca8-4b45-bcb1-24029651eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:29.890603 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2344/4744] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:29.894996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405b2a0-cccc-4d46-9768-cfea7a7b5e7e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:29.911877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405b2a0-cccc-4d46-9768-cfea7a7b5e7e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:29.928644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:29.929379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:29.929676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:29.929964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:29.932855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:29.932855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:29.934717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:29.974227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5981ba-1ca8-4b45-bcb1-24029651eb86 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:29.980763 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2401/4745] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:29.985902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5981ba-1ca8-4b45-bcb1-24029651eb86 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:29.996138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:29.997474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:29.997911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:29.998372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:29.999297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:30.008320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:30.074739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:30.082532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2345/4746] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:29 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:30.088307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57754b28-b8ca-4be3-9c77-61734190850f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:30.272824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:30.273724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:30.274102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:30.274469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:30.276373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:30.281372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:30.342823 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2402/4747] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:30 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:30.348081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:30.365187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c39f-4338-45de-8814-6ecea070fa81 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:30.384731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:30.385776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:30.386767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:30.387275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:30.388294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:30.390455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:30.404624 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2346/4748] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:30.409012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:30.427635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d502a8b-defa-4669-9f40-bba750451b9c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:30.433267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:30.434364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:30.434654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:30.435227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] PATH_INFO: `/v3/projects/468589285d224e168d1fddd43516092e/users/701c02bd876344989132e6ce6f7a4fc0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:30.459496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=468589285d224e168d1fddd43516092e, user_id=701c02bd876344989132e6ce6f7a4fc0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:30.465128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:30.491171 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2403/4749] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:30 2022] PUT /identity/v3/projects/468589285d224e168d1fddd43516092e/users/701c02bd876344989132e6ce6f7a4fc0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:30.494957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:30.506126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634601-75a7-4272-b7a4-9bba700f8c20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:30.604325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40551838-bccf-44af-96ec-ab4949aa737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:30.605550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551838-bccf-44af-96ec-ab4949aa737e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:30.606081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551838-bccf-44af-96ec-ab4949aa737e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:30.606585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551838-bccf-44af-96ec-ab4949aa737e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:30.607580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40551838-bccf-44af-96ec-ab4949aa737e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:30.611422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40551838-bccf-44af-96ec-ab4949aa737e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:30.658177 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2347/4750] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:30.662415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:30.692848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8584ac-4c6e-42c6-8025-aa8166ca09bb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:30.716905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:30.718083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:30.718420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:30.722877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] PATH_INFO: `/v3/projects/468589285d224e168d1fddd43516092e/users/701c02bd876344989132e6ce6f7a4fc0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:30.732001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=468589285d224e168d1fddd43516092e, user_id=701c02bd876344989132e6ce6f7a4fc0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:30.740471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:30.789675 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2404/4751] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:30 2022] PUT /identity/v3/projects/468589285d224e168d1fddd43516092e/users/701c02bd876344989132e6ce6f7a4fc0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:30.800740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:30.801314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:30.801752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:30.893071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] MFA Rules not processed for user `701c02bd876344989132e6ce6f7a4fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:30.894297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:31.010886 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2348/4752] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:31.015865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:31.142773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:31.144646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:31.201437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b2ac-4a67-47b2-b56c-7de08503c6bc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:31.215949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:31.218971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:31.219407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:31.219753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:31.220541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:31.229986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:31.239370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351853ff-c7eb-4c97-90ac-e75e28b1ee9f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:31.250321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:31.252219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:31.252410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:31.252693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:31.258867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:31.353244 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2405/4753] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:31 2022] POST /identity/v3/projects => generated 385 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:31.359948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:31.523628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:31.525147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:31.528045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33b91-004a-4b81-907e-1395fa6ba4b0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:31.534843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:31.536037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:31.536968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:31.538225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:31.539658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:31.542033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:31.552665 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2349/4754] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:31.593783 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2406/4755] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:31 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:31.598384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:31.613677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36858acf-440d-43f6-9366-9ddb0cc1cb23 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:31.625720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:31.626668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:31.627049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:31.628102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:31.629739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:31.636098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:31.668407 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2350/4756] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:31.672204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:31.691012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eeb84-4c7c-4738-86f5-13764563c059 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:31.709421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae9e7e-2959-4ab5-a44a-9f293fa68818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:31.710192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9e7e-2959-4ab5-a44a-9f293fa68818 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:31.710479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9e7e-2959-4ab5-a44a-9f293fa68818 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:31.712922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9e7e-2959-4ab5-a44a-9f293fa68818 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:31.713769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae9e7e-2959-4ab5-a44a-9f293fa68818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:31.721677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae9e7e-2959-4ab5-a44a-9f293fa68818 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:31.754218 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2407/4757] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:31.755093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:31.768201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef6a4b-7f69-4c9c-8779-82d517266934 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:31.784433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:31.787660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:31.787969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:31.789352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] PATH_INFO: `/v3/projects/460575013bcb4817b6fb30b7c9ada747/users/e3ced4d6917f41d2bb2976d635e10a76/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:31.843532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460575013bcb4817b6fb30b7c9ada747, user_id=e3ced4d6917f41d2bb2976d635e10a76, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:31.855516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:31.901267 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2351/4758] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:31 2022] PUT /identity/v3/projects/460575013bcb4817b6fb30b7c9ada747/users/e3ced4d6917f41d2bb2976d635e10a76/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:31.914545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd034953-9fa8-449c-9025-86759a956fb8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:31.914838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd034953-9fa8-449c-9025-86759a956fb8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:31.915119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd034953-9fa8-449c-9025-86759a956fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:32.000499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fd034953-9fa8-449c-9025-86759a956fb8 None None] MFA Rules not processed for user `e3ced4d6917f41d2bb2976d635e10a76`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:32.001756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fd034953-9fa8-449c-9025-86759a956fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:32.216259 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2408/4759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:32.229601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:32.232930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:32.368468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301dfbc-1b61-40d1-aabf-05ab81f68253 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:32.374372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e14828-583a-4186-95c5-e3f085379171 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:32.375388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14828-583a-4186-95c5-e3f085379171 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:32.376916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14828-583a-4186-95c5-e3f085379171 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:32.377487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14828-583a-4186-95c5-e3f085379171 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:32.493265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e14828-583a-4186-95c5-e3f085379171 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:32.495823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e14828-583a-4186-95c5-e3f085379171 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:32.513147 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2352/4760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:33.048030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd034953-9fa8-449c-9025-86759a956fb8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:33.156782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd034953-9fa8-449c-9025-86759a956fb8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:33.163371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:33.164683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:33.165095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:33.165496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] PATH_INFO: `/v3/users/701c02bd876344989132e6ce6f7a4fc0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:33.167267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=701c02bd876344989132e6ce6f7a4fc0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:33.169994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:33.277393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '701c02bd876344989132e6ce6f7a4fc0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:33.278831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '701c02bd876344989132e6ce6f7a4fc0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:33.297611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '701c02bd876344989132e6ce6f7a4fc0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:33.313157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '701c02bd876344989132e6ce6f7a4fc0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:33.313978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '701c02bd876344989132e6ce6f7a4fc0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:33.392289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2409/4761] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:33 2022] DELETE /identity/v3/users/701c02bd876344989132e6ce6f7a4fc0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:33.394404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:33.394871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:33.394971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:33.434427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:33.437299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:33.558323 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2353/4762] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:33.573560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:33.575460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:33.674289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3411-247f-4ea5-a029-3a3773f53244 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:33.679506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:33.680387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:33.680677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:33.681010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:33.697853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:33.699842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:33.716982 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2410/4763] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:34.604029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:34.606686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:34.624578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3fe64-da4d-49a7-968f-3a6fee348ef2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:34.631532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:34.632549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:34.632902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:34.633289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] PATH_INFO: `/v3/projects/468589285d224e168d1fddd43516092e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:34.634850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468589285d224e168d1fddd43516092e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:34.638200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:34.733991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468589285d224e168d1fddd43516092e', 'request_id': 'req-b58826d1-948b-46db-ac8c-3c494a6c2992'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:34.746494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468589285d224e168d1fddd43516092e', 'request_id': 'req-b58826d1-948b-46db-ac8c-3c494a6c2992'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:34.765744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468589285d224e168d1fddd43516092e', 'request_id': 'req-b58826d1-948b-46db-ac8c-3c494a6c2992'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:34.798869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] The token cache is being invalidate because project 468589285d224e168d1fddd43516092e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:34.799375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:34.811728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:34.816523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2354/4764] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:34 2022] DELETE /identity/v3/projects/468589285d224e168d1fddd43516092e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:34.819948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:34.832380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17acf7-51ee-46de-ba1d-d74db5ab67cc service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:34.920444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:34.922068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:34.922583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:34.923205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] PATH_INFO: `/v3/users/e3ced4d6917f41d2bb2976d635e10a76` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:34.924805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ced4d6917f41d2bb2976d635e10a76)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:34.927560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:35.002380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ced4d6917f41d2bb2976d635e10a76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:35.003124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ced4d6917f41d2bb2976d635e10a76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:35.016917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ced4d6917f41d2bb2976d635e10a76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:35.036515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ced4d6917f41d2bb2976d635e10a76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:35.037594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-03a4d686-549c-43fc-948f-6be0687e2db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ced4d6917f41d2bb2976d635e10a76'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:35.068586 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2411/4765] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:34 2022] DELETE /identity/v3/users/e3ced4d6917f41d2bb2976d635e10a76 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:35.933345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:35.934818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:35.949949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58826d1-948b-46db-ac8c-3c494a6c2992 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:36.068419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:36.069852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.070313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.070888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] PATH_INFO: `/v3/projects/460575013bcb4817b6fb30b7c9ada747` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.074033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=460575013bcb4817b6fb30b7c9ada747)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:36.076484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:36.197983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460575013bcb4817b6fb30b7c9ada747', 'request_id': 'req-cf2be572-0c96-4f17-ac7d-47d7156140fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.210793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460575013bcb4817b6fb30b7c9ada747', 'request_id': 'req-cf2be572-0c96-4f17-ac7d-47d7156140fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.231520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460575013bcb4817b6fb30b7c9ada747', 'request_id': 'req-cf2be572-0c96-4f17-ac7d-47d7156140fe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.246080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] The token cache is being invalidate because project 460575013bcb4817b6fb30b7c9ada747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:36.246695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.251565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cf2be572-0c96-4f17-ac7d-47d7156140fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.259500 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2355/4766] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:35 2022] DELETE /identity/v3/projects/460575013bcb4817b6fb30b7c9ada747 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:36.264303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c3e9-5ce2-4017-9e24-80d5ca684a62 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.264900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c3e9-5ce2-4017-9e24-80d5ca684a62 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.264900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c3e9-5ce2-4017-9e24-80d5ca684a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.285633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7b62c3e9-5ce2-4017-9e24-80d5ca684a62 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:36.286870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b62c3e9-5ce2-4017-9e24-80d5ca684a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:36.383135 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2412/4767] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:36.391483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f94dd-04c2-4e5a-a8d5-0ede52833cd3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.393955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f94dd-04c2-4e5a-a8d5-0ede52833cd3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.395037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f94dd-04c2-4e5a-a8d5-0ede52833cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.440199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8d4f94dd-04c2-4e5a-a8d5-0ede52833cd3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:36.449515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d4f94dd-04c2-4e5a-a8d5-0ede52833cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:36.465252 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2356/4768] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:36.469688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c3e9-5ce2-4017-9e24-80d5ca684a62 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:36.486480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c3e9-5ce2-4017-9e24-80d5ca684a62 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:36.500699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:36.503263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.506022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.506560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.508951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:36.509579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:36.520207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:36.558055 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2413/4769] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:36.562710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f94dd-04c2-4e5a-a8d5-0ede52833cd3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:36.571481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:36.575964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:36.591239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f94dd-04c2-4e5a-a8d5-0ede52833cd3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:36.608090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130afc80-d164-48c6-8738-99b925276363 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:36.609859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:36.611228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.614997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.615599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.616451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:36.619381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:36.623675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:36.624709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.625119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.625479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] PATH_INFO: `/v3/users/3ded00a7449c429baae75eedaab29850` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.627325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ded00a7449c429baae75eedaab29850)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:36.632056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:36.678109 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2357/4770] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:36 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:36.682143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:36.749515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ded00a7449c429baae75eedaab29850'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.751792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ded00a7449c429baae75eedaab29850'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.767840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ded00a7449c429baae75eedaab29850'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.786624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ded00a7449c429baae75eedaab29850'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.788155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f36f20d0-8eae-42da-87ac-b398bbb5778b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ded00a7449c429baae75eedaab29850'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:36.792397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c79a49-f445-4521-be17-33835da58c0c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:36.800246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:36.801581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.802286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.802792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.803862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:36.806361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:36.821436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2414/4771] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:36 2022] DELETE /identity/v3/users/3ded00a7449c429baae75eedaab29850 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:36.826149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:36.826664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:36.827675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:36.852704 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2358/4772] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:36 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:36.855280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:36.861138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:36.874924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:36.876466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:36.892672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf9124-1a76-4ce4-bead-85c23f0ab0dc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:37.043403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:37.044835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:37.044943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:37.045229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:37.046035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:37.050243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:37.060553 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2415/4773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:37.073768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:37.075807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:37.085792 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2359/4774] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:37.089950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:37.126937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fefb9-cf14-4ece-a9a1-b207ce50440f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:37.150124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:37.150798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:37.151083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:37.151605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:37.152344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:37.156834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:37.179284 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2360/4775] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:37.184208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:37.201932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd7ba-a9b7-4208-afc0-ba06381690b3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:37.216728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf82300-f4f7-4f85-9d32-ce289327a44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:37.217772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82300-f4f7-4f85-9d32-ce289327a44f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:37.218056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82300-f4f7-4f85-9d32-ce289327a44f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:37.218335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82300-f4f7-4f85-9d32-ce289327a44f admin admin] PATH_INFO: `/v3/projects/7b3eaf5efe08481facd0a9d924225445/users/b6ac0e8b77ec40f4928a2abf33ef111f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:37.242430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf82300-f4f7-4f85-9d32-ce289327a44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3eaf5efe08481facd0a9d924225445, user_id=b6ac0e8b77ec40f4928a2abf33ef111f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:37.245639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf8a1-955d-46cb-934d-3090cfe2e51b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:37.246673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf82300-f4f7-4f85-9d32-ce289327a44f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:37.252411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:37.253621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:37.264874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:37.265449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:37.331393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:37.334106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:37.337144 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2361/4776] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:37 2022] PUT /identity/v3/projects/7b3eaf5efe08481facd0a9d924225445/users/b6ac0e8b77ec40f4928a2abf33ef111f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:37.341585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:37.341892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:37.342143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:37.349238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2416/4777] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:37.387987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] MFA Rules not processed for user `b6ac0e8b77ec40f4928a2abf33ef111f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:37.389840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:37.484198 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2362/4778] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:37.499689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:37.502156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:37.580624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eca27-475f-41b8-93bf-b95f9bea3cc2 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:37.651959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:37.653565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:37.654007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:37.654479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:37.667927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:37.669706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:37.703736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2417/4779] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:38.387672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:38.389630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:38.626826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e2f79-8dbf-4e64-8f9c-ba637b5093b6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:38.649738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:38.652676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:38.657121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:38.658411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] PATH_INFO: `/v3/projects/4a94302830a44583bf2297a0898711e9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:38.664989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a94302830a44583bf2297a0898711e9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:38.668357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:38.765640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a94302830a44583bf2297a0898711e9', 'request_id': 'req-019da514-2bef-4d52-a4d2-7c40322ff7fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:38.788694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a94302830a44583bf2297a0898711e9', 'request_id': 'req-019da514-2bef-4d52-a4d2-7c40322ff7fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:38.805783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a94302830a44583bf2297a0898711e9', 'request_id': 'req-019da514-2bef-4d52-a4d2-7c40322ff7fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:38.843492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:38.845271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] The token cache is being invalidate because project 4a94302830a44583bf2297a0898711e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:38.846756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:38.847801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:38.853583 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2363/4780] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:38 2022] DELETE /identity/v3/projects/4a94302830a44583bf2297a0898711e9 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:38.855114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:38.856813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:38.867033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6e415-3c0b-4d26-a943-b4b0f9596ce6 service glance] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:38.954817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019da514-2bef-4d52-a4d2-7c40322ff7fd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:38.968530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:38.969485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:38.970152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:38.972156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] PATH_INFO: `/v3/users/e45cc10ebea14103bf370795bd7dd123` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:38.973829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45cc10ebea14103bf370795bd7dd123)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:38.975786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:39.056733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:39.057925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:39.058411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:39.058879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] PATH_INFO: `/v3/users/b6ac0e8b77ec40f4928a2abf33ef111f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:39.061110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ac0e8b77ec40f4928a2abf33ef111f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:39.063373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:39.076373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45cc10ebea14103bf370795bd7dd123'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.079018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45cc10ebea14103bf370795bd7dd123'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.096223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45cc10ebea14103bf370795bd7dd123'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.099456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45cc10ebea14103bf370795bd7dd123'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.117896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9e400b89-8154-47fb-9389-b6917d7846c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45cc10ebea14103bf370795bd7dd123'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.163643 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2364/4781] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:38 2022] DELETE /identity/v3/users/e45cc10ebea14103bf370795bd7dd123 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:39.183932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ac0e8b77ec40f4928a2abf33ef111f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.185628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ac0e8b77ec40f4928a2abf33ef111f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.197362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ac0e8b77ec40f4928a2abf33ef111f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.210388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ac0e8b77ec40f4928a2abf33ef111f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.213290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ac0e8b77ec40f4928a2abf33ef111f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.247634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:39.248348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:39.248953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:39.251574 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2418/4782] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:38 2022] DELETE /identity/v3/users/b6ac0e8b77ec40f4928a2abf33ef111f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:39.295304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:39.298890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:39.523043 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2365/4783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:39.580918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:39.583358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:39.710535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f57f3-3ae7-489b-af0e-4ff6575fca5f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:39.714822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad99f1-a3e0-49dc-9601-93a7b0a22c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:39.715545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad99f1-a3e0-49dc-9601-93a7b0a22c72 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:39.715854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad99f1-a3e0-49dc-9601-93a7b0a22c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:39.716319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad99f1-a3e0-49dc-9601-93a7b0a22c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:39.727203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad99f1-a3e0-49dc-9601-93a7b0a22c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:39.728698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad99f1-a3e0-49dc-9601-93a7b0a22c72 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:39.741582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2419/4784] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:39.901859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:39.903345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:39.916015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420cdc8-22b3-48fe-8fdf-6da7c2a47c8e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:39.922149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:39.923430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:39.923871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:39.924374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] PATH_INFO: `/v3/projects/8ad9f816a8b34e6aa6e4620a5a4ff8fa` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:39.926008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad9f816a8b34e6aa6e4620a5a4ff8fa)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:39.928359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:39.990228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad9f816a8b34e6aa6e4620a5a4ff8fa', 'request_id': 'req-dad58f27-acaf-42bb-bdcb-3265f3a68109'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:39.997729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad9f816a8b34e6aa6e4620a5a4ff8fa', 'request_id': 'req-dad58f27-acaf-42bb-bdcb-3265f3a68109'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.011704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad9f816a8b34e6aa6e4620a5a4ff8fa', 'request_id': 'req-dad58f27-acaf-42bb-bdcb-3265f3a68109'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.029794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] The token cache is being invalidate because project 8ad9f816a8b34e6aa6e4620a5a4ff8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:40.030124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.031223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dad58f27-acaf-42bb-bdcb-3265f3a68109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.042279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df8f8-a7ed-4133-8690-161c0c05f5dc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.042771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df8f8-a7ed-4133-8690-161c0c05f5dc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.042884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df8f8-a7ed-4133-8690-161c0c05f5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.044527 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2366/4785] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:39 2022] DELETE /identity/v3/projects/8ad9f816a8b34e6aa6e4620a5a4ff8fa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:40.074129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-886df8f8-a7ed-4133-8690-161c0c05f5dc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:40.077126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-886df8f8-a7ed-4133-8690-161c0c05f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:40.187313 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2420/4786] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:40.190028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473038d-b7a7-4a00-98aa-44c820e70064 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.190617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473038d-b7a7-4a00-98aa-44c820e70064 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.191052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473038d-b7a7-4a00-98aa-44c820e70064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.248515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c473038d-b7a7-4a00-98aa-44c820e70064 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:40.251675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c473038d-b7a7-4a00-98aa-44c820e70064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:40.271577 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2367/4787] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:40.272720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886df8f8-a7ed-4133-8690-161c0c05f5dc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:40.286226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886df8f8-a7ed-4133-8690-161c0c05f5dc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:40.292018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:40.292964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.293438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.293899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.296897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:40.297165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:40.299160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:40.313836 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2421/4788] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:40.318321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473038d-b7a7-4a00-98aa-44c820e70064 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:40.329826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473038d-b7a7-4a00-98aa-44c820e70064 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:40.334906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:40.335651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.335993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.336327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.337184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:40.339533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:40.389894 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2368/4789] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:40 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:40.390662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:40.433349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef367-6945-440d-af6a-6d85280191ec admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:40.574343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:40.575526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.575964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.576414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.577571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:40.580512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:40.619819 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2422/4790] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:40 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:40.623556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:40.636979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698d3e-da28-4ad2-8f89-a56f2b4191e7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:40.642332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:40.643538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.644048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.644520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.645664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:40.647603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:40.665187 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2369/4791] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:40.668127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:40.680773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10683b5e-6800-4581-ac73-c8bea01dbc7e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:40.691727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:40.692789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.695763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.696455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.697949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:40.702878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:40.727035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:40.735122 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2423/4792] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:40.737077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:40.739230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:40.747344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0561b-b5ff-49c4-9b53-2db2c6e66495 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:40.755024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae49c4d-9123-427b-8129-8d2a4d46ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:40.758523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae49c4d-9123-427b-8129-8d2a4d46ca01 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.759048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae49c4d-9123-427b-8129-8d2a4d46ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.759592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae49c4d-9123-427b-8129-8d2a4d46ca01 admin admin] PATH_INFO: `/v3/projects/6378b2d9494c44929e409bc860a7215f/users/014c638dd7fb4df3b0aa53a195875330/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.760097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4725d-c50f-4d1b-83f5-347d24121225 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:40.776650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:40.777866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.778200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.778391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] PATH_INFO: `/v3/projects/7b3eaf5efe08481facd0a9d924225445` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.781949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3eaf5efe08481facd0a9d924225445)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:40.785250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:40.787071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae49c4d-9123-427b-8129-8d2a4d46ca01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6378b2d9494c44929e409bc860a7215f, user_id=014c638dd7fb4df3b0aa53a195875330, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:40.795590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae49c4d-9123-427b-8129-8d2a4d46ca01 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:40.825009 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2370/4793] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:40 2022] PUT /identity/v3/projects/6378b2d9494c44929e409bc860a7215f/users/014c638dd7fb4df3b0aa53a195875330/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:40.837813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.838125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.838835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:40.882503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] MFA Rules not processed for user `014c638dd7fb4df3b0aa53a195875330`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:40.886036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:40.889938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3eaf5efe08481facd0a9d924225445', 'request_id': 'req-cdb252e1-761a-490d-803e-cc7f2db3721b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.902581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3eaf5efe08481facd0a9d924225445', 'request_id': 'req-cdb252e1-761a-490d-803e-cc7f2db3721b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.924005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3eaf5efe08481facd0a9d924225445', 'request_id': 'req-cdb252e1-761a-490d-803e-cc7f2db3721b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.958539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] The token cache is being invalidate because project 7b3eaf5efe08481facd0a9d924225445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:40.958951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.959683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cdb252e1-761a-490d-803e-cc7f2db3721b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:40.967877 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2424/4794] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:40 2022] DELETE /identity/v3/projects/7b3eaf5efe08481facd0a9d924225445 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:40.972974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:40.973290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:40.973567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.012978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:41.020742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:41.029560 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2371/4795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:41.030772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.037321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:41.161422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2425/4796] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:41.167231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.170478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb31937-fe77-4ef4-9c44-97b276811b41 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.176713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.178032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.178380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:41.178952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.179320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] PATH_INFO: `/v3/users/cdab30a578b947068144a0509c85eb0c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.180715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdab30a578b947068144a0509c85eb0c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.184020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.194723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984085ed-683c-4cf9-8b85-1b3711b490e0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.213619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66503481-0a5b-4a00-ac7c-4bde10ae5b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.214578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503481-0a5b-4a00-ac7c-4bde10ae5b2a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.215173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503481-0a5b-4a00-ac7c-4bde10ae5b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.215687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503481-0a5b-4a00-ac7c-4bde10ae5b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.216517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66503481-0a5b-4a00-ac7c-4bde10ae5b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.219875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66503481-0a5b-4a00-ac7c-4bde10ae5b2a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.268547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdab30a578b947068144a0509c85eb0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:41.269662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdab30a578b947068144a0509c85eb0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:41.288725 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2426/4797] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:41 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:41.293186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f671d7-c296-42aa-817f-b7b0637fad62 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.293982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdab30a578b947068144a0509c85eb0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:41.294677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f671d7-c296-42aa-817f-b7b0637fad62 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.295135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f671d7-c296-42aa-817f-b7b0637fad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.296570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdab30a578b947068144a0509c85eb0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:41.325888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdab30a578b947068144a0509c85eb0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:41.327930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e6f671d7-c296-42aa-817f-b7b0637fad62 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:41.329477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6f671d7-c296-42aa-817f-b7b0637fad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:41.353588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2372/4798] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:41 2022] DELETE /identity/v3/users/cdab30a578b947068144a0509c85eb0c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:41.354694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.357529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:41.415099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2427/4799] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:41.415961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f671d7-c296-42aa-817f-b7b0637fad62 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.428248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f671d7-c296-42aa-817f-b7b0637fad62 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.490645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5aae2-4ad2-4e63-b42b-d23462b8ebcf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.501855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.502556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.502828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.503094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.504416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.506385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.538619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.539412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.539734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.540755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.541547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:41.541911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.543884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.548969 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2373/4800] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:41 2022] POST /identity/v3/users => generated 306 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:41.553477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.565094 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2428/4801] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:41.569351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c88a-2d75-43b8-b4ac-c5fe5024e1af admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.571179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.576233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.577303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.577303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.577514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.578172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.580173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.586246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfee88-83a4-4637-ac7b-a929de05318a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.594026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.595523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.596337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.600493 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2374/4802] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:41.600748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.600748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.602386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.603445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.616806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cb7ab-5486-437c-974a-9dd3954124c3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.622490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.623577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.624191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.624191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] PATH_INFO: `/v3/projects/a55454c9572d426b949dbf7d7d396911/users/805b3800f0494956954100b49df3dc59/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.643315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55454c9572d426b949dbf7d7d396911, user_id=805b3800f0494956954100b49df3dc59, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.646421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.647546 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2429/4803] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:41 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:41.651550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.685998 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2375/4804] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:41 2022] PUT /identity/v3/projects/a55454c9572d426b949dbf7d7d396911/users/805b3800f0494956954100b49df3dc59/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:41.693324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.760468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86098d-19e4-46a7-8324-f0dcc77439a0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.768697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.769174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.769458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.769768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.770566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.772639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.777968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39db91-72c2-46d5-91c5-bc1dab9c3c5b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.783107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.785341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.786047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.786620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.787972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.789868 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2376/4805] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:09:41.790983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.791547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.804446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1ce0-575f-4a46-aff7-fa11f02f9c06 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.811390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28106506-483c-4463-8be2-255b34685e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.812418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106506-483c-4463-8be2-255b34685e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.812744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106506-483c-4463-8be2-255b34685e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.813091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106506-483c-4463-8be2-255b34685e3f admin admin] PATH_INFO: `/v3/projects/a55454c9572d426b949dbf7d7d396911/users/805b3800f0494956954100b49df3dc59/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.818089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28106506-483c-4463-8be2-255b34685e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55454c9572d426b949dbf7d7d396911, user_id=805b3800f0494956954100b49df3dc59, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.818273 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2430/4806] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:41 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:41.818378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28106506-483c-4463-8be2-255b34685e3f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:41.821284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:41.837057 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2377/4807] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:41 2022] PUT /identity/v3/projects/a55454c9572d426b949dbf7d7d396911/users/805b3800f0494956954100b49df3dc59/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:41.848105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a3c7-0943-4182-b7fa-0d9879e88ee7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:41.859632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3ba2-f1c3-4313-9587-c606fe09e352 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.860183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3ba2-f1c3-4313-9587-c606fe09e352 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.860842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3ba2-f1c3-4313-9587-c606fe09e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.958140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4f4c3ba2-f1c3-4313-9587-c606fe09e352 None None] MFA Rules not processed for user `805b3800f0494956954100b49df3dc59`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:41.959845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4f4c3ba2-f1c3-4313-9587-c606fe09e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:41.962829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:41.964473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:41.964473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:41.964706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:41.966049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:41.972970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.003471 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2431/4808] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:42.004777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.021610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cece5-21d2-43b1-8edb-1e0fe1a28e14 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.035329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.036042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.036321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.037193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.037914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.040659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.056104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2432/4809] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:42.057586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.060554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.075574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7819-140a-4aa4-8792-d98b981a5045 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.079802 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2378/4810] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:42.083500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3ba2-f1c3-4313-9587-c606fe09e352 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.096308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3ba2-f1c3-4313-9587-c606fe09e352 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.101826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.103049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.103586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.104076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.104190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.104532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.104851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] PATH_INFO: `/v3/projects/3e27519c6c114724bf36126f0362a7c0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.105023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] PATH_INFO: `/v3/projects/05b173fe99094a83b27ed3406025331a/users/d90f454c765041939fab7085fc473017/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.108195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e27519c6c114724bf36126f0362a7c0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.110533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.131419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b173fe99094a83b27ed3406025331a, user_id=d90f454c765041939fab7085fc473017, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.135606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.162569 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2379/4811] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:42 2022] PUT /identity/v3/projects/05b173fe99094a83b27ed3406025331a/users/d90f454c765041939fab7085fc473017/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:42.163839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.166315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.199133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e27519c6c114724bf36126f0362a7c0', 'request_id': 'req-1a6d83f9-26e4-48bd-aec5-e5332231c680'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:42.210099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e27519c6c114724bf36126f0362a7c0', 'request_id': 'req-1a6d83f9-26e4-48bd-aec5-e5332231c680'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:42.225190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e27519c6c114724bf36126f0362a7c0', 'request_id': 'req-1a6d83f9-26e4-48bd-aec5-e5332231c680'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:42.242481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] The token cache is being invalidate because project 3e27519c6c114724bf36126f0362a7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:42.242871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:42.244984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a6d83f9-26e4-48bd-aec5-e5332231c680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:42.246794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f5604-96d4-4a80-ae13-42b7da380b60 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.248349 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2433/4812] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:42 2022] DELETE /identity/v3/projects/3e27519c6c114724bf36126f0362a7c0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:42.249826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9669-f3c3-4987-9fc8-02e4fc77462c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.252822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9669-f3c3-4987-9fc8-02e4fc77462c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.253220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9669-f3c3-4987-9fc8-02e4fc77462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.309795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a31a9669-f3c3-4987-9fc8-02e4fc77462c None None] MFA Rules not processed for user `d90f454c765041939fab7085fc473017`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:42.311068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a31a9669-f3c3-4987-9fc8-02e4fc77462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.351888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.353707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.354023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.354301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.357547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.445459 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2434/4813] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:42.446328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.447450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f7734-40c9-4522-ae5f-9615413bc88f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.447741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f7734-40c9-4522-ae5f-9615413bc88f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.448017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f7734-40c9-4522-ae5f-9615413bc88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.448433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.460848 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2380/4814] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:42.461696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.466256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.476855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-192f7734-40c9-4522-ae5f-9615413bc88f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:42.478439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-192f7734-40c9-4522-ae5f-9615413bc88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.559782 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2435/4815] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:42.563939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe96f-5fb4-42c1-94bf-18752f02d119 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.567778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844793-3d0e-447f-a0ea-405d4ddc1a5f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.568073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844793-3d0e-447f-a0ea-405d4ddc1a5f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.568495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844793-3d0e-447f-a0ea-405d4ddc1a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.570404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.571520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.572302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.572792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.573879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.576001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.587032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e6844793-3d0e-447f-a0ea-405d4ddc1a5f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:42.588347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6844793-3d0e-447f-a0ea-405d4ddc1a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.600977 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2436/4816] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:42.602546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844793-3d0e-447f-a0ea-405d4ddc1a5f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.612840 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2381/4817] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:42.613019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844793-3d0e-447f-a0ea-405d4ddc1a5f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.614403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.683215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a06ffc-c1d9-4add-b31b-ae4c9dbf774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.684129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a06ffc-c1d9-4add-b31b-ae4c9dbf774f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.684787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a06ffc-c1d9-4add-b31b-ae4c9dbf774f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.685078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a06ffc-c1d9-4add-b31b-ae4c9dbf774f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.686255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a06ffc-c1d9-4add-b31b-ae4c9dbf774f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:42.686610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a06ffc-c1d9-4add-b31b-ae4c9dbf774f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.688867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a06ffc-c1d9-4add-b31b-ae4c9dbf774f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.695553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0dccf-a45a-4729-baed-e03b3bed69e1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.706502 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2437/4818] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:09:42.706502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95881ab0-36ee-483c-a6ae-556a151983e6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.706502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95881ab0-36ee-483c-a6ae-556a151983e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.706502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95881ab0-36ee-483c-a6ae-556a151983e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.707983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.709291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.709716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.710344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.711191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.713702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.725320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-95881ab0-36ee-483c-a6ae-556a151983e6 None None] MFA Rules not processed for user `e2b92cb8d21d42eea56146d7935a74e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:42.726527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-95881ab0-36ee-483c-a6ae-556a151983e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.738898 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2382/4819] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:42.739710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.756734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328472-0051-4f31-bf99-532110d2601d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.762832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.763511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.763841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.764483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.765345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.767888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.802715 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2383/4820] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/projects => generated 361 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:42.803636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.813390 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2438/4821] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:42.814810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95881ab0-36ee-483c-a6ae-556a151983e6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:42.830259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95881ab0-36ee-483c-a6ae-556a151983e6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.884829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04545d70-e5df-4fad-ab5a-618b6928fb5f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:42.903919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1555c4a-0292-444f-8e0d-7028c16ad493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.905159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1555c4a-0292-444f-8e0d-7028c16ad493 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.905387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1555c4a-0292-444f-8e0d-7028c16ad493 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.905711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1555c4a-0292-444f-8e0d-7028c16ad493 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.906460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1555c4a-0292-444f-8e0d-7028c16ad493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.908339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1555c4a-0292-444f-8e0d-7028c16ad493 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.926477 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2384/4822] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:42.928907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9cfcc-a5b7-4f99-b9b1-92e5fab24472 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.929222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9cfcc-a5b7-4f99-b9b1-92e5fab24472 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.929537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9cfcc-a5b7-4f99-b9b1-92e5fab24472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.935277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:42.936509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:42.936884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:42.937818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:42.938573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:42.940547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:42.951736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-91a9cfcc-a5b7-4f99-b9b1-92e5fab24472 None None] MFA Rules not processed for user `e2b92cb8d21d42eea56146d7935a74e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:42.953087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91a9cfcc-a5b7-4f99-b9b1-92e5fab24472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:42.990479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2439/4823] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/users => generated 281 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:42.991650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.008764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10cc3-5c20-46c6-8294-397f9394ac73 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.015837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.017648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.018240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.018519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] PATH_INFO: `/v3/projects/a504cdc020b74437aa81ceb6f94aaaef/users/8cf5135f180e44739ffd4c072521f700/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.030972 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2385/4824] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:43.035706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9cfcc-a5b7-4f99-b9b1-92e5fab24472 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.039278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a504cdc020b74437aa81ceb6f94aaaef, user_id=8cf5135f180e44739ffd4c072521f700, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.042427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.044956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9cfcc-a5b7-4f99-b9b1-92e5fab24472 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.052714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.053849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.054758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.054758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.055161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.057074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.064932 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2440/4825] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:42 2022] PUT /identity/v3/projects/a504cdc020b74437aa81ceb6f94aaaef/users/8cf5135f180e44739ffd4c072521f700/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:43.069388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.071367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:43.091862 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2386/4826] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:43.093154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.109613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195581e-a1a5-49f9-8d23-d348ff123bdd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.174809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba67b85-dd41-4719-bb9c-07a4d99b6c67 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.182030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.182907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.183637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.184118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.186528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:43.189397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.193884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.194246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.194528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.195291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.197903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.210165 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2387/4827] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:43.210901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.223950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e191a58-3433-43ce-987f-375a76e4ed61 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.228916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.229857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.230341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.230616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.231345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.234272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.252430 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2388/4828] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:43.256676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.265208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.266924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.267196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f982-2ef4-4e69-87aa-c87407023a53 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.272015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecaeafc-4f90-4a6c-806e-5e019375208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.272916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaeafc-4f90-4a6c-806e-5e019375208a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.273222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaeafc-4f90-4a6c-806e-5e019375208a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.273498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaeafc-4f90-4a6c-806e-5e019375208a admin admin] PATH_INFO: `/v3/projects/a504cdc020b74437aa81ceb6f94aaaef/users/8cf5135f180e44739ffd4c072521f700/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.275512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecaeafc-4f90-4a6c-806e-5e019375208a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a504cdc020b74437aa81ceb6f94aaaef, user_id=8cf5135f180e44739ffd4c072521f700, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.277960 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2441/4829] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:43.278590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.288770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef78f7-110f-46be-ae8b-c892b44a8942 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.290885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecaeafc-4f90-4a6c-806e-5e019375208a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.293754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9cc51-b556-45ee-9e86-e75df6ddc68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.294654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9cc51-b556-45ee-9e86-e75df6ddc68c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.294927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9cc51-b556-45ee-9e86-e75df6ddc68c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.295287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9cc51-b556-45ee-9e86-e75df6ddc68c admin admin] PATH_INFO: `/v3/projects/c832ebdeb92040b69b84c7b3499094dd/users/be13633f6cbd4c32afa278e037c1a1b9/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.305124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2389/4830] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:43 2022] PUT /identity/v3/projects/a504cdc020b74437aa81ceb6f94aaaef/users/8cf5135f180e44739ffd4c072521f700/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:43.313249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9cc51-b556-45ee-9e86-e75df6ddc68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c832ebdeb92040b69b84c7b3499094dd, user_id=be13633f6cbd4c32afa278e037c1a1b9, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.315084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f55a0c-6da7-42f9-828a-33a002c68105 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.315744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f55a0c-6da7-42f9-828a-33a002c68105 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.316438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9cc51-b556-45ee-9e86-e75df6ddc68c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.317170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f55a0c-6da7-42f9-828a-33a002c68105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.344975 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2442/4831] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:43 2022] PUT /identity/v3/projects/c832ebdeb92040b69b84c7b3499094dd/users/be13633f6cbd4c32afa278e037c1a1b9/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:43.359968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.360550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.360672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.381636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-62f55a0c-6da7-42f9-828a-33a002c68105 None None] MFA Rules not processed for user `8cf5135f180e44739ffd4c072521f700`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:43.383945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62f55a0c-6da7-42f9-828a-33a002c68105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:43.397374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] MFA Rules not processed for user `be13633f6cbd4c32afa278e037c1a1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:43.398644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:43.470095 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2443/4832] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:43.476075 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2390/4833] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:43.489625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.490440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:43.560069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837de8-1707-4699-8d06-ae4251e26f1b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.565833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baac71-faf6-47cb-9800-bfcd2b6d9477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.566980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baac71-faf6-47cb-9800-bfcd2b6d9477 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.567348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baac71-faf6-47cb-9800-bfcd2b6d9477 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.567670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baac71-faf6-47cb-9800-bfcd2b6d9477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.633885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baac71-faf6-47cb-9800-bfcd2b6d9477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.635410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baac71-faf6-47cb-9800-bfcd2b6d9477 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.645380 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2444/4834] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:43.738296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f55a0c-6da7-42f9-828a-33a002c68105 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:43.810018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f55a0c-6da7-42f9-828a-33a002c68105 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:43.817231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:43.818744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.819955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.820256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] PATH_INFO: `/v3/users/be13633f6cbd4c32afa278e037c1a1b9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.821634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=be13633f6cbd4c32afa278e037c1a1b9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:43.823694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:43.893881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be13633f6cbd4c32afa278e037c1a1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:43.894815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be13633f6cbd4c32afa278e037c1a1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:43.903354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be13633f6cbd4c32afa278e037c1a1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:43.904304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be13633f6cbd4c32afa278e037c1a1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:43.922093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be13633f6cbd4c32afa278e037c1a1b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:43.948053 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2391/4835] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:43 2022] DELETE /identity/v3/users/be13633f6cbd4c32afa278e037c1a1b9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:43.952538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:43.953142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:43.953654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:43.984626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:43.986384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:44.046588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:44.052623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:44.092673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2445/4836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:44.102876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:44.104298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:44.196773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d8d4-b734-47ab-86cc-7649acd687cb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:44.201197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a057c-a6f9-48e8-8c1b-f1f43123944f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:44.201872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a057c-a6f9-48e8-8c1b-f1f43123944f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:44.202181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a057c-a6f9-48e8-8c1b-f1f43123944f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:44.202458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a057c-a6f9-48e8-8c1b-f1f43123944f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:44.205821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0a7a057c-a6f9-48e8-8c1b-f1f43123944f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:44.229648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93f2cf-2874-469a-8a9d-7a406d7ac337 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:44.235638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:44.236946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:44.237356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:44.237690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:44.248112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:44.249780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:44.263249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2446/4837] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:09:44.287138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a057c-a6f9-48e8-8c1b-f1f43123944f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:44.288593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a057c-a6f9-48e8-8c1b-f1f43123944f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:44.299450 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2392/4838] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:44.559848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:44.561335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:44.576655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828aaed-2b87-42fa-9511-340a3507f229 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:44.582526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:44.583417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:44.583789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:44.584065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] PATH_INFO: `/v3/projects/c832ebdeb92040b69b84c7b3499094dd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:44.585665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c832ebdeb92040b69b84c7b3499094dd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:44.588205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:44.643877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c832ebdeb92040b69b84c7b3499094dd', 'request_id': 'req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:44.650010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c832ebdeb92040b69b84c7b3499094dd', 'request_id': 'req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:44.658681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c832ebdeb92040b69b84c7b3499094dd', 'request_id': 'req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:44.670152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] The token cache is being invalidate because project c832ebdeb92040b69b84c7b3499094dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:44.670439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:44.671134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e2a1beb5-34f3-47fa-8b64-16dc9e0b9b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:44.673476 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2447/4839] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:44 2022] DELETE /identity/v3/projects/c832ebdeb92040b69b84c7b3499094dd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:44.678082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d281-2673-4ce7-abec-2ce5aafd2a82 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:44.678436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d281-2673-4ce7-abec-2ce5aafd2a82 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:44.679179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d281-2673-4ce7-abec-2ce5aafd2a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:44.697876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7831d281-2673-4ce7-abec-2ce5aafd2a82 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:44.699544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7831d281-2673-4ce7-abec-2ce5aafd2a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:44.787559 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2393/4840] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:09:44.796604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a6eb-fab9-4384-9b57-3ef5a8291243 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:44.796790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a6eb-fab9-4384-9b57-3ef5a8291243 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:44.797277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a6eb-fab9-4384-9b57-3ef5a8291243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:44.821082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-26a2a6eb-fab9-4384-9b57-3ef5a8291243 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:44.821082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-26a2a6eb-fab9-4384-9b57-3ef5a8291243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:44.831462 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2448/4841] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:44.835095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831d281-2673-4ce7-abec-2ce5aafd2a82 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:44.847204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831d281-2673-4ce7-abec-2ce5aafd2a82 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:44.852618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:44.853318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:44.853758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:44.854181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:44.855890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:44.856206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:44.858050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:44.873097 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2394/4842] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:44.878804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2a6eb-fab9-4384-9b57-3ef5a8291243 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:44.890175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2a6eb-fab9-4384-9b57-3ef5a8291243 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:44.895700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:44.896631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:44.896991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:44.897386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:44.898571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:44.900659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:44.941534 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2449/4843] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:44 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:44.942883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:44.954780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82465cb7-d5b1-4089-ac00-2576131c4a8c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:45.018988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:45.019684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:45.019967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:45.020246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:45.020937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:45.022964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:45.046371 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2395/4844] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:44 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:09:45.050443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:45.060698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454edec-4fea-4c01-bca6-ebf9a390445b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:45.065532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:45.066209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:45.066487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:45.066761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:45.067491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:45.069187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:45.079868 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2450/4845] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:45.084169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:45.094643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af7a9-b430-455a-a085-46fa857e6a87 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:45.099995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3c999-96c7-416a-aa28-6849cdaa6910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:45.100759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3c999-96c7-416a-aa28-6849cdaa6910 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:45.101130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3c999-96c7-416a-aa28-6849cdaa6910 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:45.101408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3c999-96c7-416a-aa28-6849cdaa6910 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:45.102285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3c999-96c7-416a-aa28-6849cdaa6910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:45.103840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3c999-96c7-416a-aa28-6849cdaa6910 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:45.128371 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2396/4846] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:45.131777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:45.142759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de7b02-d911-4f67-bd96-23d000547622 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:45.149775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:45.150917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:45.151270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:45.151611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] PATH_INFO: `/v3/projects/fdd53d98faf74d6a92cdfabace62b088/users/7ce296c1004c4976930f46de34be880d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:45.168568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd53d98faf74d6a92cdfabace62b088, user_id=7ce296c1004c4976930f46de34be880d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:45.171439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:45.195212 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2451/4847] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:45 2022] PUT /identity/v3/projects/fdd53d98faf74d6a92cdfabace62b088/users/7ce296c1004c4976930f46de34be880d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:45.201562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:45.202039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:45.202439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:45.222630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:45.223833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:45.283538 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2397/4848] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:45.294053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:45.296090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:45.360996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798db9e-85a0-43d4-9ed1-666b1c8d6939 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:45.365109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:45.365757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:45.366056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:45.366318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:45.381747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:45.383407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:45.407466 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2452/4849] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:49.529614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:49.531265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:49.548100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0abd73-aaa4-42b4-8395-9a9c4cde8c03 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:49.554019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:49.555460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:49.555839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:49.556240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:49.558907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:49.703066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:49.705614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:49.722333 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2398/4850] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:56.054879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:56.056545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:56.082234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c83a-ce42-4265-976c-eb35d993e3a7 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:56.121857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:56.122704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:56.122984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:56.123251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] PATH_INFO: `/v3/users/391775bcb52b46c58b0fb0957a4f9f40` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:56.125366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391775bcb52b46c58b0fb0957a4f9f40)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:56.127806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:56.243716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391775bcb52b46c58b0fb0957a4f9f40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:56.245139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391775bcb52b46c58b0fb0957a4f9f40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:56.263597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391775bcb52b46c58b0fb0957a4f9f40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:56.286045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391775bcb52b46c58b0fb0957a4f9f40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:56.287066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391775bcb52b46c58b0fb0957a4f9f40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:56.319739 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2453/4851] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:56 2022] DELETE /identity/v3/users/391775bcb52b46c58b0fb0957a4f9f40 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:57.334992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:57.336948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:57.367776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038634-a56b-4af2-abe6-ec0a03f7b161 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:57.423858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:57.425621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:57.497571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:57.499564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:57.499915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:57.500295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] PATH_INFO: `/v3/users/d90f454c765041939fab7085fc473017` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:57.501968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90f454c765041939fab7085fc473017)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:57.506124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:57.553004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbf3a-a3ea-4601-be97-af17f8306c92 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:57.567759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:57.571919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:57.572527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:57.572972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] PATH_INFO: `/v3/projects/05f4a6d024fc4c758fe434c42500712f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:57.575147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f4a6d024fc4c758fe434c42500712f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:57.578382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:57.581238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90f454c765041939fab7085fc473017'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.582167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90f454c765041939fab7085fc473017'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.590508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90f454c765041939fab7085fc473017'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.592070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90f454c765041939fab7085fc473017'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.613437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-601b9ebc-27ab-488f-a900-f91a18d5dfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90f454c765041939fab7085fc473017'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.637829 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2399/4852] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:57 2022] DELETE /identity/v3/users/d90f454c765041939fab7085fc473017 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:57.643787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:57.644218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:57.644614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:57.659752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f4a6d024fc4c758fe434c42500712f', 'request_id': 'req-8e0adbfe-7991-4caf-92d3-e9d1841090e4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.668265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f4a6d024fc4c758fe434c42500712f', 'request_id': 'req-8e0adbfe-7991-4caf-92d3-e9d1841090e4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.688652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f4a6d024fc4c758fe434c42500712f', 'request_id': 'req-8e0adbfe-7991-4caf-92d3-e9d1841090e4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.697406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:57.700634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:57.709377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] The token cache is being invalidate because project 05f4a6d024fc4c758fe434c42500712f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:57.709931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.711031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e0adbfe-7991-4caf-92d3-e9d1841090e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:57.715510 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2454/4853] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:57 2022] DELETE /identity/v3/projects/05f4a6d024fc4c758fe434c42500712f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:57.719864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f6c5-e733-43ca-8dd3-9c10b9f40008 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:57.723028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f6c5-e733-43ca-8dd3-9c10b9f40008 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:57.723331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f6c5-e733-43ca-8dd3-9c10b9f40008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:57.765962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e681f6c5-e733-43ca-8dd3-9c10b9f40008 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:57.768722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e681f6c5-e733-43ca-8dd3-9c10b9f40008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:57.833368 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2400/4854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:57.852876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:57.854884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:57.911594 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2455/4855] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:57.924883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7cc38-2152-4241-ab17-30180b4c7da6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:57.927337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7cc38-2152-4241-ab17-30180b4c7da6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:57.927744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7cc38-2152-4241-ab17-30180b4c7da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:57.972212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8db7cc38-2152-4241-ab17-30180b4c7da6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:57.976167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8db7cc38-2152-4241-ab17-30180b4c7da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:57.992748 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2456/4856] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:57.998557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7cc38-2152-4241-ab17-30180b4c7da6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:58.011380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb918-d855-4914-92a1-a5f145a0e0fa None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:58.024151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7cc38-2152-4241-ab17-30180b4c7da6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:58.034637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:58.035487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.035869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.036805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.037328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:09:58.037813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:58.039677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:58.049458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:58.051820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.052114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.052974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.074832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:58.076809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:58.097174 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2457/4857] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:09:58.098389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:58.103783 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2401/4858] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:09:58.109995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf8210-e974-419a-b769-ad39a2db93f2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:58.116379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:58.117269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.117650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.118074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.119599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:58.121988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:58.164516 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2458/4859] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:09:58 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:58.165454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:58.191231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73667a-6196-42be-8361-c0bb0d3d5901 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:58.325819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:58.326536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.326738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.327013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.327779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:58.329772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:58.363016 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2402/4860] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:09:58 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:09:58.368543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:58.381233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6e6fb-8534-480c-bc21-a97a3181e64d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:58.394906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:58.395808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.395951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.396155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.396883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:58.398560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:58.417263 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2459/4861] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:58.421197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:58.442817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21223a47-b0d5-40a5-8e21-70e09c588562 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:58.461525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738712b-c56e-45f9-ab33-e3a53b1195e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:58.462653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738712b-c56e-45f9-ab33-e3a53b1195e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.463202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738712b-c56e-45f9-ab33-e3a53b1195e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.463628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738712b-c56e-45f9-ab33-e3a53b1195e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.465908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738712b-c56e-45f9-ab33-e3a53b1195e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:58.468261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738712b-c56e-45f9-ab33-e3a53b1195e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:58.486425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:58.498539 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2403/4862] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:09:58.499867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808483d-b610-4c2e-9196-5217d55baa11 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:58.505660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:58.506900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.507353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.507941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] PATH_INFO: `/v3/projects/24bd526c25da4572bf839ada46d8e218/users/728f865d696a447b816a864260997a58/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.529896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bd526c25da4572bf839ada46d8e218, user_id=728f865d696a447b816a864260997a58, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:58.532872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:58.565583 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2460/4863] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:09:58 2022] PUT /identity/v3/projects/24bd526c25da4572bf839ada46d8e218/users/728f865d696a447b816a864260997a58/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:58.568482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb525e1-ea3f-4d16-82d0-7e49a151427b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:58.568788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb525e1-ea3f-4d16-82d0-7e49a151427b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:58.569056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb525e1-ea3f-4d16-82d0-7e49a151427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:58.658022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-afb525e1-ea3f-4d16-82d0-7e49a151427b None None] MFA Rules not processed for user `728f865d696a447b816a864260997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:58.659767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-afb525e1-ea3f-4d16-82d0-7e49a151427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:58.800095 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2404/4864] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:58.885643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:58.887463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:59.041944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33c57c-1b24-4f26-a101-9b1a5575faad admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:59.060740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333e470-0cdc-4141-ad02-8a6a8835b8f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:59.061602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e470-0cdc-4141-ad02-8a6a8835b8f9 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:59.061946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e470-0cdc-4141-ad02-8a6a8835b8f9 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:59.062282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e470-0cdc-4141-ad02-8a6a8835b8f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:59.081555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333e470-0cdc-4141-ad02-8a6a8835b8f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:59.083306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333e470-0cdc-4141-ad02-8a6a8835b8f9 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:59.134497 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2461/4865] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:59.174768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb525e1-ea3f-4d16-82d0-7e49a151427b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:59.319236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb525e1-ea3f-4d16-82d0-7e49a151427b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:59.330278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:59.331878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:59.331878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:59.331878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] PATH_INFO: `/v3/users/728f865d696a447b816a864260997a58` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:59.332983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=728f865d696a447b816a864260997a58)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:59.335426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:59.421602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728f865d696a447b816a864260997a58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.422303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728f865d696a447b816a864260997a58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.431523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728f865d696a447b816a864260997a58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.432389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728f865d696a447b816a864260997a58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.445950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728f865d696a447b816a864260997a58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.474758 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2405/4866] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:59 2022] DELETE /identity/v3/users/728f865d696a447b816a864260997a58 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:09:59.476494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:59.476786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:59.477179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:59.515126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:09:59.515965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:59.517441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:59.518083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:59.621765 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2462/4867] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:09:59.624557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88364efd-3777-4e34-b8c2-2ae465286c3c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:59.630768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:59.631455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:59.631738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:59.632038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:59.634090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:59.642167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:59.646614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:59.660685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c42364-d464-4bdf-ae46-fead8ea044bb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:59.667281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:59.668151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:59.668441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:59.668719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:59.681530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:59.683394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:59.698142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2463/4868] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:59.720491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:59.723270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:09:59.740891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9adc6-9b8f-4f57-80e1-d42f246ad90b service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:09:59.746880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:09:59.747790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:09:59.748068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:09:59.748337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] PATH_INFO: `/v3/projects/05b173fe99094a83b27ed3406025331a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:09:59.749914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b173fe99094a83b27ed3406025331a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:59.751611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:59.759844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:09:59.762622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:09:59.779607 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2406/4869] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:09:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:09:59.825902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b173fe99094a83b27ed3406025331a', 'request_id': 'req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.833276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b173fe99094a83b27ed3406025331a', 'request_id': 'req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.846960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b173fe99094a83b27ed3406025331a', 'request_id': 'req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.860783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] The token cache is being invalidate because project 05b173fe99094a83b27ed3406025331a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:09:59.861114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.861825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:09:59.863787 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2464/4870] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:09:59 2022] DELETE /identity/v3/projects/05b173fe99094a83b27ed3406025331a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:09:59.867616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:09:59.914647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e64e6-cf8e-4574-90fd-00fe82e9d740 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:00.051744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:00.053893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:00.054732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:00.055025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] PATH_INFO: `/v3/users/8cf5135f180e44739ffd4c072521f700` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:00.056343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf5135f180e44739ffd4c072521f700)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:00.058533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:00.116052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf5135f180e44739ffd4c072521f700'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:00.116810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf5135f180e44739ffd4c072521f700'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:00.125264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf5135f180e44739ffd4c072521f700'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:00.126005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf5135f180e44739ffd4c072521f700'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:00.134866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf5135f180e44739ffd4c072521f700'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:00.158333 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2407/4871] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:09:59 2022] DELETE /identity/v3/users/8cf5135f180e44739ffd4c072521f700 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:00.835587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:00.839910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:00.876409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e065-c6b5-4807-9b93-9dafdd6f1b25 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:00.975245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:00.976754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.058707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:01.059887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.060262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.060416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] PATH_INFO: `/v3/projects/a504cdc020b74437aa81ceb6f94aaaef` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.062160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a504cdc020b74437aa81ceb6f94aaaef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:01.066367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:01.176693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a504cdc020b74437aa81ceb6f94aaaef', 'request_id': 'req-d78ed891-c191-447f-9fc9-548518fafb16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.177217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247356-3a11-46ac-9be8-3350d8cb700d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:01.187188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a504cdc020b74437aa81ceb6f94aaaef', 'request_id': 'req-d78ed891-c191-447f-9fc9-548518fafb16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.203558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a504cdc020b74437aa81ceb6f94aaaef', 'request_id': 'req-d78ed891-c191-447f-9fc9-548518fafb16'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.222088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] The token cache is being invalidate because project a504cdc020b74437aa81ceb6f94aaaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:01.222624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.225012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d78ed891-c191-447f-9fc9-548518fafb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.252394 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2465/4872] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:00 2022] DELETE /identity/v3/projects/a504cdc020b74437aa81ceb6f94aaaef => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:01.252394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830f24-a8d8-4a5f-801a-49b0829be394 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.252394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830f24-a8d8-4a5f-801a-49b0829be394 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.252394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830f24-a8d8-4a5f-801a-49b0829be394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.310142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fc830f24-a8d8-4a5f-801a-49b0829be394 None None] MFA Rules not processed for user `7ce296c1004c4976930f46de34be880d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:01.311475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fc830f24-a8d8-4a5f-801a-49b0829be394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.313197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:01.316195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.316650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.317237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] PATH_INFO: `/v3/projects/24bd526c25da4572bf839ada46d8e218` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.319037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24bd526c25da4572bf839ada46d8e218)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:01.325340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:01.466157 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2466/4873] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:01.466157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1961c9-c461-4953-9402-9268a1845ce5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.466157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1961c9-c461-4953-9402-9268a1845ce5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.466157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1961c9-c461-4953-9402-9268a1845ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.483516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bd526c25da4572bf839ada46d8e218', 'request_id': 'req-8c78e580-4b01-4d51-a36f-3f26322287b6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.484882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9a1961c9-c461-4953-9402-9268a1845ce5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:01.487154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9a1961c9-c461-4953-9402-9268a1845ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.492111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bd526c25da4572bf839ada46d8e218', 'request_id': 'req-8c78e580-4b01-4d51-a36f-3f26322287b6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.503163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bd526c25da4572bf839ada46d8e218', 'request_id': 'req-8c78e580-4b01-4d51-a36f-3f26322287b6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.522724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] The token cache is being invalidate because project 24bd526c25da4572bf839ada46d8e218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:01.523300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.524199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:01.526807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2408/4874] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:00 2022] DELETE /identity/v3/projects/24bd526c25da4572bf839ada46d8e218 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:01.527915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:01.532621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.593162 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2467/4875] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:01.593162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be48842-f5d7-4249-a19b-e9c62c7c3c1b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.593162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be48842-f5d7-4249-a19b-e9c62c7c3c1b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.593162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be48842-f5d7-4249-a19b-e9c62c7c3c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.616244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0be48842-f5d7-4249-a19b-e9c62c7c3c1b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:01.618005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0be48842-f5d7-4249-a19b-e9c62c7c3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.627632 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2468/4876] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:01.630166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea30a78-17d4-49dc-81b1-69ec601e189c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.630600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea30a78-17d4-49dc-81b1-69ec601e189c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.631201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea30a78-17d4-49dc-81b1-69ec601e189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.651006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4ea30a78-17d4-49dc-81b1-69ec601e189c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:01.651653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e580-4b01-4d51-a36f-3f26322287b6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:01.652735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ea30a78-17d4-49dc-81b1-69ec601e189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.657622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:01.658671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.659004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.659276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.661834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.662883 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2469/4877] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:01.664373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c17732-6c61-4267-913b-35a92e899322 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.664973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c17732-6c61-4267-913b-35a92e899322 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.665477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c17732-6c61-4267-913b-35a92e899322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.697790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-73c17732-6c61-4267-913b-35a92e899322 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:01.702115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-73c17732-6c61-4267-913b-35a92e899322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:01.709000 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2470/4878] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:01.710604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c17732-6c61-4267-913b-35a92e899322 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:01.725915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c17732-6c61-4267-913b-35a92e899322 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:01.741556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:01.742253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.742531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.742805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.743597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:01.743904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:01.746107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:01.766706 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2471/4879] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:10:01.767691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:01.782035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6502-13a1-4ad6-8055-cb14e3d3ef99 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:01.789807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:01.791059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.791375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.791736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.792522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:01.792864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:01.795007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:01.814310 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2472/4880] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:10:01.816017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:01.817982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:01.819424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:01.842798 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2409/4881] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:01.843485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:01.847143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c4bb2-f8e1-433f-8413-07c76308de39 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:01.854992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:01.855283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba22f6-7a4d-4c9e-b3ef-d852e0b36e47 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:01.855811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.856092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.856360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.857141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:01.860191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:01.867172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:01.868746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:01.869395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:01.869842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:01.870823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:01.874384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:01.905901 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2473/4882] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:01.910992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:01.927523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2410/4883] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:01.928471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.057695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366cfab-987d-4b46-bc56-0b4a5d34e8ab admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.070198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.071052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.071333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.071606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.073736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842adb-50a9-42b7-8eec-34e87bf97ee5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.075115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.081147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.083106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.083803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.084083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.084448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.085073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.088568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.122364 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2411/4884] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:02.126827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.135621 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2474/4885] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:01 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:02.139628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.140471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26cb3b-1286-423c-8144-55317363dd3f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.145792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.147026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.147318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.147593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.148324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.150053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.157963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79dcb0-060c-4067-992d-4cbff864d8d7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.165965 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2412/4886] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:02.166978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.170332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.171315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.171799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.177453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.179034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.181561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.192917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75bba-1471-4276-ba7b-0ff78292950d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.207397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2475/4887] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:10:02.214578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.225278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.226348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.226638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.232581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.233623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.240121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.253936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129c459-c2b3-4854-b6ae-408256a8f882 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.264907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.265626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.265904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.266175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.266907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.268537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.296450 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2413/4888] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:02.298495 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2476/4889] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:02.302451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.303493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.316659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a99a-4f77-4512-a77d-11eb66bf3728 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.321207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463c609-ebd3-4dd4-998b-3bbe6068686b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.333812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e2125-c42e-4e8d-ad6b-8d98be8510a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.334749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e2125-c42e-4e8d-ad6b-8d98be8510a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.335030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e2125-c42e-4e8d-ad6b-8d98be8510a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.335315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e2125-c42e-4e8d-ad6b-8d98be8510a4 admin admin] PATH_INFO: `/v3/projects/fa2b23705e604d36ae02cc8e63483b0a/users/371d28ee667143818e7f3800f6bcb2ff/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.335595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba9ada-b588-40a6-af24-146feb848690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.336517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba9ada-b588-40a6-af24-146feb848690 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.336795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba9ada-b588-40a6-af24-146feb848690 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.337085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba9ada-b588-40a6-af24-146feb848690 admin admin] PATH_INFO: `/v3/projects/92f38b2c41e34e73bd6baa83478dddfa/users/a6dcb8344fde4e4580e73efc09e633a7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.372168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e2125-c42e-4e8d-ad6b-8d98be8510a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2b23705e604d36ae02cc8e63483b0a, user_id=371d28ee667143818e7f3800f6bcb2ff, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.373772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba9ada-b588-40a6-af24-146feb848690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f38b2c41e34e73bd6baa83478dddfa, user_id=a6dcb8344fde4e4580e73efc09e633a7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.375840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e2125-c42e-4e8d-ad6b-8d98be8510a4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.382381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba9ada-b588-40a6-af24-146feb848690 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.407833 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2477/4890] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:02 2022] PUT /identity/v3/projects/92f38b2c41e34e73bd6baa83478dddfa/users/a6dcb8344fde4e4580e73efc09e633a7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:10:02.413071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.413739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.414239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.419570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2414/4891] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:02 2022] PUT /identity/v3/projects/fa2b23705e604d36ae02cc8e63483b0a/users/371d28ee667143818e7f3800f6bcb2ff/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:02.430037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.430349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.430592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.454105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:02.465712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:02.515636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] MFA Rules not processed for user `371d28ee667143818e7f3800f6bcb2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:02.516798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:02.590973 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2478/4892] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:10:02.629626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.631370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:02.691020 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2415/4893] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:10:02.781799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96112314-d067-46f8-a18c-cfd97462eadb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.788348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.789649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.790505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.791220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.831574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.834626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.836776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:02.837933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:02.850298 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2479/4894] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:02.858976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc9b6-0425-490d-b96c-684a825cae36 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:02.863312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a830-0fc0-4f2f-ac46-fa56a2a38361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:02.864422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a830-0fc0-4f2f-ac46-fa56a2a38361 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:02.864906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a830-0fc0-4f2f-ac46-fa56a2a38361 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:02.865414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a830-0fc0-4f2f-ac46-fa56a2a38361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:02.877218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629a830-0fc0-4f2f-ac46-fa56a2a38361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:02.879122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629a830-0fc0-4f2f-ac46-fa56a2a38361 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:02.893795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2416/4895] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:03.399479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:03.402100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:03.439458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c1d56-8a90-418a-8985-41de56f3e42d service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:03.456175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:03.458308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:03.459902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:03.460458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] PATH_INFO: `/v3/users/014c638dd7fb4df3b0aa53a195875330` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:03.464805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] RBAC: Authorizing `identity:delete_user(user_id=014c638dd7fb4df3b0aa53a195875330)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:03.476466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:03.586616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014c638dd7fb4df3b0aa53a195875330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:03.587515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014c638dd7fb4df3b0aa53a195875330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:03.599171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014c638dd7fb4df3b0aa53a195875330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:03.618698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014c638dd7fb4df3b0aa53a195875330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:03.619530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014c638dd7fb4df3b0aa53a195875330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:03.674739 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2480/4896] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:10:03 2022] DELETE /identity/v3/users/014c638dd7fb4df3b0aa53a195875330 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:03.676285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:03.676763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:03.676903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:03.730660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:03.735192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:03.826618 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2417/4897] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:03.867770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:03.869860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:03.958792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07faf2-d883-4469-90c6-5466097c373d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:03.964975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:03.965911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:03.966594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:03.966870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:03.988931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:03.993266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:04.017373 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2481/4898] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:04.421771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:04.424388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:04.444960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5201-78f9-4d12-9ad2-b1ef63169f5d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:04.450721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:04.451676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:04.452234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:04.452875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:04.455667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:04.585725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:04.589170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:04.608013 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2418/4899] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:04.780796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:04.782305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:04.810591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd589c-de85-413a-a1f6-e30c52802994 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:04.820545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:04.821548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:04.821826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:04.822105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] PATH_INFO: `/v3/projects/6378b2d9494c44929e409bc860a7215f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:04.824408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6378b2d9494c44929e409bc860a7215f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:04.826379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:04.897381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6378b2d9494c44929e409bc860a7215f', 'request_id': 'req-ade519a6-2596-4b40-85e6-3866a8d9c1a8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:04.906730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6378b2d9494c44929e409bc860a7215f', 'request_id': 'req-ade519a6-2596-4b40-85e6-3866a8d9c1a8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:04.919855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6378b2d9494c44929e409bc860a7215f', 'request_id': 'req-ade519a6-2596-4b40-85e6-3866a8d9c1a8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:04.937428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] The token cache is being invalidate because project 6378b2d9494c44929e409bc860a7215f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:04.938170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:04.939298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:04.942297 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2482/4900] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:04 2022] DELETE /identity/v3/projects/6378b2d9494c44929e409bc860a7215f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:04.946616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:04.962036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcef0-a1c9-4fab-bcf8-2e2563296597 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:05.110961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:05.112134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:05.112728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:05.113104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] PATH_INFO: `/v3/users/805b3800f0494956954100b49df3dc59` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:05.114438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805b3800f0494956954100b49df3dc59)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:05.116444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:05.244006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805b3800f0494956954100b49df3dc59'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:05.246168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805b3800f0494956954100b49df3dc59'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:05.259195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805b3800f0494956954100b49df3dc59'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:05.260301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805b3800f0494956954100b49df3dc59'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:05.277433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6271d323-c3e3-4b44-9437-40a9f0ed9d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805b3800f0494956954100b49df3dc59'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:05.316750 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2419/4901] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:10:04 2022] DELETE /identity/v3/users/805b3800f0494956954100b49df3dc59 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:06.150907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:06.153054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:06.175558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade519a6-2596-4b40-85e6-3866a8d9c1a8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:06.335780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:06.336701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:06.337452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:06.337954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] PATH_INFO: `/v3/projects/a55454c9572d426b949dbf7d7d396911` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:06.339966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55454c9572d426b949dbf7d7d396911)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:06.345641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:06.489458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55454c9572d426b949dbf7d7d396911', 'request_id': 'req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:06.511101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55454c9572d426b949dbf7d7d396911', 'request_id': 'req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:06.533773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55454c9572d426b949dbf7d7d396911', 'request_id': 'req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:06.552671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] The token cache is being invalidate because project a55454c9572d426b949dbf7d7d396911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:06.553894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:06.554809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fc6f927c-96bf-40cb-98fb-3a7e87f32a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:06.557259 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2483/4902] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:06 2022] DELETE /identity/v3/projects/a55454c9572d426b949dbf7d7d396911 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:06.562051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5425-c7ff-4c5a-879d-63d239245bf0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:06.563008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5425-c7ff-4c5a-879d-63d239245bf0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:06.563676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5425-c7ff-4c5a-879d-63d239245bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:06.586134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-88be5425-c7ff-4c5a-879d-63d239245bf0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:06.588436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-88be5425-c7ff-4c5a-879d-63d239245bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:06.672385 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2420/4903] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:10:06.679967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bf7d-c8be-4877-b79e-a0061b3b8eca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:06.680551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bf7d-c8be-4877-b79e-a0061b3b8eca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:06.681093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bf7d-c8be-4877-b79e-a0061b3b8eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:06.703535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fa85bf7d-c8be-4877-b79e-a0061b3b8eca None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:06.705139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fa85bf7d-c8be-4877-b79e-a0061b3b8eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:06.717416 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2484/4904] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:06.721182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be5425-c7ff-4c5a-879d-63d239245bf0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:06.734266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be5425-c7ff-4c5a-879d-63d239245bf0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:06.743230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:06.744411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:06.745507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:06.746001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:06.747129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:06.747869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:06.751262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:06.768238 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2421/4905] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:10:06.773845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bf7d-c8be-4877-b79e-a0061b3b8eca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:06.791397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bf7d-c8be-4877-b79e-a0061b3b8eca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:06.799905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:06.803069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:06.803289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:06.803395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:06.804110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:06.806148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:06.876179 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2485/4906] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:06 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:06.877620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:06.902981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c089a55-d2d8-43f9-b5ba-ab10be527c78 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:07.073987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:07.076081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.078414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.081092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.082089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:07.087351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:07.131117 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2422/4907] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:06 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:07.136639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:07.156461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e66b0-3e61-4745-be4f-a1cc18e8bfdd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:07.164003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:07.164816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.167732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.172389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.173343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:07.175041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:07.195394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:07.205165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2486/4908] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:07.212913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14bd3d-420c-4c74-8535-26d7926f67d6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:07.226522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582780-0c3f-44e4-bb04-0820574717e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:07.227854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582780-0c3f-44e4-bb04-0820574717e8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.230669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582780-0c3f-44e4-bb04-0820574717e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.232173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582780-0c3f-44e4-bb04-0820574717e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.240212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582780-0c3f-44e4-bb04-0820574717e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:07.243121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582780-0c3f-44e4-bb04-0820574717e8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:07.274256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:07.289627 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2423/4909] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:07.294424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865894-11f1-41d1-b90c-7d17072a2e3a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:07.304419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:07.305655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.306209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.306663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] PATH_INFO: `/v3/projects/adaec8ea9faa4d8aa706171d1551714e/users/4b287380a75748a88595ece4f1ffccd2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.331417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=adaec8ea9faa4d8aa706171d1551714e, user_id=4b287380a75748a88595ece4f1ffccd2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:07.339393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:07.364577 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2487/4910] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:07 2022] PUT /identity/v3/projects/adaec8ea9faa4d8aa706171d1551714e/users/4b287380a75748a88595ece4f1ffccd2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:07.375977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eba80-3182-4dd4-8aac-208aba88f7c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.376379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eba80-3182-4dd4-8aac-208aba88f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.376881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eba80-3182-4dd4-8aac-208aba88f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.468489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-126eba80-3182-4dd4-8aac-208aba88f7c0 None None] MFA Rules not processed for user `4b287380a75748a88595ece4f1ffccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:07.470213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-126eba80-3182-4dd4-8aac-208aba88f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:07.609254 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2424/4911] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:07.613571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:07.700932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13faf5-f296-48d0-b38c-6ea1d6127597 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.701222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13faf5-f296-48d0-b38c-6ea1d6127597 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.702564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13faf5-f296-48d0-b38c-6ea1d6127597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.774194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4d13faf5-f296-48d0-b38c-6ea1d6127597 None None] MFA Rules not processed for user `7ce296c1004c4976930f46de34be880d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:07.785388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4d13faf5-f296-48d0-b38c-6ea1d6127597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:07.814117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d977769-4fd0-4aa5-8fab-535a85410fbb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:07.819003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:07.819947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.827659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.829175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.830320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:07.833277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:07.876852 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2488/4912] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:07 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:10:07.881196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:07.920665 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2425/4913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:07.970267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509de48-e62c-49ff-befd-a929b79e03ee admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:07.992486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:07.993732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:07.994222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:07.994685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:07.997897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:08.000684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:08.043024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2489/4914] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:07 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:08.046772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13faf5-f296-48d0-b38c-6ea1d6127597 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:08.091458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13faf5-f296-48d0-b38c-6ea1d6127597 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:08.111700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:08.112855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:08.114464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:08.115467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:08.117113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:08.120102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:08.146390 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2426/4915] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:08.147838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:08.164487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270043-4a38-42df-b54a-74e7b7c000f4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:08.180768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:08.182039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:08.185422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:08.186025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] PATH_INFO: `/v3/projects/4f311065375d462c8e30ec01597731de/users/571e332ef68d4b9fb1914f605310f6ef/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:08.217487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f311065375d462c8e30ec01597731de, user_id=571e332ef68d4b9fb1914f605310f6ef, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:08.220551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:08.245213 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2490/4916] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:08 2022] PUT /identity/v3/projects/4f311065375d462c8e30ec01597731de/users/571e332ef68d4b9fb1914f605310f6ef/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:08.246743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:08.266553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef51c4-d23e-44b6-87f2-61bc652a6044 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:08.442982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903c3e9-6b17-4299-b2ec-7b11888d8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:08.444189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c3e9-6b17-4299-b2ec-7b11888d8c70 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:08.453672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c3e9-6b17-4299-b2ec-7b11888d8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:08.454401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c3e9-6b17-4299-b2ec-7b11888d8c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:08.455220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903c3e9-6b17-4299-b2ec-7b11888d8c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:08.456900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903c3e9-6b17-4299-b2ec-7b11888d8c70 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:08.480470 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2427/4917] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:10:08.484639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:08.499087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf4ef9-a428-460e-a7af-93a087eed6ef admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:08.504795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:08.505889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:08.506267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:08.506999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] PATH_INFO: `/v3/projects/4f311065375d462c8e30ec01597731de/users/571e332ef68d4b9fb1914f605310f6ef/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:08.511099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f311065375d462c8e30ec01597731de, user_id=571e332ef68d4b9fb1914f605310f6ef, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:08.521555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:08.551381 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2491/4918] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:08 2022] PUT /identity/v3/projects/4f311065375d462c8e30ec01597731de/users/571e332ef68d4b9fb1914f605310f6ef/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:08.562629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331114f-10a9-4ab9-9d1c-f35b34483ac4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:08.563172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331114f-10a9-4ab9-9d1c-f35b34483ac4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:08.563485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331114f-10a9-4ab9-9d1c-f35b34483ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:08.603005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7331114f-10a9-4ab9-9d1c-f35b34483ac4 None None] MFA Rules not processed for user `571e332ef68d4b9fb1914f605310f6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:08.604610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7331114f-10a9-4ab9-9d1c-f35b34483ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:08.751970 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2428/4919] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:08.849960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:08.851818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:08.951172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d363-d676-4ade-8a66-34a828c751c5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:08.955617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:08.956296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:08.957056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:08.957056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:08.986591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:08.988195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:09.000662 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2492/4920] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:15.292092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331114f-10a9-4ab9-9d1c-f35b34483ac4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:15.303162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:15.305362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:15.321902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331114f-10a9-4ab9-9d1c-f35b34483ac4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:15.337392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:15.337992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:15.338277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:15.341514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:15.349406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:15.390983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:15.392565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:15.446595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2429/4921] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:15.529443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8873cbb-5c35-4310-9ae3-b44717920e18 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:15.535116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:15.536293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:15.536756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:15.537337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] PATH_INFO: `/v3/users/a340104b44ec49f98a5aec0d0ce5a015` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:15.542986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a340104b44ec49f98a5aec0d0ce5a015)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:15.544856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:15.618674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a340104b44ec49f98a5aec0d0ce5a015'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:15.624351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a340104b44ec49f98a5aec0d0ce5a015'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:15.636288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a340104b44ec49f98a5aec0d0ce5a015'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:15.668322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a340104b44ec49f98a5aec0d0ce5a015'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:15.669555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59b43b08-e51f-476e-8947-e9d9deb0a73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a340104b44ec49f98a5aec0d0ce5a015'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:15.706079 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2493/4922] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:10:15 2022] DELETE /identity/v3/users/a340104b44ec49f98a5aec0d0ce5a015 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:16.837272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:16.853379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516466-93cf-42e6-9a4f-bfd835ce5630 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:16.919555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:16.920916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:16.921439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:16.926666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] PATH_INFO: `/v3/projects/78452efb7ef143efa0123d3bc4873b53` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:16.928613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78452efb7ef143efa0123d3bc4873b53)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:16.930854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:16.994095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78452efb7ef143efa0123d3bc4873b53', 'request_id': 'req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:17.001264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78452efb7ef143efa0123d3bc4873b53', 'request_id': 'req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:17.014724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78452efb7ef143efa0123d3bc4873b53', 'request_id': 'req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:17.030980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] The token cache is being invalidate because project 78452efb7ef143efa0123d3bc4873b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:17.032798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:17.033788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f59ee7a-cbd4-4e4b-ae9d-1a9611d49ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:17.036671 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2430/4923] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:16 2022] DELETE /identity/v3/projects/78452efb7ef143efa0123d3bc4873b53 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:17.043553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf155fb-7be0-4bb6-8ab5-13cc968b7bfc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.045265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf155fb-7be0-4bb6-8ab5-13cc968b7bfc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.045839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf155fb-7be0-4bb6-8ab5-13cc968b7bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.073362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cdf155fb-7be0-4bb6-8ab5-13cc968b7bfc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:17.076080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cdf155fb-7be0-4bb6-8ab5-13cc968b7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:17.176959 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2494/4924] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:17.186607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e90b4-8a23-49a5-bd6c-14b728084125 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.187138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e90b4-8a23-49a5-bd6c-14b728084125 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.187416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e90b4-8a23-49a5-bd6c-14b728084125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.209991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-412e90b4-8a23-49a5-bd6c-14b728084125 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:17.211538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-412e90b4-8a23-49a5-bd6c-14b728084125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:17.220467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2431/4925] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:10:17.225295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf155fb-7be0-4bb6-8ab5-13cc968b7bfc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:17.235621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf155fb-7be0-4bb6-8ab5-13cc968b7bfc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:17.241605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181a94-f940-410e-8826-f1234e2e4cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:17.242458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181a94-f940-410e-8826-f1234e2e4cae admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.242746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181a94-f940-410e-8826-f1234e2e4cae admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.243021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181a94-f940-410e-8826-f1234e2e4cae admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.243753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181a94-f940-410e-8826-f1234e2e4cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:17.254579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181a94-f940-410e-8826-f1234e2e4cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:17.254579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181a94-f940-410e-8826-f1234e2e4cae admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:17.269177 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2495/4926] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:10:17.271992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e90b4-8a23-49a5-bd6c-14b728084125 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:17.282536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e90b4-8a23-49a5-bd6c-14b728084125 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:17.289472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:17.290470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.290824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.291169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.292070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:17.294109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:17.320759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.321204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.323500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.369120 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2432/4927] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:17 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:17.373525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:17.380824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] MFA Rules not processed for user `a6dcb8344fde4e4580e73efc09e633a7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:17.382286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:17.533500 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2496/4928] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:17.545586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:17.547708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:17.568194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ece0f-a96b-4687-947d-f12b8cd64fec admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:17.580642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:17.581411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.582319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.582319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.584249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:17.585498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:17.628213 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2433/4929] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:17 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:17.631406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:17.647549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00012b-f126-4943-8867-d203a40a7301 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:17.654725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:17.655517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.655804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.656078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.657239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:17.659072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:17.672737 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2434/4930] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:17.676341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:17.676541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65762ce6-4756-447c-82c2-d9e770dad88b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:17.683715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:17.684697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.684830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.685086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.694899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:17.696848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc1358-02ca-4cf3-ba78-087e7d673995 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:17.697014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:17.704142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a585-39fb-4115-9777-6f64745642ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:17.706517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a585-39fb-4115-9777-6f64745642ce admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.706915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a585-39fb-4115-9777-6f64745642ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.707277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a585-39fb-4115-9777-6f64745642ce admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.708166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a585-39fb-4115-9777-6f64745642ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:17.710944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a585-39fb-4115-9777-6f64745642ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:17.714835 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2497/4931] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:10:17.760518 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2435/4932] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:17.764633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:17.779965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e0bb2-233b-44b8-bf0f-1105664f0a22 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:17.794701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f949-4ef9-483e-8c40-8e4010a5ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:17.795646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f949-4ef9-483e-8c40-8e4010a5ae53 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.795998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f949-4ef9-483e-8c40-8e4010a5ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.796274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f949-4ef9-483e-8c40-8e4010a5ae53 admin admin] PATH_INFO: `/v3/projects/dc556aaca1864bec914c801ea06a2c1c/users/e5b23242fec34285bfd83a86ae3cc847/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.830459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0f949-4ef9-483e-8c40-8e4010a5ae53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc556aaca1864bec914c801ea06a2c1c, user_id=e5b23242fec34285bfd83a86ae3cc847, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:17.833396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0f949-4ef9-483e-8c40-8e4010a5ae53 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:17.863509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2498/4933] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:17 2022] PUT /identity/v3/projects/dc556aaca1864bec914c801ea06a2c1c/users/e5b23242fec34285bfd83a86ae3cc847/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:17.873871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee709-4b8f-483f-aae8-011e27c556c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:17.874406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee709-4b8f-483f-aae8-011e27c556c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:17.874406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee709-4b8f-483f-aae8-011e27c556c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:17.925821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-51bee709-4b8f-483f-aae8-011e27c556c6 None None] MFA Rules not processed for user `e5b23242fec34285bfd83a86ae3cc847`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:17.927074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-51bee709-4b8f-483f-aae8-011e27c556c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:18.090610 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2436/4934] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:18.101823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:18.102384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:18.102384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:18.136523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] MFA Rules not processed for user `e5b23242fec34285bfd83a86ae3cc847`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:18.138879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:18.166520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2499/4935] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:18.193955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee709-4b8f-483f-aae8-011e27c556c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:18.321260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee709-4b8f-483f-aae8-011e27c556c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:18.336179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363d24d-a9b1-49aa-8aca-e48c965f2283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:18.336997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d24d-a9b1-49aa-8aca-e48c965f2283 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:18.337320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d24d-a9b1-49aa-8aca-e48c965f2283 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:18.337633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d24d-a9b1-49aa-8aca-e48c965f2283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:18.353712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363d24d-a9b1-49aa-8aca-e48c965f2283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:18.355458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363d24d-a9b1-49aa-8aca-e48c965f2283 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:18.384060 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2437/4936] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:19.070263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:19.072287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:19.174289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b7f2e-0cfc-4d6f-bc79-f66093d773ed None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:19.181907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:19.182955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:19.183256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:19.183717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] PATH_INFO: `/v3/users/371d28ee667143818e7f3800f6bcb2ff` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:19.185493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371d28ee667143818e7f3800f6bcb2ff)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:19.195866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:19.298644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371d28ee667143818e7f3800f6bcb2ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:19.299374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371d28ee667143818e7f3800f6bcb2ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:19.324959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371d28ee667143818e7f3800f6bcb2ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:19.342357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371d28ee667143818e7f3800f6bcb2ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:19.343419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371d28ee667143818e7f3800f6bcb2ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:19.383653 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2500/4937] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:10:19 2022] DELETE /identity/v3/users/371d28ee667143818e7f3800f6bcb2ff => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:19.385537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd402e-9ad5-4a79-a065-46d0665a7700 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:19.386037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd402e-9ad5-4a79-a065-46d0665a7700 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:19.386037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd402e-9ad5-4a79-a065-46d0665a7700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:19.409592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ebd402e-9ad5-4a79-a065-46d0665a7700 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:19.411243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ebd402e-9ad5-4a79-a065-46d0665a7700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:19.595420 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2438/4938] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:10:19.614059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:19.617190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:19.696243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:19.696527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:19.696981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:19.728475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] MFA Rules not processed for user `e5b23242fec34285bfd83a86ae3cc847`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:19.729915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:19.839465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45741251-61b0-4f4d-83c7-c9aa6fba8778 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:19.893183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60028b-536b-4d5d-a2ba-a7fffb6e8c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:19.893950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60028b-536b-4d5d-a2ba-a7fffb6e8c9c service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:19.895356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60028b-536b-4d5d-a2ba-a7fffb6e8c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:19.895356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60028b-536b-4d5d-a2ba-a7fffb6e8c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:19.910237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60028b-536b-4d5d-a2ba-a7fffb6e8c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:19.911808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60028b-536b-4d5d-a2ba-a7fffb6e8c9c service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:19.923754 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2439/4939] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:19.945954 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2501/4940] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:20.870136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:20.871925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:20.904381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c69ef-5991-4bf0-85a7-2535ca33ea73 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:20.933281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:20.934968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:20.935445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:20.935909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] PATH_INFO: `/v3/projects/fa2b23705e604d36ae02cc8e63483b0a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:20.937553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2b23705e604d36ae02cc8e63483b0a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:20.939769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:21.035179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2b23705e604d36ae02cc8e63483b0a', 'request_id': 'req-bc46d191-47bf-454c-964f-dff1c02455dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:21.042801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2b23705e604d36ae02cc8e63483b0a', 'request_id': 'req-bc46d191-47bf-454c-964f-dff1c02455dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:21.061890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2b23705e604d36ae02cc8e63483b0a', 'request_id': 'req-bc46d191-47bf-454c-964f-dff1c02455dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:21.079699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] The token cache is being invalidate because project fa2b23705e604d36ae02cc8e63483b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:21.080437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:21.081690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bc46d191-47bf-454c-964f-dff1c02455dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:21.087320 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2440/4941] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:20 2022] DELETE /identity/v3/projects/fa2b23705e604d36ae02cc8e63483b0a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:21.091612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca01a64-7882-4ffb-82ec-ffaaf0cae565 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.092506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca01a64-7882-4ffb-82ec-ffaaf0cae565 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.092991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca01a64-7882-4ffb-82ec-ffaaf0cae565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.127945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2ca01a64-7882-4ffb-82ec-ffaaf0cae565 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:21.134539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2ca01a64-7882-4ffb-82ec-ffaaf0cae565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:21.255760 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2502/4942] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:21.265601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0a99-633c-4a3d-b839-359c55f916a1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.266019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0a99-633c-4a3d-b839-359c55f916a1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.266388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0a99-633c-4a3d-b839-359c55f916a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.295082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-df4b0a99-633c-4a3d-b839-359c55f916a1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:21.296887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df4b0a99-633c-4a3d-b839-359c55f916a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:21.307215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2441/4943] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:21.311209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca01a64-7882-4ffb-82ec-ffaaf0cae565 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:21.328822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca01a64-7882-4ffb-82ec-ffaaf0cae565 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:21.347612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:21.348664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.349285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.350424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.352485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:21.352991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:21.355264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:21.370781 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2503/4944] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:10:21.375044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0a99-633c-4a3d-b839-359c55f916a1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:21.385206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0a99-633c-4a3d-b839-359c55f916a1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:21.390354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:21.391262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.391533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.391951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.395449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:21.398640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:21.433361 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2442/4945] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:21 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:10:21.437075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:21.462149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f37b7-b9cf-471e-889b-a8c8043d7bfe admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:21.583570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:21.584514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.584831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.585134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.586037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:21.590027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:21.633676 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2504/4946] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:21 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:10:21.637816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:21.650672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea9ce-fea1-486f-8086-2da7d2d41bff admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:21.656408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:21.657340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.657836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.658380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.659421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:21.661406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:21.673350 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2443/4947] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:21.677469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:21.694851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ed4df-ec3d-4155-a980-a4f06bdef521 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:21.703864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce8f3e-61fc-4000-b236-01b8bfbea0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:21.705456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce8f3e-61fc-4000-b236-01b8bfbea0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.705866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce8f3e-61fc-4000-b236-01b8bfbea0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.706189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce8f3e-61fc-4000-b236-01b8bfbea0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.707186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce8f3e-61fc-4000-b236-01b8bfbea0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:21.708920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce8f3e-61fc-4000-b236-01b8bfbea0b0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:21.742709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2505/4948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:21.748943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:21.767220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba7f2-bd19-4609-b687-bfc1631813db admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:21.784212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:21.785219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.785498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.786451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] PATH_INFO: `/v3/projects/57a28d6439b34d278a4d46a4c0960ade/users/e25f120609ce4107aa8bc544bb11231f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.830774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a28d6439b34d278a4d46a4c0960ade, user_id=e25f120609ce4107aa8bc544bb11231f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:21.838366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:21.868270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2444/4949] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:21 2022] PUT /identity/v3/projects/57a28d6439b34d278a4d46a4c0960ade/users/e25f120609ce4107aa8bc544bb11231f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:21.878688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58b31d-19af-4fed-bb94-d4c240da88ad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:21.879125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58b31d-19af-4fed-bb94-d4c240da88ad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:21.879471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58b31d-19af-4fed-bb94-d4c240da88ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:21.939854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ef58b31d-19af-4fed-bb94-d4c240da88ad None None] MFA Rules not processed for user `e25f120609ce4107aa8bc544bb11231f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:21.944100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef58b31d-19af-4fed-bb94-d4c240da88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:22.129901 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2506/4950] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:10:22.185359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:22.187845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:22.302816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dee08-6071-4b09-873f-97b3e8414619 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:22.308689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:22.309579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:22.310278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:22.310716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:22.323636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:22.326732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:22.341920 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2445/4951] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:25.032111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f628-a9f7-4cf7-bfb2-c8ba0ad2de8e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:25.032676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f628-a9f7-4cf7-bfb2-c8ba0ad2de8e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:25.032676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f628-a9f7-4cf7-bfb2-c8ba0ad2de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:25.105500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c423f628-a9f7-4cf7-bfb2-c8ba0ad2de8e None None] MFA Rules not processed for user `a6dcb8344fde4e4580e73efc09e633a7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:25.117842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c423f628-a9f7-4cf7-bfb2-c8ba0ad2de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:25.221343 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2507/4952] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:25.479338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:25.481567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:25.667435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56933374-6385-4543-9c45-edeae6d0a115 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:25.686039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '571e332ef68d4b9fb1914f605310f6ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f311065375d462c8e30ec01597731de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:25.686802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:25.687078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:25.687362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:25.688110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:25.688419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:25.690091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:25.722842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2446/4953] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:10:25.724049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f628-a9f7-4cf7-bfb2-c8ba0ad2de8e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:25.743775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f628-a9f7-4cf7-bfb2-c8ba0ad2de8e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:25.761680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '571e332ef68d4b9fb1914f605310f6ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f311065375d462c8e30ec01597731de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:25.762651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:25.764234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:25.764760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:25.769400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:25.777583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:25.877245 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2508/4954] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:25 2022] POST /identity/v3/projects => generated 349 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:25.880066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:25.900989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4152-76bf-4bb9-aaf5-245c7bc93aca tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:26.044386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '571e332ef68d4b9fb1914f605310f6ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f311065375d462c8e30ec01597731de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:26.045368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:26.045992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:26.046797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:26.047893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:26.048436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:26.050360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:26.077858 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2447/4955] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:10:27.271999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:27.286513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a510f0-521a-41fd-9c79-4959c51fed74 tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:27.302165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '571e332ef68d4b9fb1914f605310f6ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f311065375d462c8e30ec01597731de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:27.303088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:27.303370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:27.303645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] PATH_INFO: `/v3/projects/9b5271846dd3488aae999005abae5d5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:27.305139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b5271846dd3488aae999005abae5d5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:27.307945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:27.397367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5271846dd3488aae999005abae5d5c', 'request_id': 'req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:27.410616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5271846dd3488aae999005abae5d5c', 'request_id': 'req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:27.432390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5271846dd3488aae999005abae5d5c', 'request_id': 'req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:27.470742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] The token cache is being invalidate because project 9b5271846dd3488aae999005abae5d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:27.471197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:27.474099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b5e2063-e41a-4cb2-b344-3c8c4570b57f tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:27.477099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2509/4956] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:27 2022] DELETE /identity/v3/projects/9b5271846dd3488aae999005abae5d5c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:27.496178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:27.498756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:27.577903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af7a67-ec18-4403-bfc3-56a94084f01d tempest-RoutersAdminTest-1970726094 tempest-RoutersAdminTest-1970726094-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:27.660496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:27.661714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:27.662150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:27.662603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:27.665377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:27.835891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:27.839208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:27.863381 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2448/4957] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:31.831008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:31.831870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:31.832303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:31.852305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] MFA Rules not processed for user `2abb09d2f7844f3ba0f7a20787d73e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:31.853786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:31.928104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2510/4958] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:34.551396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:34.553182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:34.651303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ec61-21e1-46ad-9683-9f56c3076620 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:34.657385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb4481-acec-480a-ac6d-5c3fd7128ce8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:34.658450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb4481-acec-480a-ac6d-5c3fd7128ce8 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:34.658952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb4481-acec-480a-ac6d-5c3fd7128ce8 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:34.659472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb4481-acec-480a-ac6d-5c3fd7128ce8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:34.661999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ddb4481-acec-480a-ac6d-5c3fd7128ce8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:34.683517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb4481-acec-480a-ac6d-5c3fd7128ce8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:34.686373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb4481-acec-480a-ac6d-5c3fd7128ce8 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:34.701176 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2449/4959] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:38.478994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:38.480580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:38.665463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c0ae-419a-4faf-b0ab-5a17461f0707 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:38.676037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:38.678420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:38.678802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:38.679328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] PATH_INFO: `/v3/users/e25f120609ce4107aa8bc544bb11231f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:38.681690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25f120609ce4107aa8bc544bb11231f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:38.684187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:38.802905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25f120609ce4107aa8bc544bb11231f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:38.803930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25f120609ce4107aa8bc544bb11231f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:38.818547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25f120609ce4107aa8bc544bb11231f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:38.835535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25f120609ce4107aa8bc544bb11231f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:38.837226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25f120609ce4107aa8bc544bb11231f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:38.870466 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2511/4960] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:10:38 2022] DELETE /identity/v3/users/e25f120609ce4107aa8bc544bb11231f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:38.875783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:38.876305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:38.886452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:38.948247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:38.952130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:39.129614 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2450/4961] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:39.150018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:39.152195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:39.290125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03a498-7295-4c2d-939e-3b794dd88c8c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:39.302748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:39.304007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:39.304710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:39.305240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:39.329025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:39.335798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:39.359070 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2512/4962] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:40.179864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:40.182339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:40.205824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c0a39-8022-4d57-bfb9-13491da04159 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:40.212921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742408b1-c1bb-4764-94a9-184e03b4d0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:40.215694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742408b1-c1bb-4764-94a9-184e03b4d0bd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:40.216434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742408b1-c1bb-4764-94a9-184e03b4d0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:40.216906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742408b1-c1bb-4764-94a9-184e03b4d0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:40.228841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-742408b1-c1bb-4764-94a9-184e03b4d0bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:40.242016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742408b1-c1bb-4764-94a9-184e03b4d0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:40.244061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742408b1-c1bb-4764-94a9-184e03b4d0bd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:40.257421 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2451/4963] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:40.540071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:40.541716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:40.564124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2a6b-9402-4d7b-80ea-cfd26bd003a7 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:40.575339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:40.576255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:40.576733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:40.577245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] PATH_INFO: `/v3/projects/57a28d6439b34d278a4d46a4c0960ade` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:40.579833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a28d6439b34d278a4d46a4c0960ade)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:40.590996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:40.697820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a28d6439b34d278a4d46a4c0960ade', 'request_id': 'req-d398f42a-2f25-45c8-81f9-16565dff6903'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:40.707307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a28d6439b34d278a4d46a4c0960ade', 'request_id': 'req-d398f42a-2f25-45c8-81f9-16565dff6903'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:40.735612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a28d6439b34d278a4d46a4c0960ade', 'request_id': 'req-d398f42a-2f25-45c8-81f9-16565dff6903'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:40.756665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] The token cache is being invalidate because project 57a28d6439b34d278a4d46a4c0960ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:10:40.756951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:40.757876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d398f42a-2f25-45c8-81f9-16565dff6903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:10:40.761267 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2513/4964] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:10:40 2022] DELETE /identity/v3/projects/57a28d6439b34d278a4d46a4c0960ade => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:40.767663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54bd3-ee50-40b3-8068-4f2961f68dc5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:40.768566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54bd3-ee50-40b3-8068-4f2961f68dc5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:40.770807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54bd3-ee50-40b3-8068-4f2961f68dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:40.805128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cbe54bd3-ee50-40b3-8068-4f2961f68dc5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:40.807090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cbe54bd3-ee50-40b3-8068-4f2961f68dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:40.942528 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2452/4965] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:40.947945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3963d-f1c5-4e0c-88bf-7bd0f8e0818d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:40.948236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3963d-f1c5-4e0c-88bf-7bd0f8e0818d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:40.948515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3963d-f1c5-4e0c-88bf-7bd0f8e0818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.021528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5ed3963d-f1c5-4e0c-88bf-7bd0f8e0818d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:41.022816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ed3963d-f1c5-4e0c-88bf-7bd0f8e0818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:41.047074 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2514/4966] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:41.051718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54bd3-ee50-40b3-8068-4f2961f68dc5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.064836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54bd3-ee50-40b3-8068-4f2961f68dc5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:41.071367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:41.072143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.072431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.073343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.074220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:10:41.074533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:41.076190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:41.095166 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2453/4967] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:10:41.099813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3963d-f1c5-4e0c-88bf-7bd0f8e0818d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.114166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3963d-f1c5-4e0c-88bf-7bd0f8e0818d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:41.126376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:41.129701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.130187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.130622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.131591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:41.135592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:41.193832 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2515/4968] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:41 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:41.197755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.214503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef3d6-157f-4beb-a56f-edd2226730de admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:41.296342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:41.297848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.298325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.298736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.299771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:41.313537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:41.351531 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2454/4969] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:41 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:41.354427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.366587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1e37-4897-42de-b29a-de73fd89c784 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:41.372202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:41.373398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.373952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.374406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.375281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:41.377402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:41.395070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.401970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2516/4970] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:41.405874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673e3ca-a041-4519-aa2f-8aaa64ad8c69 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:41.411292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa645a-56f3-44b1-922c-38f8acafc050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:41.412241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa645a-56f3-44b1-922c-38f8acafc050 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.412673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa645a-56f3-44b1-922c-38f8acafc050 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.413149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa645a-56f3-44b1-922c-38f8acafc050 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.414428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa645a-56f3-44b1-922c-38f8acafc050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:41.416157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa645a-56f3-44b1-922c-38f8acafc050 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:41.433141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.439130 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2455/4971] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:10:41.445836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152268-773c-4c1f-bb51-ab9debba48c9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:41.451155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:41.452826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.453304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.453753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] PATH_INFO: `/v3/projects/d72cf766836c4811b624170c75eb7387/users/8a6f9e9ae0f7454db191ce65b69ad39b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.485668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72cf766836c4811b624170c75eb7387, user_id=8a6f9e9ae0f7454db191ce65b69ad39b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:41.488879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:41.534916 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2517/4972] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:41 2022] PUT /identity/v3/projects/d72cf766836c4811b624170c75eb7387/users/8a6f9e9ae0f7454db191ce65b69ad39b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:41.549394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae46e-5a93-4aca-bca1-709d8a78a833 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.549688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae46e-5a93-4aca-bca1-709d8a78a833 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.550555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae46e-5a93-4aca-bca1-709d8a78a833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.618829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-428ae46e-5a93-4aca-bca1-709d8a78a833 None None] MFA Rules not processed for user `8a6f9e9ae0f7454db191ce65b69ad39b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:41.620160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-428ae46e-5a93-4aca-bca1-709d8a78a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:41.720103 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2456/4973] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:41.730452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.843627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebfbc-dc5c-4560-a399-1a48b2b14b16 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:41.850605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:41.851424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:41.852244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:41.852626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:41.853512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:41.855578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:41.906755 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2518/4974] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:10:41 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:41.910708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ae46e-5a93-4aca-bca1-709d8a78a833 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:41.924807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ae46e-5a93-4aca-bca1-709d8a78a833 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:42.015135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:42.015924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:42.016209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:42.018749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:42.018749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:42.021923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:42.076122 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2457/4975] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:10:41 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:10:42.091356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:42.112095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8107e4-3497-49a9-848a-9cb62d0da8e3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:42.145744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:42.146464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:42.146647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:42.146923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:42.147662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:42.149339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:42.175781 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2519/4976] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:42.180102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:42.192132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d3147-2d96-48de-a78a-f348f2bd7efc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:42.202869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:42.208501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:42.210338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:42.210809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] PATH_INFO: `/v3/projects/3a029530a07947fe875cc26f1c2d5e99/users/f9af87ef8bd343f8a086eaa052e31c46/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:42.244528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a029530a07947fe875cc26f1c2d5e99, user_id=f9af87ef8bd343f8a086eaa052e31c46, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:42.249690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:42.270851 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2458/4977] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:42 2022] PUT /identity/v3/projects/3a029530a07947fe875cc26f1c2d5e99/users/f9af87ef8bd343f8a086eaa052e31c46/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:42.274683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:42.285811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11926ee-d643-4d31-9b49-15f7d2259560 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:42.405594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14499-61ec-42a3-8d61-f8bbc8e863a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:42.406591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14499-61ec-42a3-8d61-f8bbc8e863a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:42.407125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14499-61ec-42a3-8d61-f8bbc8e863a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:42.407769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14499-61ec-42a3-8d61-f8bbc8e863a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:42.408717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14499-61ec-42a3-8d61-f8bbc8e863a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:42.410961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14499-61ec-42a3-8d61-f8bbc8e863a2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:42.431142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2520/4978] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:10:42.432274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:42.463422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567fd0a-f349-4e08-b011-98c77809d794 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:42.476670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:42.481209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:42.481617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:42.481901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] PATH_INFO: `/v3/projects/3a029530a07947fe875cc26f1c2d5e99/users/f9af87ef8bd343f8a086eaa052e31c46/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:42.484274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a029530a07947fe875cc26f1c2d5e99, user_id=f9af87ef8bd343f8a086eaa052e31c46, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:42.487890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:42.507660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2459/4979] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:10:42 2022] PUT /identity/v3/projects/3a029530a07947fe875cc26f1c2d5e99/users/f9af87ef8bd343f8a086eaa052e31c46/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:10:42.518718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310ea98-67ae-421e-bdd1-d87bc66fd290 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:42.519301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310ea98-67ae-421e-bdd1-d87bc66fd290 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:42.519656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310ea98-67ae-421e-bdd1-d87bc66fd290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:42.613185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c310ea98-67ae-421e-bdd1-d87bc66fd290 None None] MFA Rules not processed for user `f9af87ef8bd343f8a086eaa052e31c46`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:10:42.620736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c310ea98-67ae-421e-bdd1-d87bc66fd290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:42.743975 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2521/4980] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:10:42.757622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:42.765104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:42.897387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850740-1789-4e7b-9e35-2e934f465b93 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:42.903796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:42.904478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:42.904757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:42.905249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:42.930986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:42.932421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:42.961981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2460/4981] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:43.130551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310ea98-67ae-421e-bdd1-d87bc66fd290 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:43.143611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310ea98-67ae-421e-bdd1-d87bc66fd290 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:43.152310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:43.153001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:43.153310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:43.153588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:43.325027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:43.326683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:43.353691 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2522/4982] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:10:48.478918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:10:48.480419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:48.604087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fbb98-9d28-4de0-8875-cd4889bbdce0 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:10:48.621460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594c12d-3ba4-4c1d-8df7-d5800448ba5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:10:48.622371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c12d-3ba4-4c1d-8df7-d5800448ba5a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:10:48.622909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c12d-3ba4-4c1d-8df7-d5800448ba5a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:10:48.623249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c12d-3ba4-4c1d-8df7-d5800448ba5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:10:48.627865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c594c12d-3ba4-4c1d-8df7-d5800448ba5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:10:48.646364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c12d-3ba4-4c1d-8df7-d5800448ba5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:10:48.648163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c12d-3ba4-4c1d-8df7-d5800448ba5a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:10:48.689334 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2461/4983] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:10:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:00.440588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:00.458577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346baf5-e66f-40ad-9f73-c5f142a37d10 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:00.471262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:00.474659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:00.474950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:00.475358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:00.480711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:00.513603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:00.515620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:00.538293 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2523/4984] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:09.283697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:09.284530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:09.284908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:09.297506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:09.298941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:09.322708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:09.324338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:09.400121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606ad3-0dac-48d5-8b0a-0f9a668a0453 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:09.407245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:09.408490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:09.408721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2462/4985] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:09.409333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:09.409808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] PATH_INFO: `/v3/users/4b287380a75748a88595ece4f1ffccd2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:09.411566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b287380a75748a88595ece4f1ffccd2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:09.419951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:09.477139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:09.479069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:09.491278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b287380a75748a88595ece4f1ffccd2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:09.492134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b287380a75748a88595ece4f1ffccd2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:09.502054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b287380a75748a88595ece4f1ffccd2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:09.515844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b287380a75748a88595ece4f1ffccd2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:09.517439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6110236-4043-40ef-a9ad-f18b373018bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b287380a75748a88595ece4f1ffccd2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:09.542439 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2524/4986] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:09 2022] DELETE /identity/v3/users/4b287380a75748a88595ece4f1ffccd2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:09.547524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:09.548079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:09.549176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:09.573840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:09.575560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:09.602584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbc2f1-b70f-4224-89cb-8af7008e38f1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:09.683141 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2525/4987] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:09.702499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:09.703899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:09.704603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:09.704918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:09.705210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:09.705442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:09.707265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:09.803398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:09.807469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:09.818980 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2463/4988] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:11:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:11:09.833434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5a22-c6bd-47f4-9f62-cce194bcaa47 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:09.842998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:09.843741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:09.844095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:09.844370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:09.858584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:09.860511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:09.903367 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2526/4989] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:10.394787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:10.397955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:10.426966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94398-f8de-4577-bb0c-4a0a1d5edfd0 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:10.434453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:10.435764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:10.436259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:10.436734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] PATH_INFO: `/v3/projects/adaec8ea9faa4d8aa706171d1551714e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:10.438501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=adaec8ea9faa4d8aa706171d1551714e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:10.441007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:10.530746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adaec8ea9faa4d8aa706171d1551714e', 'request_id': 'req-b1a0b42c-c87c-4965-ad90-1eca567b01ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.545697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adaec8ea9faa4d8aa706171d1551714e', 'request_id': 'req-b1a0b42c-c87c-4965-ad90-1eca567b01ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.562207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adaec8ea9faa4d8aa706171d1551714e', 'request_id': 'req-b1a0b42c-c87c-4965-ad90-1eca567b01ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.578266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] The token cache is being invalidate because project adaec8ea9faa4d8aa706171d1551714e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:10.578746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.579577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.581748 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2464/4990] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:10 2022] DELETE /identity/v3/projects/adaec8ea9faa4d8aa706171d1551714e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:10.585585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:10.601063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66970590-66b3-4b6b-b1a5-7f5e23c73d00 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:10.681391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:10.682712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:10.683186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:10.683667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] PATH_INFO: `/v3/users/571e332ef68d4b9fb1914f605310f6ef` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:10.686300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571e332ef68d4b9fb1914f605310f6ef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:10.689062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:10.749180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571e332ef68d4b9fb1914f605310f6ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.749885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571e332ef68d4b9fb1914f605310f6ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.757159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571e332ef68d4b9fb1914f605310f6ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.766875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571e332ef68d4b9fb1914f605310f6ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.768371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90146525-a2ac-46b7-971c-5c6667145562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571e332ef68d4b9fb1914f605310f6ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:10.793024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2527/4991] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:10 2022] DELETE /identity/v3/users/571e332ef68d4b9fb1914f605310f6ef => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:11.053248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:11.055295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:11.091604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0b42c-c87c-4965-ad90-1eca567b01ab admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:11.224911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:11.225943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.226350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.226507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] PATH_INFO: `/v3/projects/4f311065375d462c8e30ec01597731de` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.228112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f311065375d462c8e30ec01597731de)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:11.231853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:11.327595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f311065375d462c8e30ec01597731de', 'request_id': 'req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:11.335292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f311065375d462c8e30ec01597731de', 'request_id': 'req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:11.349286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f311065375d462c8e30ec01597731de', 'request_id': 'req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:11.364365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] The token cache is being invalidate because project 4f311065375d462c8e30ec01597731de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:11.364816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:11.365508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3f60f34e-c0db-4dbf-a9f5-788dbeb8f7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:11.367442 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2465/4992] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:11 2022] DELETE /identity/v3/projects/4f311065375d462c8e30ec01597731de => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:11.373357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ac25-0c30-448a-b31e-65bbd58e4942 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.373702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ac25-0c30-448a-b31e-65bbd58e4942 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.373980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ac25-0c30-448a-b31e-65bbd58e4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.397755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2341ac25-0c30-448a-b31e-65bbd58e4942 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:11.398979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2341ac25-0c30-448a-b31e-65bbd58e4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:11.480081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2528/4993] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:11.488344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a0c2-6af5-484d-936a-2338289519d9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.488915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a0c2-6af5-484d-936a-2338289519d9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.489066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a0c2-6af5-484d-936a-2338289519d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.514453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0cc7a0c2-6af5-484d-936a-2338289519d9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:11.515844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0cc7a0c2-6af5-484d-936a-2338289519d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:11.524602 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2466/4994] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:11.528998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ac25-0c30-448a-b31e-65bbd58e4942 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:11.541448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ac25-0c30-448a-b31e-65bbd58e4942 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:11.546609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:11.547369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.547960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.548290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.549808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:11.550238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:11.552008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:11.568148 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2529/4995] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:11.569421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a0c2-6af5-484d-936a-2338289519d9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:11.579178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a0c2-6af5-484d-936a-2338289519d9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:11.584394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:11.586538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.586538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.586538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.586538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:11.588607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:11.632223 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2467/4996] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:11 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:11.632553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:11.642426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38179cc-31ac-4ea8-9afa-4d967a537a38 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:11.729445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:11.731306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.731969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.732534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.733646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:11.735935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:11.775374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:11.775600 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2530/4997] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:11 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:11.787455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7b031-3e6a-47b1-822b-e58e3ce83020 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:11.794709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:11.796598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.797220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.797725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.798685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:11.800555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:11.819707 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2468/4998] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:11.829837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:11.856347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e834-f86d-4c9c-aab3-afdd2fe691f5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:11.862295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449834d-29b0-4cbb-95d3-1296a9be8f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:11.863230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449834d-29b0-4cbb-95d3-1296a9be8f37 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.863678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449834d-29b0-4cbb-95d3-1296a9be8f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.864324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449834d-29b0-4cbb-95d3-1296a9be8f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.865513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449834d-29b0-4cbb-95d3-1296a9be8f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:11.867542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449834d-29b0-4cbb-95d3-1296a9be8f37 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:11.901834 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2531/4999] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:11.903922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:11.916761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898675e-4c5a-45af-9769-83c88b08aacf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:11.922690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:11.924249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.924535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.924852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] PATH_INFO: `/v3/projects/78b84250ec9748bd9bda30bb77eeb991/users/2ee63f1348904a0e95a3876f36dfc393/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:11.945128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b84250ec9748bd9bda30bb77eeb991, user_id=2ee63f1348904a0e95a3876f36dfc393, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:11.948601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:11.971003 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2469/5000] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:11 2022] PUT /identity/v3/projects/78b84250ec9748bd9bda30bb77eeb991/users/2ee63f1348904a0e95a3876f36dfc393/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:11.982906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:11.983225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:11.983501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:12.014457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] MFA Rules not processed for user `2ee63f1348904a0e95a3876f36dfc393`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:12.015687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:12.095462 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2532/5001] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:12.105479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:12.107643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:12.205756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a74b1-7d00-4cac-bfb0-3f1b847fb58b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:12.209610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc1568-2da0-4e4b-bee2-a76afb8f406e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:12.210538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1568-2da0-4e4b-bee2-a76afb8f406e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:12.210892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1568-2da0-4e4b-bee2-a76afb8f406e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:12.211461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1568-2da0-4e4b-bee2-a76afb8f406e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:12.222978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc1568-2da0-4e4b-bee2-a76afb8f406e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:12.225096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc1568-2da0-4e4b-bee2-a76afb8f406e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:12.237133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2470/5002] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:17.430039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:17.431490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:17.547529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba369f-e0cf-4d36-8b7a-f27f959b327a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:17.555056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:17.556672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:17.557184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:17.557654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] PATH_INFO: `/v3/users/e5b23242fec34285bfd83a86ae3cc847` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:17.559398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b23242fec34285bfd83a86ae3cc847)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:17.561501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:17.640454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b23242fec34285bfd83a86ae3cc847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:17.641855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b23242fec34285bfd83a86ae3cc847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:17.654438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b23242fec34285bfd83a86ae3cc847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:17.669252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b23242fec34285bfd83a86ae3cc847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:17.670069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b23242fec34285bfd83a86ae3cc847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:17.695359 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2533/5003] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:17 2022] DELETE /identity/v3/users/e5b23242fec34285bfd83a86ae3cc847 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:17.700420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:17.700923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:17.701079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:17.727764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:17.729403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:17.814841 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2471/5004] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:17.824689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:17.829073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:17.914249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e1e0d-3599-4bc5-ae98-0b90cd0958b0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:17.957242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd28a1-77fa-4f71-a4ba-aa6faf13936d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:17.957948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd28a1-77fa-4f71-a4ba-aa6faf13936d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:17.958233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd28a1-77fa-4f71-a4ba-aa6faf13936d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:17.958510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd28a1-77fa-4f71-a4ba-aa6faf13936d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:17.988865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd28a1-77fa-4f71-a4ba-aa6faf13936d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:18.001989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd28a1-77fa-4f71-a4ba-aa6faf13936d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:18.031334 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2534/5005] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:18.770242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:18.771832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:18.786527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d63372-fa92-4c27-84ac-f5eaba13579e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:18.792525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:18.794171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:18.795317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:18.795860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] PATH_INFO: `/v3/projects/dc556aaca1864bec914c801ea06a2c1c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:18.826366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc556aaca1864bec914c801ea06a2c1c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:18.829902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:18.984325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc556aaca1864bec914c801ea06a2c1c', 'request_id': 'req-aa753f93-258e-4339-bf30-070f710cd10b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:19.012816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc556aaca1864bec914c801ea06a2c1c', 'request_id': 'req-aa753f93-258e-4339-bf30-070f710cd10b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:19.026724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc556aaca1864bec914c801ea06a2c1c', 'request_id': 'req-aa753f93-258e-4339-bf30-070f710cd10b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:19.076788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] The token cache is being invalidate because project dc556aaca1864bec914c801ea06a2c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:19.077182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:19.077798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aa753f93-258e-4339-bf30-070f710cd10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:19.082341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2472/5006] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:18 2022] DELETE /identity/v3/projects/dc556aaca1864bec914c801ea06a2c1c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:19.087396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c4ef9-8662-4663-a5b8-d61e03969544 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.087911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c4ef9-8662-4663-a5b8-d61e03969544 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.087911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c4ef9-8662-4663-a5b8-d61e03969544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.130542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3b0c4ef9-8662-4663-a5b8-d61e03969544 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:19.131805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3b0c4ef9-8662-4663-a5b8-d61e03969544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:19.273051 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2535/5007] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:19.275474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44990244-d8fa-47b1-8be5-21822fde8093 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.275474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44990244-d8fa-47b1-8be5-21822fde8093 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.275474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44990244-d8fa-47b1-8be5-21822fde8093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.318297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-44990244-d8fa-47b1-8be5-21822fde8093 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:19.319859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-44990244-d8fa-47b1-8be5-21822fde8093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:19.331691 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2473/5008] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:19.338456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c4ef9-8662-4663-a5b8-d61e03969544 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:19.356013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c4ef9-8662-4663-a5b8-d61e03969544 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:19.376918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:19.378635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.380655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.381117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.381938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:19.386604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:19.388524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:19.417955 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2536/5009] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:19.422415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44990244-d8fa-47b1-8be5-21822fde8093 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:19.454590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44990244-d8fa-47b1-8be5-21822fde8093 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:19.459966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:19.460773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.461166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.461498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.462278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:19.464723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:19.510998 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2474/5010] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:19 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:19.512443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:19.523755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546f2c2-46f6-47ea-919a-fdc4148584ee admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:19.646834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:19.647416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.647690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.648192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.652004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:19.659251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:19.741414 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2537/5011] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:19 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:19.743546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:19.757883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca24a4-89d9-48d1-8555-a9f1f5b93b3d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:19.763466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:19.764592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.765224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.765649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.766784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:19.768978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:19.788785 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2475/5012] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:19.792538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:19.804579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29351e37-3761-4cce-bd9b-eb0b51f4db4c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:19.810219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:19.811311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.811995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.812238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.813344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:19.815204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:19.833425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2538/5013] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:11:19.839626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:19.862911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e936e21-d2e1-49a7-b206-24fd5ae9633d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:19.870236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:19.872027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:19.894026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089e1dd-fe23-46a5-9f4a-08d2dbaa539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:19.894896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e1dd-fe23-46a5-9f4a-08d2dbaa539b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.895238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e1dd-fe23-46a5-9f4a-08d2dbaa539b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.895509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e1dd-fe23-46a5-9f4a-08d2dbaa539b admin admin] PATH_INFO: `/v3/projects/52aec4680cd54b72b29e0ecf9f956ea9/users/9b81f97cb916418bb6a8a27fc1353e85/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.899995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7ed76-1c83-4499-a83f-231b5c395281 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:19.910828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:19.911848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.912197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.913417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] PATH_INFO: `/v3/users/2ee63f1348904a0e95a3876f36dfc393` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:19.915180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee63f1348904a0e95a3876f36dfc393)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:19.920898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:19.923654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089e1dd-fe23-46a5-9f4a-08d2dbaa539b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52aec4680cd54b72b29e0ecf9f956ea9, user_id=9b81f97cb916418bb6a8a27fc1353e85, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:19.926613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089e1dd-fe23-46a5-9f4a-08d2dbaa539b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:19.954791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2476/5014] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:19 2022] PUT /identity/v3/projects/52aec4680cd54b72b29e0ecf9f956ea9/users/9b81f97cb916418bb6a8a27fc1353e85/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:19.967420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:19.967700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:19.968264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:20.013811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee63f1348904a0e95a3876f36dfc393'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.014817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee63f1348904a0e95a3876f36dfc393'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.022907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee63f1348904a0e95a3876f36dfc393'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.031074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] MFA Rules not processed for user `9b81f97cb916418bb6a8a27fc1353e85`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:20.032362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.041101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee63f1348904a0e95a3876f36dfc393'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.042101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-927ef833-6da3-402c-ac0c-0c09bda4f169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee63f1348904a0e95a3876f36dfc393'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.104087 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2539/5015] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:19 2022] DELETE /identity/v3/users/2ee63f1348904a0e95a3876f36dfc393 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:20.118810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:20.120043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:20.121013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:20.141756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2477/5016] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:20.146152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:20.147702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.151775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:20.153488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.233871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592c439-c766-45f3-be3a-9e2970c355a8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:20.254242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2540/5017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:20.264577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:20.267453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.340740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44adff7-7b24-4edf-befd-d432383c6cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:20.342480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44adff7-7b24-4edf-befd-d432383c6cac service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:20.342825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44adff7-7b24-4edf-befd-d432383c6cac service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:20.343680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44adff7-7b24-4edf-befd-d432383c6cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:20.385817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c544a0-3c87-410d-9729-38ecda234729 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:20.400815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:20.401320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:20.401604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:20.401956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:20.426963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:20.428839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:20.451100 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2541/5018] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:20.453843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:20.456434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.457423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44adff7-7b24-4edf-befd-d432383c6cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:20.459707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44adff7-7b24-4edf-befd-d432383c6cac service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:20.475010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af9537-fd3d-4654-9ac0-26af705bd4f3 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:20.482344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:20.483440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:20.483719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:20.484136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] PATH_INFO: `/v3/users/8a6f9e9ae0f7454db191ce65b69ad39b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:20.485387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6f9e9ae0f7454db191ce65b69ad39b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:20.487948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:20.496145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2478/5019] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:20.591034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6f9e9ae0f7454db191ce65b69ad39b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.593567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6f9e9ae0f7454db191ce65b69ad39b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.615065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6f9e9ae0f7454db191ce65b69ad39b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.633100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6f9e9ae0f7454db191ce65b69ad39b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.633719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6f9e9ae0f7454db191ce65b69ad39b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:20.656969 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2542/5020] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:20 2022] DELETE /identity/v3/users/8a6f9e9ae0f7454db191ce65b69ad39b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:20.661890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:20.662176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:20.662455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:20.689997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:20.691738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.759206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:20.760662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.821754 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2479/5021] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:20.833512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:20.835205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:20.921422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bd706-b948-41d6-ae03-0cf962039618 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:20.935420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:20.937288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:20.937574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:20.937849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] PATH_INFO: `/v3/projects/78b84250ec9748bd9bda30bb77eeb991` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:20.939295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b84250ec9748bd9bda30bb77eeb991)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:20.941279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:20.967269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1ef82-d170-42ff-9fd5-98f1dc74f418 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:20.976483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13657c71-521f-4bad-bde4-62dd27b828de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:20.977487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657c71-521f-4bad-bde4-62dd27b828de service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:20.977970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657c71-521f-4bad-bde4-62dd27b828de service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:20.978421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657c71-521f-4bad-bde4-62dd27b828de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.004589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13657c71-521f-4bad-bde4-62dd27b828de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.006440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13657c71-521f-4bad-bde4-62dd27b828de service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.022244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2480/5022] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:21.073017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b84250ec9748bd9bda30bb77eeb991', 'request_id': 'req-a72bc468-5410-44dc-a451-6ad5147fd8ee'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.089713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b84250ec9748bd9bda30bb77eeb991', 'request_id': 'req-a72bc468-5410-44dc-a451-6ad5147fd8ee'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.103957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b84250ec9748bd9bda30bb77eeb991', 'request_id': 'req-a72bc468-5410-44dc-a451-6ad5147fd8ee'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.117425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] The token cache is being invalidate because project 78b84250ec9748bd9bda30bb77eeb991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:21.117991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.118536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a72bc468-5410-44dc-a451-6ad5147fd8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.123549 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2543/5023] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:20 2022] DELETE /identity/v3/projects/78b84250ec9748bd9bda30bb77eeb991 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:21.126282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf53b2d-1676-49e4-82be-001fe326fe0b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.126774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf53b2d-1676-49e4-82be-001fe326fe0b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.127224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf53b2d-1676-49e4-82be-001fe326fe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.152534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-abf53b2d-1676-49e4-82be-001fe326fe0b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:21.154558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-abf53b2d-1676-49e4-82be-001fe326fe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:21.239485 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2481/5024] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:21.241298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0cea1-b792-4c22-b0a9-d41155fe6ee9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.241760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0cea1-b792-4c22-b0a9-d41155fe6ee9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.242200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0cea1-b792-4c22-b0a9-d41155fe6ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.284341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a1b0cea1-b792-4c22-b0a9-d41155fe6ee9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:21.285784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a1b0cea1-b792-4c22-b0a9-d41155fe6ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:21.301750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf53b2d-1676-49e4-82be-001fe326fe0b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.312149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf53b2d-1676-49e4-82be-001fe326fe0b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:21.313087 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2544/5025] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:21.317648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:21.318336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.318614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.318937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.319675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:21.319986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.321914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.342122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0cea1-b792-4c22-b0a9-d41155fe6ee9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.353662 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2482/5026] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:21.355176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0cea1-b792-4c22-b0a9-d41155fe6ee9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:21.361953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:21.362818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.363823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.364214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.365338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.375217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.427070 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2545/5027] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:21 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:21.431810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.442059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a97d9-18f4-421a-b70f-3aa53721a063 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:21.517637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:21.518466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.518747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.519009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.519751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.522075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.550765 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2483/5028] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:21 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:21.552384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.565728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c626f-fbd4-4ede-b9ea-2f99982af44d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:21.571114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:21.572186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.572689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.573428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.575052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.577085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.593094 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2546/5029] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:21.598524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.613981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6071-4202-4d0c-946a-0505491df0f5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:21.626030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.633507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:21.659488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:21.660199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.660479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.660760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.674863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.677296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.679752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4d7e-9d59-473e-bcff-8370ecc42e3b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:21.686326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:21.687505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.688016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.688440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] PATH_INFO: `/v3/projects/d72cf766836c4811b624170c75eb7387` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.689901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72cf766836c4811b624170c75eb7387)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.692417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.705372 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2484/5030] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:21.710454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.740079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748c0b6-5068-4456-9378-c29c5bf4bd6a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:21.762177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12575a37-04d1-4e30-bf8c-2e18ae79b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:21.767327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12575a37-04d1-4e30-bf8c-2e18ae79b694 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.767870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12575a37-04d1-4e30-bf8c-2e18ae79b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.768149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12575a37-04d1-4e30-bf8c-2e18ae79b694 admin admin] PATH_INFO: `/v3/projects/bd0504afdd8049e5883290466984b189/users/888c53168b654abeba992f50e8ed0697/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.810016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12575a37-04d1-4e30-bf8c-2e18ae79b694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0504afdd8049e5883290466984b189, user_id=888c53168b654abeba992f50e8ed0697, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:21.814520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12575a37-04d1-4e30-bf8c-2e18ae79b694 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:21.834521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72cf766836c4811b624170c75eb7387', 'request_id': 'req-eade2afb-f651-4ebd-a1cb-6a271b695644'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.836674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2485/5031] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:21 2022] PUT /identity/v3/projects/bd0504afdd8049e5883290466984b189/users/888c53168b654abeba992f50e8ed0697/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:21.842641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72cf766836c4811b624170c75eb7387', 'request_id': 'req-eade2afb-f651-4ebd-a1cb-6a271b695644'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.852423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:21.853202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:21.855255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:21.885227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72cf766836c4811b624170c75eb7387', 'request_id': 'req-eade2afb-f651-4ebd-a1cb-6a271b695644'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.898493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] MFA Rules not processed for user `888c53168b654abeba992f50e8ed0697`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:21.900410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:21.900613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] The token cache is being invalidate because project d72cf766836c4811b624170c75eb7387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:21.902104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.902909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:21.908010 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2547/5032] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:21 2022] DELETE /identity/v3/projects/d72cf766836c4811b624170c75eb7387 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:21.909577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:21.912987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:22.035403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2afb-f651-4ebd-a1cb-6a271b695644 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:22.045731 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2486/5033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:22.053973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:22.055875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:22.113258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:22.114166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:22.114442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:22.114713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] PATH_INFO: `/v3/users/f9af87ef8bd343f8a086eaa052e31c46` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:22.115927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9af87ef8bd343f8a086eaa052e31c46)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:22.118234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:22.153793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6afafe-199f-473b-a669-e3967925a055 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:22.159963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:22.160884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:22.161324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:22.161827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:22.173268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:22.175095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:22.188128 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2487/5034] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:22.193696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9af87ef8bd343f8a086eaa052e31c46'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:22.197701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9af87ef8bd343f8a086eaa052e31c46'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:22.206746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9af87ef8bd343f8a086eaa052e31c46'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:22.217324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9af87ef8bd343f8a086eaa052e31c46'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:22.218444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97cad607-a8e7-42dc-b4fe-3d3ffeba9d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9af87ef8bd343f8a086eaa052e31c46'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:22.300634 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2548/5035] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:21 2022] DELETE /identity/v3/users/f9af87ef8bd343f8a086eaa052e31c46 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:23.072366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:23.095283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066528bd-ae99-415d-b141-942c68dccc8e service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:23.244407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:23.245835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.246517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.246957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] PATH_INFO: `/v3/projects/3a029530a07947fe875cc26f1c2d5e99` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.248552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a029530a07947fe875cc26f1c2d5e99)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:23.250696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:23.330552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a029530a07947fe875cc26f1c2d5e99', 'request_id': 'req-279e5f35-354d-4529-a999-3515295e9202'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:23.342145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a029530a07947fe875cc26f1c2d5e99', 'request_id': 'req-279e5f35-354d-4529-a999-3515295e9202'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:23.354604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a029530a07947fe875cc26f1c2d5e99', 'request_id': 'req-279e5f35-354d-4529-a999-3515295e9202'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:23.374250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] The token cache is being invalidate because project 3a029530a07947fe875cc26f1c2d5e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:23.375281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:23.375451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-279e5f35-354d-4529-a999-3515295e9202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:23.377375 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2488/5036] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:23 2022] DELETE /identity/v3/projects/3a029530a07947fe875cc26f1c2d5e99 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:23.382623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd132d4-fcaf-479d-af11-0318e40ded4b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.383142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd132d4-fcaf-479d-af11-0318e40ded4b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.383254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd132d4-fcaf-479d-af11-0318e40ded4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.409559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7cd132d4-fcaf-479d-af11-0318e40ded4b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:23.411251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7cd132d4-fcaf-479d-af11-0318e40ded4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:23.489862 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2549/5037] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:23.497220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9640c-33ee-491c-80aa-00edc17c9ff8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.497731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9640c-33ee-491c-80aa-00edc17c9ff8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.498107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9640c-33ee-491c-80aa-00edc17c9ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.524279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-81c9640c-33ee-491c-80aa-00edc17c9ff8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:23.525549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-81c9640c-33ee-491c-80aa-00edc17c9ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:23.540112 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2489/5038] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:23.544530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd132d4-fcaf-479d-af11-0318e40ded4b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:23.556865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd132d4-fcaf-479d-af11-0318e40ded4b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:23.565711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:23.567036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.567740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.568379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.569438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:23.569853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:23.571780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:23.590169 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2550/5039] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:11:23.595047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9640c-33ee-491c-80aa-00edc17c9ff8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:23.610963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9640c-33ee-491c-80aa-00edc17c9ff8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:23.636686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:23.639210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.639547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.639922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.640649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:23.643084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:23.700434 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2490/5040] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:23 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:23.703317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:23.719428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21ea2c-4931-4394-9848-835fbc6d9f37 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:23.795816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:23.796517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.796970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.797480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.798394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:23.800574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:23.850087 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2551/5041] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:23 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:23.854496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:23.872258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d2f4-0a50-4589-81ee-7f9f59ed8928 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:23.880982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:23.882124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.882476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.883108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.886802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:23.889083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:23.908771 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2491/5042] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:23.909483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:23.921074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759921fe-dfce-4b8c-9656-5065baf3f39b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:23.927844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb50e1c-35cd-4dc7-8a04-2f87363e692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:23.928319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50e1c-35cd-4dc7-8a04-2f87363e692b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.928591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50e1c-35cd-4dc7-8a04-2f87363e692b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.928869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50e1c-35cd-4dc7-8a04-2f87363e692b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.929676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb50e1c-35cd-4dc7-8a04-2f87363e692b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:23.931322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb50e1c-35cd-4dc7-8a04-2f87363e692b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:23.945377 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2552/5043] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:23.946776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:23.967819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107e317-68f1-4d4a-bc37-7987c2af28e3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:23.973164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:23.974185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:23.974470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:23.974745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] PATH_INFO: `/v3/projects/6aa0bd05f69d4194b9e2c3a09b737abc/users/237443b66fcb46eaaea3ccee285d7633/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:23.989950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa0bd05f69d4194b9e2c3a09b737abc, user_id=237443b66fcb46eaaea3ccee285d7633, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:23.993118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.007722 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2492/5044] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:23 2022] PUT /identity/v3/projects/6aa0bd05f69d4194b9e2c3a09b737abc/users/237443b66fcb46eaaea3ccee285d7633/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:24.018349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e067d7-c77c-4319-a608-25697d69c6ed None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.018717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e067d7-c77c-4319-a608-25697d69c6ed None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.019089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e067d7-c77c-4319-a608-25697d69c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.046714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c1e067d7-c77c-4319-a608-25697d69c6ed None None] MFA Rules not processed for user `237443b66fcb46eaaea3ccee285d7633`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:24.048042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c1e067d7-c77c-4319-a608-25697d69c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:24.115546 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2553/5045] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:24.120204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:24.182989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692b94-9987-4ee8-88a5-10afec6f572b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:24.187984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:24.188645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.188919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.189219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.189940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:24.191843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.224874 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2493/5046] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:24 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:24.226057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e067d7-c77c-4319-a608-25697d69c6ed None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:24.237115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e067d7-c77c-4319-a608-25697d69c6ed None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:24.300149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:24.301001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.301433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.301857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.302773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:24.305135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.334783 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2554/5047] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:24 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:24.335975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:24.352014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc316a7-a6f4-4eed-94fe-61b5ee28cde4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:24.361052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:24.364739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.365285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.367283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.368395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:24.370998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.395320 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2494/5048] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:24.397735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:24.410604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a14d7a-57c5-4f70-94e8-842fdb4816b5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:24.416614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:24.417638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.418373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.418841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] PATH_INFO: `/v3/projects/3246a385261849308113c0c31b27eebc/users/da3d5fa676fa4f14819d41ca56effa10/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.437839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3246a385261849308113c0c31b27eebc, user_id=da3d5fa676fa4f14819d41ca56effa10, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:24.440612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.461856 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2555/5049] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:24 2022] PUT /identity/v3/projects/3246a385261849308113c0c31b27eebc/users/da3d5fa676fa4f14819d41ca56effa10/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:24.465940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:24.476934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd433b3-df57-48cd-a1a5-4498275651af admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:24.531646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822e075-766a-4e7d-b29a-f9df705705ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:24.532320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822e075-766a-4e7d-b29a-f9df705705ff admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.532596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822e075-766a-4e7d-b29a-f9df705705ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.532864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822e075-766a-4e7d-b29a-f9df705705ff admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.533615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822e075-766a-4e7d-b29a-f9df705705ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:24.535342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822e075-766a-4e7d-b29a-f9df705705ff admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.548227 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2495/5050] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:24.549441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:24.562403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa288536-7468-4216-8331-56db32410f68 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:24.568734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:24.570424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.570979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.572600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] PATH_INFO: `/v3/projects/3246a385261849308113c0c31b27eebc/users/da3d5fa676fa4f14819d41ca56effa10/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.575262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3246a385261849308113c0c31b27eebc, user_id=da3d5fa676fa4f14819d41ca56effa10, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:24.579274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.594655 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2556/5051] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:24 2022] PUT /identity/v3/projects/3246a385261849308113c0c31b27eebc/users/da3d5fa676fa4f14819d41ca56effa10/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:24.606508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2741cf-48cd-41a8-a0be-d16f681a45b9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.606791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2741cf-48cd-41a8-a0be-d16f681a45b9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.607063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2741cf-48cd-41a8-a0be-d16f681a45b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.634958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5c2741cf-48cd-41a8-a0be-d16f681a45b9 None None] MFA Rules not processed for user `da3d5fa676fa4f14819d41ca56effa10`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:24.636095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c2741cf-48cd-41a8-a0be-d16f681a45b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:24.733183 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2496/5052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:24.744588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:24.746851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:24.805608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991a0d-54af-444a-bc1d-105b67047759 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:24.809463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2e412-7f73-49b4-ac69-aecd34d9c049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:24.810112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e412-7f73-49b4-ac69-aecd34d9c049 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:24.810395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e412-7f73-49b4-ac69-aecd34d9c049 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:24.810660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e412-7f73-49b4-ac69-aecd34d9c049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:24.819686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2e412-7f73-49b4-ac69-aecd34d9c049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:24.821173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2e412-7f73-49b4-ac69-aecd34d9c049 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:24.830936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2557/5053] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:25.406161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2741cf-48cd-41a8-a0be-d16f681a45b9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:25.512369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2741cf-48cd-41a8-a0be-d16f681a45b9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:25.520415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:25.521634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:25.521943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:25.522427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] PATH_INFO: `/v3/users/237443b66fcb46eaaea3ccee285d7633` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:25.526316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=237443b66fcb46eaaea3ccee285d7633)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:25.529951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:25.614743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237443b66fcb46eaaea3ccee285d7633'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:25.615611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237443b66fcb46eaaea3ccee285d7633'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:25.628906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237443b66fcb46eaaea3ccee285d7633'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:25.630050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237443b66fcb46eaaea3ccee285d7633'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:25.642065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237443b66fcb46eaaea3ccee285d7633'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:25.669778 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2497/5054] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:25 2022] DELETE /identity/v3/users/237443b66fcb46eaaea3ccee285d7633 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:25.675354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:25.675863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:25.676031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:25.699587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:25.702111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:25.775278 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2558/5055] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:25.786893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:25.788939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:25.861614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23dcad-8bbb-4b76-b823-4e5b0ae2c42d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:25.866365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:25.867214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:25.867517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:25.867832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:25.880459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:25.882693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:25.895461 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2498/5056] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:11:26.248591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:26.251057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:26.271823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbafb5b-f5f3-4eba-b4cc-8270bf52c50b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:26.280871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:26.281665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:26.282039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:26.282421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] PATH_INFO: `/v3/projects/6aa0bd05f69d4194b9e2c3a09b737abc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:26.283932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa0bd05f69d4194b9e2c3a09b737abc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:26.286049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:26.370466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa0bd05f69d4194b9e2c3a09b737abc', 'request_id': 'req-0e16c617-70fc-4a5b-9a36-3a047163fe04'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.386563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa0bd05f69d4194b9e2c3a09b737abc', 'request_id': 'req-0e16c617-70fc-4a5b-9a36-3a047163fe04'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.399161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa0bd05f69d4194b9e2c3a09b737abc', 'request_id': 'req-0e16c617-70fc-4a5b-9a36-3a047163fe04'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.412772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] The token cache is being invalidate because project 6aa0bd05f69d4194b9e2c3a09b737abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:26.413141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.413801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.418817 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2559/5057] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:26 2022] DELETE /identity/v3/projects/6aa0bd05f69d4194b9e2c3a09b737abc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:26.422852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:26.446037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8113-1c22-4742-91d1-407b87c17ed0 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:26.525909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:26.527397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:26.528026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:26.528584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] PATH_INFO: `/v3/users/da3d5fa676fa4f14819d41ca56effa10` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:26.530714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3d5fa676fa4f14819d41ca56effa10)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:26.532927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:26.582948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3d5fa676fa4f14819d41ca56effa10'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.583923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3d5fa676fa4f14819d41ca56effa10'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.594847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3d5fa676fa4f14819d41ca56effa10'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.595703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3d5fa676fa4f14819d41ca56effa10'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.609927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3d5fa676fa4f14819d41ca56effa10'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.631770 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2499/5058] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:26 2022] DELETE /identity/v3/users/da3d5fa676fa4f14819d41ca56effa10 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:26.825206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:26.827747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:26.852808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16c617-70fc-4a5b-9a36-3a047163fe04 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:26.922324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:26.923789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:26.924274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:26.924553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] PATH_INFO: `/v3/users/9b81f97cb916418bb6a8a27fc1353e85` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:26.925920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b81f97cb916418bb6a8a27fc1353e85)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:26.927916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:26.971079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:26.973363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:26.994122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b81f97cb916418bb6a8a27fc1353e85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.994890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b81f97cb916418bb6a8a27fc1353e85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:26.997612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1f39-e2ca-468b-8148-22542853edaa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.008971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b81f97cb916418bb6a8a27fc1353e85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.016468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.018089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.018441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.018847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] PATH_INFO: `/v3/projects/3246a385261849308113c0c31b27eebc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.021469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b81f97cb916418bb6a8a27fc1353e85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.021685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3246a385261849308113c0c31b27eebc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.025061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.025434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70a79336-85a7-47a5-8945-a0857e877fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b81f97cb916418bb6a8a27fc1353e85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.051834 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2560/5059] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:26 2022] DELETE /identity/v3/users/9b81f97cb916418bb6a8a27fc1353e85 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:27.057156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.057751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.058396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.083952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:27.086000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:27.129436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3246a385261849308113c0c31b27eebc', 'request_id': 'req-a6b32240-67e1-4324-bbc5-2b000883ad82'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.140021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3246a385261849308113c0c31b27eebc', 'request_id': 'req-a6b32240-67e1-4324-bbc5-2b000883ad82'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.156905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3246a385261849308113c0c31b27eebc', 'request_id': 'req-a6b32240-67e1-4324-bbc5-2b000883ad82'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.164515 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2561/5060] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:27.176184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] The token cache is being invalidate because project 3246a385261849308113c0c31b27eebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:27.176583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.176885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:27.178464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a6b32240-67e1-4324-bbc5-2b000883ad82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:27.179151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:27.180400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2500/5061] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:26 2022] DELETE /identity/v3/projects/3246a385261849308113c0c31b27eebc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:27.186020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ed3f-96ec-4881-922b-563cfa6f8ef1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.186465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ed3f-96ec-4881-922b-563cfa6f8ef1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.186815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ed3f-96ec-4881-922b-563cfa6f8ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.223692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4da5ed3f-96ec-4881-922b-563cfa6f8ef1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:27.230080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4da5ed3f-96ec-4881-922b-563cfa6f8ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:27.302451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513875-9fc4-42bd-bf84-45aded36daba None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.370620 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2501/5062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:27.379131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a0d5-4690-4ccb-8899-25221e36f75b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.379633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a0d5-4690-4ccb-8899-25221e36f75b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.380192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a0d5-4690-4ccb-8899-25221e36f75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.408402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e444a0d5-4690-4ccb-8899-25221e36f75b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:27.410089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e444a0d5-4690-4ccb-8899-25221e36f75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:27.412224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.414465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.414465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.414465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.419503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:27.422993 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2502/5063] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:27.428698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444a0d5-4690-4ccb-8899-25221e36f75b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:27.446243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444a0d5-4690-4ccb-8899-25221e36f75b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.464514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.465946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.468656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.469674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.470416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.470831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.472416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:27.473624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.475790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.477175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2562/5064] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:27.491831 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2503/5065] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:27.498037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:27.518235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1a9b8-b71e-4cd6-b607-7dd1cedf287f service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.527977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.531184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.531915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.532211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.533023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.535877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.576486 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2563/5066] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:27 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:27.581470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:27.596598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0b6b9-be1e-43bc-9da7-bd2794dc756c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.716328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.717743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.718308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.718796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.720525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.723535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.758044 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2504/5067] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:27 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:27.762085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:27.781321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f8ac-25e4-4b9a-963d-63b587eb46a3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.790451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.791766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.792133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.792495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.793256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.799235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.846363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2564/5068] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:27.847335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:27.861514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff344b0-0eb0-4c90-b7be-13bd8ec3ba1b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.876780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0006ef3-92c9-4682-b8ff-00f0940f7572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.877840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0006ef3-92c9-4682-b8ff-00f0940f7572 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.879001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0006ef3-92c9-4682-b8ff-00f0940f7572 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.880063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0006ef3-92c9-4682-b8ff-00f0940f7572 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.881284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0006ef3-92c9-4682-b8ff-00f0940f7572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.884572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0006ef3-92c9-4682-b8ff-00f0940f7572 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.915786 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2505/5069] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:27.921164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:27.934561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd57b3-5c35-4939-8f3d-b905359366ba admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:27.940113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:27.941864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:27.941864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:27.941864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] PATH_INFO: `/v3/projects/e3dec084ee4e48db998269d15a7a7fab/users/0d465dbae54441d4a365ba3041be690d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:27.961121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dec084ee4e48db998269d15a7a7fab, user_id=0d465dbae54441d4a365ba3041be690d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:27.965328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:27.990272 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2565/5070] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:27 2022] PUT /identity/v3/projects/e3dec084ee4e48db998269d15a7a7fab/users/0d465dbae54441d4a365ba3041be690d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:28.002961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61655-2679-4988-8ec1-ce35e9f5bb20 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.003444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61655-2679-4988-8ec1-ce35e9f5bb20 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.004080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61655-2679-4988-8ec1-ce35e9f5bb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.065990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-49e61655-2679-4988-8ec1-ce35e9f5bb20 None None] MFA Rules not processed for user `0d465dbae54441d4a365ba3041be690d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:28.069356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-49e61655-2679-4988-8ec1-ce35e9f5bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:28.132426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.134891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:28.200466 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2506/5071] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:28.205839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e61655-2679-4988-8ec1-ce35e9f5bb20 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.262248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa83bc3-cb1c-49f3-8b46-ffe184fa3f8b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.272074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.275682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.275997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.276277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] PATH_INFO: `/v3/projects/52aec4680cd54b72b29e0ecf9f956ea9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.280596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=52aec4680cd54b72b29e0ecf9f956ea9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:28.288752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:28.326712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e61655-2679-4988-8ec1-ce35e9f5bb20 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.333392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.334239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.334608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.335000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.335853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:28.338475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:28.421503 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2507/5072] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:28 2022] POST /identity/v3/projects => generated 369 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:28.423999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.442046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52aec4680cd54b72b29e0ecf9f956ea9', 'request_id': 'req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:28.470078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52aec4680cd54b72b29e0ecf9f956ea9', 'request_id': 'req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:28.491822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52aec4680cd54b72b29e0ecf9f956ea9', 'request_id': 'req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:28.528313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] The token cache is being invalidate because project 52aec4680cd54b72b29e0ecf9f956ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:28.529061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:28.542760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8b0cf56-45d1-45f5-9332-ae97e76c5eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:28.546319 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2566/5073] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:28 2022] DELETE /identity/v3/projects/52aec4680cd54b72b29e0ecf9f956ea9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:28.554028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721f09-9030-4010-b52e-1cccad003fcd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.554028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721f09-9030-4010-b52e-1cccad003fcd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.554265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721f09-9030-4010-b52e-1cccad003fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.595954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab50b7-612e-43d6-9d54-89b741848816 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.616256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-94721f09-9030-4010-b52e-1cccad003fcd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:28.617497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-94721f09-9030-4010-b52e-1cccad003fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:28.628282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.642298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.642978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.646324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.647066 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2567/5074] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:28.648143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:28.655139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e719f5-97e4-4be8-8ebf-60ab121beb84 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.655543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e719f5-97e4-4be8-8ebf-60ab121beb84 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.655786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e719f5-97e4-4be8-8ebf-60ab121beb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.661551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:28.694229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-32e719f5-97e4-4be8-8ebf-60ab121beb84 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:28.695720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-32e719f5-97e4-4be8-8ebf-60ab121beb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:28.715478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2568/5075] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:28.719476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e719f5-97e4-4be8-8ebf-60ab121beb84 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.727758 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2508/5076] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:28 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:28.729799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.734048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:28.741539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e719f5-97e4-4be8-8ebf-60ab121beb84 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.753294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.754008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.754388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.754682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.755541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:28.755927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:28.758900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:28.761921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f0bd6-3076-4638-9e1d-19f964da1440 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.769314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.770066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.770360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.770639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.771378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:28.773007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:28.791731 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2509/5077] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:28.791731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.793808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:28.796180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2569/5078] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:28.798762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.813109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73c2a4-3b03-4e4d-96b9-2fd9a86e64ff admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.819717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.821177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.821698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.822206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] PATH_INFO: `/v3/projects/d90fd504cef04ac7b84e94e8da4e47f0/users/1d5e9a52d42b406ab81a1012f771b7b5/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.841348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90fd504cef04ac7b84e94e8da4e47f0, user_id=1d5e9a52d42b406ab81a1012f771b7b5, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:28.845284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:28.866024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2570/5079] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:28 2022] PUT /identity/v3/projects/d90fd504cef04ac7b84e94e8da4e47f0/users/1d5e9a52d42b406ab81a1012f771b7b5/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:28.868282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:28.895400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9ecba-0706-4a00-8f41-57dfc1e591c9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.947857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c4b4b-789e-48bc-9aae-3a3d806debbc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:28.959198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.960063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.960494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.961336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.962005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:28.964375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:28.980375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:28.982134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:28.982720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:28.983389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:28.985874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:29.000795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.003515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.015272 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2571/5080] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:28 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:29.015272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.023179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2510/5081] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:29.025551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.059499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdcc39-c027-4535-a6ec-fed85c928230 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.140906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.141776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.142147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.142521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.143308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.145538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.196973 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2511/5082] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:29 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:29.211015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.240837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863702-253f-439b-a0aa-b2850174adfc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.253486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068ca7-e9d8-4732-9f79-ff5c3a3075c0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.258537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.259276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.259527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.259773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.262034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.266443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.267138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.267404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.267670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.270223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.274462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.293608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.305729 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2512/5083] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:29.328099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.332591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2572/5084] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:29.339933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.345176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b39301-d56e-4f18-98f7-42ea777ec12d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.359632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.363337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fa7b-7a1f-493d-a11a-3d45a45b3881 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.365572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.366332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.367072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.369902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.373004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.376136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4fb32-a07d-4b22-a648-3ed3428ae59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.377235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4fb32-a07d-4b22-a648-3ed3428ae59c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.377795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4fb32-a07d-4b22-a648-3ed3428ae59c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.377928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4fb32-a07d-4b22-a648-3ed3428ae59c admin admin] PATH_INFO: `/v3/projects/d90fd504cef04ac7b84e94e8da4e47f0/users/1d5e9a52d42b406ab81a1012f771b7b5/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.380079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4fb32-a07d-4b22-a648-3ed3428ae59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90fd504cef04ac7b84e94e8da4e47f0, user_id=1d5e9a52d42b406ab81a1012f771b7b5, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.382975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4fb32-a07d-4b22-a648-3ed3428ae59c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.395153 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2513/5085] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:29.398613 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2573/5086] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:29 2022] PUT /identity/v3/projects/d90fd504cef04ac7b84e94e8da4e47f0/users/1d5e9a52d42b406ab81a1012f771b7b5/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:29.400180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.412872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.413598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.413942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.420452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a33c9d-b9fe-478a-9c51-1fe97ce4615e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.454455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] MFA Rules not processed for user `1d5e9a52d42b406ab81a1012f771b7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:29.458053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:29.510267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fcc0f-f544-46f6-8997-58a853df9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.511447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fcc0f-f544-46f6-8997-58a853df9bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.513523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fcc0f-f544-46f6-8997-58a853df9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.514295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fcc0f-f544-46f6-8997-58a853df9bd6 admin admin] PATH_INFO: `/v3/projects/1a59d9e7c09f414e9750653c3291992d/users/1c1ee9ee86a440c1b7416852950f0999/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.545535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fcc0f-f544-46f6-8997-58a853df9bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a59d9e7c09f414e9750653c3291992d, user_id=1c1ee9ee86a440c1b7416852950f0999, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.552992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fcc0f-f544-46f6-8997-58a853df9bd6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.581275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2514/5087] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:29 2022] PUT /identity/v3/projects/1a59d9e7c09f414e9750653c3291992d/users/1c1ee9ee86a440c1b7416852950f0999/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:29.593010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8862080-757a-4ed0-900f-f1dfe240ef06 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.593330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8862080-757a-4ed0-900f-f1dfe240ef06 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.593689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8862080-757a-4ed0-900f-f1dfe240ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.628994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2574/5088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:29.652568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.657857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:29.663094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f8862080-757a-4ed0-900f-f1dfe240ef06 None None] MFA Rules not processed for user `1c1ee9ee86a440c1b7416852950f0999`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:29.664318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f8862080-757a-4ed0-900f-f1dfe240ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:29.781221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379bda-99b2-49a3-9df1-e735ef88d43a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.818917 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2515/5089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:29.823970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8862080-757a-4ed0-900f-f1dfe240ef06 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:29.866857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.868986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.869557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.870136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.951130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.953103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:29.956430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8862080-757a-4ed0-900f-f1dfe240ef06 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:29.965468 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2575/5090] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:29.967659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:29.968755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:29.969330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:29.969890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:29.970910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:29.973495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:30.018957 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2516/5091] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:29 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:30.023546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:30.039910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee82e-c3da-40d3-a365-ac34349499dc service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:30.147338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:30.148743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:30.149263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:30.149608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:30.150557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:30.153141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:30.198659 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2576/5092] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:30 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:30.205401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:30.237269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237bfa8-362a-48ca-8a9e-91284805f4d5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:30.273830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:30.275445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:30.276065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:30.276861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:30.279673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:30.283616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:30.321570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2517/5093] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:30.326343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:30.344322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a56c6a-a722-4f7e-8371-6b8aae36dc51 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:30.365624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:30.366983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:30.368490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:30.368894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] PATH_INFO: `/v3/projects/04d257b0f45e478ca762217e7a20a14c/users/71f6c487f804467a8ba45ddc36d72ae0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:30.439211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d257b0f45e478ca762217e7a20a14c, user_id=71f6c487f804467a8ba45ddc36d72ae0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:30.450988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:30.495689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2577/5094] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:30 2022] PUT /identity/v3/projects/04d257b0f45e478ca762217e7a20a14c/users/71f6c487f804467a8ba45ddc36d72ae0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:30.497144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:30.508798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ec78-2c01-48c0-9dd0-29efd80013dd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:30.713186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be04f87-45f1-42ca-a65f-97f3c554fcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:30.713868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04f87-45f1-42ca-a65f-97f3c554fcfc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:30.714134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04f87-45f1-42ca-a65f-97f3c554fcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:30.714420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04f87-45f1-42ca-a65f-97f3c554fcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:30.719214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be04f87-45f1-42ca-a65f-97f3c554fcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:30.721007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be04f87-45f1-42ca-a65f-97f3c554fcfc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:30.748884 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2518/5095] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:30.753371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:30.767454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00c7f1-f98c-438c-940b-05743a0502ba admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:30.777767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:30.779472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:30.779849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:30.780250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] PATH_INFO: `/v3/projects/04d257b0f45e478ca762217e7a20a14c/users/71f6c487f804467a8ba45ddc36d72ae0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:30.782718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d257b0f45e478ca762217e7a20a14c, user_id=71f6c487f804467a8ba45ddc36d72ae0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:30.785724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:30.813905 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2578/5096] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:30 2022] PUT /identity/v3/projects/04d257b0f45e478ca762217e7a20a14c/users/71f6c487f804467a8ba45ddc36d72ae0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:30.828141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2afe4c-7898-401a-9183-472d9da2fe0a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:30.828693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2afe4c-7898-401a-9183-472d9da2fe0a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:30.829167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2afe4c-7898-401a-9183-472d9da2fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:30.882403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-be2afe4c-7898-401a-9183-472d9da2fe0a None None] MFA Rules not processed for user `71f6c487f804467a8ba45ddc36d72ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:30.883689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-be2afe4c-7898-401a-9183-472d9da2fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:31.056046 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2519/5097] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:31.057686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:31.075636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0307278-c45a-4d85-b5b0-5dcfe16af28d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:31.088837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:31.090437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:31.090955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:31.091436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:31.092537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:31.094659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:31.141260 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2579/5098] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:11:31 2022] POST /identity/v3/domains => generated 246 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:31.145585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2afe4c-7898-401a-9183-472d9da2fe0a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:31.159418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2afe4c-7898-401a-9183-472d9da2fe0a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:31.305458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:31.306253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:31.306542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:31.306822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:31.307593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:31.310307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:31.377304 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2520/5099] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:31 2022] POST /identity/v3/projects => generated 409 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:31.377517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:31.395115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dfb4f-ba6d-403a-814f-2673f7a20f34 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:31.477427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:31.478669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:31.479385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:31.479758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:31.480519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:31.483155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:31.518526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:31.533647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2a995-8676-4db4-9d47-e3e90cd36edb tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:31.536139 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2580/5100] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:31 2022] POST /identity/v3/users => generated 348 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:31.549303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118b9c-5eca-4817-9a6c-d0c650e455e6 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:31.550433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118b9c-5eca-4817-9a6c-d0c650e455e6 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:31.551923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118b9c-5eca-4817-9a6c-d0c650e455e6 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:31.552540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118b9c-5eca-4817-9a6c-d0c650e455e6 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:31.553564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118b9c-5eca-4817-9a6c-d0c650e455e6 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:31.556797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118b9c-5eca-4817-9a6c-d0c650e455e6 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:31.585479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:31.588259 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2521/5101] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:11:31.601732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666f4e5-ea3e-4d09-bfbe-dfbd31d73321 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:31.616361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dc26e-14fb-4f2b-9e50-f0cb7424b8df tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:31.617423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc26e-14fb-4f2b-9e50-f0cb7424b8df tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:31.617710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc26e-14fb-4f2b-9e50-f0cb7424b8df tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:31.617992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc26e-14fb-4f2b-9e50-f0cb7424b8df tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/projects/92b904c5628b48b88f7fbc86870b45e6/users/47dd213a877f4f4f8c9850294e322208/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:31.653368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dc26e-14fb-4f2b-9e50-f0cb7424b8df tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:create_grant(project_id=92b904c5628b48b88f7fbc86870b45e6, user_id=47dd213a877f4f4f8c9850294e322208, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:31.656421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dc26e-14fb-4f2b-9e50-f0cb7424b8df tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:31.695363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2581/5102] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:31 2022] PUT /identity/v3/projects/92b904c5628b48b88f7fbc86870b45e6/users/47dd213a877f4f4f8c9850294e322208/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:31.701429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f5fd-2ef8-4f7b-bc5a-be30cb784f52 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:31.701792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f5fd-2ef8-4f7b-bc5a-be30cb784f52 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:31.702121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f5fd-2ef8-4f7b-bc5a-be30cb784f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:31.933737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a924f5fd-2ef8-4f7b-bc5a-be30cb784f52 None None] MFA Rules not processed for user `47dd213a877f4f4f8c9850294e322208`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:31.935410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a924f5fd-2ef8-4f7b-bc5a-be30cb784f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:31.970654 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2522/5103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:31.981511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292707-7166-430f-81ff-9683f989d6ca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:31.981787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292707-7166-430f-81ff-9683f989d6ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:31.982074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292707-7166-430f-81ff-9683f989d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:32.015163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8b292707-7166-430f-81ff-9683f989d6ca None None] MFA Rules not processed for user `47dd213a877f4f4f8c9850294e322208`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:32.016529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8b292707-7166-430f-81ff-9683f989d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:32.033990 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2582/5104] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:32.038389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924f5fd-2ef8-4f7b-bc5a-be30cb784f52 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:32.054033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924f5fd-2ef8-4f7b-bc5a-be30cb784f52 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:32.061900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47dd213a877f4f4f8c9850294e322208', 'user_domain_id': '09f9d829da944594b74ea7a776f69d31', 'system_scope': None, 'project_id': '92b904c5628b48b88f7fbc86870b45e6', 'project_domain_id': '09f9d829da944594b74ea7a776f69d31', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:32.065290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:32.065290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:32.065290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:32.081773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:32.087931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:32.102526 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2523/5105] 10.222.0.30 () {56 vars in 1283 bytes} [Sat Apr 9 21:11:32 2022] GET /identity/v3/auth/tokens => generated 3352 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:32.108701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292707-7166-430f-81ff-9683f989d6ca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:32.200729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292707-7166-430f-81ff-9683f989d6ca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:32.209957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:32.210922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:32.211279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:32.211629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/users/47dd213a877f4f4f8c9850294e322208` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:32.214620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=47dd213a877f4f4f8c9850294e322208)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:32.217251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:32.319947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dd213a877f4f4f8c9850294e322208'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.323392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dd213a877f4f4f8c9850294e322208'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.334450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dd213a877f4f4f8c9850294e322208'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.344222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dd213a877f4f4f8c9850294e322208'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.345333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dd213a877f4f4f8c9850294e322208'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.357426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:32.387211 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2583/5106] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:32 2022] DELETE /identity/v3/users/47dd213a877f4f4f8c9850294e322208 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:32.395928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:32.405552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:32.478024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fc98d-ff82-4d40-ad10-5dcaa7553b58 tempest-test_project-385678740 tempest-user-1118182753] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:32.515575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edaccd6-4e9e-4b58-8e73-e2ae0b8e98f2 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:32.531541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:32.532444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:32.532722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:32.533308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/projects/92b904c5628b48b88f7fbc86870b45e6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:32.534975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:delete_project(project_id=92b904c5628b48b88f7fbc86870b45e6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:32.536937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:32.565008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:32.566217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:32.566516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:32.567170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] PATH_INFO: `/v3/users/0d465dbae54441d4a365ba3041be690d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:32.569811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d465dbae54441d4a365ba3041be690d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:32.573585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:32.604059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b904c5628b48b88f7fbc86870b45e6', 'request_id': 'req-c847cd3f-5f48-4735-94d0-267c283db7f3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.611774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b904c5628b48b88f7fbc86870b45e6', 'request_id': 'req-c847cd3f-5f48-4735-94d0-267c283db7f3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.624911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b904c5628b48b88f7fbc86870b45e6', 'request_id': 'req-c847cd3f-5f48-4735-94d0-267c283db7f3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.642556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] The token cache is being invalidate because project 92b904c5628b48b88f7fbc86870b45e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:32.642944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.643656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.649092 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2584/5107] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:32 2022] DELETE /identity/v3/projects/92b904c5628b48b88f7fbc86870b45e6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:32.650554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:32.650723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d465dbae54441d4a365ba3041be690d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.651545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d465dbae54441d4a365ba3041be690d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.654281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:32.664426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d465dbae54441d4a365ba3041be690d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.666404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d465dbae54441d4a365ba3041be690d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.683400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-06f3b624-0d60-4a08-933b-cb87a5948ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d465dbae54441d4a365ba3041be690d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.721418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2524/5108] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:32 2022] DELETE /identity/v3/users/0d465dbae54441d4a365ba3041be690d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:32.727501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:32.728289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:32.728796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:32.755792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:32.758228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:32.812845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cd3f-5f48-4735-94d0-267c283db7f3 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:32.891262 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2525/5109] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:32.913371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:32.914979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:32.939331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:32.941131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:32.941668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:32.941876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/domains/09f9d829da944594b74ea7a776f69d31` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:32.945790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=09f9d829da944594b74ea7a776f69d31)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:32.948137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:32.974985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '09f9d829da944594b74ea7a776f69d31'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:32.976219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '09f9d829da944594b74ea7a776f69d31'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.003132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68f56-84bb-40b6-a352-278836a2bd6d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:33.031340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '09f9d829da944594b74ea7a776f69d31'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.032292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '09f9d829da944594b74ea7a776f69d31'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.036860 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2585/5110] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:11:32 2022] PATCH /identity/v3/domains/09f9d829da944594b74ea7a776f69d31 => generated 247 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:11:33.041808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:33.044614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:33.111836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:33.113132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:33.113396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:33.116151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:33.120851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:33.181610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818c00-23eb-4342-b55f-cb3dfc298334 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:33.188112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f6c487f804467a8ba45ddc36d72ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04d257b0f45e478ca762217e7a20a14c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:33.190018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:33.190323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:33.190562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] PATH_INFO: `/v3/domains/09f9d829da944594b74ea7a776f69d31` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:33.206554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=09f9d829da944594b74ea7a776f69d31)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:33.210055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:33.242364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '09f9d829da944594b74ea7a776f69d31'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.246239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '09f9d829da944594b74ea7a776f69d31'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.252472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:33.254302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:33.273981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2526/5111] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:33.319615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f9d829da944594b74ea7a776f69d31', 'request_id': 'req-f6f2e530-9171-4536-9dc2-6124243aee72'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.333530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f9d829da944594b74ea7a776f69d31', 'request_id': 'req-f6f2e530-9171-4536-9dc2-6124243aee72'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.350350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f9d829da944594b74ea7a776f69d31', 'request_id': 'req-f6f2e530-9171-4536-9dc2-6124243aee72'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.375173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] The token cache is being invalidate because project 09f9d829da944594b74ea7a776f69d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:33.375475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.376279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.389522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '09f9d829da944594b74ea7a776f69d31', 'request_id': 'req-f6f2e530-9171-4536-9dc2-6124243aee72'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.398251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '09f9d829da944594b74ea7a776f69d31', 'request_id': 'req-f6f2e530-9171-4536-9dc2-6124243aee72'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.399088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f2e530-9171-4536-9dc2-6124243aee72 tempest-TestDefaultProjectId-744572375 tempest-TestDefaultProjectId-744572375-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '09f9d829da944594b74ea7a776f69d31', 'request_id': 'req-f6f2e530-9171-4536-9dc2-6124243aee72'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.407481 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2586/5112] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:11:33 2022] DELETE /identity/v3/domains/09f9d829da944594b74ea7a776f69d31 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:33.415116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:33.416568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:33.444229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aee65e-826c-4ad1-8258-41a43f69edc8 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:33.554588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:33.555498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:33.555759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:33.556032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] PATH_INFO: `/v3/users/1c1ee9ee86a440c1b7416852950f0999` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:33.557544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1ee9ee86a440c1b7416852950f0999)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:33.559427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:33.667071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1ee9ee86a440c1b7416852950f0999'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.668013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1ee9ee86a440c1b7416852950f0999'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.685271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1ee9ee86a440c1b7416852950f0999'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.687464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1ee9ee86a440c1b7416852950f0999'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.706906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1ee9ee86a440c1b7416852950f0999'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:33.732178 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2527/5113] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:33 2022] DELETE /identity/v3/users/1c1ee9ee86a440c1b7416852950f0999 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:33.737418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:33.737701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:33.737976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:33.760413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:33.765355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:33.886035 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2587/5114] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:33.904316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:33.905991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:33.991863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f62f7-9049-4403-beb8-6ab59aa75ef7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:33.996946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:33.997737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:33.998199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:33.998606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:34.015458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:34.019579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:34.020153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:34.021915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:34.044441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379625-5071-4e95-93d6-617fdc392b62 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:34.053246 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2528/5115] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:34.057759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:34.059019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:34.059703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:34.060059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] PATH_INFO: `/v3/projects/e3dec084ee4e48db998269d15a7a7fab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:34.066559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dec084ee4e48db998269d15a7a7fab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:34.070389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:34.163831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dec084ee4e48db998269d15a7a7fab', 'request_id': 'req-8bb44da1-933f-4402-9f64-c3b116a2e450'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.176406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dec084ee4e48db998269d15a7a7fab', 'request_id': 'req-8bb44da1-933f-4402-9f64-c3b116a2e450'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.190953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dec084ee4e48db998269d15a7a7fab', 'request_id': 'req-8bb44da1-933f-4402-9f64-c3b116a2e450'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.208249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] The token cache is being invalidate because project e3dec084ee4e48db998269d15a7a7fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:34.208680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.209405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bb44da1-933f-4402-9f64-c3b116a2e450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.211205 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2588/5116] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:34 2022] DELETE /identity/v3/projects/e3dec084ee4e48db998269d15a7a7fab => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:34.216100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:34.233340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:34.233751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:34.234111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:34.235359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ee2d-43aa-4633-89e7-4cac2487b881 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:34.274598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:34.276052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:34.346341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:34.347254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:34.347532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:34.348390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] PATH_INFO: `/v3/users/1d5e9a52d42b406ab81a1012f771b7b5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:34.350151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5e9a52d42b406ab81a1012f771b7b5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:34.353257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:34.389746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2589/5117] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:34.416242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:34.418131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:34.465975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5e9a52d42b406ab81a1012f771b7b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.466957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5e9a52d42b406ab81a1012f771b7b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.482678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5e9a52d42b406ab81a1012f771b7b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.483687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5e9a52d42b406ab81a1012f771b7b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.504135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5e9a52d42b406ab81a1012f771b7b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:34.553354 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2529/5118] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:34 2022] DELETE /identity/v3/users/1d5e9a52d42b406ab81a1012f771b7b5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:34.554706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d994-899f-4c54-a7fe-ea8b5b7826f2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:34.674091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:34.676654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:34.732084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:34.733393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:34.733691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:34.734020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:34.737260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:34.855557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9ef85-4266-4973-8f1b-328dc095b4d6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:34.862034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:34.864019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:34.872130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:34.875432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:34.876630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:34.876781 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2590/5119] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:11:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:11:34.879067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] PATH_INFO: `/v3/projects/1a59d9e7c09f414e9750653c3291992d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:34.883644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a59d9e7c09f414e9750653c3291992d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:34.888774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:34.994300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a59d9e7c09f414e9750653c3291992d', 'request_id': 'req-05d87c74-479c-4cc2-9958-bda321dfcf0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.009675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a59d9e7c09f414e9750653c3291992d', 'request_id': 'req-05d87c74-479c-4cc2-9958-bda321dfcf0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.035003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a59d9e7c09f414e9750653c3291992d', 'request_id': 'req-05d87c74-479c-4cc2-9958-bda321dfcf0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.079015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] The token cache is being invalidate because project 1a59d9e7c09f414e9750653c3291992d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:35.079908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.080881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.089135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2530/5120] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:34 2022] DELETE /identity/v3/projects/1a59d9e7c09f414e9750653c3291992d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:35.094827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:35.113434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407cbf9-c234-4f88-b65f-642eaefa9a09 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:35.131109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:35.133158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:35.314102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:35.315887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:35.316407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:35.316702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] PATH_INFO: `/v3/users/71f6c487f804467a8ba45ddc36d72ae0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:35.325402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f6c487f804467a8ba45ddc36d72ae0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:35.332093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:35.382729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d87c74-479c-4cc2-9958-bda321dfcf0d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:35.405241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:35.408802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:35.410915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:35.411224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] PATH_INFO: `/v3/projects/d90fd504cef04ac7b84e94e8da4e47f0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:35.419925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90fd504cef04ac7b84e94e8da4e47f0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:35.433770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:35.455060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f6c487f804467a8ba45ddc36d72ae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.455894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f6c487f804467a8ba45ddc36d72ae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.466072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f6c487f804467a8ba45ddc36d72ae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.483729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f6c487f804467a8ba45ddc36d72ae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.484662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b4b211d-0039-4633-9a2f-5dd14e9b71ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f6c487f804467a8ba45ddc36d72ae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.530002 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2591/5121] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:35 2022] DELETE /identity/v3/users/71f6c487f804467a8ba45ddc36d72ae0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:35.598998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90fd504cef04ac7b84e94e8da4e47f0', 'request_id': 'req-fec736bb-98ef-4531-a5b1-6feb6da16eb1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.606570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90fd504cef04ac7b84e94e8da4e47f0', 'request_id': 'req-fec736bb-98ef-4531-a5b1-6feb6da16eb1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.618374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90fd504cef04ac7b84e94e8da4e47f0', 'request_id': 'req-fec736bb-98ef-4531-a5b1-6feb6da16eb1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.642967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] The token cache is being invalidate because project d90fd504cef04ac7b84e94e8da4e47f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:35.643869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.644837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fec736bb-98ef-4531-a5b1-6feb6da16eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:35.646724 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2531/5122] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:35 2022] DELETE /identity/v3/projects/d90fd504cef04ac7b84e94e8da4e47f0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:35.654051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00924-5cda-41a8-8692-4bebdb2280b8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:35.655265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00924-5cda-41a8-8692-4bebdb2280b8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:35.655502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00924-5cda-41a8-8692-4bebdb2280b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:35.684792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4fe00924-5cda-41a8-8692-4bebdb2280b8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:35.686581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4fe00924-5cda-41a8-8692-4bebdb2280b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:35.851308 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2592/5123] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:35.860988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33854c-6c55-4aa7-8a23-e7f7b02e9fb2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:35.861847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33854c-6c55-4aa7-8a23-e7f7b02e9fb2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:35.862297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33854c-6c55-4aa7-8a23-e7f7b02e9fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:35.926733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f33854c-6c55-4aa7-8a23-e7f7b02e9fb2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:35.931946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f33854c-6c55-4aa7-8a23-e7f7b02e9fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:35.953794 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2532/5124] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:35.957639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00924-5cda-41a8-8692-4bebdb2280b8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:35.979464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00924-5cda-41a8-8692-4bebdb2280b8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:35.993407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:35.994212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:35.994597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:35.994951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:35.995755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:35.996063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:35.999281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:36.023662 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2593/5125] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:36.027853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33854c-6c55-4aa7-8a23-e7f7b02e9fb2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:36.042397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33854c-6c55-4aa7-8a23-e7f7b02e9fb2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:36.053590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:36.054280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.056034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.060762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.061610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:36.064860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:36.126417 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2533/5126] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:36 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:36.130974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:36.149420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf412e7-8625-42f7-869d-2c672a1d7c76 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:36.209003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:36.211794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:36.276860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:36.277613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.278459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.278742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.279469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:36.282613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:36.310931 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2594/5127] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:36 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:36.316212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:36.330589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463029-dd4d-4e66-8b7b-191f2ec61b35 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:36.345228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:36.345998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.346319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.346792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.348696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:36.355601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786242b-5c0d-4ec8-96c9-0be28ee93613 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:36.360601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:36.363981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:36.366296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.366296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.366296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] PATH_INFO: `/v3/projects/04d257b0f45e478ca762217e7a20a14c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.380431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d257b0f45e478ca762217e7a20a14c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:36.384569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:36.395709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2595/5128] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:36.399652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:36.422221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d43ec-c67e-4a7e-9eed-275f46664a5f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:36.428116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:36.429083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.429469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.429760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.430564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:36.434056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:36.474681 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2596/5129] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:36.485190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d257b0f45e478ca762217e7a20a14c', 'request_id': 'req-04fcefea-9785-47ef-9a30-03c91ef44575'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:36.490517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:36.495750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d257b0f45e478ca762217e7a20a14c', 'request_id': 'req-04fcefea-9785-47ef-9a30-03c91ef44575'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:36.509230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d257b0f45e478ca762217e7a20a14c', 'request_id': 'req-04fcefea-9785-47ef-9a30-03c91ef44575'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:36.521004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c069-9546-4319-81ac-8543299f28be admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:36.568865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] The token cache is being invalidate because project 04d257b0f45e478ca762217e7a20a14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:36.570087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:36.571896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04fcefea-9785-47ef-9a30-03c91ef44575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:36.589995 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2534/5130] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:36 2022] DELETE /identity/v3/projects/04d257b0f45e478ca762217e7a20a14c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:36.599776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380e2b-b224-445f-bfc1-b97530e3b9d1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.600656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380e2b-b224-445f-bfc1-b97530e3b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.606447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380e2b-b224-445f-bfc1-b97530e3b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.663845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-62380e2b-b224-445f-bfc1-b97530e3b9d1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:36.669388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62380e2b-b224-445f-bfc1-b97530e3b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:36.741160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f179b-8e5c-45cd-842e-74acc835baea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:36.742843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f179b-8e5c-45cd-842e-74acc835baea admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.743233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f179b-8e5c-45cd-842e-74acc835baea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.743367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f179b-8e5c-45cd-842e-74acc835baea admin admin] PATH_INFO: `/v3/projects/bd65e151f2844d9d975f47875ede6d49/users/1b7d13712cee41c582f5e901c75fc377/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.782367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f179b-8e5c-45cd-842e-74acc835baea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd65e151f2844d9d975f47875ede6d49, user_id=1b7d13712cee41c582f5e901c75fc377, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:36.785206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f179b-8e5c-45cd-842e-74acc835baea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:36.836888 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2597/5131] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:36 2022] PUT /identity/v3/projects/bd65e151f2844d9d975f47875ede6d49/users/1b7d13712cee41c582f5e901c75fc377/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:36.849923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.849923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.850265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.872351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2535/5132] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:36.881952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911931-0518-4da2-989d-2c1ff45890cc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:36.882608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911931-0518-4da2-989d-2c1ff45890cc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:36.883231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911931-0518-4da2-989d-2c1ff45890cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:36.953564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] MFA Rules not processed for user `1b7d13712cee41c582f5e901c75fc377`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:36.955490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:36.971722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4c911931-0518-4da2-989d-2c1ff45890cc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:36.974695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4c911931-0518-4da2-989d-2c1ff45890cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:37.058696 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2598/5133] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:37.062342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:37.064201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:37.284888 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2536/5134] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:37.286398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911931-0518-4da2-989d-2c1ff45890cc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:37.300128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911931-0518-4da2-989d-2c1ff45890cc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:37.311783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:37.313773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:37.314905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:37.317494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:37.320689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:37.321078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:37.323109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:37.323255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266fe2-de3c-4435-8134-1eb90eab8762 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:37.338228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:37.338623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:37.338901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:37.339246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:37.339966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:37.352294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:37.375887 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2537/5135] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:37.381110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:37.396015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2599/5136] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:37 2022] POST /identity/v3/projects => generated 379 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:37.400563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:37.413472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a519878-c83d-42b9-b9df-38c2377fca8a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:37.624182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e83a1c-66be-49ff-9d4d-5718753dead4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:37.646819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:37.648384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:37.648846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:37.649371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:37.650247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:37.653700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:37.654608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:37.656346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:37.658002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:37.658218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:37.658452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:37.664653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:37.700891 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2600/5137] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:37 2022] POST /identity/v3/users => generated 296 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:37.704514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:37.741000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891703b-5a9d-4d73-a8b3-962d4bfa85c9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:37.759090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:37.760427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:37.761221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:37.761679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:37.762475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:37.776135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:37.792775 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2538/5138] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:37 2022] POST /identity/v3/projects => generated 371 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:37.795801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:37.823453 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2601/5139] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:37.825367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:37.862809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce25a4f-1b02-4de1-9d56-ec5b6e2cfd80 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.006789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572db91-266b-4893-9c3b-64884e18c2d1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.007606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:38.008953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.009385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.009673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] PATH_INFO: `/v3/projects/72d13601c0854cab8b76a58fa5359772/users/aa7a4de61782499e9c3f7c21d13f9172/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.022565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:38.025334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.026596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.026883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.027962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:38.035257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:38.044260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d13601c0854cab8b76a58fa5359772, user_id=aa7a4de61782499e9c3f7c21d13f9172, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:38.049316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:38.090331 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2539/5141] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:37 2022] POST /identity/v3/users => generated 286 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:38.091020 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2602/5141] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:37 2022] PUT /identity/v3/projects/72d13601c0854cab8b76a58fa5359772/users/aa7a4de61782499e9c3f7c21d13f9172/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:38.094127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:38.095216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:38.175374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd988b14-49f4-4ea0-919f-dc2c9b82cd8c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.281257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abf78a-ad90-4e32-82f0-9c92b605db96 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.294375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:38.295210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.295492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.295768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.296921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:38.299477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:38.314430 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2603/5142] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:38.319099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:38.349093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933b18d-f376-4623-a3e3-bbe81d63b271 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.366709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:38.368474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.369408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.369781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.370701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:38.374475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:38.389961 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2604/5143] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:38.394762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:38.412923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1be66-5800-4156-a945-3ec4e8e5f661 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.419560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a7637-b946-429f-9a39-7d5cf97ed304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:38.421134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a7637-b946-429f-9a39-7d5cf97ed304 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.421487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a7637-b946-429f-9a39-7d5cf97ed304 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.421984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a7637-b946-429f-9a39-7d5cf97ed304 admin admin] PATH_INFO: `/v3/projects/11dfc974bfaa4642a3de4b2ceaee5841/users/78d2432dc26046b18072653c0a682275/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.463099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a7637-b946-429f-9a39-7d5cf97ed304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11dfc974bfaa4642a3de4b2ceaee5841, user_id=78d2432dc26046b18072653c0a682275, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:38.467693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a7637-b946-429f-9a39-7d5cf97ed304 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:38.501715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:38.506954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.506954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.506954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.510224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:38.516121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:38.529121 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2605/5144] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:38 2022] PUT /identity/v3/projects/11dfc974bfaa4642a3de4b2ceaee5841/users/78d2432dc26046b18072653c0a682275/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:38.537414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a29852-27f0-464d-ba91-4b8b9c795296 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.538216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a29852-27f0-464d-ba91-4b8b9c795296 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.538216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a29852-27f0-464d-ba91-4b8b9c795296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.541110 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2540/5145] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:38.562039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:38.589182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-95a29852-27f0-464d-ba91-4b8b9c795296 None None] MFA Rules not processed for user `78d2432dc26046b18072653c0a682275`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:38.591046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-95a29852-27f0-464d-ba91-4b8b9c795296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:38.594022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed175f8b-e6f6-4143-84a2-19189084ece2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.846918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4dff4-f5bc-4ad1-8359-23367faf72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:38.850880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4dff4-f5bc-4ad1-8359-23367faf72d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.852310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4dff4-f5bc-4ad1-8359-23367faf72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.852310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4dff4-f5bc-4ad1-8359-23367faf72d9 admin admin] PATH_INFO: `/v3/projects/72d13601c0854cab8b76a58fa5359772/users/aa7a4de61782499e9c3f7c21d13f9172/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:38.861476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4dff4-f5bc-4ad1-8359-23367faf72d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d13601c0854cab8b76a58fa5359772, user_id=aa7a4de61782499e9c3f7c21d13f9172, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:38.861707 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2606/5146] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:38.862629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a29852-27f0-464d-ba91-4b8b9c795296 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:38.874561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4dff4-f5bc-4ad1-8359-23367faf72d9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:38.899420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a29852-27f0-464d-ba91-4b8b9c795296 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:38.932274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2541/5147] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:38 2022] PUT /identity/v3/projects/72d13601c0854cab8b76a58fa5359772/users/aa7a4de61782499e9c3f7c21d13f9172/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:38.939666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:38.940945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:38.943296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:39.039620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] MFA Rules not processed for user `aa7a4de61782499e9c3f7c21d13f9172`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:39.039620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:39.059213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d2432dc26046b18072653c0a682275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11dfc974bfaa4642a3de4b2ceaee5841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:39.059933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:39.060986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:39.061140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] PATH_INFO: `/v3/auth/catalog` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:39.061735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:39.066200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:39.079303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2607/5148] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 21:11:38 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:39.082086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:39.159049 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2542/5149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:39.172705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:39.174395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:39.244140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd1b4f-076a-4ed6-9329-fea8fb491632 tempest-IdentityCatalogTest-36382983 tempest-IdentityCatalogTest-36382983-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:39.251820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:39.253274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:39.253546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:39.253875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] PATH_INFO: `/v3/users/78d2432dc26046b18072653c0a682275` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:39.255903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d2432dc26046b18072653c0a682275)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:39.258885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:39.296742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc0a2-03b9-4e85-9ef8-0f1610dbe134 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:39.303671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a019d6-6894-434e-ad2d-14e4f65cfd8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:39.304849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a019d6-6894-434e-ad2d-14e4f65cfd8f service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:39.305353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a019d6-6894-434e-ad2d-14e4f65cfd8f service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:39.305811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a019d6-6894-434e-ad2d-14e4f65cfd8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:39.320733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a019d6-6894-434e-ad2d-14e4f65cfd8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:39.322741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a019d6-6894-434e-ad2d-14e4f65cfd8f service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:39.337780 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2543/5150] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:39.361993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d2432dc26046b18072653c0a682275'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:39.364155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d2432dc26046b18072653c0a682275'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:39.388297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d2432dc26046b18072653c0a682275'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:39.403973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d2432dc26046b18072653c0a682275'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:39.405059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d2432dc26046b18072653c0a682275'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:39.441680 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2608/5151] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:39 2022] DELETE /identity/v3/users/78d2432dc26046b18072653c0a682275 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:39.449121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:39.449121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:39.449121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:39.506577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:39.509363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:39.724748 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2544/5152] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:39.743772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:39.746840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:40.040064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47ec67-00e4-48e1-89d9-93a5823eeb5b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:40.050416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:40.051376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:40.051761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:40.052149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:40.068982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:40.071312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:40.086214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2609/5153] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:40.209663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:40.216411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:40.334636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4463b94-c184-40e8-a703-170def3b56c3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:40.340925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7a4de61782499e9c3f7c21d13f9172', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d13601c0854cab8b76a58fa5359772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:40.341717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:40.342041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:40.342314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:40.343053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:40.343583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:40.345509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:40.365679 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2545/5154] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:40.370399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:40.384558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca968-4d3c-4c6d-b1b2-9aa54363cd16 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:40.414425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7a4de61782499e9c3f7c21d13f9172', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d13601c0854cab8b76a58fa5359772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:40.414683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:40.414847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:40.415127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:40.415836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:40.418224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:40.516412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2610/5155] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:40 2022] POST /identity/v3/projects => generated 354 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:40.522253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:40.538031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2eec7-ec3b-4367-b2e6-0d3fd332b36c tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:40.793937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7a4de61782499e9c3f7c21d13f9172', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d13601c0854cab8b76a58fa5359772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:40.796116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:40.796491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:40.797010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:40.798507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:40.799144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:40.801008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:40.822545 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2546/5156] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:41.052813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:41.074947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcbc2-744a-43fa-9b6e-91d6a559aefb tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:41.093360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7a4de61782499e9c3f7c21d13f9172', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d13601c0854cab8b76a58fa5359772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:41.094277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:41.094561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:41.094840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] PATH_INFO: `/v3/projects/6af88fa7d415474896b0a98e215df1b7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:41.097802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6af88fa7d415474896b0a98e215df1b7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:41.100101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:41.149686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:41.152024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:41.275142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af88fa7d415474896b0a98e215df1b7', 'request_id': 'req-ba4864ed-13ff-4d7e-861a-869c4cf4580d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.289259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af88fa7d415474896b0a98e215df1b7', 'request_id': 'req-ba4864ed-13ff-4d7e-861a-869c4cf4580d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.301451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af88fa7d415474896b0a98e215df1b7', 'request_id': 'req-ba4864ed-13ff-4d7e-861a-869c4cf4580d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.329940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] The token cache is being invalidate because project 6af88fa7d415474896b0a98e215df1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:41.332738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.335540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba4864ed-13ff-4d7e-861a-869c4cf4580d tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.338662 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2611/5157] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:41 2022] DELETE /identity/v3/projects/6af88fa7d415474896b0a98e215df1b7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:41.404988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf1c4-aa84-4ede-9573-17e8d6acbcb4 tempest-VolumeQuotaClassesTest-516235533 tempest-VolumeQuotaClassesTest-516235533-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:41.587898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:41.589257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:41.589795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:41.590363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] PATH_INFO: `/v3/projects/11dfc974bfaa4642a3de4b2ceaee5841` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:41.591884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11dfc974bfaa4642a3de4b2ceaee5841)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:41.594041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:41.730097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11dfc974bfaa4642a3de4b2ceaee5841', 'request_id': 'req-59c0db9c-c126-4635-b616-8d8546c9b6c2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.746549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11dfc974bfaa4642a3de4b2ceaee5841', 'request_id': 'req-59c0db9c-c126-4635-b616-8d8546c9b6c2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.761945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11dfc974bfaa4642a3de4b2ceaee5841', 'request_id': 'req-59c0db9c-c126-4635-b616-8d8546c9b6c2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.806460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] The token cache is being invalidate because project 11dfc974bfaa4642a3de4b2ceaee5841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:41.808266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.813966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:41.816924 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2547/5158] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:41 2022] DELETE /identity/v3/projects/11dfc974bfaa4642a3de4b2ceaee5841 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:41.821670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30491c98-715a-4fa1-b281-d1ba63810ac6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:41.822878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30491c98-715a-4fa1-b281-d1ba63810ac6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:41.823505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30491c98-715a-4fa1-b281-d1ba63810ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:41.872486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-30491c98-715a-4fa1-b281-d1ba63810ac6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:41.874801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-30491c98-715a-4fa1-b281-d1ba63810ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:41.881221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:41.883646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:42.100440 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2612/5159] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:42.109254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d932ba-2e68-42ed-8f17-b83a08dd61fe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.109608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d932ba-2e68-42ed-8f17-b83a08dd61fe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.109946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d932ba-2e68-42ed-8f17-b83a08dd61fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.122601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0db9c-c126-4635-b616-8d8546c9b6c2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.136464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.137572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.138559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.140042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] PATH_INFO: `/v3/users/1b7d13712cee41c582f5e901c75fc377` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.142592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7d13712cee41c582f5e901c75fc377)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.146324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.150433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-91d932ba-2e68-42ed-8f17-b83a08dd61fe None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:42.152705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-91d932ba-2e68-42ed-8f17-b83a08dd61fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:42.165007 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2613/5160] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:42.170753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d932ba-2e68-42ed-8f17-b83a08dd61fe None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:42.197552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d932ba-2e68-42ed-8f17-b83a08dd61fe None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.235143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.236549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.236780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.237089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.243225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7d13712cee41c582f5e901c75fc377'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:42.243446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:42.243717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.245702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7d13712cee41c582f5e901c75fc377'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:42.252079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.268241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7d13712cee41c582f5e901c75fc377'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:42.269558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7d13712cee41c582f5e901c75fc377'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:42.285765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc5f8096-ed61-4d5e-83f9-21ce0e8341b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7d13712cee41c582f5e901c75fc377'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:42.288628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2614/5161] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:42.304983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:42.324208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:42.357572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a6a9c-77e9-4ee9-8a5a-032545a17779 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.363059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.364025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.364470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.364935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.365763 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2548/5162] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:41 2022] DELETE /identity/v3/users/1b7d13712cee41c582f5e901c75fc377 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:42.366358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.369091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.371420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.371707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.372823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.439706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:42.440941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:42.442117 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2615/5163] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:42 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:42.446458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:42.566752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe532d5-ea84-49fb-b7ed-4b1ad0e7f4f7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.589677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.591389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.591686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.591970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.592722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.603665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.660559 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2616/5164] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:42 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:42.662715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:42.699801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181ca1f-f0d3-4899-bb4e-28e66fd614d2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.711848 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2549/5165] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:42.717204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.721780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.724555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:42.726209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.726645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.726764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:42.730354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.732133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.761029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2617/5166] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:42.762001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:42.783714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792d01-36d3-44c6-a355-b544e688180d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.783714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.783714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.783714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.784493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.784493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.784717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.805107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2618/5167] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:42.806743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:42.828273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508cd66-bb54-4efd-8387-ca2dad7ec259 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.845641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac5e1e-5bee-4cff-a68d-a7f0985ff207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.848390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5e1e-5bee-4cff-a68d-a7f0985ff207 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.848734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5e1e-5bee-4cff-a68d-a7f0985ff207 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.848945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5e1e-5bee-4cff-a68d-a7f0985ff207 admin admin] PATH_INFO: `/v3/projects/53660392583a4a7694e6c3e39d3a902f/users/afe6c99093404a7bb4c11fe019cd65b7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.864320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d705338-7b57-4afc-8981-b81510b8fc54 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:42.878515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:42.881256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.881532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.881868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.895969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac5e1e-5bee-4cff-a68d-a7f0985ff207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53660392583a4a7694e6c3e39d3a902f, user_id=afe6c99093404a7bb4c11fe019cd65b7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.902894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac5e1e-5bee-4cff-a68d-a7f0985ff207 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.936731 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2619/5168] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:42 2022] PUT /identity/v3/projects/53660392583a4a7694e6c3e39d3a902f/users/afe6c99093404a7bb4c11fe019cd65b7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:42.937002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:42.942810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:42.950259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:42.950484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:42.950711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:42.975466 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2550/5169] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:11:43.039987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] MFA Rules not processed for user `afe6c99093404a7bb4c11fe019cd65b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:43.041733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:43.201159 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2620/5170] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:43.202551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:43.212642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b81fae-0c70-4c70-98d0-1bf21e040129 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:43.351561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:43.353274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:43.353840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:43.354696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:43.356735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:43.359197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:43.424805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:43.426303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:43.450963 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2551/5171] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:43 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:43.457171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:43.504556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0aca9-29d2-45df-8d3f-280969c42928 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:43.686338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:43.687250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:43.687722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:43.688676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] PATH_INFO: `/v3/projects/bd65e151f2844d9d975f47875ede6d49` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:43.690729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd65e151f2844d9d975f47875ede6d49)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:43.694251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:43.762128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490ab4-5231-437b-9ab3-41dcb8ae583f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:43.779284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd65e151f2844d9d975f47875ede6d49', 'request_id': 'req-56c23bcc-a14f-47b2-90ae-4c949e14bea0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:43.786908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd65e151f2844d9d975f47875ede6d49', 'request_id': 'req-56c23bcc-a14f-47b2-90ae-4c949e14bea0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:43.801872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd65e151f2844d9d975f47875ede6d49', 'request_id': 'req-56c23bcc-a14f-47b2-90ae-4c949e14bea0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:43.818132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] The token cache is being invalidate because project bd65e151f2844d9d975f47875ede6d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:43.825114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:43.827478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:43.829715 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2621/5172] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:43 2022] DELETE /identity/v3/projects/bd65e151f2844d9d975f47875ede6d49 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:43.860093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:43.867590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:43.879337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:43.881223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:43.882459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:43.883009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:43.883881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:43.886824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:43.904089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c23bcc-a14f-47b2-90ae-4c949e14bea0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:43.925433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:43.927216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:43.929419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:43.930185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] PATH_INFO: `/v3/users/aa7a4de61782499e9c3f7c21d13f9172` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:43.932722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7a4de61782499e9c3f7c21d13f9172)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:43.934958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:43.939176 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2552/5173] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:43 2022] POST /identity/v3/users => generated 290 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:43.940817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:43.944904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:43.971119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954023d-9682-4cf8-9b8d-50332d80ae20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:43.980269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:43.981260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:43.981545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:43.982211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:43.983294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:43.985164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:44.003576 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2553/5174] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:44.008957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:44.069954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079a4cb-f2c5-4a8d-9273-2413e6abdf76 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:44.075434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7a4de61782499e9c3f7c21d13f9172'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:44.076201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7a4de61782499e9c3f7c21d13f9172'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:44.086095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7a4de61782499e9c3f7c21d13f9172'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:44.098847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:44.100028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:44.100533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:44.101013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:44.102139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:44.104028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:44.104482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7a4de61782499e9c3f7c21d13f9172'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:44.105240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b3af226e-ab0e-4160-96fe-620ba9968e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7a4de61782499e9c3f7c21d13f9172'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:44.127347 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2554/5175] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:44.131492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:44.142683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:44.150944 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2622/5176] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:43 2022] DELETE /identity/v3/users/aa7a4de61782499e9c3f7c21d13f9172 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:44.158433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928032c1-4308-418e-b30a-221dcb882aa9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:44.317805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:44.319301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:44.319591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:44.319873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] PATH_INFO: `/v3/projects/9e94c30126b94caaab0c95f1fb188b07/users/a0885dad72d54717866bfe0562fbc0fc/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:44.345888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e94c30126b94caaab0c95f1fb188b07, user_id=a0885dad72d54717866bfe0562fbc0fc, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:44.350069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:44.379700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2555/5177] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:44 2022] PUT /identity/v3/projects/9e94c30126b94caaab0c95f1fb188b07/users/a0885dad72d54717866bfe0562fbc0fc/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:44.391701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583eae-d463-4035-878e-b95e0d3fadfc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:44.392336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583eae-d463-4035-878e-b95e0d3fadfc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:44.392924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583eae-d463-4035-878e-b95e0d3fadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:44.462922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-74583eae-d463-4035-878e-b95e0d3fadfc None None] MFA Rules not processed for user `a0885dad72d54717866bfe0562fbc0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:44.464674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-74583eae-d463-4035-878e-b95e0d3fadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:44.619195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2623/5178] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:44.625008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:44.626998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:44.794613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6290f-a9d4-49dc-9ca5-748c047e60d5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:44.806096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24354d-87dd-4c82-899b-7a402ad52394 tempest-IdentityV3ProjectsTest-807395264 tempest-IdentityV3ProjectsTest-807395264-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe6c99093404a7bb4c11fe019cd65b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53660392583a4a7694e6c3e39d3a902f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:44.807479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24354d-87dd-4c82-899b-7a402ad52394 tempest-IdentityV3ProjectsTest-807395264 tempest-IdentityV3ProjectsTest-807395264-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:44.807938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24354d-87dd-4c82-899b-7a402ad52394 tempest-IdentityV3ProjectsTest-807395264 tempest-IdentityV3ProjectsTest-807395264-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:44.808414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24354d-87dd-4c82-899b-7a402ad52394 tempest-IdentityV3ProjectsTest-807395264 tempest-IdentityV3ProjectsTest-807395264-project] PATH_INFO: `/v3/users/afe6c99093404a7bb4c11fe019cd65b7/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:44.811216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24354d-87dd-4c82-899b-7a402ad52394 tempest-IdentityV3ProjectsTest-807395264 tempest-IdentityV3ProjectsTest-807395264-project] RBAC: Authorizing `identity:list_user_projects(user_id=afe6c99093404a7bb4c11fe019cd65b7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:44.813513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24354d-87dd-4c82-899b-7a402ad52394 tempest-IdentityV3ProjectsTest-807395264 tempest-IdentityV3ProjectsTest-807395264-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:44.912679 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2556/5179] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:11:44 2022] GET /identity/v3/users/afe6c99093404a7bb4c11fe019cd65b7/projects => generated 515 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:11:44.918596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8c6e-f689-4688-9c52-21bb6e029b59 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:44.919166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8c6e-f689-4688-9c52-21bb6e029b59 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:44.919258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8c6e-f689-4688-9c52-21bb6e029b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:44.977610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-930f8c6e-f689-4688-9c52-21bb6e029b59 None None] MFA Rules not processed for user `afe6c99093404a7bb4c11fe019cd65b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:44.978678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-930f8c6e-f689-4688-9c52-21bb6e029b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:45.022498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2624/5180] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:45.027569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.027875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.028210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.063939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] MFA Rules not processed for user `afe6c99093404a7bb4c11fe019cd65b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:45.066396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:45.195401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.models.token_model [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] User afe6c99093404a7bb4c11fe019cd65b7 has no access to project 9e94c30126b94caaab0c95f1fb188b07 {{(pid=102531) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Apr 09 21:11:45.200374 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 09 21:11:45.209884 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2557/5181] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 183 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 09 21:11:45.212874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f8c6e-f689-4688-9c52-21bb6e029b59 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:45.361063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f8c6e-f689-4688-9c52-21bb6e029b59 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:45.369020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:45.370485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.370774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.371048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] PATH_INFO: `/v3/users/afe6c99093404a7bb4c11fe019cd65b7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.373184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe6c99093404a7bb4c11fe019cd65b7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:45.375842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:45.406716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:45.408848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:45.441989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb6020-2741-41cb-b444-b39727b01c5b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:45.459219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:45.460840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.461397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.461970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] PATH_INFO: `/v3/projects/72d13601c0854cab8b76a58fa5359772` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.464244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d13601c0854cab8b76a58fa5359772)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:45.472510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe6c99093404a7bb4c11fe019cd65b7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.473563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe6c99093404a7bb4c11fe019cd65b7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.478264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:45.501767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe6c99093404a7bb4c11fe019cd65b7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.519558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe6c99093404a7bb4c11fe019cd65b7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.521393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a65fa3b-ca42-485f-84e0-5a3f0096b3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe6c99093404a7bb4c11fe019cd65b7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.580753 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2625/5182] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:45 2022] DELETE /identity/v3/users/afe6c99093404a7bb4c11fe019cd65b7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:45.586351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.587851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.588413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.600701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d13601c0854cab8b76a58fa5359772', 'request_id': 'req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.633843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:45.634922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d13601c0854cab8b76a58fa5359772', 'request_id': 'req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.635349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:45.667946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d13601c0854cab8b76a58fa5359772', 'request_id': 'req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.697111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] The token cache is being invalidate because project 72d13601c0854cab8b76a58fa5359772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:45.697407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.701854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1892a67b-8ff6-40b9-8be7-22153c8ec0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:45.708381 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2558/5183] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:45 2022] DELETE /identity/v3/projects/72d13601c0854cab8b76a58fa5359772 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:45.710477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dac3d-5cfa-49a7-bf16-6825e377c8e7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.710762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dac3d-5cfa-49a7-bf16-6825e377c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.711065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dac3d-5cfa-49a7-bf16-6825e377c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.770694 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2626/5184] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:45.770955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-512dac3d-5cfa-49a7-bf16-6825e377c8e7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:45.771325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-512dac3d-5cfa-49a7-bf16-6825e377c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:45.808646 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2559/5185] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:45.813127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:45.814844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:45.816303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae8581-2b37-4d22-ac8c-9fa0a98985c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.819652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae8581-2b37-4d22-ac8c-9fa0a98985c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.820064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae8581-2b37-4d22-ac8c-9fa0a98985c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.876944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-51ae8581-2b37-4d22-ac8c-9fa0a98985c0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:45.884146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-51ae8581-2b37-4d22-ac8c-9fa0a98985c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:45.906474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7a0b3-aafd-4ab3-a986-3844eac51788 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:45.913623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2560/5186] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:45.915009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:45.915244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae8581-2b37-4d22-ac8c-9fa0a98985c0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:45.915704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.915986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.916268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.930730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:45.932164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae8581-2b37-4d22-ac8c-9fa0a98985c0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:45.932638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:45.951028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:45.951362 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2627/5187] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:45.951476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:45.951704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:45.952016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:45.952872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:45.953279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:45.955848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:45.986942 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2561/5188] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:45.993663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:46.013808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547093-489a-446b-826a-43aed8a646a2 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:46.049633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:46.050341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:46.050617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:46.050888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:46.061768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:46.065943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:46.157182 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2628/5189] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:45 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:46.159185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:46.175942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30eb3-ba22-498e-9cd6-47293272bec9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:46.368182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:46.370893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:46.372410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:46.373767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:46.375573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:46.382776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:46.445400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2562/5190] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:46 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:46.449566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:46.467721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456883-f75b-43e3-968d-f694a7c93912 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:46.472789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:46.473890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:46.474486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:46.474828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:46.475884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:46.477936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:46.496680 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2629/5191] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:46.500511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:46.514396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3992c-4a54-41a1-ab52-893d8bb57771 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:46.536508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11870ac-9756-4935-a8b9-0144a3bd8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:46.541428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11870ac-9756-4935-a8b9-0144a3bd8761 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:46.541428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11870ac-9756-4935-a8b9-0144a3bd8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:46.541428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11870ac-9756-4935-a8b9-0144a3bd8761 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:46.541428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11870ac-9756-4935-a8b9-0144a3bd8761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:46.546206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11870ac-9756-4935-a8b9-0144a3bd8761 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:46.572856 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2563/5192] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:46.580915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:46.614351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bc31f-2a7b-4b35-97da-331dfe47e24a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:46.614351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:46.614351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:46.614351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:46.614901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] PATH_INFO: `/v3/projects/8ff962f8646c4b9c93e3ac77e4e750cb/users/10c382520b4140a1bc4b22ca495fd917/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:46.656187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff962f8646c4b9c93e3ac77e4e750cb, user_id=10c382520b4140a1bc4b22ca495fd917, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:46.659093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:46.686185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2630/5193] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:46 2022] PUT /identity/v3/projects/8ff962f8646c4b9c93e3ac77e4e750cb/users/10c382520b4140a1bc4b22ca495fd917/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:46.706165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94d46-e5dc-4c7d-a5b0-006d5a2d98c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:46.706453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94d46-e5dc-4c7d-a5b0-006d5a2d98c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:46.707087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94d46-e5dc-4c7d-a5b0-006d5a2d98c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:46.762096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-36e94d46-e5dc-4c7d-a5b0-006d5a2d98c6 None None] MFA Rules not processed for user `10c382520b4140a1bc4b22ca495fd917`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:46.765310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36e94d46-e5dc-4c7d-a5b0-006d5a2d98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:46.898134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2564/5194] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:46.903057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.019618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fea32d-5b9a-4ab5-9a8f-9235816390fd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:47.035810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:47.036837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:47.037311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:47.037786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:47.038736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:47.043378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:47.110168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94d46-e5dc-4c7d-a5b0-006d5a2d98c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.129080 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2631/5195] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:46 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:47.135965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94d46-e5dc-4c7d-a5b0-006d5a2d98c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:47.300335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:47.301028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:47.301339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:47.301624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:47.302323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:47.304303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:47.376761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.385408 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2565/5196] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:47 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:47.389542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2570d0-956b-4def-b834-0c4778286df6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:47.397279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:47.398354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:47.398354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:47.398581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:47.401731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:47.405363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:47.431295 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2632/5197] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:47.442118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.456518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f0c3b-eeea-4231-9fc8-fb728ffab00f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:47.463280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.466397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:47.482412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:47.483175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:47.483525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:47.483806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:47.484561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:47.487106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:47.494297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caf158-cf6f-43dc-8230-33f91653c373 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:47.503220 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2566/5198] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:47.504563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.522713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:47.525908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:47.526211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:47.526762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] PATH_INFO: `/v3/projects/53660392583a4a7694e6c3e39d3a902f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:47.530395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53660392583a4a7694e6c3e39d3a902f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:47.532399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:47.549079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eee95-b665-42fb-a3ae-79f0691e43f0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:47.563971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d64669-0d24-4453-8f87-6ff4773005c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:47.566098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64669-0d24-4453-8f87-6ff4773005c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:47.587501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64669-0d24-4453-8f87-6ff4773005c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:47.588337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64669-0d24-4453-8f87-6ff4773005c4 admin admin] PATH_INFO: `/v3/projects/e84e0b81d71f4bbe8cd048a5d3d61d0d/users/5438e4e2d88d4fa490203ef5d7d0ce2e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:47.641751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d64669-0d24-4453-8f87-6ff4773005c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84e0b81d71f4bbe8cd048a5d3d61d0d, user_id=5438e4e2d88d4fa490203ef5d7d0ce2e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:47.644354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d64669-0d24-4453-8f87-6ff4773005c4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:47.656867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53660392583a4a7694e6c3e39d3a902f', 'request_id': 'req-24ced8a0-9a3e-49f0-9d00-610d6539337c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:47.680562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53660392583a4a7694e6c3e39d3a902f', 'request_id': 'req-24ced8a0-9a3e-49f0-9d00-610d6539337c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:47.704655 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2567/5199] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:47 2022] PUT /identity/v3/projects/e84e0b81d71f4bbe8cd048a5d3d61d0d/users/5438e4e2d88d4fa490203ef5d7d0ce2e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:47.706426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:47.706877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:47.707344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:47.735875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53660392583a4a7694e6c3e39d3a902f', 'request_id': 'req-24ced8a0-9a3e-49f0-9d00-610d6539337c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:47.762491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] The token cache is being invalidate because project 53660392583a4a7694e6c3e39d3a902f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:47.763092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:47.765986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:47.767694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] MFA Rules not processed for user `5438e4e2d88d4fa490203ef5d7d0ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:47.769671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:47.771242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2633/5200] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:47 2022] DELETE /identity/v3/projects/53660392583a4a7694e6c3e39d3a902f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:47.774783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.778180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:47.922619 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2568/5201] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:47.924499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:47.930703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:48.003480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ced8a0-9a3e-49f0-9d00-610d6539337c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:48.122672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:48.124376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.124835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.125540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] PATH_INFO: `/v3/users/a0885dad72d54717866bfe0562fbc0fc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.129807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0885dad72d54717866bfe0562fbc0fc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:48.132128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:48.220324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502eff9-2ed5-4dc8-9068-cc19ad2d64c0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:48.234668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0885dad72d54717866bfe0562fbc0fc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:48.236000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:48.237857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.238855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0885dad72d54717866bfe0562fbc0fc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:48.239237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.240868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.242791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:48.250384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:48.264348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0885dad72d54717866bfe0562fbc0fc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:48.280365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0885dad72d54717866bfe0562fbc0fc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:48.280996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0885dad72d54717866bfe0562fbc0fc'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:48.307791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2569/5202] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:47 2022] POST /identity/v3/projects => generated 387 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:48.315669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:48.321593 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2634/5203] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:47 2022] DELETE /identity/v3/users/a0885dad72d54717866bfe0562fbc0fc => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:48.333759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:48.505627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac79f-bfaa-48ab-a134-f8a00842a213 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:48.603289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:48.604330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.604700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.604977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.605776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:48.608111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:48.646888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:48.647501 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2570/5204] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:48 2022] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:48.659816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc200b7-e84c-4f4d-8c85-613e8a1dfbbc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:48.666027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:48.667016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.667353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.667695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.668491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:48.670327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:48.682529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2635/5205] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:11:48.687009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:48.714437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96256e-0003-4a34-a4fa-1dc172cd34af admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:48.724796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:48.725748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.726030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.726295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] PATH_INFO: `/v3/projects/7d4e539da0d04702b8556ca3b11344b6/users/8b7e31fab4c14e44b6348b0e5fcdca2c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.744420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4e539da0d04702b8556ca3b11344b6, user_id=8b7e31fab4c14e44b6348b0e5fcdca2c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:48.747578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:48.764278 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2571/5206] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:48 2022] PUT /identity/v3/projects/7d4e539da0d04702b8556ca3b11344b6/users/8b7e31fab4c14e44b6348b0e5fcdca2c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:48.768075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:48.778853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950def55-b6fe-4ab6-b62d-1335756cf9ba admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:48.847290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b47b14-806a-4ebc-9b28-3d17ee7eb11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:48.848021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47b14-806a-4ebc-9b28-3d17ee7eb11e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.848641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47b14-806a-4ebc-9b28-3d17ee7eb11e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.848994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47b14-806a-4ebc-9b28-3d17ee7eb11e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.849665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b47b14-806a-4ebc-9b28-3d17ee7eb11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:48.851480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b47b14-806a-4ebc-9b28-3d17ee7eb11e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:48.863515 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2636/5207] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:48.867569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:48.880295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf2a5-2817-4894-bbb5-c8ab48dcfb10 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:48.885334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:48.886241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.886697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.886976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] PATH_INFO: `/v3/projects/7d4e539da0d04702b8556ca3b11344b6/users/8b7e31fab4c14e44b6348b0e5fcdca2c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.888998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4e539da0d04702b8556ca3b11344b6, user_id=8b7e31fab4c14e44b6348b0e5fcdca2c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:48.892088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:48.907735 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2572/5208] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:48 2022] PUT /identity/v3/projects/7d4e539da0d04702b8556ca3b11344b6/users/8b7e31fab4c14e44b6348b0e5fcdca2c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:48.918504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:48.918694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:48.918947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:48.948880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] MFA Rules not processed for user `8b7e31fab4c14e44b6348b0e5fcdca2c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:48.950171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:49.023860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.025716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:49.071162 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2637/5209] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:49.081352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.083183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:49.135304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac14c-b189-4892-8c99-ad8dba8743d0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:49.141152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:49.142036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.142310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.142575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] PATH_INFO: `/v3/projects/9e94c30126b94caaab0c95f1fb188b07` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.143921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e94c30126b94caaab0c95f1fb188b07)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:49.145874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:49.207846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0496-3411-45c6-8c83-c2389dcfaeea None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:49.214039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e94c30126b94caaab0c95f1fb188b07', 'request_id': 'req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:49.219844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e94c30126b94caaab0c95f1fb188b07', 'request_id': 'req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:49.234342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e94c30126b94caaab0c95f1fb188b07', 'request_id': 'req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:49.251878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] The token cache is being invalidate because project 9e94c30126b94caaab0c95f1fb188b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:49.252262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:49.253227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0506ecc5-e9e5-4ac5-b031-b0184b3fa30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:49.257146 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2573/5210] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:49 2022] DELETE /identity/v3/projects/9e94c30126b94caaab0c95f1fb188b07 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:49.258534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844bbd7-5df8-459f-8263-353680321714 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.258819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844bbd7-5df8-459f-8263-353680321714 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.259161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844bbd7-5df8-459f-8263-353680321714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.282702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363cd8f-6f96-4cf6-b426-0ed79f3c580e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:49.283525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cd8f-6f96-4cf6-b426-0ed79f3c580e service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.283818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cd8f-6f96-4cf6-b426-0ed79f3c580e service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.284160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cd8f-6f96-4cf6-b426-0ed79f3c580e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.286194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e363cd8f-6f96-4cf6-b426-0ed79f3c580e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:49.292865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2844bbd7-5df8-459f-8263-353680321714 None None] MFA Rules not processed for user `a6dcb8344fde4e4580e73efc09e633a7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:49.294525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2844bbd7-5df8-459f-8263-353680321714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:49.378514 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2574/5211] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:49.378514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc13386-a292-4b81-a3cd-6388580431c1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.378514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc13386-a292-4b81-a3cd-6388580431c1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.378514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc13386-a292-4b81-a3cd-6388580431c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.390362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363cd8f-6f96-4cf6-b426-0ed79f3c580e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:49.391916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363cd8f-6f96-4cf6-b426-0ed79f3c580e service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:49.399640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1fc13386-a292-4b81-a3cd-6388580431c1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:49.401263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1fc13386-a292-4b81-a3cd-6388580431c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:49.419695 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2638/5212] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:11:49.524025 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2575/5213] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:49.532088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614bd10-ec93-45e7-8eec-f4440d2ca500 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.532499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614bd10-ec93-45e7-8eec-f4440d2ca500 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.532877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614bd10-ec93-45e7-8eec-f4440d2ca500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.552933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0614bd10-ec93-45e7-8eec-f4440d2ca500 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:49.555000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0614bd10-ec93-45e7-8eec-f4440d2ca500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:49.572460 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2639/5214] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:49.573391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc13386-a292-4b81-a3cd-6388580431c1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.585489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc13386-a292-4b81-a3cd-6388580431c1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:49.599623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:49.600325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.600611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.600890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.602237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:49.602237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:49.603590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:49.618215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2576/5215] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:11:49.621888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614bd10-ec93-45e7-8eec-f4440d2ca500 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.636987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614bd10-ec93-45e7-8eec-f4440d2ca500 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:49.643828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:49.644992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.645482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.645979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.646882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:49.649070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:49.695843 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2640/5216] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:49 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:49.700061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.711736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d76a-818a-4369-9187-c79894d2b982 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:49.801708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:49.802521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.802803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.803074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.803774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:49.805740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:49.831091 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2577/5217] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:49 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:49.837858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.851040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74d38-4e60-4830-a481-d51f93de0149 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:49.856542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:49.857630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.857923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.858196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.858930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:49.860567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:49.874513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2641/5218] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:11:49.878907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.891741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2d94-45de-4cf7-9f7b-81b882a759fa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:49.898460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:49.899371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:49.899743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:49.900024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] PATH_INFO: `/v3/projects/a27641299e3f4fcd8a501a77002a8d54/users/20140e0dbcc04d4d865e271b0f42d287/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:49.917890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27641299e3f4fcd8a501a77002a8d54, user_id=20140e0dbcc04d4d865e271b0f42d287, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:49.921394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:49.939132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2578/5219] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:49 2022] PUT /identity/v3/projects/a27641299e3f4fcd8a501a77002a8d54/users/20140e0dbcc04d4d865e271b0f42d287/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:49.943936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:49.957690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1790f4f-a703-425c-b35a-e4c983f23583 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.045222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c6e76-8537-4966-b1be-e2a9654a6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.045918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e76-8537-4966-b1be-e2a9654a6be0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.046362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e76-8537-4966-b1be-e2a9654a6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.046582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e76-8537-4966-b1be-e2a9654a6be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.047429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c6e76-8537-4966-b1be-e2a9654a6be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.049073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c6e76-8537-4966-b1be-e2a9654a6be0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.061326 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2642/5220] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:50.064944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:50.077976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf419ba-d970-4123-803e-e16d485a8341 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.083340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.084297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.084579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.084849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] PATH_INFO: `/v3/projects/a27641299e3f4fcd8a501a77002a8d54/users/20140e0dbcc04d4d865e271b0f42d287/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.087086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27641299e3f4fcd8a501a77002a8d54, user_id=20140e0dbcc04d4d865e271b0f42d287, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.090060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.102775 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2579/5221] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:50 2022] PUT /identity/v3/projects/a27641299e3f4fcd8a501a77002a8d54/users/20140e0dbcc04d4d865e271b0f42d287/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:50.118719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1407f4-1f2f-443b-8fa7-62722dc162e4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.119395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1407f4-1f2f-443b-8fa7-62722dc162e4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.119879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1407f4-1f2f-443b-8fa7-62722dc162e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.133820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:50.142804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:50.161724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9a1407f4-1f2f-443b-8fa7-62722dc162e4 None None] MFA Rules not processed for user `20140e0dbcc04d4d865e271b0f42d287`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:50.162978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9a1407f4-1f2f-443b-8fa7-62722dc162e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:50.251584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd9c6-fc60-44ff-a276-ee85dff3a171 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.255888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.256627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.256980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.257609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.259982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:50.263079 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2643/5222] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:50.267748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1407f4-1f2f-443b-8fa7-62722dc162e4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:50.398956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.406543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1407f4-1f2f-443b-8fa7-62722dc162e4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.411803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.418202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.419449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.419449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.419817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.420653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.425659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.436683 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2580/5223] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:50.498742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2644/5224] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:50 2022] POST /identity/v3/projects => generated 393 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:50.499861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:50.513566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b571ab-c0c3-4b1d-b94b-02b96071ef2c service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.616321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.620326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.620728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.621468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.622134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.624258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.663662 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2581/5225] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:50 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:50.665005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:50.680867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160595ce-e7e9-465a-a973-df51d68532ac admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.688360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.689591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.690462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.691054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.692673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.694732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.709304 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2645/5226] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:50.714041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:50.730689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03db2ee-aaa4-4b83-a988-ae36a15d0f24 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.742084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74fbf-a7d6-4281-b896-951888b3cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.743432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74fbf-a7d6-4281-b896-951888b3cb23 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.744173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74fbf-a7d6-4281-b896-951888b3cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.744677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74fbf-a7d6-4281-b896-951888b3cb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.745783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74fbf-a7d6-4281-b896-951888b3cb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.747860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74fbf-a7d6-4281-b896-951888b3cb23 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.776709 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2582/5227] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:50.781271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:50.799004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4e55-e3e1-445e-9b5e-5106e7e59aab admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:50.802331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:50.803962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.804338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.804868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] PATH_INFO: `/v3/projects/eef259bae6314623a988187d5d6f9721/users/15270725c43f4fe5a09d84b66344dee0/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.839375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef259bae6314623a988187d5d6f9721, user_id=15270725c43f4fe5a09d84b66344dee0, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:50.842853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:50.865136 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2646/5228] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:50 2022] PUT /identity/v3/projects/eef259bae6314623a988187d5d6f9721/users/15270725c43f4fe5a09d84b66344dee0/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:50.876700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c88f8-3d5b-4cdb-bb7c-7d4756f349b8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:50.877007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c88f8-3d5b-4cdb-bb7c-7d4756f349b8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:50.877397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c88f8-3d5b-4cdb-bb7c-7d4756f349b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:50.913360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c16c88f8-3d5b-4cdb-bb7c-7d4756f349b8 None None] MFA Rules not processed for user `15270725c43f4fe5a09d84b66344dee0`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:50.914644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c16c88f8-3d5b-4cdb-bb7c-7d4756f349b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:51.004589 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2583/5229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:51.018217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:51.022751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:51.117328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e469-735a-4058-af52-9e97fb10fad7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:51.121865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254112d-e22e-443d-b766-e9ed8085a5c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:51.122513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254112d-e22e-443d-b766-e9ed8085a5c3 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:51.123414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254112d-e22e-443d-b766-e9ed8085a5c3 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:51.123666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254112d-e22e-443d-b766-e9ed8085a5c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:51.198945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254112d-e22e-443d-b766-e9ed8085a5c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:51.200437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254112d-e22e-443d-b766-e9ed8085a5c3 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:51.210627 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2647/5230] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:51.972357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c88f8-3d5b-4cdb-bb7c-7d4756f349b8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:52.061903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c88f8-3d5b-4cdb-bb7c-7d4756f349b8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:52.070341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:52.071692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:52.072116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:52.072593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] PATH_INFO: `/v3/users/20140e0dbcc04d4d865e271b0f42d287` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:52.074632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20140e0dbcc04d4d865e271b0f42d287)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:52.076844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:52.150279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20140e0dbcc04d4d865e271b0f42d287'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:52.151821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20140e0dbcc04d4d865e271b0f42d287'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:52.161334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20140e0dbcc04d4d865e271b0f42d287'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:52.162719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20140e0dbcc04d4d865e271b0f42d287'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:52.187744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20140e0dbcc04d4d865e271b0f42d287'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:52.216313 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2584/5231] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:51 2022] DELETE /identity/v3/users/20140e0dbcc04d4d865e271b0f42d287 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:52.221342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:52.221937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:52.222128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:52.253551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:52.256518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:52.340234 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2648/5232] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:11:52.351895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:52.353538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:52.436488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400594b0-fa88-4b94-b114-f4e63af82ef5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:52.440648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:52.441517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:52.441746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:52.441995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:52.454533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:52.456163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:52.510277 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2585/5233] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:11:52.982036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:52.983836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:52.997391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c469b-2b44-494f-8c25-cc28d6c101e7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:53.020369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:53.021984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:53.023758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:53.024980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:53.025196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:53.025731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] PATH_INFO: `/v3/projects/a27641299e3f4fcd8a501a77002a8d54` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:53.027265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27641299e3f4fcd8a501a77002a8d54)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:53.030170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:53.040617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccca7e8-1443-418e-b629-6b80b0f4da4d service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:53.046375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:53.047353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:53.047705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:53.048039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] PATH_INFO: `/v3/users/888c53168b654abeba992f50e8ed0697` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:53.049857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888c53168b654abeba992f50e8ed0697)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:53.051883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:53.096688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27641299e3f4fcd8a501a77002a8d54', 'request_id': 'req-f229e76c-40a2-4639-bd45-94c2f2c13b0d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.109796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27641299e3f4fcd8a501a77002a8d54', 'request_id': 'req-f229e76c-40a2-4639-bd45-94c2f2c13b0d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.119436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888c53168b654abeba992f50e8ed0697'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.119624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27641299e3f4fcd8a501a77002a8d54', 'request_id': 'req-f229e76c-40a2-4639-bd45-94c2f2c13b0d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.120542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888c53168b654abeba992f50e8ed0697'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.129369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888c53168b654abeba992f50e8ed0697'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.130447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888c53168b654abeba992f50e8ed0697'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.135418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] The token cache is being invalidate because project a27641299e3f4fcd8a501a77002a8d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:53.135989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.136794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.138721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2649/5234] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:52 2022] DELETE /identity/v3/projects/a27641299e3f4fcd8a501a77002a8d54 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:53.144034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:53.145692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:53.149127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bd4a96e5-3ad5-4fa8-8f79-f1006a288658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888c53168b654abeba992f50e8ed0697'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.175885 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2586/5235] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:53 2022] DELETE /identity/v3/users/888c53168b654abeba992f50e8ed0697 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:53.180494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:53.180883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:53.181245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:53.208538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:53.210178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:53.280626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229e76c-40a2-4639-bd45-94c2f2c13b0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:53.292098 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2587/5236] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:53.305172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:53.307522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:53.370361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:53.378785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:53.378785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:53.378785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] PATH_INFO: `/v3/users/15270725c43f4fe5a09d84b66344dee0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:53.378785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15270725c43f4fe5a09d84b66344dee0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:53.382738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:53.413468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9ef6-10cb-4d66-8cd0-bf522b0b54d7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:53.421082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:53.421884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:53.422164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:53.423231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:53.488819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:53.492299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:53.506149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15270725c43f4fe5a09d84b66344dee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.507316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15270725c43f4fe5a09d84b66344dee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.527807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15270725c43f4fe5a09d84b66344dee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.543789 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2588/5237] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:53.546552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15270725c43f4fe5a09d84b66344dee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.561095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15270725c43f4fe5a09d84b66344dee0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:53.596652 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2650/5238] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:53 2022] DELETE /identity/v3/users/15270725c43f4fe5a09d84b66344dee0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:54.340922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:54.342730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:54.368972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30b2-1838-45bb-9f04-45435b1565ec service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:54.483692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:54.485095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.485727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.486278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] PATH_INFO: `/v3/projects/bd0504afdd8049e5883290466984b189` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.488058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0504afdd8049e5883290466984b189)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:54.490643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:54.531316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:54.533841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:54.551625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69843498-e98f-4859-a376-31fea0e8c1e2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:54.562171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:54.563559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.566192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.566727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] PATH_INFO: `/v3/projects/eef259bae6314623a988187d5d6f9721` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.570909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef259bae6314623a988187d5d6f9721)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:54.578390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:54.586444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0504afdd8049e5883290466984b189', 'request_id': 'req-019bc233-bed0-4ecb-b716-6d7cec91def3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.601539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0504afdd8049e5883290466984b189', 'request_id': 'req-019bc233-bed0-4ecb-b716-6d7cec91def3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.612336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0504afdd8049e5883290466984b189', 'request_id': 'req-019bc233-bed0-4ecb-b716-6d7cec91def3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.632076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] The token cache is being invalidate because project bd0504afdd8049e5883290466984b189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:54.632355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.633636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-019bc233-bed0-4ecb-b716-6d7cec91def3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.635361 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2589/5239] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:54 2022] DELETE /identity/v3/projects/bd0504afdd8049e5883290466984b189 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:54.641390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c51ef-f483-4611-aa8d-6b2af0657d5b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.642189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c51ef-f483-4611-aa8d-6b2af0657d5b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.642754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c51ef-f483-4611-aa8d-6b2af0657d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.681232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cc1c51ef-f483-4611-aa8d-6b2af0657d5b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:54.682468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc1c51ef-f483-4611-aa8d-6b2af0657d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:54.687555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef259bae6314623a988187d5d6f9721', 'request_id': 'req-71775c86-130d-44d7-973f-6e8a72b7c1f8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.697657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef259bae6314623a988187d5d6f9721', 'request_id': 'req-71775c86-130d-44d7-973f-6e8a72b7c1f8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.707517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef259bae6314623a988187d5d6f9721', 'request_id': 'req-71775c86-130d-44d7-973f-6e8a72b7c1f8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.726114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] The token cache is being invalidate because project eef259bae6314623a988187d5d6f9721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:54.727532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.729494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-71775c86-130d-44d7-973f-6e8a72b7c1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:54.731913 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2651/5240] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:54 2022] DELETE /identity/v3/projects/eef259bae6314623a988187d5d6f9721 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:54.740045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b9c5-50e2-44b6-bd44-f48a8bd59ce8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.740426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b9c5-50e2-44b6-bd44-f48a8bd59ce8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.740866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b9c5-50e2-44b6-bd44-f48a8bd59ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.766108 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2590/5241] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:54.767470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ee64b9c5-50e2-44b6-bd44-f48a8bd59ce8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:54.769202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee64b9c5-50e2-44b6-bd44-f48a8bd59ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:54.774704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a854d-8071-4988-8d1b-fcf2e271469e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.775294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a854d-8071-4988-8d1b-fcf2e271469e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.775548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a854d-8071-4988-8d1b-fcf2e271469e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.779613 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2652/5242] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:54.787924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1de5d-b7ea-42d6-9559-718ef951c46b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.788878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1de5d-b7ea-42d6-9559-718ef951c46b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.788878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1de5d-b7ea-42d6-9559-718ef951c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.806184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c14a854d-8071-4988-8d1b-fcf2e271469e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:54.808078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c14a854d-8071-4988-8d1b-fcf2e271469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:54.811204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d8c1de5d-b7ea-42d6-9559-718ef951c46b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:54.812699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d8c1de5d-b7ea-42d6-9559-718ef951c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:54.828937 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2653/5243] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:54.829588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2591/5244] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:54.830985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1de5d-b7ea-42d6-9559-718ef951c46b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:54.831255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a854d-8071-4988-8d1b-fcf2e271469e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:54.843545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1de5d-b7ea-42d6-9559-718ef951c46b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:54.844822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a854d-8071-4988-8d1b-fcf2e271469e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:54.849718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:54.850889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.851324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.851784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.853123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:54.853582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:54.853836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:54.855334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.855717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.856121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.856344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:54.858702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:11:54.859918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:54.862829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:54.882099 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2592/5245] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:54.887115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:54.892091 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2654/5246] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:11:54.896576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:54.906440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ef7ad-92f8-43fc-adb3-b74618411b63 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:54.910209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa231fc-ab9b-4269-b774-964495e3db3b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:54.915740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:54.916691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.917284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.917900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.918453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:54.919871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:54.921525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:54.921832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:54.922310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:54.923171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:54.924118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:54.927527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:54.975696 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2655/5247] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:54 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:54.982334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.015237 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2593/5248] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:54 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:11:55.016773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.086812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7fcca-0ecb-40a4-a216-30196a7c61c2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.120300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269db9-d0eb-4114-bd10-220f2963d7b9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.133674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.134514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.135411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.135845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.136687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.139785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.185090 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2594/5249] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:55 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:55.185090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.188776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:55.192055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.192975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.193583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.193965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.194836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.197785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.234315 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2656/5250] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:54 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:55.235292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.247219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b4ce-79e9-4127-8d69-f0c2b00efca7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.254017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.254752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.255014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.255470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.256403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.258601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.281823 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2657/5251] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:55.282618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.299815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4e55-93db-457e-98be-317d61b6f952 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.306976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.307701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.308045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.308401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2284ea-51f6-4ee4-8236-73535fcc7350 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.309613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.310885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.313076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.314454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.315402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.315883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.316365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.318999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:55.333484 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2658/5252] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:55.333484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.351080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f499f9-4a2b-4bf7-8af0-9cc8b8f49380 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.356652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.358336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.358336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.358336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.359037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.361019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.378106 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2659/5253] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:55.379177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.391923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992f02-e00b-4074-aaa3-74a92490f95d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.398131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.399561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.400149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.400634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.401888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.404139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.406727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.408434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.420276 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2595/5254] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:55.421070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.421354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2660/5255] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:55.422672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.433704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa220b-53f9-442e-8346-95cbab34a3d6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.440215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efaf53-92c2-4a89-baef-4ea57dca31e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.441472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efaf53-92c2-4a89-baef-4ea57dca31e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.441768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efaf53-92c2-4a89-baef-4ea57dca31e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.442065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efaf53-92c2-4a89-baef-4ea57dca31e6 admin admin] PATH_INFO: `/v3/projects/24c30dc1180c4f9c94484c7a7a635654/users/c6598cbb302a432f809d7165b7d8c007/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.445235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73248377-eb36-4f3d-95ea-e5c6d86a9fdc service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.463552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efaf53-92c2-4a89-baef-4ea57dca31e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c30dc1180c4f9c94484c7a7a635654, user_id=c6598cbb302a432f809d7165b7d8c007, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.467399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efaf53-92c2-4a89-baef-4ea57dca31e6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.467620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c802d-d520-448b-8cd2-c7bcf4c79ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.468202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c802d-d520-448b-8cd2-c7bcf4c79ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.468683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c802d-d520-448b-8cd2-c7bcf4c79ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.469078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c802d-d520-448b-8cd2-c7bcf4c79ca9 admin admin] PATH_INFO: `/v3/projects/d59186925e814b2d8afcdd575878d396/users/7ac92c656343420cb62bcdee8e831f0e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.500214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2661/5256] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:55 2022] PUT /identity/v3/projects/24c30dc1180c4f9c94484c7a7a635654/users/c6598cbb302a432f809d7165b7d8c007/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:55.513552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df73da-b69b-47c6-9be1-e5d1680e58be None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.514008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df73da-b69b-47c6-9be1-e5d1680e58be None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.515373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df73da-b69b-47c6-9be1-e5d1680e58be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.518444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c802d-d520-448b-8cd2-c7bcf4c79ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59186925e814b2d8afcdd575878d396, user_id=7ac92c656343420cb62bcdee8e831f0e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.522059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c802d-d520-448b-8cd2-c7bcf4c79ca9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.547657 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2596/5257] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:55 2022] PUT /identity/v3/projects/d59186925e814b2d8afcdd575878d396/users/7ac92c656343420cb62bcdee8e831f0e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:55.553729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.554094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.554266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.562707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d2df73da-b69b-47c6-9be1-e5d1680e58be None None] MFA Rules not processed for user `c6598cbb302a432f809d7165b7d8c007`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:55.564800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d2df73da-b69b-47c6-9be1-e5d1680e58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:55.585253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:55.587745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:55.691206 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2662/5258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:55.696466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df73da-b69b-47c6-9be1-e5d1680e58be None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.701079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2597/5259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:55.709832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df73da-b69b-47c6-9be1-e5d1680e58be None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.711652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.713285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:55.721774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.723867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.724383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.724774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.726467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.729415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.790795 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2663/5260] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:55 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:55.794205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:55.806838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452460-d7ca-4534-9e09-93fcb05c6b5b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.886403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.887083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.887403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.889718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.959517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275e496-0ad9-40b4-ae67-ae73d9d4e07d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:55.967570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:55.969184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:55.969809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:55.970161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:55.970929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.974458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:55.990579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:55.992936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:56.014643 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2598/5261] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:11:56.015300 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2664/5262] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:55 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:56.019616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:56.034433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626012ad-87b2-4511-a820-435d945e635a service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:56.041313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:56.042142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:56.043387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:56.043695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:56.044591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:56.046922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:56.064413 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2599/5263] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:56.070129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:56.087395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33acc8-be7b-47f5-896b-ca493b2b8342 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:56.093815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:56.096390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:56.096918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:56.100069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] PATH_INFO: `/v3/projects/a6b10bbd62134b0792c2b3b3cb2a1624/users/de4fa8c327fd4bd8ac4b4215b1302a9f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:56.121304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b10bbd62134b0792c2b3b3cb2a1624, user_id=de4fa8c327fd4bd8ac4b4215b1302a9f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:56.124830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:56.168846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:56.169420 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2665/5264] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:56 2022] PUT /identity/v3/projects/a6b10bbd62134b0792c2b3b3cb2a1624/users/de4fa8c327fd4bd8ac4b4215b1302a9f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:56.186183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981449c-4616-4207-af21-d58f0129184b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:56.325175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199ec65-07e2-43ea-b290-d5001637029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:56.325175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199ec65-07e2-43ea-b290-d5001637029c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:56.325175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199ec65-07e2-43ea-b290-d5001637029c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:56.325175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199ec65-07e2-43ea-b290-d5001637029c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:56.328078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199ec65-07e2-43ea-b290-d5001637029c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:56.331140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199ec65-07e2-43ea-b290-d5001637029c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:56.361562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:56.363791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2600/5265] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:11:56.376176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419206b-a7d5-4868-8b34-d47067938112 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:56.384170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:56.384687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:56.385019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:56.385430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] PATH_INFO: `/v3/projects/a6b10bbd62134b0792c2b3b3cb2a1624/users/de4fa8c327fd4bd8ac4b4215b1302a9f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:56.388162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b10bbd62134b0792c2b3b3cb2a1624, user_id=de4fa8c327fd4bd8ac4b4215b1302a9f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:56.393736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:56.428220 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2666/5266] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:56 2022] PUT /identity/v3/projects/a6b10bbd62134b0792c2b3b3cb2a1624/users/de4fa8c327fd4bd8ac4b4215b1302a9f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:11:56.433620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44effae6-abf2-4ffc-bfa9-9a3590da6b08 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:56.434121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44effae6-abf2-4ffc-bfa9-9a3590da6b08 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:56.434471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44effae6-abf2-4ffc-bfa9-9a3590da6b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:56.497890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-44effae6-abf2-4ffc-bfa9-9a3590da6b08 None None] MFA Rules not processed for user `de4fa8c327fd4bd8ac4b4215b1302a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:56.499630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-44effae6-abf2-4ffc-bfa9-9a3590da6b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:56.639329 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2601/5267] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:56.664968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:56.667811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:56.880763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30ea23-a159-4bd7-b1eb-9b281cbe2f09 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:56.885300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:56.898057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:56.898057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:56.899569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:56.925366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:56.927546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:56.979392 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2667/5268] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:57.380319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3193-d539-43e4-82d5-9ec997beafdd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:57.380567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3193-d539-43e4-82d5-9ec997beafdd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:57.380823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3193-d539-43e4-82d5-9ec997beafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:57.423068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d31f3193-d539-43e4-82d5-9ec997beafdd None None] MFA Rules not processed for user `7ac92c656343420cb62bcdee8e831f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:57.425095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d31f3193-d539-43e4-82d5-9ec997beafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:57.571439 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2602/5269] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:57.577941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:57.750431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04f0c-56c7-4641-9d96-913b125ae286 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:57.760675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:57.769871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:57.770801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:57.771237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:57.773577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:57.802537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:57.875776 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2668/5270] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:11:57 2022] POST /identity/v3/projects => generated 405 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:57.879121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f3193-d539-43e4-82d5-9ec997beafdd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:57.906901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f3193-d539-43e4-82d5-9ec997beafdd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:58.052442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:58.053706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:58.053994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:58.054605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:58.065324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:58.065324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:58.103591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2603/5271] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:11:57 2022] POST /identity/v3/users => generated 309 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:11:58.106445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:58.121586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818045c-c1a9-41f3-97ff-72acf69cc930 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:58.130278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:58.131815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:58.132274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:58.132769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:58.134652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:58.136746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:58.151151 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2669/5272] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:11:58.157737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:58.177907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c89d-7b61-4c2c-857e-c36eac6612df admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:58.195070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:58.196238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:58.196473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:58.196623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] PATH_INFO: `/v3/projects/a409a162b1f040b2a8260724f77f5609/users/74700bcb662842d08e33fa3be1b1ccf0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:58.230469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a409a162b1f040b2a8260724f77f5609, user_id=74700bcb662842d08e33fa3be1b1ccf0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:58.240646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:58.277819 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2604/5273] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:58 2022] PUT /identity/v3/projects/a409a162b1f040b2a8260724f77f5609/users/74700bcb662842d08e33fa3be1b1ccf0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:58.283976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:58.299461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c62079-5361-46cd-90b8-3a81cda2df7f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:58.430193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:58.430984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:58.432483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:58.437002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:58.447626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:58.447626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:58.461939 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2670/5274] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:11:58.467344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:58.483070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016ebda-a25b-446a-bf24-78987751d5a3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:58.494093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc5ed5-2f7d-431b-8d4d-66f315aa8961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:58.496098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5ed5-2f7d-431b-8d4d-66f315aa8961 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:58.496755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5ed5-2f7d-431b-8d4d-66f315aa8961 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:58.497251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5ed5-2f7d-431b-8d4d-66f315aa8961 admin admin] PATH_INFO: `/v3/projects/a409a162b1f040b2a8260724f77f5609/users/74700bcb662842d08e33fa3be1b1ccf0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:58.500948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc5ed5-2f7d-431b-8d4d-66f315aa8961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a409a162b1f040b2a8260724f77f5609, user_id=74700bcb662842d08e33fa3be1b1ccf0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:58.504581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc5ed5-2f7d-431b-8d4d-66f315aa8961 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:58.544274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2605/5275] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:11:58 2022] PUT /identity/v3/projects/a409a162b1f040b2a8260724f77f5609/users/74700bcb662842d08e33fa3be1b1ccf0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:58.588246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:58.590402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:58.613862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d69a-e715-48ff-8167-199f28f51108 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:58.696631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:58.698142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:58.698378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:58.698844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] PATH_INFO: `/v3/users/10c382520b4140a1bc4b22ca495fd917` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:58.700579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c382520b4140a1bc4b22ca495fd917)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:58.702721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:58.780835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c382520b4140a1bc4b22ca495fd917'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:58.782664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c382520b4140a1bc4b22ca495fd917'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:58.796877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c382520b4140a1bc4b22ca495fd917'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:58.809718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c382520b4140a1bc4b22ca495fd917'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:58.810669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c382520b4140a1bc4b22ca495fd917'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:58.836560 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2671/5276] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:11:58 2022] DELETE /identity/v3/users/10c382520b4140a1bc4b22ca495fd917 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:11:58.841661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba503f8-11c9-4ee1-8ccb-1aa27c512cba None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:58.842258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba503f8-11c9-4ee1-8ccb-1aa27c512cba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:58.842383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba503f8-11c9-4ee1-8ccb-1aa27c512cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:58.867050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ba503f8-11c9-4ee1-8ccb-1aa27c512cba None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:58.868184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ba503f8-11c9-4ee1-8ccb-1aa27c512cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:58.975558 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2606/5277] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:58.996976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:58.999186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:59.099687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6db4d-cc5a-48bc-9581-29bfd7b4a411 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:59.104730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad66e4-a27d-4f40-9aa3-eeb8c6970927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:59.107014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad66e4-a27d-4f40-9aa3-eeb8c6970927 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:59.107959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad66e4-a27d-4f40-9aa3-eeb8c6970927 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:59.108472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad66e4-a27d-4f40-9aa3-eeb8c6970927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:59.121677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad66e4-a27d-4f40-9aa3-eeb8c6970927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:59.123560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad66e4-a27d-4f40-9aa3-eeb8c6970927 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:59.139031 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2672/5278] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:11:59.364784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:59.365633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:59.365633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:59.389475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] MFA Rules not processed for user `2abb09d2f7844f3ba0f7a20787d73e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:59.391272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:59.488518 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2607/5279] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:11:59.774850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5ad46-2b8b-4d65-a279-6d860b35be68 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:59.775081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5ad46-2b8b-4d65-a279-6d860b35be68 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:59.775339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5ad46-2b8b-4d65-a279-6d860b35be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:59.812041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:11:59.814818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:59.841903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-81a5ad46-2b8b-4d65-a279-6d860b35be68 None None] MFA Rules not processed for user `74700bcb662842d08e33fa3be1b1ccf0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:11:59.846103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-81a5ad46-2b8b-4d65-a279-6d860b35be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:11:59.849491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fb5a3-048d-406c-aa76-1e542909967e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:11:59.856666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:11:59.858312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:11:59.858901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:11:59.859328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] PATH_INFO: `/v3/projects/8ff962f8646c4b9c93e3ac77e4e750cb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:11:59.860971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff962f8646c4b9c93e3ac77e4e750cb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:11:59.865613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:11:59.938381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff962f8646c4b9c93e3ac77e4e750cb', 'request_id': 'req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:59.948845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff962f8646c4b9c93e3ac77e4e750cb', 'request_id': 'req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:59.965395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff962f8646c4b9c93e3ac77e4e750cb', 'request_id': 'req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:59.993405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] The token cache is being invalidate because project 8ff962f8646c4b9c93e3ac77e4e750cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:11:59.993699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:59.996203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:11:59.998289 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2608/5280] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:11:59 2022] DELETE /identity/v3/projects/8ff962f8646c4b9c93e3ac77e4e750cb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:00.002547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:00.004040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:00.011120 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2673/5281] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:00.109476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2c3f-3657-40a1-9db5-eccb77fe2d23 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:00.115685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:00.117137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:00.120983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:00.121456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] PATH_INFO: `/v3/users/5438e4e2d88d4fa490203ef5d7d0ce2e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:00.123744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5438e4e2d88d4fa490203ef5d7d0ce2e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:00.126102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:00.200959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5438e4e2d88d4fa490203ef5d7d0ce2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:00.202147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5438e4e2d88d4fa490203ef5d7d0ce2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:00.209648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5438e4e2d88d4fa490203ef5d7d0ce2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:00.210377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5438e4e2d88d4fa490203ef5d7d0ce2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:00.219800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5438e4e2d88d4fa490203ef5d7d0ce2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:00.241865 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2609/5282] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:00 2022] DELETE /identity/v3/users/5438e4e2d88d4fa490203ef5d7d0ce2e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:01.121118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5ad46-2b8b-4d65-a279-6d860b35be68 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:01.135772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5ad46-2b8b-4d65-a279-6d860b35be68 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:01.146386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:01.146386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:01.259837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5bd9-c57e-4e24-aa0c-31b484dd5cc0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:01.264584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:01.265311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:01.265591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:01.265868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:01.273712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:01.274715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:01.275276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:01.275492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] PATH_INFO: `/v3/projects/e84e0b81d71f4bbe8cd048a5d3d61d0d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:01.279476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84e0b81d71f4bbe8cd048a5d3d61d0d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:01.280077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:01.282525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:01.381393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84e0b81d71f4bbe8cd048a5d3d61d0d', 'request_id': 'req-14a12412-8e9e-4378-83d5-ee658aaf3da0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.394174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84e0b81d71f4bbe8cd048a5d3d61d0d', 'request_id': 'req-14a12412-8e9e-4378-83d5-ee658aaf3da0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.399519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:01.401300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:01.411710 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2674/5283] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:01.415615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84e0b81d71f4bbe8cd048a5d3d61d0d', 'request_id': 'req-14a12412-8e9e-4378-83d5-ee658aaf3da0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.433720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] The token cache is being invalidate because project e84e0b81d71f4bbe8cd048a5d3d61d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:01.434091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.445228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14a12412-8e9e-4378-83d5-ee658aaf3da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.459019 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2610/5284] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:01 2022] DELETE /identity/v3/projects/e84e0b81d71f4bbe8cd048a5d3d61d0d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:01.460298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:01.482456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62868885-59e4-485e-9596-7b8d729a2387 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:01.596458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:01.597444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:01.597726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:01.598011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] PATH_INFO: `/v3/users/8b7e31fab4c14e44b6348b0e5fcdca2c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:01.599993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7e31fab4c14e44b6348b0e5fcdca2c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:01.602073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:01.674097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7e31fab4c14e44b6348b0e5fcdca2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.675424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7e31fab4c14e44b6348b0e5fcdca2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.687615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7e31fab4c14e44b6348b0e5fcdca2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.703018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7e31fab4c14e44b6348b0e5fcdca2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.703731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7e31fab4c14e44b6348b0e5fcdca2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:01.731552 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2675/5285] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:01 2022] DELETE /identity/v3/users/8b7e31fab4c14e44b6348b0e5fcdca2c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:02.239912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:02.240436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:02.240558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:02.263972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:02.265986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:02.362074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:02.364397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:02.389534 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2611/5286] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:02.408803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:02.410564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:02.479901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05d6ce-6aca-4162-91fb-a498174d2021 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:02.489415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:02.491190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:02.491740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:02.492219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] PATH_INFO: `/v3/users/7ac92c656343420cb62bcdee8e831f0e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:02.494886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac92c656343420cb62bcdee8e831f0e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:02.497947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:02.507303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff886eea-3619-4097-b52d-af86cd90a591 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:02.517199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:02.517199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:02.517199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:02.517199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:02.527726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:02.530641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:02.546631 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2612/5287] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:12:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:12:02.586700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac92c656343420cb62bcdee8e831f0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.587592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac92c656343420cb62bcdee8e831f0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.597116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac92c656343420cb62bcdee8e831f0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.634904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac92c656343420cb62bcdee8e831f0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.636217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-455b76dc-ecf6-423d-a3c1-5a76efa6a64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac92c656343420cb62bcdee8e831f0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.665393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2676/5288] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:02 2022] DELETE /identity/v3/users/7ac92c656343420cb62bcdee8e831f0e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:02.724475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:02.725957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:02.742329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18466216-8963-4650-bcfa-01f5c2574d04 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:02.816022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:02.817293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:02.817722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:02.818139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] PATH_INFO: `/v3/projects/7d4e539da0d04702b8556ca3b11344b6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:02.821393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4e539da0d04702b8556ca3b11344b6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:02.824874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:02.912311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4e539da0d04702b8556ca3b11344b6', 'request_id': 'req-b439daf0-9445-44a6-9c44-4ba528eabef6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.920613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4e539da0d04702b8556ca3b11344b6', 'request_id': 'req-b439daf0-9445-44a6-9c44-4ba528eabef6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.934601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4e539da0d04702b8556ca3b11344b6', 'request_id': 'req-b439daf0-9445-44a6-9c44-4ba528eabef6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.965535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] The token cache is being invalidate because project 7d4e539da0d04702b8556ca3b11344b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:02.965835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.966685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:02.975448 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2613/5289] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:02 2022] DELETE /identity/v3/projects/7d4e539da0d04702b8556ca3b11344b6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:02.976551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493c8f3-0e95-49b6-a4c0-9942111092ab None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:02.976899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493c8f3-0e95-49b6-a4c0-9942111092ab None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:02.977397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493c8f3-0e95-49b6-a4c0-9942111092ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.018083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d493c8f3-0e95-49b6-a4c0-9942111092ab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:03.019402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d493c8f3-0e95-49b6-a4c0-9942111092ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.092929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.095261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.164988 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2677/5290] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:03.181772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ca47-bd81-491c-9764-0d97e905341a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.186138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ca47-bd81-491c-9764-0d97e905341a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.186615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ca47-bd81-491c-9764-0d97e905341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.233000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0fe3ca47-bd81-491c-9764-0d97e905341a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:03.234943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0fe3ca47-bd81-491c-9764-0d97e905341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.247732 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2678/5291] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:03.251864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3ca47-bd81-491c-9764-0d97e905341a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.264335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3ca47-bd81-491c-9764-0d97e905341a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.273664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.277142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439daf0-9445-44a6-9c44-4ba528eabef6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.284274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.286887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.288186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.289209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.290240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:03.290554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.292420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.293115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.293242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.293542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] PATH_INFO: `/v3/users/c6598cbb302a432f809d7165b7d8c007` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.295881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6598cbb302a432f809d7165b7d8c007)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.307196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.315794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2679/5292] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:03.316698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.331271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.353777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451803-e107-4fd6-96ae-444f8f0e3373 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.361265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.362775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.363740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.364221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] PATH_INFO: `/v3/projects/d59186925e814b2d8afcdd575878d396` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.366103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59186925e814b2d8afcdd575878d396)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.369624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.446972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6598cbb302a432f809d7165b7d8c007'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.447899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6598cbb302a432f809d7165b7d8c007'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.457887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6598cbb302a432f809d7165b7d8c007'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.459355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6598cbb302a432f809d7165b7d8c007'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.467364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59186925e814b2d8afcdd575878d396', 'request_id': 'req-6b0708ce-8835-44ee-a137-8761a3891270'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.473061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6598cbb302a432f809d7165b7d8c007'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.478988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59186925e814b2d8afcdd575878d396', 'request_id': 'req-6b0708ce-8835-44ee-a137-8761a3891270'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.489684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59186925e814b2d8afcdd575878d396', 'request_id': 'req-6b0708ce-8835-44ee-a137-8761a3891270'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.499554 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2614/5293] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:03 2022] DELETE /identity/v3/users/c6598cbb302a432f809d7165b7d8c007 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:03.500661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.502370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.531311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] The token cache is being invalidate because project d59186925e814b2d8afcdd575878d396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:03.532076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.533205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0708ce-8835-44ee-a137-8761a3891270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.538988 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2680/5294] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:03 2022] DELETE /identity/v3/projects/d59186925e814b2d8afcdd575878d396 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:03.550612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.551307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.555600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.578614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:03.580226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.596154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d096ad1-e90a-4d0c-8dfa-53672b61e835 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.602450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.603477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.604085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.604521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.605618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.607824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.647856 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2615/5295] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:03 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:03.648848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.651276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.656572 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2681/5296] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:03.657533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.659039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.672772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a0681-f6cc-486e-add7-2990c8dcd28f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.741874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.742076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d6f29-3c2b-4465-9264-730cae46f5f7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.742810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.743193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.743507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.744645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.747156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.748403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.748762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.749065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.749368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] PATH_INFO: `/v3/users/74700bcb662842d08e33fa3be1b1ccf0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.751438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74700bcb662842d08e33fa3be1b1ccf0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.752897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.778303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2682/5297] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:03 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:03.779728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.781917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.818686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74700bcb662842d08e33fa3be1b1ccf0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.819664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74700bcb662842d08e33fa3be1b1ccf0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.827628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74700bcb662842d08e33fa3be1b1ccf0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.829549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74700bcb662842d08e33fa3be1b1ccf0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.837709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74700bcb662842d08e33fa3be1b1ccf0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:03.853525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51ff2-cd74-4160-b15e-156993af0ec2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.857853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.858514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.858808 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2616/5298] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:03 2022] DELETE /identity/v3/users/74700bcb662842d08e33fa3be1b1ccf0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:03.858933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.859268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.859781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:03.861854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.861988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:03.876863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.878538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.890282 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2683/5299] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:03.958424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b67a6-a540-4e2f-9329-986ccd58e908 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:03.964856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:03.966471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:03.966471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:03.967586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:03.968511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:03.970914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:03.990690 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2617/5300] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:03.992138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.006463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1d02-aff9-4025-b1b3-e0cca6b7cde3 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.012902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579234bc-b017-4bb6-8a28-6393e1ff5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.013864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579234bc-b017-4bb6-8a28-6393e1ff5cad admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.014385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579234bc-b017-4bb6-8a28-6393e1ff5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.014673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579234bc-b017-4bb6-8a28-6393e1ff5cad admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.015492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579234bc-b017-4bb6-8a28-6393e1ff5cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.018183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579234bc-b017-4bb6-8a28-6393e1ff5cad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.029851 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2684/5301] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:04.034349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.048795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6830f-a343-4e07-a255-29af56ebf32f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.054339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.055668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.055980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.056521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] PATH_INFO: `/v3/projects/8f1b43b503244eac945f137cf5cfdebb/users/5adf05308fc1421595eeddd8f46f744d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.076645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1b43b503244eac945f137cf5cfdebb, user_id=5adf05308fc1421595eeddd8f46f744d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.079551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.100020 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2618/5302] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:04 2022] PUT /identity/v3/projects/8f1b43b503244eac945f137cf5cfdebb/users/5adf05308fc1421595eeddd8f46f744d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:04.116929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce29e57-ddf8-4ef7-b25d-bed9a343c8f4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.116929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce29e57-ddf8-4ef7-b25d-bed9a343c8f4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.117319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce29e57-ddf8-4ef7-b25d-bed9a343c8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.154880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.156683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5ce29e57-ddf8-4ef7-b25d-bed9a343c8f4 None None] MFA Rules not processed for user `5adf05308fc1421595eeddd8f46f744d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:04.158148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ce29e57-ddf8-4ef7-b25d-bed9a343c8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.158673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.270617 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2685/5303] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:04.275220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce29e57-ddf8-4ef7-b25d-bed9a343c8f4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.303264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72bc52-1601-4834-85af-afd65f1f6969 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.309234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.310324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.310624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.311067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] PATH_INFO: `/v3/projects/a409a162b1f040b2a8260724f77f5609` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.312583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a409a162b1f040b2a8260724f77f5609)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.314772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.407222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a409a162b1f040b2a8260724f77f5609', 'request_id': 'req-cb6abf72-1b1d-4f12-801c-5349f32331d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.416466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a409a162b1f040b2a8260724f77f5609', 'request_id': 'req-cb6abf72-1b1d-4f12-801c-5349f32331d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.428467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce29e57-ddf8-4ef7-b25d-bed9a343c8f4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.446137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a409a162b1f040b2a8260724f77f5609', 'request_id': 'req-cb6abf72-1b1d-4f12-801c-5349f32331d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.483108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] The token cache is being invalidate because project a409a162b1f040b2a8260724f77f5609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:04.483822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.484551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.488446 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2619/5304] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:04 2022] DELETE /identity/v3/projects/a409a162b1f040b2a8260724f77f5609 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:04.489939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.491559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.531034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6aa0-8426-46f6-beb0-10a1af3ecc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.531756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6aa0-8426-46f6-beb0-10a1af3ecc5c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.532227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6aa0-8426-46f6-beb0-10a1af3ecc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.532498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6aa0-8426-46f6-beb0-10a1af3ecc5c admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.533337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6aa0-8426-46f6-beb0-10a1af3ecc5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.535194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6aa0-8426-46f6-beb0-10a1af3ecc5c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.569762 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2686/5305] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:04 2022] POST /identity/v3/projects => generated 391 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:04.571861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.572382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.572727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.579667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6abf72-1b1d-4f12-801c-5349f32331d9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.597073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:04.598655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.654969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.656009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.656289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.656566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] PATH_INFO: `/v3/projects/24c30dc1180c4f9c94484c7a7a635654` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.657957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c30dc1180c4f9c94484c7a7a635654)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.659995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.679680 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2687/5306] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:04.680727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.682779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.696853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27090cc3-790e-46cf-ad37-ed376e50e4e7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.705377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a67f5-ead8-40c5-a462-868ed52db1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.705919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a67f5-ead8-40c5-a462-868ed52db1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.706344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a67f5-ead8-40c5-a462-868ed52db1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.706643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a67f5-ead8-40c5-a462-868ed52db1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.707321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a67f5-ead8-40c5-a462-868ed52db1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.710191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a67f5-ead8-40c5-a462-868ed52db1f6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.727721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c30dc1180c4f9c94484c7a7a635654', 'request_id': 'req-d765aa56-d198-4ab3-8e99-d8060cc11669'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.733941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c30dc1180c4f9c94484c7a7a635654', 'request_id': 'req-d765aa56-d198-4ab3-8e99-d8060cc11669'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.743262 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2688/5307] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:04 2022] POST /identity/v3/users => generated 302 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:04.743639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c30dc1180c4f9c94484c7a7a635654', 'request_id': 'req-d765aa56-d198-4ab3-8e99-d8060cc11669'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.748426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.748719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.749068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.755963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] The token cache is being invalidate because project 24c30dc1180c4f9c94484c7a7a635654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:04.756256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.757086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.758744 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2620/5308] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:04 2022] DELETE /identity/v3/projects/24c30dc1180c4f9c94484c7a7a635654 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:04.762271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.762271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.768036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:04.769368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.844733 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2689/5309] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:04.844983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765aa56-d198-4ab3-8e99-d8060cc11669 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.845136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.847495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.851633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.852650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.852994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.856110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.856110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.856367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.863372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1899c6a-69d8-42d4-8090-bf9ab31ec187 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.871354 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2621/5310] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:04.871530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.871641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.871766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.871766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.871766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] PATH_INFO: `/v3/users/de4fa8c327fd4bd8ac4b4215b1302a9f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.873065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4fa8c327fd4bd8ac4b4215b1302a9f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.875370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.881060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb7f75-8bb9-405d-8dc8-29e740c6d366 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.886500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.887249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.887972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.887972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.888571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:04.888944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.890780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.907104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2622/5311] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:04.910684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.922339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a122c-1c7c-43b7-87bc-9ff5cd64586f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:04.927689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:04.928728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:04.929242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:04.929547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] PATH_INFO: `/v3/projects/b9f1b8772dea4cedb8fbd278940ff4c9/users/1430b517def345c2b26f34adb16c9de4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:04.936904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4fa8c327fd4bd8ac4b4215b1302a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.937970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4fa8c327fd4bd8ac4b4215b1302a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.948492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f1b8772dea4cedb8fbd278940ff4c9, user_id=1430b517def345c2b26f34adb16c9de4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:04.948907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4fa8c327fd4bd8ac4b4215b1302a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.951626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:04.959351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4fa8c327fd4bd8ac4b4215b1302a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.960255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4fa8c327fd4bd8ac4b4215b1302a9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:04.967726 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2623/5312] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:04 2022] PUT /identity/v3/projects/b9f1b8772dea4cedb8fbd278940ff4c9/users/1430b517def345c2b26f34adb16c9de4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:04.969117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.970756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:04.996426 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2690/5313] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:04 2022] DELETE /identity/v3/users/de4fa8c327fd4bd8ac4b4215b1302a9f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:04.997581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:04.999658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.069813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383a9a-ca6c-41c1-a93e-23150fe1f567 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.126940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab300d7-c493-4621-9c4b-3197942b9204 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.145980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.147207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.147722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.148679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.150072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.152903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.156551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.157280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.157651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.157933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.159237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.161208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.169555 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2691/5314] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:05.175177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.188761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a205c-fd2e-49ff-a3e0-47038caf8314 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.195247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ae10a-4488-48e0-bf36-caa067ae45d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.198433 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2624/5315] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:04 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:05.202884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.211402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae10a-4488-48e0-bf36-caa067ae45d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.212924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae10a-4488-48e0-bf36-caa067ae45d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.213856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae10a-4488-48e0-bf36-caa067ae45d8 admin admin] PATH_INFO: `/v3/projects/b9f1b8772dea4cedb8fbd278940ff4c9/users/1430b517def345c2b26f34adb16c9de4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.219324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ae10a-4488-48e0-bf36-caa067ae45d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f1b8772dea4cedb8fbd278940ff4c9, user_id=1430b517def345c2b26f34adb16c9de4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.222825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ae10a-4488-48e0-bf36-caa067ae45d8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.245758 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2692/5316] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:05 2022] PUT /identity/v3/projects/b9f1b8772dea4cedb8fbd278940ff4c9/users/1430b517def345c2b26f34adb16c9de4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:05.258470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.259165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.259600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.296151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f428-8e85-4d3c-a39d-90b978c9cfba admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.326229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] MFA Rules not processed for user `1430b517def345c2b26f34adb16c9de4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:05.327750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.409838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.410643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.410928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.411243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.411949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.414223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.451960 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2693/5317] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:05.451960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.451960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.460746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2625/5318] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:05 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:05.465205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.467376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.472838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09423-effe-4f72-9140-d11ec3ef2854 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.480264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.483315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.483776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.484278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] PATH_INFO: `/v3/projects/a6b10bbd62134b0792c2b3b3cb2a1624` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.485770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b10bbd62134b0792c2b3b3cb2a1624)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.488515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.549693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313cd88-07d8-4a21-8bde-c7526000d071 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.556919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b10bbd62134b0792c2b3b3cb2a1624', 'request_id': 'req-68276577-7a64-4eff-a851-0c371c473aa7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:05.573158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b10bbd62134b0792c2b3b3cb2a1624', 'request_id': 'req-68276577-7a64-4eff-a851-0c371c473aa7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:05.586596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b10bbd62134b0792c2b3b3cb2a1624', 'request_id': 'req-68276577-7a64-4eff-a851-0c371c473aa7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:05.603020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] The token cache is being invalidate because project a6b10bbd62134b0792c2b3b3cb2a1624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:05.603905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:05.604992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:05.610750 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2694/5319] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:05 2022] DELETE /identity/v3/projects/a6b10bbd62134b0792c2b3b3cb2a1624 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:05.610750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.611309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.627904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.629166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.629453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.629747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.631715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.688990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68276577-7a64-4eff-a851-0c371c473aa7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.694359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ffd7a-1d1a-4584-9857-5021bc91b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.695145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ffd7a-1d1a-4584-9857-5021bc91b0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.695591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ffd7a-1d1a-4584-9857-5021bc91b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.695786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ffd7a-1d1a-4584-9857-5021bc91b0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.696531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ffd7a-1d1a-4584-9857-5021bc91b0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.698576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ffd7a-1d1a-4584-9857-5021bc91b0e0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.713115 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2695/5320] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:05.713587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f36f-02e3-4947-adb8-63ee98805854 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.713887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f36f-02e3-4947-adb8-63ee98805854 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.714823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f36f-02e3-4947-adb8-63ee98805854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.729562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.731410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.738618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7cc4f36f-02e3-4947-adb8-63ee98805854 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:05.740611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7cc4f36f-02e3-4947-adb8-63ee98805854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.747423 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2626/5321] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:05.748435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.761843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e803-d9e4-44e3-a014-796ce93fb09b service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.762737 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2696/5322] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:05.768122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.769258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.769788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.770294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.771237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.771683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.771982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.772261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.773948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.792515 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2627/5323] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:05.795158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.812184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:05.813948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.819108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ce8c1-4eaf-479b-abc9-28ae495e6db3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.826329 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2697/5324] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:05.826329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.826329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.828995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.830387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.830682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.830948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] PATH_INFO: `/v3/projects/9293eccaacca410f986ae18d9b26abfb/users/5e3f54d4c2414fcb8ddd022a48a02bed/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.847584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d4786-0c1d-4fef-8a7d-52ad0bcb761b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.852770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782fb5-a60a-4ef5-ace4-55ca09c41726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.853443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782fb5-a60a-4ef5-ace4-55ca09c41726 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.854094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9293eccaacca410f986ae18d9b26abfb, user_id=5e3f54d4c2414fcb8ddd022a48a02bed, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.854651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782fb5-a60a-4ef5-ace4-55ca09c41726 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.854651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782fb5-a60a-4ef5-ace4-55ca09c41726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.856585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8782fb5-a60a-4ef5-ace4-55ca09c41726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:05.857713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.890328 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2628/5325] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:05 2022] PUT /identity/v3/projects/9293eccaacca410f986ae18d9b26abfb/users/5e3f54d4c2414fcb8ddd022a48a02bed/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:05.890328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:05.954139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782fb5-a60a-4ef5-ace4-55ca09c41726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:05.957427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782fb5-a60a-4ef5-ace4-55ca09c41726 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:05.972326 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2698/5326] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:05.972326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cfbce-a4df-4cfd-9f48-5ffe64bcbe24 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.972326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cfbce-a4df-4cfd-9f48-5ffe64bcbe24 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:05.972727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cfbce-a4df-4cfd-9f48-5ffe64bcbe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:05.978427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad077a-5842-405c-8922-0136f3c38d09 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:05.998368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:05.998932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:05.999404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.000387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.002559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:06.002726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.005209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.012109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-342cfbce-a4df-4cfd-9f48-5ffe64bcbe24 None None] MFA Rules not processed for user `5e3f54d4c2414fcb8ddd022a48a02bed`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:06.014565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-342cfbce-a4df-4cfd-9f48-5ffe64bcbe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:06.029818 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2629/5327] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:06.031349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.047929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c14d4-bc2b-4c2a-8882-a3ee2e243ebc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.057884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.058808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.059086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.060702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.062551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.064393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.142824 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2630/5328] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:06 2022] POST /identity/v3/projects => generated 395 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:06.147252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.292537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8a977-2b70-4684-b4ba-1ca0edeab3c4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.298640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.299716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.300198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.300840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.301860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.304217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.323949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2699/5329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:06.329363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cfbce-a4df-4cfd-9f48-5ffe64bcbe24 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.342138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cfbce-a4df-4cfd-9f48-5ffe64bcbe24 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.344727 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2631/5330] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:06 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:06.346215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.350163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.351005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.351353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.351649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.352394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.354518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.371333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5f7f-d6a5-45f2-aec9-4270d7005611 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.378897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.379478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.403545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.403873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.407925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.411361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.414570 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2700/5331] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:06 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:06.418777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.459527 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2632/5332] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:06.465470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.484456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a6327-905a-4807-9a24-2355c1644d75 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.521083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dbc5c-2887-4269-a5d9-b42b64953b6d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.528171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.529715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.530311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.531067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.532080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.535581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.569713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.570631 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2701/5333] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:06 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:06.575124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.575421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.576645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.577633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.578478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.580502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.596636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2633/5334] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:12:06.597706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182805b2-6a0f-4902-a6ae-a564bb8b551d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.600357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.603661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.604363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.604682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.604962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.605842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.607706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.617984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0abf7-e522-4b6a-8bd0-3e4bf83b366e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.622173 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2702/5335] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:06.625608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744fc83-cda6-4dbb-85f5-42879d91a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.626163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.626598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fc83-cda6-4dbb-85f5-42879d91a261 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.626874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fc83-cda6-4dbb-85f5-42879d91a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.627153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fc83-cda6-4dbb-85f5-42879d91a261 admin admin] PATH_INFO: `/v3/projects/79616748303948e69d7aa4b13ae39dd1/users/66253560d025446da45a395ad583f4f2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.644714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005ca3a-b44c-4491-993f-4bf8e969dc31 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.649116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744fc83-cda6-4dbb-85f5-42879d91a261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79616748303948e69d7aa4b13ae39dd1, user_id=66253560d025446da45a395ad583f4f2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.650562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.651965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.652243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.652491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] PATH_INFO: `/v3/projects/6327dda9725c448ab5e87430fa509d78/users/085ca3751e1c49fca1d480806950d519/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.654408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744fc83-cda6-4dbb-85f5-42879d91a261 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.674576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6327dda9725c448ab5e87430fa509d78, user_id=085ca3751e1c49fca1d480806950d519, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.678502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.683954 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2634/5336] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:06 2022] PUT /identity/v3/projects/79616748303948e69d7aa4b13ae39dd1/users/66253560d025446da45a395ad583f4f2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:06.688183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.688527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.688888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.704910 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2703/5337] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:06 2022] PUT /identity/v3/projects/6327dda9725c448ab5e87430fa509d78/users/085ca3751e1c49fca1d480806950d519/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:06.709512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.737397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] MFA Rules not processed for user `66253560d025446da45a395ad583f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:06.738718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:06.791888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981fe4d-67a7-438b-8bba-e0f2d583f6c6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.800721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.801552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.801869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.802191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.802863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.809337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.825641 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2704/5338] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:06.826379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.849582 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2635/5339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:06.856647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee866a1-905a-4971-9490-c4d2bc32c078 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.862335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:06.863606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f3c42-6e02-4b0c-909c-c92fb1088748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:06.864218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:06.864846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f3c42-6e02-4b0c-909c-c92fb1088748 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.865181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f3c42-6e02-4b0c-909c-c92fb1088748 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.867137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f3c42-6e02-4b0c-909c-c92fb1088748 admin admin] PATH_INFO: `/v3/projects/6327dda9725c448ab5e87430fa509d78/users/085ca3751e1c49fca1d480806950d519/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.871867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f3c42-6e02-4b0c-909c-c92fb1088748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6327dda9725c448ab5e87430fa509d78, user_id=085ca3751e1c49fca1d480806950d519, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:06.882637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f3c42-6e02-4b0c-909c-c92fb1088748 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:06.907129 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2705/5340] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:06 2022] PUT /identity/v3/projects/6327dda9725c448ab5e87430fa509d78/users/085ca3751e1c49fca1d480806950d519/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:06.917496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4f1e4-ee6d-43bc-a360-80e47b8872d1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:06.917769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4f1e4-ee6d-43bc-a360-80e47b8872d1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:06.919724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4f1e4-ee6d-43bc-a360-80e47b8872d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:06.963277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7a4e-0e9e-4cc1-90ae-f8c45871acfa None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:06.969007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-afa4f1e4-ee6d-43bc-a360-80e47b8872d1 None None] MFA Rules not processed for user `085ca3751e1c49fca1d480806950d519`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:06.970929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-afa4f1e4-ee6d-43bc-a360-80e47b8872d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:07.058630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:07.059599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:07.060137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:07.060678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:07.080858 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2706/5341] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:07.097361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4f1e4-ee6d-43bc-a360-80e47b8872d1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:07.163914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:07.165665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:07.176360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4f1e4-ee6d-43bc-a360-80e47b8872d1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:07.181192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e54470-27ef-4129-a4f7-1bea7357f383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:07.182586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e54470-27ef-4129-a4f7-1bea7357f383 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:07.182975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e54470-27ef-4129-a4f7-1bea7357f383 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:07.183479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e54470-27ef-4129-a4f7-1bea7357f383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:07.189481 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2636/5342] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:07.197862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e54470-27ef-4129-a4f7-1bea7357f383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:07.200009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e54470-27ef-4129-a4f7-1bea7357f383 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:07.225741 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2707/5343] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:07.546743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:07.707381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5192-18dc-4dab-bb99-f770d2c7140f service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:07.721735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:07.731551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:07.732237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:07.733791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] PATH_INFO: `/v3/users/5e3f54d4c2414fcb8ddd022a48a02bed` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:07.737179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3f54d4c2414fcb8ddd022a48a02bed)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:07.742368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:07.853578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3f54d4c2414fcb8ddd022a48a02bed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:07.855351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3f54d4c2414fcb8ddd022a48a02bed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:07.885921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3f54d4c2414fcb8ddd022a48a02bed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:07.887664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3f54d4c2414fcb8ddd022a48a02bed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:07.912470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3f54d4c2414fcb8ddd022a48a02bed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:07.956445 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2637/5344] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:07 2022] DELETE /identity/v3/users/5e3f54d4c2414fcb8ddd022a48a02bed => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:07.961463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207893a-e692-4918-a689-cf9055a22185 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:07.962073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207893a-e692-4918-a689-cf9055a22185 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:07.962073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207893a-e692-4918-a689-cf9055a22185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:07.992846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9207893a-e692-4918-a689-cf9055a22185 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:07.994133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9207893a-e692-4918-a689-cf9055a22185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:08.114254 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2708/5345] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:08.130298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:08.132267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:08.258386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccf38d-95bf-4d9c-8abd-ff8dee7141b8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:08.263591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:08.264352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:08.264696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:08.265338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:08.285496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:08.287088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:08.320143 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2638/5346] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:08.356176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207893a-e692-4918-a689-cf9055a22185 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:08.358753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9207893a-e692-4918-a689-cf9055a22185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:08.617060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207893a-e692-4918-a689-cf9055a22185 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:08.633352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:08.634208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:08.634731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:08.635018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:08.648371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:08.674389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:08.677001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:08.703847 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2709/5347] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:09.083073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:09.084685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:09.103595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165fa3-141d-4ba3-a519-54e51a2d0676 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:09.113864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:09.115623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:09.117463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:09.118182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] PATH_INFO: `/v3/projects/9293eccaacca410f986ae18d9b26abfb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:09.120522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9293eccaacca410f986ae18d9b26abfb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:09.122792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:09.227116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9293eccaacca410f986ae18d9b26abfb', 'request_id': 'req-5455641b-6edc-4088-adb0-5fb418eaba2b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.240332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9293eccaacca410f986ae18d9b26abfb', 'request_id': 'req-5455641b-6edc-4088-adb0-5fb418eaba2b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.254809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9293eccaacca410f986ae18d9b26abfb', 'request_id': 'req-5455641b-6edc-4088-adb0-5fb418eaba2b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.289093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] The token cache is being invalidate because project 9293eccaacca410f986ae18d9b26abfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:09.289792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.290482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.295607 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2639/5348] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:09 2022] DELETE /identity/v3/projects/9293eccaacca410f986ae18d9b26abfb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:09.296904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:09.318659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab2d6-bc22-42ba-8406-f6610148708a service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:09.408380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:09.409415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:09.409700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:09.410154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] PATH_INFO: `/v3/users/085ca3751e1c49fca1d480806950d519` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:09.412050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085ca3751e1c49fca1d480806950d519)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:09.415650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:09.528978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085ca3751e1c49fca1d480806950d519'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.537343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085ca3751e1c49fca1d480806950d519'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.564679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085ca3751e1c49fca1d480806950d519'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.579122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085ca3751e1c49fca1d480806950d519'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.580042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085ca3751e1c49fca1d480806950d519'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:09.633705 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2710/5349] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:09 2022] DELETE /identity/v3/users/085ca3751e1c49fca1d480806950d519 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:10.459177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:10.463739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:10.481563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455641b-6edc-4088-adb0-5fb418eaba2b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:10.590542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:10.592080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:10.592393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:10.592873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] PATH_INFO: `/v3/users/5adf05308fc1421595eeddd8f46f744d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:10.594451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adf05308fc1421595eeddd8f46f744d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:10.596850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:10.704470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adf05308fc1421595eeddd8f46f744d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.710505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adf05308fc1421595eeddd8f46f744d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.719096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adf05308fc1421595eeddd8f46f744d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.720726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adf05308fc1421595eeddd8f46f744d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.730646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:10.732434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:10.744669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b48b894-587b-420c-9996-bbb8cd4f583d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adf05308fc1421595eeddd8f46f744d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.756199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80143c15-f2a2-455c-988c-a8a15ae69da0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:10.763221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:10.764568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:10.765106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:10.765668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] PATH_INFO: `/v3/projects/6327dda9725c448ab5e87430fa509d78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:10.768249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6327dda9725c448ab5e87430fa509d78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:10.777532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:10.805164 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2640/5350] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:10 2022] DELETE /identity/v3/users/5adf05308fc1421595eeddd8f46f744d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:10.811297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:10.811853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:10.812175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:10.846947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:10.849390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:10.884689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6327dda9725c448ab5e87430fa509d78', 'request_id': 'req-b4ef734a-5e0c-4bdb-99df-b256b62908ee'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.899940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6327dda9725c448ab5e87430fa509d78', 'request_id': 'req-b4ef734a-5e0c-4bdb-99df-b256b62908ee'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.911264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6327dda9725c448ab5e87430fa509d78', 'request_id': 'req-b4ef734a-5e0c-4bdb-99df-b256b62908ee'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.936465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] The token cache is being invalidate because project 6327dda9725c448ab5e87430fa509d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:10.936719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.937711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b4ef734a-5e0c-4bdb-99df-b256b62908ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:10.943104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2711/5351] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:10 2022] DELETE /identity/v3/projects/6327dda9725c448ab5e87430fa509d78 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:10.944888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0978b3-16ef-45ca-95b8-e123114c6672 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:10.945144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0978b3-16ef-45ca-95b8-e123114c6672 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:10.945591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0978b3-16ef-45ca-95b8-e123114c6672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:10.967843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3e0978b3-16ef-45ca-95b8-e123114c6672 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:10.969544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3e0978b3-16ef-45ca-95b8-e123114c6672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:10.998937 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2641/5352] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:11.006153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.008392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:11.071186 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2712/5353] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:11.087127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef115ea-9ccf-4b2c-a6bf-52448b84e064 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.091180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef115ea-9ccf-4b2c-a6bf-52448b84e064 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.091958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef115ea-9ccf-4b2c-a6bf-52448b84e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.112977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b3bef-d17b-4f2f-8a5e-b5a6ad933a95 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.116709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aef115ea-9ccf-4b2c-a6bf-52448b84e064 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:11.118388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aef115ea-9ccf-4b2c-a6bf-52448b84e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:11.119013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.119732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.120018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.120886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.130354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2713/5354] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:11.131885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.133671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.134729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef115ea-9ccf-4b2c-a6bf-52448b84e064 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.146049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef115ea-9ccf-4b2c-a6bf-52448b84e064 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.151672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.152478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.153090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.153615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.154315 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2642/5355] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:11.154491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:11.154763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.156569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.174577 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2714/5356] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:12:11.180625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.200523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017dd45-e8e8-42ae-a206-78e3887e9b33 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.208339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.210144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.210861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.211773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.213791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.217873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.281710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.282555 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2643/5357] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:11 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:11.300658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12861b-0cd6-4e44-a7ea-3ef3096a3d0e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.406849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.407655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.407993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.408331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.409056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.411039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.444303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2715/5358] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:11 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:11.447411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.464868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71e33-34d1-4766-a549-be52c51c8e44 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.481334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.482138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.482609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.482859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.483627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.485443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.509781 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2644/5359] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:11.520466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.546864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6226e8-93ec-431b-9820-d647de237beb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.556254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.557002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.557431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.557756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.558804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.561307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.577111 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2716/5360] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:11.582347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.602152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbf2ca-3e57-4de7-92de-79ff5cc5ef1e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.610490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732bfd8-c908-4fb0-88e6-8a39c922a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.611975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bfd8-c908-4fb0-88e6-8a39c922a014 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.612748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bfd8-c908-4fb0-88e6-8a39c922a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.613240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bfd8-c908-4fb0-88e6-8a39c922a014 admin admin] PATH_INFO: `/v3/projects/d4278f12b2484658b204fec79172cd04/users/7a45a5cde3bb44138a006c29a68542e9/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.650043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732bfd8-c908-4fb0-88e6-8a39c922a014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4278f12b2484658b204fec79172cd04, user_id=7a45a5cde3bb44138a006c29a68542e9, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.655590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732bfd8-c908-4fb0-88e6-8a39c922a014 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.658997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.661690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:11.687472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50390c47-97e3-4889-ba61-13135eee01e4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:11.708584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2645/5361] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:11 2022] PUT /identity/v3/projects/d4278f12b2484658b204fec79172cd04/users/7a45a5cde3bb44138a006c29a68542e9/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:11.744010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.744804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.746315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.752196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:11.754659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:11.755268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:11.755793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] PATH_INFO: `/v3/projects/8f1b43b503244eac945f137cf5cfdebb` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:11.758134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1b43b503244eac945f137cf5cfdebb)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:11.762110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:11.811767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] MFA Rules not processed for user `7a45a5cde3bb44138a006c29a68542e9`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:11.814373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:11.844242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1b43b503244eac945f137cf5cfdebb', 'request_id': 'req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:11.854429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1b43b503244eac945f137cf5cfdebb', 'request_id': 'req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:11.870925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1b43b503244eac945f137cf5cfdebb', 'request_id': 'req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:11.891626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] The token cache is being invalidate because project 8f1b43b503244eac945f137cf5cfdebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:11.893526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:11.894671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:11.897589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2717/5362] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:11 2022] DELETE /identity/v3/projects/8f1b43b503244eac945f137cf5cfdebb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:11.902316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.904092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:11.976336 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2646/5363] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:11.978441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:11.981228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:12.002342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18f830-5c9e-4fc5-83a2-2cb56dbb8e7e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.012009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.013868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.014305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.014765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] PATH_INFO: `/v3/users/1430b517def345c2b26f34adb16c9de4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.016853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1430b517def345c2b26f34adb16c9de4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.020533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.109633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1430b517def345c2b26f34adb16c9de4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:12.111024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1430b517def345c2b26f34adb16c9de4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:12.130417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1430b517def345c2b26f34adb16c9de4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:12.132125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a235-9a7f-4fe7-817d-e87ab112c995 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.149456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.151003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1430b517def345c2b26f34adb16c9de4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:12.151261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.152215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.152682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1430b517def345c2b26f34adb16c9de4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:12.153292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.154593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.157430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.181178 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2718/5364] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:11 2022] DELETE /identity/v3/users/1430b517def345c2b26f34adb16c9de4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:12.198549 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2647/5365] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:11 2022] POST /identity/v3/projects => generated 401 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:12.202943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:12.204634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:12.311313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56af5e-0116-4d65-87de-fa003b59c6ba admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.416220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.416983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.417694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.417694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.419638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.420752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.468796 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2719/5366] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:12 2022] POST /identity/v3/users => generated 307 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:12.476723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:12.509649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70308-7176-4e0e-96e0-3b598d16a082 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.526326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.530314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.530314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.533130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.537424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.542912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.565124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2648/5367] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:12.568445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:12.584762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1dcfc-3310-416c-ba34-858ec1b0d19f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.593165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.594899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.595186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.595462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] PATH_INFO: `/v3/projects/d67475e95f6a4151ace659e1bb92714c/users/0339fe4832084389a75145c3f684e194/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.625615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67475e95f6a4151ace659e1bb92714c, user_id=0339fe4832084389a75145c3f684e194, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.637564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.669091 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2720/5368] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:12 2022] PUT /identity/v3/projects/d67475e95f6a4151ace659e1bb92714c/users/0339fe4832084389a75145c3f684e194/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:12.672708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:12.691247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61813600-78f0-47e5-9fd1-acf70393b655 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.813452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.815882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.816762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.818608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.819421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.821597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:12.823120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.823816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:12.853453 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2649/5369] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:12.857471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3584071-799f-4165-97a9-d1d2036607b2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.857856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:12.870462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.871456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5189f-2943-4671-9015-c0669e32745a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:12.874941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.875593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.876663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] PATH_INFO: `/v3/projects/b9f1b8772dea4cedb8fbd278940ff4c9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.878968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576690b0-df42-46d3-bc4f-6c2f07975e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:12.880253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576690b0-df42-46d3-bc4f-6c2f07975e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.880600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f1b8772dea4cedb8fbd278940ff4c9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.880748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576690b0-df42-46d3-bc4f-6c2f07975e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.881152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576690b0-df42-46d3-bc4f-6c2f07975e24 admin admin] PATH_INFO: `/v3/projects/d67475e95f6a4151ace659e1bb92714c/users/0339fe4832084389a75145c3f684e194/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.885026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576690b0-df42-46d3-bc4f-6c2f07975e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67475e95f6a4151ace659e1bb92714c, user_id=0339fe4832084389a75145c3f684e194, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:12.887306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.888608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576690b0-df42-46d3-bc4f-6c2f07975e24 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:12.912458 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2650/5370] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:12 2022] PUT /identity/v3/projects/d67475e95f6a4151ace659e1bb92714c/users/0339fe4832084389a75145c3f684e194/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:12.923310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:12.923707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:12.924053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:12.965657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] MFA Rules not processed for user `0339fe4832084389a75145c3f684e194`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:12.968617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:12.986828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f1b8772dea4cedb8fbd278940ff4c9', 'request_id': 'req-b1f88008-a188-4a2f-8672-03efb6315dfa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:13.003027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f1b8772dea4cedb8fbd278940ff4c9', 'request_id': 'req-b1f88008-a188-4a2f-8672-03efb6315dfa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:13.015771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f1b8772dea4cedb8fbd278940ff4c9', 'request_id': 'req-b1f88008-a188-4a2f-8672-03efb6315dfa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:13.043987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] The token cache is being invalidate because project b9f1b8772dea4cedb8fbd278940ff4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:13.044908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:13.045842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1f88008-a188-4a2f-8672-03efb6315dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:13.047981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2721/5371] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:12 2022] DELETE /identity/v3/projects/b9f1b8772dea4cedb8fbd278940ff4c9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:13.057779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d0df3-16fb-441e-8527-4788eb5c0add None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.058189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d0df3-16fb-441e-8527-4788eb5c0add None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.058300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d0df3-16fb-441e-8527-4788eb5c0add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.103996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-267d0df3-16fb-441e-8527-4788eb5c0add None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:13.106076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-267d0df3-16fb-441e-8527-4788eb5c0add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:13.112830 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2651/5372] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:13.124911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.128258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:13.237881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861e765-acbc-4ee6-9b94-f39d4e834edf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.242982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.243718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.243999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.244533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.252936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2722/5373] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:13.255434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6b3eb-8f68-41bd-acf5-ba9d7f41e92a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.255721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6b3eb-8f68-41bd-acf5-ba9d7f41e92a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.255988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6b3eb-8f68-41bd-acf5-ba9d7f41e92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.257168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.258726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.279813 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2652/5374] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:13.299345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2fc6b3eb-8f68-41bd-acf5-ba9d7f41e92a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:13.301571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2fc6b3eb-8f68-41bd-acf5-ba9d7f41e92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:13.313568 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2723/5375] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:13.318578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.340774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73b50f-5dc5-44c5-9076-d2320e5b3f50 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.346614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.347397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.347709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.348004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.349160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:13.353745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.360920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.375297 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2653/5376] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:13.381853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6b3eb-8f68-41bd-acf5-ba9d7f41e92a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.402586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6b3eb-8f68-41bd-acf5-ba9d7f41e92a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.403702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.410637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.412468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.413259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.414008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.415638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.417997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79b9e-e33f-48c4-a643-59318c1aaf3f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.420403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.422647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.423797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.424031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.424488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.426857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:13.478014 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2724/5377] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:13 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:13.481351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.532075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.533890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.548581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2654/5378] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:13.563501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bcc2a-30ae-4992-a2ec-078101b5a281 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.573886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.574598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.574980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.575279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.576747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.589931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.616153 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2725/5379] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:13 2022] POST /identity/v3/users => generated 303 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:13.620277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.634065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0682421-0c8e-4286-95df-f9da8c73f7ca service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.648507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.650702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.651217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.651742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.653718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.656967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.675535 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2655/5380] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:13.677533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.696052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe290a1-6e9c-493c-a076-327dc9e684df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.702539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb6f33-065b-42ba-a3c0-4d5aa1ca1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.703288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb6f33-065b-42ba-a3c0-4d5aa1ca1e06 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.703777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb6f33-065b-42ba-a3c0-4d5aa1ca1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.703904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb6f33-065b-42ba-a3c0-4d5aa1ca1e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.704690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb6f33-065b-42ba-a3c0-4d5aa1ca1e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.706676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb6f33-065b-42ba-a3c0-4d5aa1ca1e06 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.731894 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2726/5381] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:13.736126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:13.751143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931bedf-9411-4440-9f5c-77a765ec15d7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:13.758375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:13.760066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.760517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.762171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] PATH_INFO: `/v3/projects/cc1b8680b8e64fe3b97b0b0c90675c02/users/5c8b21ae96b14afa9c0ca9ac21b351f1/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.787178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1b8680b8e64fe3b97b0b0c90675c02, user_id=5c8b21ae96b14afa9c0ca9ac21b351f1, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:13.790902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:13.813702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2656/5382] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:13 2022] PUT /identity/v3/projects/cc1b8680b8e64fe3b97b0b0c90675c02/users/5c8b21ae96b14afa9c0ca9ac21b351f1/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:13.823194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58223db-4a23-4cfa-95de-0a1732c0a95e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:13.823741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58223db-4a23-4cfa-95de-0a1732c0a95e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:13.823944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58223db-4a23-4cfa-95de-0a1732c0a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:13.866507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b58223db-4a23-4cfa-95de-0a1732c0a95e None None] MFA Rules not processed for user `5c8b21ae96b14afa9c0ca9ac21b351f1`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:13.867889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b58223db-4a23-4cfa-95de-0a1732c0a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:13.959008 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2727/5383] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:13.963983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:14.075745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd85c-11d5-4f88-b24f-340ae154a1f2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:14.083258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:14.084062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.084340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.084618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.085616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:14.088338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:14.132815 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2657/5384] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:13 2022] POST /identity/v3/projects => generated 409 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:14.134156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58223db-4a23-4cfa-95de-0a1732c0a95e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:14.147169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58223db-4a23-4cfa-95de-0a1732c0a95e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:14.240181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:14.241449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.241776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.242057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.244873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:14.249169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:14.288385 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2728/5385] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:14 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:14.292930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:14.314838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684aea-c461-4201-9433-7d61a1621e66 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:14.320602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:14.321683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.321828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.322988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.323727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:14.325514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:14.339479 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2658/5386] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:14.344082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:14.356859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358629b-df32-4b2e-8b36-2d1ef0935c94 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:14.362359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:14.363393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.363712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.363960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] PATH_INFO: `/v3/projects/a097a78b6bcb46d6a1ae5e774b95854d/users/7df96ac5ec7c4690b972fb9e90df8e97/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.389972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a097a78b6bcb46d6a1ae5e774b95854d, user_id=7df96ac5ec7c4690b972fb9e90df8e97, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:14.392689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:14.420966 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2729/5387] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:14 2022] PUT /identity/v3/projects/a097a78b6bcb46d6a1ae5e774b95854d/users/7df96ac5ec7c4690b972fb9e90df8e97/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:14.424813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:14.435268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf8f87-40af-400d-80d1-565f7debd970 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:14.513904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572d85e-8afb-42b2-a345-9318f6350db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:14.514958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d85e-8afb-42b2-a345-9318f6350db9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.515465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d85e-8afb-42b2-a345-9318f6350db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.516279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d85e-8afb-42b2-a345-9318f6350db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.517388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572d85e-8afb-42b2-a345-9318f6350db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:14.519802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572d85e-8afb-42b2-a345-9318f6350db9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:14.537996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2659/5388] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:14.539654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:14.553352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b331-9b37-48ad-814b-bd7d57f810fc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:14.560121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:14.561994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.562349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.562630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] PATH_INFO: `/v3/projects/a097a78b6bcb46d6a1ae5e774b95854d/users/7df96ac5ec7c4690b972fb9e90df8e97/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.565521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a097a78b6bcb46d6a1ae5e774b95854d, user_id=7df96ac5ec7c4690b972fb9e90df8e97, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:14.571538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:14.590658 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2730/5389] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:14 2022] PUT /identity/v3/projects/a097a78b6bcb46d6a1ae5e774b95854d/users/7df96ac5ec7c4690b972fb9e90df8e97/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:14.602937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.602937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.602937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.631776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] MFA Rules not processed for user `7df96ac5ec7c4690b972fb9e90df8e97`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:14.633240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:14.727284 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2660/5390] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:14.740062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:14.801413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb2e3-2a18-42f1-9a12-faefaef1e8d3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:14.805114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:14.805783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:14.806062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:14.806329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:14.816088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:14.817595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:14.826840 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2731/5391] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:15.026734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:15.028199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:15.054110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744bb1-4c2e-44c5-8450-19663e353ac3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:15.062215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f0a49-5876-4eba-b4a1-177cb329aa2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:15.063083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f0a49-5876-4eba-b4a1-177cb329aa2a service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:15.063412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f0a49-5876-4eba-b4a1-177cb329aa2a service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:15.063792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f0a49-5876-4eba-b4a1-177cb329aa2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:15.149515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f0a49-5876-4eba-b4a1-177cb329aa2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:15.151154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f0a49-5876-4eba-b4a1-177cb329aa2a service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:15.162688 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2661/5392] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:17.998118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:18.002803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:18.084955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5d82-28a3-4dd1-9b8b-99f02685205e service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:18.094393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:18.095664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:18.096134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:18.096640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] PATH_INFO: `/v3/users/7a45a5cde3bb44138a006c29a68542e9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:18.099552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a45a5cde3bb44138a006c29a68542e9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:18.103188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:18.173413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a45a5cde3bb44138a006c29a68542e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.174522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a45a5cde3bb44138a006c29a68542e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.182038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a45a5cde3bb44138a006c29a68542e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.194094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a45a5cde3bb44138a006c29a68542e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.195842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a45a5cde3bb44138a006c29a68542e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.218689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2732/5393] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:17 2022] DELETE /identity/v3/users/7a45a5cde3bb44138a006c29a68542e9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:18.223057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:18.224584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:18.225215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:18.243428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:18.245609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:18.327601 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2662/5394] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:18.334641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:18.340727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:18.410806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b1f2f-a22f-49d7-b9bd-1947c36aaa25 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:18.415341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:18.416067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:18.416385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:18.416658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:18.430933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:18.432599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:18.459848 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2733/5395] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:18.843860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:18.845317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:18.858346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462248b-b456-4bc3-aff9-09da77154ee2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:18.865397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:18.866398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:18.867206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:18.867206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] PATH_INFO: `/v3/projects/d4278f12b2484658b204fec79172cd04` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:18.868736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4278f12b2484658b204fec79172cd04)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:18.873626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:18.933314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4278f12b2484658b204fec79172cd04', 'request_id': 'req-57a66029-e543-4dde-a5f8-1a513cc09b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.940192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4278f12b2484658b204fec79172cd04', 'request_id': 'req-57a66029-e543-4dde-a5f8-1a513cc09b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.949444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4278f12b2484658b204fec79172cd04', 'request_id': 'req-57a66029-e543-4dde-a5f8-1a513cc09b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.962935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] The token cache is being invalidate because project d4278f12b2484658b204fec79172cd04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:18.963213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.963959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:18.965950 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2663/5396] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:18 2022] DELETE /identity/v3/projects/d4278f12b2484658b204fec79172cd04 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:18.970246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:18.981370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e823ab2-dd30-47af-b5cc-995c5bb257b5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:19.044282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:19.046137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:19.046559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:19.046939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] PATH_INFO: `/v3/users/0339fe4832084389a75145c3f684e194` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:19.048275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0339fe4832084389a75145c3f684e194)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:19.050555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:19.112575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0339fe4832084389a75145c3f684e194'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.113252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0339fe4832084389a75145c3f684e194'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.119899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0339fe4832084389a75145c3f684e194'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.129055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0339fe4832084389a75145c3f684e194'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.129688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5e2b386-ec25-4cca-81c8-60caf7aee675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0339fe4832084389a75145c3f684e194'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.148149 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2734/5397] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:18 2022] DELETE /identity/v3/users/0339fe4832084389a75145c3f684e194 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:19.494456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:19.496897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:19.516171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66029-e543-4dde-a5f8-1a513cc09b08 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:19.592744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:19.593752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:19.594113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:19.594449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] PATH_INFO: `/v3/projects/d67475e95f6a4151ace659e1bb92714c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:19.595648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67475e95f6a4151ace659e1bb92714c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:19.597694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:19.648232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67475e95f6a4151ace659e1bb92714c', 'request_id': 'req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.656733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67475e95f6a4151ace659e1bb92714c', 'request_id': 'req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.666176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67475e95f6a4151ace659e1bb92714c', 'request_id': 'req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.683206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] The token cache is being invalidate because project d67475e95f6a4151ace659e1bb92714c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:19.684002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.685078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-64e0af9d-d639-4cb3-ad70-6a0dcdcb0896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:19.694066 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2664/5398] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:19 2022] DELETE /identity/v3/projects/d67475e95f6a4151ace659e1bb92714c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:19.695847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447541-b6b3-445f-88ee-8e4820c8ec82 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:19.696134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447541-b6b3-445f-88ee-8e4820c8ec82 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:19.696422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447541-b6b3-445f-88ee-8e4820c8ec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:19.725824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2a447541-b6b3-445f-88ee-8e4820c8ec82 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:19.727302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2a447541-b6b3-445f-88ee-8e4820c8ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:19.807018 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2735/5399] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:19.815762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a7de-3a19-472d-bdc7-fe3e0148ddf5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:19.816026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a7de-3a19-472d-bdc7-fe3e0148ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:19.816311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a7de-3a19-472d-bdc7-fe3e0148ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:19.836222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bb11a7de-3a19-472d-bdc7-fe3e0148ddf5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:19.837783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb11a7de-3a19-472d-bdc7-fe3e0148ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:19.852324 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2665/5400] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:19.857265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a447541-b6b3-445f-88ee-8e4820c8ec82 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:19.871121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a447541-b6b3-445f-88ee-8e4820c8ec82 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:19.877574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:19.878212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:19.878530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:19.879016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:19.879995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:19.880383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:19.882211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:19.901264 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2736/5401] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:19.902653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11a7de-3a19-472d-bdc7-fe3e0148ddf5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:19.912541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11a7de-3a19-472d-bdc7-fe3e0148ddf5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:19.917456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:19.918165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:19.918480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:19.918761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:19.919465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:19.921602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:19.953403 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2666/5402] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:19 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:19.957695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:19.969545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0285a6-b5d4-431f-af58-fb8e773081da admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.029528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.029528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.030686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.030912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.031556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.033884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.057406 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2737/5403] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:19 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:20.061459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.071568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2c60f-ad7f-487d-a04e-f2686b303d3e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.076615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.077331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.077609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.077878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.078590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.080213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.090723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2667/5404] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:20.094720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.105184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec69e2-f341-4969-9df1-760c53bc244f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.110578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025203f-e5ab-48e3-bdc8-69d983627dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.111265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025203f-e5ab-48e3-bdc8-69d983627dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.111544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025203f-e5ab-48e3-bdc8-69d983627dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.111814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025203f-e5ab-48e3-bdc8-69d983627dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.112542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025203f-e5ab-48e3-bdc8-69d983627dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.114207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025203f-e5ab-48e3-bdc8-69d983627dd3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.124798 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2738/5405] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:20.129027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.139475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196671d-97a1-4760-a83d-0dca9228c35a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.144620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.145601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.145881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.146142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] PATH_INFO: `/v3/projects/a9f8b175df3d4e77960eda0e4eb4ce60/users/49aef69f9b114c26a48fb7666c65e51c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.160543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f8b175df3d4e77960eda0e4eb4ce60, user_id=49aef69f9b114c26a48fb7666c65e51c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.163246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.176746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2668/5406] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:20 2022] PUT /identity/v3/projects/a9f8b175df3d4e77960eda0e4eb4ce60/users/49aef69f9b114c26a48fb7666c65e51c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:20.186670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cb780-f3d4-4515-ae6e-2c94fb10e0ad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.186957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cb780-f3d4-4515-ae6e-2c94fb10e0ad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.187229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cb780-f3d4-4515-ae6e-2c94fb10e0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.212502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b63cb780-f3d4-4515-ae6e-2c94fb10e0ad None None] MFA Rules not processed for user `49aef69f9b114c26a48fb7666c65e51c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:20.213876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b63cb780-f3d4-4515-ae6e-2c94fb10e0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:20.276524 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2739/5407] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:20.281295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.341217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8bfdd-e586-492e-b960-56249690914a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.346120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.346815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.347096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.347371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.348173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.350424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.380773 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2669/5408] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:20 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:20.384954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cb780-f3d4-4515-ae6e-2c94fb10e0ad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.397201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cb780-f3d4-4515-ae6e-2c94fb10e0ad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.493445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.494149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.494427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.494701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.495449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.497555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.519429 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2740/5409] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:20 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:20.523740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.535838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4cf10-93a1-4ae9-ac1a-76c995b1712f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.541164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.542113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.542402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.542680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.543417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.545280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.558520 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2670/5410] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:20.566184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.582848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314ddcc-f7ae-4dda-b956-cc06ca4c1cc2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.593318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.595350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.595710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.596095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] PATH_INFO: `/v3/projects/98071d99911a47d8b9d3391cc37493d2/users/4517741fa5234c25ac5d37297badcdef/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.614610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98071d99911a47d8b9d3391cc37493d2, user_id=4517741fa5234c25ac5d37297badcdef, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.618622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.636984 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2741/5411] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:20 2022] PUT /identity/v3/projects/98071d99911a47d8b9d3391cc37493d2/users/4517741fa5234c25ac5d37297badcdef/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:20.640795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.651875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4b7d3-33ae-4af2-8423-6314cdc7eb75 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.721529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7940c-4e47-4146-a411-32f905024752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.722356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7940c-4e47-4146-a411-32f905024752 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.722773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7940c-4e47-4146-a411-32f905024752 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.723173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7940c-4e47-4146-a411-32f905024752 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.724341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7940c-4e47-4146-a411-32f905024752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.726661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7940c-4e47-4146-a411-32f905024752 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.738745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2671/5412] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:20.743478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.755315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d369e-370c-4e40-a805-c02b508418f9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:20.762090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:20.763575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.763941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.764313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] PATH_INFO: `/v3/projects/98071d99911a47d8b9d3391cc37493d2/users/4517741fa5234c25ac5d37297badcdef/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.767256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98071d99911a47d8b9d3391cc37493d2, user_id=4517741fa5234c25ac5d37297badcdef, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:20.770224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:20.785615 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2742/5413] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:20 2022] PUT /identity/v3/projects/98071d99911a47d8b9d3391cc37493d2/users/4517741fa5234c25ac5d37297badcdef/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:20.796254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f00be-cb4f-4a28-8604-5379dc67de96 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:20.796552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f00be-cb4f-4a28-8604-5379dc67de96 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:20.796818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f00be-cb4f-4a28-8604-5379dc67de96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:20.829493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f3f00be-cb4f-4a28-8604-5379dc67de96 None None] MFA Rules not processed for user `4517741fa5234c25ac5d37297badcdef`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:20.830833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f3f00be-cb4f-4a28-8604-5379dc67de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:20.914263 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2672/5414] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:20.927545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:20.929723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:21.008640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b289547-0803-454f-b4ce-87a38b080b4e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:21.012997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264fb0f-bef3-48f8-a2f9-d6139d60e9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:21.014158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264fb0f-bef3-48f8-a2f9-d6139d60e9ff service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:21.015249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264fb0f-bef3-48f8-a2f9-d6139d60e9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:21.015848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264fb0f-bef3-48f8-a2f9-d6139d60e9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:21.028571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264fb0f-bef3-48f8-a2f9-d6139d60e9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:21.031550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264fb0f-bef3-48f8-a2f9-d6139d60e9ff service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:21.045175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2743/5415] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:21.511296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f00be-cb4f-4a28-8604-5379dc67de96 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:21.576624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f00be-cb4f-4a28-8604-5379dc67de96 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:21.581581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:21.582504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:21.583086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:21.583368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] PATH_INFO: `/v3/users/49aef69f9b114c26a48fb7666c65e51c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:21.584701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=49aef69f9b114c26a48fb7666c65e51c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:21.587703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:21.641398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49aef69f9b114c26a48fb7666c65e51c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:21.642068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49aef69f9b114c26a48fb7666c65e51c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:21.649549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49aef69f9b114c26a48fb7666c65e51c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:21.650371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49aef69f9b114c26a48fb7666c65e51c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:21.661199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49aef69f9b114c26a48fb7666c65e51c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:21.687699 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2673/5416] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:21 2022] DELETE /identity/v3/users/49aef69f9b114c26a48fb7666c65e51c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:21.692459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:21.693018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:21.693018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:21.713246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:21.714718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:21.809129 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2744/5417] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:21.820096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:21.822326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:21.890218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c06cb-d468-40b5-a40e-5e3cf9345edc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:21.893904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:21.894559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:21.894832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:21.895100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:21.904977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:21.906446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:21.927690 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2674/5418] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:21.930127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:21.932117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:21.935232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:21.936811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:21.948290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b801443-b8fa-4258-9878-7eb0b9e36809 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:21.954043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:21.954996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:21.955279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:21.955982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] PATH_INFO: `/v3/users/66253560d025446da45a395ad583f4f2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:21.956927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66253560d025446da45a395ad583f4f2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:21.959563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:21.960732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b99c7-9b98-443b-b5a3-eaff73e688b7 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:21.968557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:21.969852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:21.970482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:21.971015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] PATH_INFO: `/v3/users/5c8b21ae96b14afa9c0ca9ac21b351f1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:21.972605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8b21ae96b14afa9c0ca9ac21b351f1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:21.976163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.024222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66253560d025446da45a395ad583f4f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.024939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66253560d025446da45a395ad583f4f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.032647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66253560d025446da45a395ad583f4f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.042272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66253560d025446da45a395ad583f4f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.042508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8b21ae96b14afa9c0ca9ac21b351f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.043312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8b21ae96b14afa9c0ca9ac21b351f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.043452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0490429f-78c5-406c-87f5-0974ac1bcb08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66253560d025446da45a395ad583f4f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.053218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8b21ae96b14afa9c0ca9ac21b351f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.054024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8b21ae96b14afa9c0ca9ac21b351f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.064130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e56a5eb9-fc8b-4acb-91ab-831317dd1a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8b21ae96b14afa9c0ca9ac21b351f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.065604 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2745/5419] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:21 2022] DELETE /identity/v3/users/66253560d025446da45a395ad583f4f2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:22.071008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.071289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.072498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.090174 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2675/5420] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:21 2022] DELETE /identity/v3/users/5c8b21ae96b14afa9c0ca9ac21b351f1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:22.094653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.094942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.095944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.099210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:22.100902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.117839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:22.119539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.170585 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2746/5421] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:22.178038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.179511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.188647 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2676/5422] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:22.199028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.201247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.266715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0413-4a1c-4bee-9a23-004adaaa448b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.271381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:22.272135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.272386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b241-9679-4e2c-8bab-749bcc88d1a2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.272521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.272994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.276510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:22.277243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.277527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.277803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.282763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:22.284354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.287894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:22.289759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.295868 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2747/5423] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:22.296919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.298412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.301418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2677/5424] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:22.312673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36bb3-0b16-4dcc-937b-aeef437d52a5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.317582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:22.318724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.319001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.319276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] PATH_INFO: `/v3/projects/a9f8b175df3d4e77960eda0e4eb4ce60` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.321286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f8b175df3d4e77960eda0e4eb4ce60)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:22.323228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.377837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f8b175df3d4e77960eda0e4eb4ce60', 'request_id': 'req-48e77f33-cb89-4737-b62e-1b4b22dc38c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.388595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f8b175df3d4e77960eda0e4eb4ce60', 'request_id': 'req-48e77f33-cb89-4737-b62e-1b4b22dc38c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.398478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f8b175df3d4e77960eda0e4eb4ce60', 'request_id': 'req-48e77f33-cb89-4737-b62e-1b4b22dc38c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.413795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] The token cache is being invalidate because project a9f8b175df3d4e77960eda0e4eb4ce60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:22.414063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.414806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.416748 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2748/5425] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:22 2022] DELETE /identity/v3/projects/a9f8b175df3d4e77960eda0e4eb4ce60 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:22.421132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.432415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f77fb2-df60-4459-9617-776815a02b16 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.523319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:22.524251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.524681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.524965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] PATH_INFO: `/v3/users/4517741fa5234c25ac5d37297badcdef` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.526596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4517741fa5234c25ac5d37297badcdef)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:22.531893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.554902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.556522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.583417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e77f33-cb89-4737-b62e-1b4b22dc38c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.589811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:22.591360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.591855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.592305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] PATH_INFO: `/v3/projects/79616748303948e69d7aa4b13ae39dd1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.593789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79616748303948e69d7aa4b13ae39dd1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:22.596629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.602350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4517741fa5234c25ac5d37297badcdef'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.603076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4517741fa5234c25ac5d37297badcdef'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.613148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4517741fa5234c25ac5d37297badcdef'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.613941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4517741fa5234c25ac5d37297badcdef'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.624977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4517741fa5234c25ac5d37297badcdef'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.647006 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2678/5426] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:22 2022] DELETE /identity/v3/users/4517741fa5234c25ac5d37297badcdef => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:22.695434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79616748303948e69d7aa4b13ae39dd1', 'request_id': 'req-2e52b42a-6a6d-4095-a240-20b7e569b28e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.707646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79616748303948e69d7aa4b13ae39dd1', 'request_id': 'req-2e52b42a-6a6d-4095-a240-20b7e569b28e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.709907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.716826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.718246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79616748303948e69d7aa4b13ae39dd1', 'request_id': 'req-2e52b42a-6a6d-4095-a240-20b7e569b28e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.735053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] The token cache is being invalidate because project 79616748303948e69d7aa4b13ae39dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:22.735364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.736047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2e52b42a-6a6d-4095-a240-20b7e569b28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.737960 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2749/5427] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:22 2022] DELETE /identity/v3/projects/79616748303948e69d7aa4b13ae39dd1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:22.743901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025468-1cee-44be-b961-8c5ad7cdd591 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.744236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025468-1cee-44be-b961-8c5ad7cdd591 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.744432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025468-1cee-44be-b961-8c5ad7cdd591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.770227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-43025468-1cee-44be-b961-8c5ad7cdd591 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:22.771732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-43025468-1cee-44be-b961-8c5ad7cdd591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.815246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac4a00-5c53-4ba9-b578-a8dd8cc4fc0f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.855457 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2750/5428] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:22.863561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c28c4d-de49-4e4e-b602-99846122e961 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.863863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c28c4d-de49-4e4e-b602-99846122e961 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.864108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c28c4d-de49-4e4e-b602-99846122e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.884491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a3c28c4d-de49-4e4e-b602-99846122e961 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:22.886113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a3c28c4d-de49-4e4e-b602-99846122e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:22.888507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:22.889725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.890110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.890454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] PATH_INFO: `/v3/projects/cc1b8680b8e64fe3b97b0b0c90675c02` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.891943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1b8680b8e64fe3b97b0b0c90675c02)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:22.894560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.898980 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2751/5429] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:22.900026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c28c4d-de49-4e4e-b602-99846122e961 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.910067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c28c4d-de49-4e4e-b602-99846122e961 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.915168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:22.915871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:22.916157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:22.916433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:22.917202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:22.917515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:22.919212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:22.932714 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2752/5430] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:22.937316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:22.947644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84a39-9bc0-4627-9c27-eb38a597141b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:22.957460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1b8680b8e64fe3b97b0b0c90675c02', 'request_id': 'req-8e8ac074-683c-48c5-b97d-972d1c42d5ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.963920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1b8680b8e64fe3b97b0b0c90675c02', 'request_id': 'req-8e8ac074-683c-48c5-b97d-972d1c42d5ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.975727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1b8680b8e64fe3b97b0b0c90675c02', 'request_id': 'req-8e8ac074-683c-48c5-b97d-972d1c42d5ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.997413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] The token cache is being invalidate because project cc1b8680b8e64fe3b97b0b0c90675c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:22.998031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:22.998916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.001257 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2679/5431] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:22 2022] DELETE /identity/v3/projects/cc1b8680b8e64fe3b97b0b0c90675c02 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:23.001969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.003744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.020821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.021547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.021821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.022296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.024061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.026150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.058591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2753/5432] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:22 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:23.061981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.063720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.077459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ac074-683c-48c5-b97d-972d1c42d5ce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.130380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799eac-557c-4e0d-b379-8531e64c46db admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.135630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.136123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.136754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.137117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.137326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.137445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] PATH_INFO: `/v3/users/7df96ac5ec7c4690b972fb9e90df8e97` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.137554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.137854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] PATH_INFO: `/v3/projects/98071d99911a47d8b9d3391cc37493d2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.138829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df96ac5ec7c4690b972fb9e90df8e97)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.139285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=98071d99911a47d8b9d3391cc37493d2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.140783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.141582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.192499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df96ac5ec7c4690b972fb9e90df8e97'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.193438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98071d99911a47d8b9d3391cc37493d2', 'request_id': 'req-b7a5fce8-7f75-44e6-8615-944f039d7eeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.193596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df96ac5ec7c4690b972fb9e90df8e97'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.199979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98071d99911a47d8b9d3391cc37493d2', 'request_id': 'req-b7a5fce8-7f75-44e6-8615-944f039d7eeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.205399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df96ac5ec7c4690b972fb9e90df8e97'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.211430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98071d99911a47d8b9d3391cc37493d2', 'request_id': 'req-b7a5fce8-7f75-44e6-8615-944f039d7eeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.214451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df96ac5ec7c4690b972fb9e90df8e97'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.215173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4d8bbeff-be53-4fb6-81e6-fd7e8da49c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df96ac5ec7c4690b972fb9e90df8e97'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.224989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] The token cache is being invalidate because project 98071d99911a47d8b9d3391cc37493d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:23.225303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.225974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.227550 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2680/5433] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:23 2022] DELETE /identity/v3/projects/98071d99911a47d8b9d3391cc37493d2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:23.228286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.230097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.235437 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2754/5434] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:23 2022] DELETE /identity/v3/users/7df96ac5ec7c4690b972fb9e90df8e97 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:23.238414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848ca4-4538-48c5-a766-47a6698ab763 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.238698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848ca4-4538-48c5-a766-47a6698ab763 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.239079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848ca4-4538-48c5-a766-47a6698ab763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.258893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b1848ca4-4538-48c5-a766-47a6698ab763 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:23.260274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b1848ca4-4538-48c5-a766-47a6698ab763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.305471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5fce8-7f75-44e6-8615-944f039d7eeb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.332213 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2755/5435] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:23.340272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c115-f38d-4903-bf4d-1d7ff4c96b05 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.340600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c115-f38d-4903-bf4d-1d7ff4c96b05 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.340933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c115-f38d-4903-bf4d-1d7ff4c96b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.364172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5b62c115-f38d-4903-bf4d-1d7ff4c96b05 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:23.365744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5b62c115-f38d-4903-bf4d-1d7ff4c96b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.380272 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2756/5436] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:23.381499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62c115-f38d-4903-bf4d-1d7ff4c96b05 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.382384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.383168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.383420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.383687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.384416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.386457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.392842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62c115-f38d-4903-bf4d-1d7ff4c96b05 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.399331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.400061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.400357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.400716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.401389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:23.401713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.403461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.419155 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2681/5437] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:23.421528 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2757/5438] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:23.423623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.426127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.436031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f0f0-f860-4328-aac5-250721371db7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.441987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.443766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.444333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.444780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.445708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548c604-8f98-4533-8ae7-738a93bc606b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.446791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.448566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.453732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.454731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.455204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.455595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.456387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.458603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.462723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2682/5439] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:23.467463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.482781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c739c-b0c5-470b-8dce-e9fcfbb617e6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.489292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.490135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.490581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.491279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.492584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.494863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.515303 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2683/5440] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:23.527536 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2758/5441] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:23.528101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.528548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.545068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557224-71ee-45bb-812c-73585fbca681 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.611513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.613284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.613588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4e3a-06ff-415d-aee1-d2e12c5ad9c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.613807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.613807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] PATH_INFO: `/v3/projects/5d1fe3272f44492ab3e82549fed639f4/users/27fcd74be18d4c3aa2b3e67ec6f6ac93/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.618574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.619389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.619554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.619831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.623311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.623311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.634406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1fe3272f44492ab3e82549fed639f4, user_id=27fcd74be18d4c3aa2b3e67ec6f6ac93, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.638448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.651587 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2759/5442] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:23.652517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.654657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.660375 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2684/5443] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:23 2022] PUT /identity/v3/projects/5d1fe3272f44492ab3e82549fed639f4/users/27fcd74be18d4c3aa2b3e67ec6f6ac93/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:23.666322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.668067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db903496-13f0-4f37-9edd-22cec6a3b8c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.730390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.731514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.731798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.732066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] PATH_INFO: `/v3/projects/a097a78b6bcb46d6a1ae5e774b95854d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.733377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a097a78b6bcb46d6a1ae5e774b95854d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.734425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3176b6-81df-4dc1-b17c-3b5da9297f57 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.735309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.739697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273949a-1d62-4cda-a7ce-1253aaf1b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.740475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273949a-1d62-4cda-a7ce-1253aaf1b049 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.740787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273949a-1d62-4cda-a7ce-1253aaf1b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.741160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273949a-1d62-4cda-a7ce-1253aaf1b049 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.741915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273949a-1d62-4cda-a7ce-1253aaf1b049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.743679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273949a-1d62-4cda-a7ce-1253aaf1b049 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.755116 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2685/5444] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:23.756497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5945f-1bc3-4bc5-9fa8-0ef6d0f51fee None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.756785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5945f-1bc3-4bc5-9fa8-0ef6d0f51fee None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.757079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5945f-1bc3-4bc5-9fa8-0ef6d0f51fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.788364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a097a78b6bcb46d6a1ae5e774b95854d', 'request_id': 'req-3269c12e-15e9-41ec-8ebe-f25afc7a8011'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.790780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ddd5945f-1bc3-4bc5-9fa8-0ef6d0f51fee None None] MFA Rules not processed for user `27fcd74be18d4c3aa2b3e67ec6f6ac93`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:23.792169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ddd5945f-1bc3-4bc5-9fa8-0ef6d0f51fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.795894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a097a78b6bcb46d6a1ae5e774b95854d', 'request_id': 'req-3269c12e-15e9-41ec-8ebe-f25afc7a8011'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.804034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a097a78b6bcb46d6a1ae5e774b95854d', 'request_id': 'req-3269c12e-15e9-41ec-8ebe-f25afc7a8011'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.815457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] The token cache is being invalidate because project a097a78b6bcb46d6a1ae5e774b95854d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:23.815761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.816400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:23.818001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2760/5445] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:23 2022] DELETE /identity/v3/projects/a097a78b6bcb46d6a1ae5e774b95854d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:23.818743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.820048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.866079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2686/5446] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:23.866079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.866079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.866079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.884243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:23.885501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.890428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c12e-15e9-41ec-8ebe-f25afc7a8011 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.893751 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2687/5447] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:23.894456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.895828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.903395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c4ae-3fe0-40cd-9fa8-2c3ee6b5eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.904363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c4ae-3fe0-40cd-9fa8-2c3ee6b5eefe admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.904712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c4ae-3fe0-40cd-9fa8-2c3ee6b5eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.905104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c4ae-3fe0-40cd-9fa8-2c3ee6b5eefe admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.905951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519c4ae-3fe0-40cd-9fa8-2c3ee6b5eefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.907585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519c4ae-3fe0-40cd-9fa8-2c3ee6b5eefe admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.919288 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2761/5448] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:23.920721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9470-694f-4983-b8e7-90ac80e995e8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.921014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9470-694f-4983-b8e7-90ac80e995e8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.921891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9470-694f-4983-b8e7-90ac80e995e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.941492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ef8e9470-694f-4983-b8e7-90ac80e995e8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:23.942761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef8e9470-694f-4983-b8e7-90ac80e995e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:23.951039 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2762/5449] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:23.951804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9470-694f-4983-b8e7-90ac80e995e8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.958176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1562b-56b6-4202-9a09-15c89cb60edb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.962243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.962787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9470-694f-4983-b8e7-90ac80e995e8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:23.963029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.963232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.963498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.968876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94714b-1387-4a95-b5fe-ac4c0c8af224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:23.970095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94714b-1387-4a95-b5fe-ac4c0c8af224 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:23.970404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94714b-1387-4a95-b5fe-ac4c0c8af224 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:23.970781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94714b-1387-4a95-b5fe-ac4c0c8af224 admin admin] PATH_INFO: `/v3/projects/efd920ac81ae4ec2b537910c574da53d/users/77fd422f1d56472187ac7bc549689629/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:23.973076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.974937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.984901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2688/5450] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:23.985773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:23.988916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94714b-1387-4a95-b5fe-ac4c0c8af224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd920ac81ae4ec2b537910c574da53d, user_id=77fd422f1d56472187ac7bc549689629, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:23.992583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94714b-1387-4a95-b5fe-ac4c0c8af224 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:23.998651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794af33-98be-43bf-8e1d-9bb776b0375d service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.005987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.006941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.007226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.007495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.008377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:24.009064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.018979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.019170 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2763/5451] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:23 2022] PUT /identity/v3/projects/efd920ac81ae4ec2b537910c574da53d/users/77fd422f1d56472187ac7bc549689629/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:24.021363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e95fe-bbcc-45e1-aed0-0df0438bc388 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.021850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e95fe-bbcc-45e1-aed0-0df0438bc388 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.022193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e95fe-bbcc-45e1-aed0-0df0438bc388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.025163 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2689/5452] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:24.030420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.042258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc314175-cfa3-4b7a-9828-cc3132689e76 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.054797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-873e95fe-bbcc-45e1-aed0-0df0438bc388 None None] MFA Rules not processed for user `77fd422f1d56472187ac7bc549689629`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:24.056790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-873e95fe-bbcc-45e1-aed0-0df0438bc388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:24.111717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.112387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.112664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.112937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.113663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.115682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.143625 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2690/5453] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:24.148084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.152908 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2764/5454] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:24.158191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e95fe-bbcc-45e1-aed0-0df0438bc388 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.171435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e95fe-bbcc-45e1-aed0-0df0438bc388 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.229899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55cca2-8de7-441c-86d6-adb3603f37b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.235108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.235736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.236207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.236522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.237712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.239820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.240216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.240674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.241057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.241413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.242197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.244621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.265283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2691/5455] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:24.269581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.275689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2765/5456] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:24.279761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.280849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da16a-78e6-4c55-bbc8-5c8fb5134e42 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.353070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.353776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.354056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.354329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.355060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.356698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.359705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3efa5c-e056-46c7-b123-5efb39134d64 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.364950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.365669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.365947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.366221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.366955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.370324 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2692/5457] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:12:24.370505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.371401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.382959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d018-664e-49ac-b848-de59382fed87 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.388928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.389794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.390074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.390381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.391285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.392937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.395501 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2766/5458] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:24.399521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.407132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2693/5459] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:24.411890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.420021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9fa7-00d9-432e-9169-1f455eebddf2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.426040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.426303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993c73-2774-4bca-9909-96e5096f5830 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.426747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.427018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.427696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.429071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.430998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.432796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174644e8-7fdb-4e97-ba31-a2fe404144e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.440858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174644e8-7fdb-4e97-ba31-a2fe404144e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.440858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174644e8-7fdb-4e97-ba31-a2fe404144e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.440858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174644e8-7fdb-4e97-ba31-a2fe404144e1 admin admin] PATH_INFO: `/v3/projects/28015434ce7d4115b79bd9878fd05291/users/567663080ebd482db1fb952bed288b8e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.449700 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2767/5460] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:24.451270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.464427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174644e8-7fdb-4e97-ba31-a2fe404144e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28015434ce7d4115b79bd9878fd05291, user_id=567663080ebd482db1fb952bed288b8e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.467356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174644e8-7fdb-4e97-ba31-a2fe404144e1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.472920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e8232-108b-4b10-a30a-739fe813ea4b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.480060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.481485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.481830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.482611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] PATH_INFO: `/v3/projects/042f0df1e4e049b789df27c47af01dce/users/d2538426783944769097315f0cebb11a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.496199 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2694/5461] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:24 2022] PUT /identity/v3/projects/28015434ce7d4115b79bd9878fd05291/users/567663080ebd482db1fb952bed288b8e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:24.499824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=042f0df1e4e049b789df27c47af01dce, user_id=d2538426783944769097315f0cebb11a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.502339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0670-18d1-4555-abf5-ed195db8b0bc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.503018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0670-18d1-4555-abf5-ed195db8b0bc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.503220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.503439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0670-18d1-4555-abf5-ed195db8b0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.537060 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2768/5462] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:24 2022] PUT /identity/v3/projects/042f0df1e4e049b789df27c47af01dce/users/d2538426783944769097315f0cebb11a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:24.540792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.544423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c26b0670-18d1-4555-abf5-ed195db8b0bc None None] MFA Rules not processed for user `567663080ebd482db1fb952bed288b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:24.545924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c26b0670-18d1-4555-abf5-ed195db8b0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:24.611392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe8b-39f0-474f-a725-5174b57b19fa admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.616109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.616788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.617295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.617722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.618447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.620282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.624714 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2695/5463] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:24.626440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0670-18d1-4555-abf5-ed195db8b0bc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.638764 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2769/5464] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:12:24.639035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0670-18d1-4555-abf5-ed195db8b0bc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.639971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.642959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848e858-ea64-43c9-9bd4-63d07212fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.643677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848e858-ea64-43c9-9bd4-63d07212fb88 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.643952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848e858-ea64-43c9-9bd4-63d07212fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.644217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848e858-ea64-43c9-9bd4-63d07212fb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.644998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848e858-ea64-43c9-9bd4-63d07212fb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.647776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848e858-ea64-43c9-9bd4-63d07212fb88 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.651180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30338872-8744-483b-8e09-49ec328642ad admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.655977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.656948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.657336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.657676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] PATH_INFO: `/v3/projects/042f0df1e4e049b789df27c47af01dce/users/d2538426783944769097315f0cebb11a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.659718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042f0df1e4e049b789df27c47af01dce, user_id=d2538426783944769097315f0cebb11a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.662693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.674969 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2770/5465] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:24 2022] PUT /identity/v3/projects/042f0df1e4e049b789df27c47af01dce/users/d2538426783944769097315f0cebb11a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:24.685249 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2696/5466] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:24.686458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.688734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.689107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.689417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.724963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] MFA Rules not processed for user `d2538426783944769097315f0cebb11a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:24.726693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:24.772554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05207a-547c-499a-9652-3dc5e92b81b0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.802523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2697/5467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:24.814212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.816340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:24.836173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.836912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.838358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.838992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.839522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.842350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.873332 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2771/5468] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:24 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:24.877788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.890468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851952d-53c0-405d-98c4-12b77b104ca5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.892537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee993a-0078-46a0-87f3-65093314c9e6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.896371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.897292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.897451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.897627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.897904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.898022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.898208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.898483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.898688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.900440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.909016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.910583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.916481 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2772/5469] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:24.918551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.923263 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2698/5470] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:24.931971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748bc5-9d1b-4743-b137-f51e25e373dc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.937025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdef46-047a-4e49-84e2-5d6b85afaaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.938016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdef46-047a-4e49-84e2-5d6b85afaaef admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.938300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdef46-047a-4e49-84e2-5d6b85afaaef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.938571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdef46-047a-4e49-84e2-5d6b85afaaef admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:24.939310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdef46-047a-4e49-84e2-5d6b85afaaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:24.941071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdef46-047a-4e49-84e2-5d6b85afaaef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:24.952194 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2773/5471] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:24.957169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:24.971936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdc460-6887-4193-82fb-4c7142c540ae service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:24.977826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:24.978852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:24.979254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:24.979622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] PATH_INFO: `/v3/projects/66c1e36e7d954f639a51792b4ae7637c/users/454ee49c1cce4ef2af2e88f79be54df1/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.003711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c1e36e7d954f639a51792b4ae7637c, user_id=454ee49c1cce4ef2af2e88f79be54df1, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.006558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.027810 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2699/5472] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:24 2022] PUT /identity/v3/projects/66c1e36e7d954f639a51792b4ae7637c/users/454ee49c1cce4ef2af2e88f79be54df1/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:25.039100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682039-4e6b-48ee-9d73-7aff2d0e6b5b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.039393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682039-4e6b-48ee-9d73-7aff2d0e6b5b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.039651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682039-4e6b-48ee-9d73-7aff2d0e6b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.046771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.078455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7b682039-4e6b-48ee-9d73-7aff2d0e6b5b None None] MFA Rules not processed for user `454ee49c1cce4ef2af2e88f79be54df1`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:25.079704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b682039-4e6b-48ee-9d73-7aff2d0e6b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:25.136887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1162a-104a-4736-a86f-cbc71d61bb43 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.141485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.142146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.142422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.142701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.173327 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2774/5473] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:25.178072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682039-4e6b-48ee-9d73-7aff2d0e6b5b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.218551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.220524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.231735 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2700/5474] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:25.248734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682039-4e6b-48ee-9d73-7aff2d0e6b5b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.257183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.257183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.257431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.257652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.258501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.261289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.296956 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2775/5475] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:25 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:25.301434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.314680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7f270-fd3a-48a7-85c5-1117e193ca0f service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.396012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.396765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.397058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.397343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.398034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.401186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.435692 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2701/5476] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:25 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:25.437321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.450182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7269d1-024b-426a-afc1-9096a9b4a1fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.458561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.459722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.460244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.460617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.461666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.464046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.493770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.494435 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2776/5477] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:25.505824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f540c-e301-4dd2-b42f-9ac23c26974a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.514165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.515570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.515944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.516319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] PATH_INFO: `/v3/projects/be9a3e8188b64e369d848f3844fd3092/users/4e66b0db9b4d4ef4b4f135ac41535590/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.543564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9a3e8188b64e369d848f3844fd3092, user_id=4e66b0db9b4d4ef4b4f135ac41535590, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.547493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.603537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.605709 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2702/5478] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:25 2022] PUT /identity/v3/projects/be9a3e8188b64e369d848f3844fd3092/users/4e66b0db9b4d4ef4b4f135ac41535590/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:25.606817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.616059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3189-432f-4eac-af64-439080dcfe83 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.712003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a43c1-b7ca-41cc-a082-a4e1f94caf16 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.715117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.715836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.716557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.716866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.718616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.718772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.719601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.719882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.720160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] PATH_INFO: `/v3/users/77fd422f1d56472187ac7bc549689629` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.720953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.724525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fd422f1d56472187ac7bc549689629)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.726871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.734024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2777/5479] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:12:25.739317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:25.753008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc81bb-e1f0-490c-a0d7-bba8e9b66c4d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:25.762439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b019cc-5c21-43fc-940a-657e8db82a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:25.763598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b019cc-5c21-43fc-940a-657e8db82a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.763958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b019cc-5c21-43fc-940a-657e8db82a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.764572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b019cc-5c21-43fc-940a-657e8db82a22 admin admin] PATH_INFO: `/v3/projects/be9a3e8188b64e369d848f3844fd3092/users/4e66b0db9b4d4ef4b4f135ac41535590/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.767478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b019cc-5c21-43fc-940a-657e8db82a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9a3e8188b64e369d848f3844fd3092, user_id=4e66b0db9b4d4ef4b4f135ac41535590, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:25.771355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b019cc-5c21-43fc-940a-657e8db82a22 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:25.805467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fd422f1d56472187ac7bc549689629'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:25.806260 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2778/5480] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:25 2022] PUT /identity/v3/projects/be9a3e8188b64e369d848f3844fd3092/users/4e66b0db9b4d4ef4b4f135ac41535590/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:25.809276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fd422f1d56472187ac7bc549689629'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:25.820596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fd422f1d56472187ac7bc549689629'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:25.821571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fd422f1d56472187ac7bc549689629'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:25.822268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.822603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.823798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.833650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d171238b-0c50-4b38-bd78-91fe61373809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fd422f1d56472187ac7bc549689629'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:25.866176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] MFA Rules not processed for user `4e66b0db9b4d4ef4b4f135ac41535590`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:25.867713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:25.871250 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2703/5481] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:25 2022] DELETE /identity/v3/users/77fd422f1d56472187ac7bc549689629 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:25.876353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:25.876624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:25.877197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:25.920066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:25.921761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:26.021721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2779/5482] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:26.034193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:26.036049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:26.040889 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2704/5483] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:26.052708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:26.054699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:26.127712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78220e8-a060-404b-9b43-d37f0d2f7f38 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:26.133918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:26.134636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:26.134919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:26.135229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:26.146725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:26.147091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac3f3c-8e39-4686-817b-67cf97dfe034 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:26.149132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:26.152438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:26.153265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:26.153611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:26.154479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:26.160509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2780/5484] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:26.167752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:26.169260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:26.181827 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2705/5485] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:26.211793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:26.214314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:26.228948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6853ca-30c6-4932-a3ac-03c5dccd2f47 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:26.233374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:26.234271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:26.234520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:26.234789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:26.236951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:26.319636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:26.321090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:26.332052 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2781/5486] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:26.570031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:26.571431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:26.592768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aa648-9963-4023-864e-8389d22b99d1 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:26.602313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:26.603347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:26.603695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:26.604035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] PATH_INFO: `/v3/projects/efd920ac81ae4ec2b537910c574da53d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:26.605679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd920ac81ae4ec2b537910c574da53d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:26.607944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:26.693394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd920ac81ae4ec2b537910c574da53d', 'request_id': 'req-054d6b54-6266-41d2-a71c-a597a31e394d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:26.704644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd920ac81ae4ec2b537910c574da53d', 'request_id': 'req-054d6b54-6266-41d2-a71c-a597a31e394d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:26.721713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd920ac81ae4ec2b537910c574da53d', 'request_id': 'req-054d6b54-6266-41d2-a71c-a597a31e394d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:26.740193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] The token cache is being invalidate because project efd920ac81ae4ec2b537910c574da53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:26.740720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:26.741493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:26.743781 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2706/5487] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:26 2022] DELETE /identity/v3/projects/efd920ac81ae4ec2b537910c574da53d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:26.748266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:26.763652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb74491-20a9-45d9-9bb4-8543230fb9e1 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:26.861978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:26.863104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:26.863422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:26.863699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] PATH_INFO: `/v3/users/d2538426783944769097315f0cebb11a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:26.866378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2538426783944769097315f0cebb11a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:26.867327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:26.991439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2538426783944769097315f0cebb11a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:26.992250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2538426783944769097315f0cebb11a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.015006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2538426783944769097315f0cebb11a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.049826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2538426783944769097315f0cebb11a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.050888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f314ccd8-db7e-452d-8acc-196db1c40276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2538426783944769097315f0cebb11a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.082613 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2782/5488] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:26 2022] DELETE /identity/v3/users/d2538426783944769097315f0cebb11a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:27.479177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:27.480613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:27.500714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6b54-6266-41d2-a71c-a597a31e394d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:27.581395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:27.582287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:27.582565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:27.582835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] PATH_INFO: `/v3/projects/042f0df1e4e049b789df27c47af01dce` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:27.585605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042f0df1e4e049b789df27c47af01dce)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:27.588307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:27.656389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042f0df1e4e049b789df27c47af01dce', 'request_id': 'req-1f18928b-929b-4175-9ede-0fc8567714e2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.664774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042f0df1e4e049b789df27c47af01dce', 'request_id': 'req-1f18928b-929b-4175-9ede-0fc8567714e2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.673885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042f0df1e4e049b789df27c47af01dce', 'request_id': 'req-1f18928b-929b-4175-9ede-0fc8567714e2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.697251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] The token cache is being invalidate because project 042f0df1e4e049b789df27c47af01dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:27.697643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.698503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1f18928b-929b-4175-9ede-0fc8567714e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:27.701001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2707/5489] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:27 2022] DELETE /identity/v3/projects/042f0df1e4e049b789df27c47af01dce => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:27.706325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd540a-4022-4eab-9f98-ce519dae1697 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:27.708941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd540a-4022-4eab-9f98-ce519dae1697 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:27.708941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd540a-4022-4eab-9f98-ce519dae1697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:27.734182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-84bd540a-4022-4eab-9f98-ce519dae1697 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:27.735550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-84bd540a-4022-4eab-9f98-ce519dae1697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:27.832068 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2783/5490] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:27.839851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb240-db03-4bf9-be4f-1e43e5632b8d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:27.840334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb240-db03-4bf9-be4f-1e43e5632b8d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:27.840702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb240-db03-4bf9-be4f-1e43e5632b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:27.872619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8f1cb240-db03-4bf9-be4f-1e43e5632b8d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:27.874307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f1cb240-db03-4bf9-be4f-1e43e5632b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:27.888217 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2708/5491] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:27.890594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd540a-4022-4eab-9f98-ce519dae1697 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:27.906540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd540a-4022-4eab-9f98-ce519dae1697 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:27.911839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:27.912765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:27.913261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:27.913661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:27.914645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:27.915041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:27.917285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:27.930913 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2784/5492] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:27.935093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb240-db03-4bf9-be4f-1e43e5632b8d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:27.945594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb240-db03-4bf9-be4f-1e43e5632b8d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:27.951008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:27.952176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:27.952482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:27.952731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:27.953499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:27.955588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:27.991214 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2709/5493] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:27 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:27.995815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:28.008790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dacde-19a6-4de6-ac31-a1289029074f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:28.084726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:28.085493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:28.085773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:28.086042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:28.086779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:28.088850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:28.117435 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2785/5494] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:27 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:28.121784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:28.135152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075f658-62a6-44f1-aa99-188877df33a5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:28.140737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:28.141608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:28.142061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:28.142849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:28.143691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:28.145586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:28.169357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2710/5495] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:28.174370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:28.196198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688640a-37a3-4f5b-b091-e865a058de20 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:28.204360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884932f-7820-4c06-95f2-b111e88ccddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:28.205334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884932f-7820-4c06-95f2-b111e88ccddc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:28.206344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884932f-7820-4c06-95f2-b111e88ccddc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:28.209886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884932f-7820-4c06-95f2-b111e88ccddc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:28.212465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884932f-7820-4c06-95f2-b111e88ccddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:28.214660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884932f-7820-4c06-95f2-b111e88ccddc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:28.231946 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2786/5496] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:28.232594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:28.244939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb4ab1-62e8-4fd7-aea5-8a49250bd210 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:28.251038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:28.251960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:28.252289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:28.252820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] PATH_INFO: `/v3/projects/9bd28da6b23940dc816d678fc6f2b9db/users/74311b56951549df8388565bff4a5499/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:28.274424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd28da6b23940dc816d678fc6f2b9db, user_id=74311b56951549df8388565bff4a5499, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:28.278489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:28.307837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2711/5497] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:28 2022] PUT /identity/v3/projects/9bd28da6b23940dc816d678fc6f2b9db/users/74311b56951549df8388565bff4a5499/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:28.319325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:28.319928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:28.320458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:28.364221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] MFA Rules not processed for user `74311b56951549df8388565bff4a5499`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:28.366734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:28.484673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2787/5498] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:28.499113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:28.501206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:28.616757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee94dd8-1a6c-40cb-a1c4-881eef808f4d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:28.651769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743240da-1671-424a-9296-a8e57d3c1040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:28.652424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743240da-1671-424a-9296-a8e57d3c1040 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:28.652704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743240da-1671-424a-9296-a8e57d3c1040 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:28.652997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743240da-1671-424a-9296-a8e57d3c1040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:28.670236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743240da-1671-424a-9296-a8e57d3c1040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:28.672112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743240da-1671-424a-9296-a8e57d3c1040 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:28.705235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2712/5499] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:29.850452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:29.851976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:29.927276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e014284-1e26-42a8-824c-945d94ce3398 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:29.932412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:29.933537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:29.933852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:29.934176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] PATH_INFO: `/v3/users/567663080ebd482db1fb952bed288b8e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:29.935631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] RBAC: Authorizing `identity:delete_user(user_id=567663080ebd482db1fb952bed288b8e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:29.937835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:29.993288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567663080ebd482db1fb952bed288b8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:29.994219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567663080ebd482db1fb952bed288b8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:30.002674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567663080ebd482db1fb952bed288b8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:30.012117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567663080ebd482db1fb952bed288b8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:30.012883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567663080ebd482db1fb952bed288b8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:30.035570 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2788/5500] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:29 2022] DELETE /identity/v3/users/567663080ebd482db1fb952bed288b8e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:30.040529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff607c3-6ced-4fc0-a38e-bd6504c225bb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:30.041068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff607c3-6ced-4fc0-a38e-bd6504c225bb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:30.041195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff607c3-6ced-4fc0-a38e-bd6504c225bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:30.061647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ff607c3-6ced-4fc0-a38e-bd6504c225bb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:30.063351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ff607c3-6ced-4fc0-a38e-bd6504c225bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:30.154033 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2713/5501] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:30.160178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:30.161873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:30.207298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0101-e91c-4d8a-9524-8eb2ae14e1ec None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:30.207752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0101-e91c-4d8a-9524-8eb2ae14e1ec None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:30.208645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0101-e91c-4d8a-9524-8eb2ae14e1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:30.232531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5aaf0101-e91c-4d8a-9524-8eb2ae14e1ec None None] MFA Rules not processed for user `74311b56951549df8388565bff4a5499`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:30.233879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5aaf0101-e91c-4d8a-9524-8eb2ae14e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:30.263936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50ad46-3ea3-4277-a563-6f98bb3bdfda admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:30.270116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:30.271168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:30.271653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:30.272188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:30.289875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:30.291357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:30.304887 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2789/5502] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:30.324724 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2714/5503] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:30.957217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:30.959924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:30.994894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065b35-bf9a-4ba9-9c2b-10a07dfcee49 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:31.011261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:31.012236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:31.012538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:31.012924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] PATH_INFO: `/v3/projects/28015434ce7d4115b79bd9878fd05291` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:31.019144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28015434ce7d4115b79bd9878fd05291)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:31.019144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:31.108831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28015434ce7d4115b79bd9878fd05291', 'request_id': 'req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.116914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28015434ce7d4115b79bd9878fd05291', 'request_id': 'req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.136746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28015434ce7d4115b79bd9878fd05291', 'request_id': 'req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.162129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] The token cache is being invalidate because project 28015434ce7d4115b79bd9878fd05291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:31.162434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.163090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.164987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2790/5504] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:30 2022] DELETE /identity/v3/projects/28015434ce7d4115b79bd9878fd05291 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:31.169414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf0101-e91c-4d8a-9524-8eb2ae14e1ec None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:31.183000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf0101-e91c-4d8a-9524-8eb2ae14e1ec None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:31.248732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:31.250424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:31.250704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:31.250978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] PATH_INFO: `/v3/users/454ee49c1cce4ef2af2e88f79be54df1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:31.252281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454ee49c1cce4ef2af2e88f79be54df1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:31.254282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:31.313103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454ee49c1cce4ef2af2e88f79be54df1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.314175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454ee49c1cce4ef2af2e88f79be54df1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.324323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454ee49c1cce4ef2af2e88f79be54df1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.325344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454ee49c1cce4ef2af2e88f79be54df1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.342594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454ee49c1cce4ef2af2e88f79be54df1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.364607 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2715/5505] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:31 2022] DELETE /identity/v3/users/454ee49c1cce4ef2af2e88f79be54df1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:31.765579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:31.767824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:31.787529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f99c3-eaaf-4c1c-8000-b38cb5101426 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:31.852560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:31.854139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:31.854474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:31.854774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] PATH_INFO: `/v3/projects/66c1e36e7d954f639a51792b4ae7637c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:31.858803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c1e36e7d954f639a51792b4ae7637c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:31.861375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:31.917269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c1e36e7d954f639a51792b4ae7637c', 'request_id': 'req-c89ab070-bc48-4735-8502-71a7d7ac0e7b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.922990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c1e36e7d954f639a51792b4ae7637c', 'request_id': 'req-c89ab070-bc48-4735-8502-71a7d7ac0e7b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.932690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c1e36e7d954f639a51792b4ae7637c', 'request_id': 'req-c89ab070-bc48-4735-8502-71a7d7ac0e7b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.945477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] The token cache is being invalidate because project 66c1e36e7d954f639a51792b4ae7637c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:31.945920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.946735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:31.948380 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2791/5506] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:31 2022] DELETE /identity/v3/projects/66c1e36e7d954f639a51792b4ae7637c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:31.952565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:31.954259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:31.967336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb01e-2d83-4b1a-9e90-370cfcfc11c6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:32.027593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:32.028499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:32.028773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:32.029116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] PATH_INFO: `/v3/users/4e66b0db9b4d4ef4b4f135ac41535590` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:32.030308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e66b0db9b4d4ef4b4f135ac41535590)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:32.032560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:32.090227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e66b0db9b4d4ef4b4f135ac41535590'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.091715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e66b0db9b4d4ef4b4f135ac41535590'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.100993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e66b0db9b4d4ef4b4f135ac41535590'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.102198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e66b0db9b4d4ef4b4f135ac41535590'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.112772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e678841c-7eb9-481d-bc54-37bc46aadb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e66b0db9b4d4ef4b4f135ac41535590'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.138496 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2716/5507] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:31 2022] DELETE /identity/v3/users/4e66b0db9b4d4ef4b4f135ac41535590 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:32.551762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:32.553233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:32.568617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab070-bc48-4735-8502-71a7d7ac0e7b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:32.632254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:32.633271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:32.633590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:32.633920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] PATH_INFO: `/v3/projects/be9a3e8188b64e369d848f3844fd3092` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:32.635170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9a3e8188b64e369d848f3844fd3092)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:32.637220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:32.684242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9a3e8188b64e369d848f3844fd3092', 'request_id': 'req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.689606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9a3e8188b64e369d848f3844fd3092', 'request_id': 'req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.697949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9a3e8188b64e369d848f3844fd3092', 'request_id': 'req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.710329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] The token cache is being invalidate because project be9a3e8188b64e369d848f3844fd3092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:32.710614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.711304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-17b24d9a-4fbd-4aaf-96e8-75ab7d990928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:32.712885 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2792/5508] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:32 2022] DELETE /identity/v3/projects/be9a3e8188b64e369d848f3844fd3092 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:32.718946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf943442-89e4-4d6e-adcb-e6cdc02ea9b6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:32.719432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf943442-89e4-4d6e-adcb-e6cdc02ea9b6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:32.719677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf943442-89e4-4d6e-adcb-e6cdc02ea9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:32.738294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cf943442-89e4-4d6e-adcb-e6cdc02ea9b6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:32.739523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cf943442-89e4-4d6e-adcb-e6cdc02ea9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:32.801745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2717/5509] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:32.812050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0de85-3295-4808-b413-d2a8eddb92fc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:32.812518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0de85-3295-4808-b413-d2a8eddb92fc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:32.814314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0de85-3295-4808-b413-d2a8eddb92fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:32.835298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6bb0de85-3295-4808-b413-d2a8eddb92fc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:32.836617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6bb0de85-3295-4808-b413-d2a8eddb92fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:32.845374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2793/5510] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:32.850075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf943442-89e4-4d6e-adcb-e6cdc02ea9b6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:32.861125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf943442-89e4-4d6e-adcb-e6cdc02ea9b6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:32.867099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:32.867919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:32.868301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:32.868678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:32.869675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:32.869981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:32.871635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:32.889227 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2718/5511] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:32.891585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0de85-3295-4808-b413-d2a8eddb92fc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:32.902052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0de85-3295-4808-b413-d2a8eddb92fc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:32.907217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:32.907958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:32.908244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:32.908515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:32.909246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:32.911329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:32.939183 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2794/5512] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:32 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:32.943250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:32.965750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56025ea-28ce-4fb9-b0ae-63ce93df6c90 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:33.034800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:33.035567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.035917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.036254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.037427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:33.039665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:33.066650 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2719/5513] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:32 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:33.070794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:33.082159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a723ba-9a33-46c9-b06f-101d0d1ad2cf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:33.087888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:33.088602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.089025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.089434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.090600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:33.093328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:33.106350 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2795/5514] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:12:33.110435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:33.121358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085637d-24f7-4331-821a-25fee2005724 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:33.126987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfd0fe-a282-43ac-9810-3657b3bc8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:33.127815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd0fe-a282-43ac-9810-3657b3bc8f82 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.128359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd0fe-a282-43ac-9810-3657b3bc8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.128857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd0fe-a282-43ac-9810-3657b3bc8f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.129809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfd0fe-a282-43ac-9810-3657b3bc8f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:33.131644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfd0fe-a282-43ac-9810-3657b3bc8f82 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:33.145265 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2720/5515] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:12:33.149422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:33.160576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa569d-ebe1-47e7-87e3-9bc01ac58cb5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:33.166509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:33.167388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.167729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.168068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] PATH_INFO: `/v3/projects/487e539dbf284bd18ee411802104bee1/users/4abe80c63e90475ba494707ab88d675c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.185447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487e539dbf284bd18ee411802104bee1, user_id=4abe80c63e90475ba494707ab88d675c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:33.189133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:33.217296 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2796/5516] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:33 2022] PUT /identity/v3/projects/487e539dbf284bd18ee411802104bee1/users/4abe80c63e90475ba494707ab88d675c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:33.221485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da91316-dba4-49e7-ace2-ee7a69924ef6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.222097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da91316-dba4-49e7-ace2-ee7a69924ef6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.222097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da91316-dba4-49e7-ace2-ee7a69924ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.254903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4da91316-dba4-49e7-ace2-ee7a69924ef6 None None] MFA Rules not processed for user `4abe80c63e90475ba494707ab88d675c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:33.256103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4da91316-dba4-49e7-ace2-ee7a69924ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:33.338365 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2721/5517] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:33.351042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:33.352862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:33.428033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f55fa-9d57-4a46-b2ff-12638893ae16 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:33.433442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbd789-c53a-4a27-8c26-930f74aa5de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:33.434184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd789-c53a-4a27-8c26-930f74aa5de2 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.434813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd789-c53a-4a27-8c26-930f74aa5de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.435076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd789-c53a-4a27-8c26-930f74aa5de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.446540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbd789-c53a-4a27-8c26-930f74aa5de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:33.448033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbd789-c53a-4a27-8c26-930f74aa5de2 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:33.461157 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2797/5518] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:33.630658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dad05-4d6c-454f-b504-87705432ccf8 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.630912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dad05-4d6c-454f-b504-87705432ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.631110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dad05-4d6c-454f-b504-87705432ccf8 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.633492 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2722/5519] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:12:33.640407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f93f-84e1-463e-9eea-72401ab2265c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.641355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f93f-84e1-463e-9eea-72401ab2265c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.641824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f93f-84e1-463e-9eea-72401ab2265c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.689551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e970f93f-84e1-463e-9eea-72401ab2265c None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:33.691027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e970f93f-84e1-463e-9eea-72401ab2265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:33.769443 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2798/5520] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:33.778250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dad05-4d6c-454f-b504-87705432ccf8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:33.780928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b44dad05-4d6c-454f-b504-87705432ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:33.805639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dad05-4d6c-454f-b504-87705432ccf8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:33.812215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58358bf-15af-43f9-8fd9-58b4161411e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:33.817975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58358bf-15af-43f9-8fd9-58b4161411e9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:33.818584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58358bf-15af-43f9-8fd9-58b4161411e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:33.819936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58358bf-15af-43f9-8fd9-58b4161411e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:33.833422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58358bf-15af-43f9-8fd9-58b4161411e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:33.836001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58358bf-15af-43f9-8fd9-58b4161411e9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:33.846943 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2723/5521] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:36.958649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970f93f-84e1-463e-9eea-72401ab2265c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:37.041842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970f93f-84e1-463e-9eea-72401ab2265c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:37.052579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:37.054496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:37.054779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:37.055048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] PATH_INFO: `/v3/users/4abe80c63e90475ba494707ab88d675c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:37.056309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abe80c63e90475ba494707ab88d675c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:37.058347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:37.116473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abe80c63e90475ba494707ab88d675c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.117302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abe80c63e90475ba494707ab88d675c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.124572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abe80c63e90475ba494707ab88d675c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.135242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abe80c63e90475ba494707ab88d675c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.136039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abe80c63e90475ba494707ab88d675c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.153423 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2799/5522] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:36 2022] DELETE /identity/v3/users/4abe80c63e90475ba494707ab88d675c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:37.158046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:37.158554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:37.158662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:37.176030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:37.177391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:37.234350 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2724/5523] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:37.246237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:37.247923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:37.317687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d1e2-24e8-4e89-a923-cf8de52377e0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:37.322556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eaa36-3dd5-4938-9618-0fb2385f6c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:37.323819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eaa36-3dd5-4938-9618-0fb2385f6c47 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:37.324662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eaa36-3dd5-4938-9618-0fb2385f6c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:37.324662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eaa36-3dd5-4938-9618-0fb2385f6c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:37.337591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eaa36-3dd5-4938-9618-0fb2385f6c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:37.339073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eaa36-3dd5-4938-9618-0fb2385f6c47 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:37.350544 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2800/5524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:37.830656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:37.832144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:37.844166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac6ea-ade1-4867-a18e-767ad8c56785 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:37.849220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:37.850099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:37.850379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:37.850694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] PATH_INFO: `/v3/projects/487e539dbf284bd18ee411802104bee1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:37.851895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487e539dbf284bd18ee411802104bee1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:37.860051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:37.902482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487e539dbf284bd18ee411802104bee1', 'request_id': 'req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.908508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487e539dbf284bd18ee411802104bee1', 'request_id': 'req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.917219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487e539dbf284bd18ee411802104bee1', 'request_id': 'req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.929885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] The token cache is being invalidate because project 487e539dbf284bd18ee411802104bee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:37.930178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.930867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-74240fec-e6a8-4bed-8490-b7d90e1fa6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:37.932665 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2725/5525] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:37 2022] DELETE /identity/v3/projects/487e539dbf284bd18ee411802104bee1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:37.937813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735d815-97b0-4b45-955d-9a2236701306 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:37.938172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735d815-97b0-4b45-955d-9a2236701306 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:37.938554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735d815-97b0-4b45-955d-9a2236701306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:37.958963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6735d815-97b0-4b45-955d-9a2236701306 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:37.960185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6735d815-97b0-4b45-955d-9a2236701306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.031208 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2801/5526] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:38.032234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e690f-e5f8-4e13-985f-d918d375c1d7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.032528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e690f-e5f8-4e13-985f-d918d375c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.032808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e690f-e5f8-4e13-985f-d918d375c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.062279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ae4e690f-e5f8-4e13-985f-d918d375c1d7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:38.063507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ae4e690f-e5f8-4e13-985f-d918d375c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.073411 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2726/5527] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:38.076863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735d815-97b0-4b45-955d-9a2236701306 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.086852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735d815-97b0-4b45-955d-9a2236701306 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.092227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.092940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.093235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.093559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.094289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:38.094648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.096595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.109961 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2802/5528] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:38.114811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e690f-e5f8-4e13-985f-d918d375c1d7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.117445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.119358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.125199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e690f-e5f8-4e13-985f-d918d375c1d7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.130643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.131298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.131725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.131991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.132691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.133150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f862f-ed3e-4970-9c68-294a9f8412f9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.134738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.137931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.138927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.139208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.139484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] PATH_INFO: `/v3/users/27fcd74be18d4c3aa2b3e67ec6f6ac93` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.140698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fcd74be18d4c3aa2b3e67ec6f6ac93)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.142913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.174290 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2727/5529] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:38 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:38.180236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.196933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fcd74be18d4c3aa2b3e67ec6f6ac93'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.197835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fcd74be18d4c3aa2b3e67ec6f6ac93'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.205196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fcd74be18d4c3aa2b3e67ec6f6ac93'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.215584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fcd74be18d4c3aa2b3e67ec6f6ac93'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.216309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-49f211a3-b09e-4b6c-909b-f76648c04177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fcd74be18d4c3aa2b3e67ec6f6ac93'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.234499 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2803/5530] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:38 2022] DELETE /identity/v3/users/27fcd74be18d4c3aa2b3e67ec6f6ac93 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:38.238872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.239169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.239439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.252424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d23ff6-111a-40fc-9521-48e0ef1fbef4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.259509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:38.261711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.327135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.327844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.328237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.328518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.329561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.331890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.341984 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2804/5531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:38.349782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.354105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.367607 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2728/5532] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:38 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:38.369008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.371522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.388702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755d2a6-080b-4670-b6c3-ceb5be9c1c3a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.396002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.396794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.397190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.397469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.398384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.400231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.413410 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2729/5533] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:38.418294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.435007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488e9d3-ed21-4f5e-8f65-11c6dda32c0b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.437119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c61a4-9196-46e4-91e4-c4819d0ca84e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.445757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d36503-3d75-4e59-99c4-2b9eed5a6e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.446907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36503-3d75-4e59-99c4-2b9eed5a6e2d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.447188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36503-3d75-4e59-99c4-2b9eed5a6e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.447469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36503-3d75-4e59-99c4-2b9eed5a6e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.449414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.450299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.451755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.452307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.453543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.456686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.463571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d36503-3d75-4e59-99c4-2b9eed5a6e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.465678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d36503-3d75-4e59-99c4-2b9eed5a6e2d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.473078 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2730/5534] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:38.477874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.481093 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2805/5535] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:38.492191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc9522-9889-4136-b87b-414e081f0998 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.500160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.501233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.501547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.501726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] PATH_INFO: `/v3/projects/7c8a833a07344c0890674bc22b729623/users/be5f36a679a34676ad49fe542972166c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.527579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8a833a07344c0890674bc22b729623, user_id=be5f36a679a34676ad49fe542972166c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.531768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.556682 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2731/5536] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:38 2022] PUT /identity/v3/projects/7c8a833a07344c0890674bc22b729623/users/be5f36a679a34676ad49fe542972166c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:38.566493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.566785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.567051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.601969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] MFA Rules not processed for user `be5f36a679a34676ad49fe542972166c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:38.603440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.724105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.725977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.742278 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2806/5537] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:38.759881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:38.761807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.806273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98967-f405-4893-bc05-b90af1da8000 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.812331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.813541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.813849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.814132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] PATH_INFO: `/v3/projects/5d1fe3272f44492ab3e82549fed639f4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.816691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1fe3272f44492ab3e82549fed639f4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.818863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.831287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b2f3b-99ab-4c97-821a-420197cdf1bb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:38.834879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f056b5-b4be-4046-8ce5-e9ef4eea8dfb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:38.835533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f056b5-b4be-4046-8ce5-e9ef4eea8dfb service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.835808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f056b5-b4be-4046-8ce5-e9ef4eea8dfb service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.836078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f056b5-b4be-4046-8ce5-e9ef4eea8dfb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.845524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f056b5-b4be-4046-8ce5-e9ef4eea8dfb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:38.846617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f056b5-b4be-4046-8ce5-e9ef4eea8dfb service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:38.856312 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2807/5538] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:12:38.868117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1fe3272f44492ab3e82549fed639f4', 'request_id': 'req-94476861-20dd-4dbd-bf2d-bd664e066d0f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.873550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1fe3272f44492ab3e82549fed639f4', 'request_id': 'req-94476861-20dd-4dbd-bf2d-bd664e066d0f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.881994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1fe3272f44492ab3e82549fed639f4', 'request_id': 'req-94476861-20dd-4dbd-bf2d-bd664e066d0f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.893624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] The token cache is being invalidate because project 5d1fe3272f44492ab3e82549fed639f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:38.893908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.894553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-94476861-20dd-4dbd-bf2d-bd664e066d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:38.896147 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2732/5539] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:38 2022] DELETE /identity/v3/projects/5d1fe3272f44492ab3e82549fed639f4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:38.901140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ee47-b0a0-4b48-ab27-4c7545f2b904 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.901439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ee47-b0a0-4b48-ab27-4c7545f2b904 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.901712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ee47-b0a0-4b48-ab27-4c7545f2b904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:38.920690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9209ee47-b0a0-4b48-ab27-4c7545f2b904 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:38.921926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9209ee47-b0a0-4b48-ab27-4c7545f2b904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:38.980269 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2808/5540] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:38.989073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496cdfd-ac76-4716-9790-d7bfc3043569 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:38.989363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496cdfd-ac76-4716-9790-d7bfc3043569 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:38.989680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496cdfd-ac76-4716-9790-d7bfc3043569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.008645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c496cdfd-ac76-4716-9790-d7bfc3043569 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:39.010007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c496cdfd-ac76-4716-9790-d7bfc3043569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:39.018406 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2733/5541] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:39.023040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ee47-b0a0-4b48-ab27-4c7545f2b904 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:39.034281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ee47-b0a0-4b48-ab27-4c7545f2b904 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:39.039074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:39.040512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.040795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.041105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.041859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:39.042167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:39.044036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:39.065008 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2809/5542] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:39.069740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496cdfd-ac76-4716-9790-d7bfc3043569 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:39.080353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496cdfd-ac76-4716-9790-d7bfc3043569 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:39.090352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:39.092538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.093525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.094029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.096437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:39.100379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:39.136467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2734/5543] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:39 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:39.141186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:39.153248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694c05-cb1d-4370-bed9-a56389d6ccbb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:39.277070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:39.278553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.278965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.279302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.282312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:39.285549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:39.317404 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2810/5544] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:39 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:39.321288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:39.334643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fadaa-5dfa-4dce-9df7-bdc55fbc8367 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:39.339946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:39.340760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.341195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.341623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.342634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:39.344491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:39.369096 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2735/5545] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:39.378973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:39.391372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504f56-524b-49eb-a30a-094035f5b08f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:39.398010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bedbc-6c3a-47a0-b01b-92fed133552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:39.398543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bedbc-6c3a-47a0-b01b-92fed133552d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.398812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bedbc-6c3a-47a0-b01b-92fed133552d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.399081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bedbc-6c3a-47a0-b01b-92fed133552d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.399815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bedbc-6c3a-47a0-b01b-92fed133552d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:39.401467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bedbc-6c3a-47a0-b01b-92fed133552d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:39.413220 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2811/5546] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:12:39.417364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:39.428004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2b4df-4ad6-4eb9-b269-aa8f1cf5157b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:39.433380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:39.434489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.434774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.435142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] PATH_INFO: `/v3/projects/97758c81f2fc433ca44911e9cdcf79e7/users/f164063f73da486abe2f2772e8db47f9/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.465410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=97758c81f2fc433ca44911e9cdcf79e7, user_id=f164063f73da486abe2f2772e8db47f9, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:39.469184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:39.485545 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2736/5547] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:39 2022] PUT /identity/v3/projects/97758c81f2fc433ca44911e9cdcf79e7/users/f164063f73da486abe2f2772e8db47f9/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:39.496817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.497146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.497979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.541883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] MFA Rules not processed for user `f164063f73da486abe2f2772e8db47f9`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:39.543491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:39.607975 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2812/5548] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:12:39.621691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:39.624671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:39.694900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e9e05-c652-4448-aaff-d5c78f4199aa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:39.698612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:39.699262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:39.699536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:39.699803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:39.709718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:39.711342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:39.721481 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2737/5549] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:47.590782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:47.595404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:47.698245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7740a-9dcd-4c7d-9352-be9ca59455e1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:47.706639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df24f0f-f367-4f61-9487-8b42c937084d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:47.707879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df24f0f-f367-4f61-9487-8b42c937084d service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:47.708224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df24f0f-f367-4f61-9487-8b42c937084d service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:47.708616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df24f0f-f367-4f61-9487-8b42c937084d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:47.710738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4df24f0f-f367-4f61-9487-8b42c937084d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:47.725932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df24f0f-f367-4f61-9487-8b42c937084d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:47.728746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df24f0f-f367-4f61-9487-8b42c937084d service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:47.752565 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2813/5550] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:55.438878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:55.440576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:55.529565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f40032-b680-48f9-b69d-f8c946171a20 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:55.542871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:55.543950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:55.544362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:55.544863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] PATH_INFO: `/v3/users/be5f36a679a34676ad49fe542972166c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:55.546354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5f36a679a34676ad49fe542972166c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:55.548614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:55.621185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5f36a679a34676ad49fe542972166c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:55.622138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5f36a679a34676ad49fe542972166c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:55.640339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5f36a679a34676ad49fe542972166c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:55.641464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5f36a679a34676ad49fe542972166c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:55.651878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5f36a679a34676ad49fe542972166c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:55.701635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2738/5551] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:12:55 2022] DELETE /identity/v3/users/be5f36a679a34676ad49fe542972166c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:55.706525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:55.707741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:55.708188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:55.731198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:55.732999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:55.813253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2814/5552] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:55.827421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:55.828906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:55.918303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d00f1-a36a-4727-8d65-b56345398c58 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:55.923849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6c2d0-dda4-4526-b23d-5ad22a16f77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:55.924838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c2d0-dda4-4526-b23d-5ad22a16f77d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:55.925245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c2d0-dda4-4526-b23d-5ad22a16f77d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:55.925743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c2d0-dda4-4526-b23d-5ad22a16f77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:55.943294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6c2d0-dda4-4526-b23d-5ad22a16f77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:55.944884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6c2d0-dda4-4526-b23d-5ad22a16f77d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:55.957570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2739/5553] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:12:56.379207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:56.380773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:56.407224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777df69-aff3-45ee-9eac-651bc8612c37 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:56.422107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:56.423375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:56.423844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:56.429182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] PATH_INFO: `/v3/projects/7c8a833a07344c0890674bc22b729623` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:56.431164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8a833a07344c0890674bc22b729623)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:56.434425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:56.517815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8a833a07344c0890674bc22b729623', 'request_id': 'req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:56.549553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8a833a07344c0890674bc22b729623', 'request_id': 'req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:56.578333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8a833a07344c0890674bc22b729623', 'request_id': 'req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:56.594725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] The token cache is being invalidate because project 7c8a833a07344c0890674bc22b729623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:12:56.595280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:56.596000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6aaad7ac-fa7a-4fa3-a6be-0a854c6bf93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:12:56.597689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2815/5554] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:12:56 2022] DELETE /identity/v3/projects/7c8a833a07344c0890674bc22b729623 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:56.603499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fae99-f6ad-4bf4-9b15-3669573597d3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:56.603980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fae99-f6ad-4bf4-9b15-3669573597d3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:56.604216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fae99-f6ad-4bf4-9b15-3669573597d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:56.638313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a01fae99-f6ad-4bf4-9b15-3669573597d3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:56.639950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a01fae99-f6ad-4bf4-9b15-3669573597d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:56.725421 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2740/5555] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:56.733439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea8c8-538f-4ec4-a982-ffe915e2a33d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:56.733972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea8c8-538f-4ec4-a982-ffe915e2a33d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:56.734354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea8c8-538f-4ec4-a982-ffe915e2a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:56.771290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8fdea8c8-538f-4ec4-a982-ffe915e2a33d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:56.783442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8fdea8c8-538f-4ec4-a982-ffe915e2a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:56.799167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fae99-f6ad-4bf4-9b15-3669573597d3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:56.799890 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2816/5556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:56.812767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fae99-f6ad-4bf4-9b15-3669573597d3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:56.826134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:56.826894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:56.827190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:56.827453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:56.829787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:12:56.830664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:56.832440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:56.858173 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2741/5557] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:12:56.872359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea8c8-538f-4ec4-a982-ffe915e2a33d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:56.884554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea8c8-538f-4ec4-a982-ffe915e2a33d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:56.889910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:56.890840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:56.891119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:56.891403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:56.892081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:56.894242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:56.935858 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2817/5558] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:56 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:56.940345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:56.956408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa102dad-77c6-41b6-b92d-8116c7afa94b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.027479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.028280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.028738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.029113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.030130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.032214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.064394 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2742/5559] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:56 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:57.065732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.076470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ae10-39d9-4ce2-b549-cf13c3f6c6bd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.082519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.084116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.084116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.084375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.085466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.086743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.100199 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2818/5560] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:57.104034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.115532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999cebc-5de8-497c-8640-0f6f997ffbdb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.120752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d9df9-cd85-4fb8-838f-40ee80fc0f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.121640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d9df9-cd85-4fb8-838f-40ee80fc0f1f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.121971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d9df9-cd85-4fb8-838f-40ee80fc0f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.122172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d9df9-cd85-4fb8-838f-40ee80fc0f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.122997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d9df9-cd85-4fb8-838f-40ee80fc0f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.124628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d9df9-cd85-4fb8-838f-40ee80fc0f1f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.139310 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2743/5561] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:57.141251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.152857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9940a8b-1a5f-4bd2-b253-eadee206ce2e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.165896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.166993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.167489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.168544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] PATH_INFO: `/v3/projects/0cbaded0b4ad4c4587cc36402e326750/users/b5534646a6384067bda99af7c864d494/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.185093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbaded0b4ad4c4587cc36402e326750, user_id=b5534646a6384067bda99af7c864d494, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.187774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.205212 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2819/5562] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:57 2022] PUT /identity/v3/projects/0cbaded0b4ad4c4587cc36402e326750/users/b5534646a6384067bda99af7c864d494/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:12:57.216763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b50a2-17a3-4602-addf-48905d4e2532 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.217068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b50a2-17a3-4602-addf-48905d4e2532 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.217349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b50a2-17a3-4602-addf-48905d4e2532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.247380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-092b50a2-17a3-4602-addf-48905d4e2532 None None] MFA Rules not processed for user `b5534646a6384067bda99af7c864d494`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:57.248757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-092b50a2-17a3-4602-addf-48905d4e2532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:57.328698 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2744/5563] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:57.333647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.408431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81360-6b34-4fda-ab51-578166eb89dd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.414094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.414846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.415133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.415411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.416235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.418344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.471714 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2820/5564] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:12:57 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:12:57.476019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b50a2-17a3-4602-addf-48905d4e2532 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.489203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b50a2-17a3-4602-addf-48905d4e2532 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.550824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.551642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.551981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.552261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.552951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.555136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.581658 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2745/5565] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:12:57 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:12:57.582973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.594250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27b1e-09fa-4f77-8786-c95cb6df6b13 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.599717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.600416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.600696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.600966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.601878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.603651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.615815 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2821/5566] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:57.620813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.631910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd65bb-7075-4025-a6aa-64a95fe9acb8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.637303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.638312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.638778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.639120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] PATH_INFO: `/v3/projects/c05fb2ff69eb4e3e8464952cacd62c77/users/f9202e7a69af4d7aba0bdf5982972be9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.656585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05fb2ff69eb4e3e8464952cacd62c77, user_id=f9202e7a69af4d7aba0bdf5982972be9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.659809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.678915 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2746/5567] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:57 2022] PUT /identity/v3/projects/c05fb2ff69eb4e3e8464952cacd62c77/users/f9202e7a69af4d7aba0bdf5982972be9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:57.683538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.696697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5ffc-810b-4016-ba50-cbe98ed0ee2f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.760112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92e864-5ce5-4e69-b1d1-d6772cf63db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.760876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92e864-5ce5-4e69-b1d1-d6772cf63db2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.761265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92e864-5ce5-4e69-b1d1-d6772cf63db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.761634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92e864-5ce5-4e69-b1d1-d6772cf63db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.762474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92e864-5ce5-4e69-b1d1-d6772cf63db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.764279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92e864-5ce5-4e69-b1d1-d6772cf63db2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.778955 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2822/5568] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:12:57.780338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.791326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c3d3-237e-4147-a3dc-fd05598663bd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:57.796646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:57.797794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.798172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.798544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] PATH_INFO: `/v3/projects/c05fb2ff69eb4e3e8464952cacd62c77/users/f9202e7a69af4d7aba0bdf5982972be9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.800752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05fb2ff69eb4e3e8464952cacd62c77, user_id=f9202e7a69af4d7aba0bdf5982972be9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:57.803621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:57.815486 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2747/5569] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:12:57 2022] PUT /identity/v3/projects/c05fb2ff69eb4e3e8464952cacd62c77/users/f9202e7a69af4d7aba0bdf5982972be9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:12:57.825555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:57.825844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:57.826117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:57.865647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] MFA Rules not processed for user `f9202e7a69af4d7aba0bdf5982972be9`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:12:57.867031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:57.954641 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2823/5570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:12:57.968274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:12:57.973515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:12:58.084815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3f88-ecc1-44d1-befb-38c0931fd8f6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:12:58.092572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:12:58.093292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:12:58.093710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:12:58.093993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:12:58.157960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:12:58.159958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:12:58.170678 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2748/5571] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:02.070176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:02.072666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:02.160293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5337-d946-4b01-a942-ef4069fa6730 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:02.168841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:02.168841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:02.169244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:02.169370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:02.171599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:02.187144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:02.188171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:02.216247 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2824/5572] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:02.600158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:02.601777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:02.702736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a50e-4a55-483c-9a59-ab2b731b4629 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:02.708797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:02.709592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:02.710091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:02.710523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:02.722908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:02.724988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:02.739390 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2749/5573] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:08.383793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:08.385756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:08.492578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232bf18-82fa-4b17-a755-9b4d626f1be8 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:08.500836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:08.502324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:08.502810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:08.503250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] PATH_INFO: `/v3/users/2abb09d2f7844f3ba0f7a20787d73e4b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:08.504681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abb09d2f7844f3ba0f7a20787d73e4b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:08.507718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:08.609682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abb09d2f7844f3ba0f7a20787d73e4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:08.610510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abb09d2f7844f3ba0f7a20787d73e4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:08.620087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abb09d2f7844f3ba0f7a20787d73e4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:08.641974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abb09d2f7844f3ba0f7a20787d73e4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:08.643700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-803fb07c-5c46-48e9-a273-55c50e1832bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abb09d2f7844f3ba0f7a20787d73e4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:08.716251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2825/5574] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:08 2022] DELETE /identity/v3/users/2abb09d2f7844f3ba0f7a20787d73e4b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:09.227237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:09.242474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018f4e-e688-4fce-b6f0-8af0564391e5 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:09.362664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:09.363560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:09.363886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:09.364309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] PATH_INFO: `/v3/projects/d475c8fbc1f74285a1c98fd75bd109f2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:09.365577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d475c8fbc1f74285a1c98fd75bd109f2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:09.370943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:09.465013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd475c8fbc1f74285a1c98fd75bd109f2', 'request_id': 'req-2b263d7c-029c-46b3-aeb8-30650dfafccf'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:09.478419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd475c8fbc1f74285a1c98fd75bd109f2', 'request_id': 'req-2b263d7c-029c-46b3-aeb8-30650dfafccf'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:09.492429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd475c8fbc1f74285a1c98fd75bd109f2', 'request_id': 'req-2b263d7c-029c-46b3-aeb8-30650dfafccf'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:09.506402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] The token cache is being invalidate because project d475c8fbc1f74285a1c98fd75bd109f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:09.506694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:09.507588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b263d7c-029c-46b3-aeb8-30650dfafccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:09.509294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2750/5575] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:09 2022] DELETE /identity/v3/projects/d475c8fbc1f74285a1c98fd75bd109f2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:09.514425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9ab2-4b3a-4666-823b-49c2c7ac8dcc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:09.515430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9ab2-4b3a-4666-823b-49c2c7ac8dcc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:09.515880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9ab2-4b3a-4666-823b-49c2c7ac8dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:09.549685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d7cd9ab2-4b3a-4666-823b-49c2c7ac8dcc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:09.551868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7cd9ab2-4b3a-4666-823b-49c2c7ac8dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:09.671734 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2826/5576] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:09.678715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc281a6-4a07-4246-90c2-7baa1f4cd2f2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:09.680352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc281a6-4a07-4246-90c2-7baa1f4cd2f2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:09.680352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc281a6-4a07-4246-90c2-7baa1f4cd2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:09.739609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-acc281a6-4a07-4246-90c2-7baa1f4cd2f2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:09.745552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-acc281a6-4a07-4246-90c2-7baa1f4cd2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:09.756877 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2751/5577] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:09.762153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9ab2-4b3a-4666-823b-49c2c7ac8dcc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:09.791856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9ab2-4b3a-4666-823b-49c2c7ac8dcc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:09.802739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:09.806740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:09.808495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:09.810099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:09.811137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:09.811717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:09.814174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:09.835599 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2827/5578] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:13:09.839268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc281a6-4a07-4246-90c2-7baa1f4cd2f2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:09.867412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc281a6-4a07-4246-90c2-7baa1f4cd2f2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:09.878249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0fe88-de02-4860-80ca-920249041940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:09.879018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0fe88-de02-4860-80ca-920249041940 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:09.879493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0fe88-de02-4860-80ca-920249041940 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:09.879769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0fe88-de02-4860-80ca-920249041940 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:09.880941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0fe88-de02-4860-80ca-920249041940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:09.883054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0fe88-de02-4860-80ca-920249041940 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:09.924027 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2752/5579] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:09 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:09.928227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:09.944633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365732-ea38-4567-a471-304302368bb6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:09.945250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365732-ea38-4567-a471-304302368bb6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:09.945745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365732-ea38-4567-a471-304302368bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:09.964888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856274d2-53c8-4162-8814-621aa876bfb5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:09.966951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d7365732-ea38-4567-a471-304302368bb6 None None] MFA Rules not processed for user `b5534646a6384067bda99af7c864d494`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:09.968501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d7365732-ea38-4567-a471-304302368bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:10.072962 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2753/5580] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:10.110661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:10.111427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:10.111705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:10.111982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:10.112770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:10.116319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:10.195465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2828/5581] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:09 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:10.199508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365732-ea38-4567-a471-304302368bb6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:10.214822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365732-ea38-4567-a471-304302368bb6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:10.223415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:10.224472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:10.224911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:10.225245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:10.226055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:10.228126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:10.241784 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2754/5582] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:10.245600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:10.262694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcdac2-ba26-4cf1-b15e-4fac6588ed6d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:10.268667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14134828-19bb-474c-89f3-23a4a483c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:10.269399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134828-19bb-474c-89f3-23a4a483c5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:10.269676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134828-19bb-474c-89f3-23a4a483c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:10.269949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134828-19bb-474c-89f3-23a4a483c5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:10.271883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14134828-19bb-474c-89f3-23a4a483c5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:10.273820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14134828-19bb-474c-89f3-23a4a483c5d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:10.288638 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2829/5583] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:10.293563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:10.324857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ccce-5b8a-443c-b7ed-8ad72f2ac90d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:10.333292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:10.334657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:10.335188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:10.335679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] PATH_INFO: `/v3/projects/8e644d1486be4ca4a4c60c46c53837ec/users/59d2c9a942c046ee8be5ccaeb86bee97/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:10.357422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e644d1486be4ca4a4c60c46c53837ec, user_id=59d2c9a942c046ee8be5ccaeb86bee97, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:10.360544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:10.379525 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2755/5584] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:10 2022] PUT /identity/v3/projects/8e644d1486be4ca4a4c60c46c53837ec/users/59d2c9a942c046ee8be5ccaeb86bee97/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:10.385633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbce2a-b443-4580-a4de-0e0d20bd508c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:10.386723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbce2a-b443-4580-a4de-0e0d20bd508c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:10.387388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbce2a-b443-4580-a4de-0e0d20bd508c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:10.410147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c0dbce2a-b443-4580-a4de-0e0d20bd508c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:10.412142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c0dbce2a-b443-4580-a4de-0e0d20bd508c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:10.484166 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2830/5585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:10.494770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:10.497637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:10.572823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e0fb-779e-4f08-85f5-cadc0e139c0d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:10.577365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:10.578113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:10.578445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:10.578774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:10.590090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:10.591766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:10.606438 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2756/5586] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:11.939775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038f5d-cf74-4fdc-96f0-03aeaa96dace None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:11.940312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038f5d-cf74-4fdc-96f0-03aeaa96dace None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:11.940312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038f5d-cf74-4fdc-96f0-03aeaa96dace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:11.986342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ba038f5d-cf74-4fdc-96f0-03aeaa96dace None None] MFA Rules not processed for user `59d2c9a942c046ee8be5ccaeb86bee97`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:11.988495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ba038f5d-cf74-4fdc-96f0-03aeaa96dace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:12.070836 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2831/5587] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:13.574588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:13.591313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0cee3-6ac6-4190-a994-2b1fc717ff3b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:13.619617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:13.620551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:13.621333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:13.621333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] PATH_INFO: `/v3/users/59d2c9a942c046ee8be5ccaeb86bee97` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:13.623556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d2c9a942c046ee8be5ccaeb86bee97)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:13.627411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:13.735926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d2c9a942c046ee8be5ccaeb86bee97'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:13.737016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d2c9a942c046ee8be5ccaeb86bee97'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:13.757284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d2c9a942c046ee8be5ccaeb86bee97'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:13.761552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d2c9a942c046ee8be5ccaeb86bee97'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:13.774160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8b00b250-7db3-46a3-9c6b-5c9ec90fbfb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d2c9a942c046ee8be5ccaeb86bee97'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:13.818719 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2757/5588] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:13 2022] DELETE /identity/v3/users/59d2c9a942c046ee8be5ccaeb86bee97 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:15.184065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba038f5d-cf74-4fdc-96f0-03aeaa96dace None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:15.235263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba038f5d-cf74-4fdc-96f0-03aeaa96dace None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:15.356903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:15.358224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:15.358698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:15.359158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] PATH_INFO: `/v3/projects/8e644d1486be4ca4a4c60c46c53837ec` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:15.360626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e644d1486be4ca4a4c60c46c53837ec)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:15.364042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:15.505735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e644d1486be4ca4a4c60c46c53837ec', 'request_id': 'req-446ea6ac-a76d-4320-a9cf-4797475d993e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:15.534981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e644d1486be4ca4a4c60c46c53837ec', 'request_id': 'req-446ea6ac-a76d-4320-a9cf-4797475d993e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:15.561648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e644d1486be4ca4a4c60c46c53837ec', 'request_id': 'req-446ea6ac-a76d-4320-a9cf-4797475d993e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:15.644853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] The token cache is being invalidate because project 8e644d1486be4ca4a4c60c46c53837ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:15.645174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:15.649553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-446ea6ac-a76d-4320-a9cf-4797475d993e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:15.654851 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2832/5589] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:15 2022] DELETE /identity/v3/projects/8e644d1486be4ca4a4c60c46c53837ec => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:15.660409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937519a-e008-4182-96a4-ae510a908f9e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:15.660904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937519a-e008-4182-96a4-ae510a908f9e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:15.661943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937519a-e008-4182-96a4-ae510a908f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:15.712419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d937519a-e008-4182-96a4-ae510a908f9e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:15.714177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d937519a-e008-4182-96a4-ae510a908f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:15.946353 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2758/5590] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:15.954534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403725-69aa-4380-be52-b6cb60ecbdd7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:15.954824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403725-69aa-4380-be52-b6cb60ecbdd7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:15.955157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403725-69aa-4380-be52-b6cb60ecbdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.003119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b1403725-69aa-4380-be52-b6cb60ecbdd7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:16.004352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b1403725-69aa-4380-be52-b6cb60ecbdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:16.033829 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2833/5591] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:16.037991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937519a-e008-4182-96a4-ae510a908f9e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:16.056673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937519a-e008-4182-96a4-ae510a908f9e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:16.068682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:16.070514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:16.070994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:16.071430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.072443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:16.072930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:16.077701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:16.112140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2759/5592] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:16.116401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403725-69aa-4380-be52-b6cb60ecbdd7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:16.131822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403725-69aa-4380-be52-b6cb60ecbdd7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:16.142734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:16.143757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:16.144196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:16.144623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.145977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:16.161530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:16.239705 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2834/5593] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:16.243579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:16.259225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90563-4486-4b7a-af19-84bb40603cad admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:16.470431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:16.471153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:16.471438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:16.471716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.472434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:16.479886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:16.542498 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2760/5594] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:16 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:16.543642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:16.573651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3e330-9e99-46d7-9c7c-266c50ec38c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:16.586430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:16.587592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:16.588106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:16.590899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.592121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:16.600449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:16.629094 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2835/5595] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:13:16.633205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:16.648810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684bd6a-8435-4b0f-b687-56e5fb9b7cc2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:16.657719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69423c9b-4d73-471f-b666-54359f7288e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:16.659497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423c9b-4d73-471f-b666-54359f7288e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:16.659789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423c9b-4d73-471f-b666-54359f7288e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:16.660065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423c9b-4d73-471f-b666-54359f7288e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.661029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69423c9b-4d73-471f-b666-54359f7288e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:16.662516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69423c9b-4d73-471f-b666-54359f7288e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:16.736743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:16.737855 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2761/5596] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:16.750706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ede9b5-77a9-4906-b8dd-a29a74809d5a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:16.758446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:16.761407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:16.761872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:16.762309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] PATH_INFO: `/v3/projects/42541b0a749141b597348fc70050086c/users/820f7a8210944546a2154db153fdd345/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.783269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42541b0a749141b597348fc70050086c, user_id=820f7a8210944546a2154db153fdd345, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:16.797290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:16.826988 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2836/5597] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:16 2022] PUT /identity/v3/projects/42541b0a749141b597348fc70050086c/users/820f7a8210944546a2154db153fdd345/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:16.833771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cdfa8-8705-4c9d-956f-ab17f86ab3ab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:16.834111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cdfa8-8705-4c9d-956f-ab17f86ab3ab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:16.834387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cdfa8-8705-4c9d-956f-ab17f86ab3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:16.857684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-109cdfa8-8705-4c9d-956f-ab17f86ab3ab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:16.858802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-109cdfa8-8705-4c9d-956f-ab17f86ab3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:17.004759 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2762/5598] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:17.042839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:17.048211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:17.180350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915b719-52b1-4509-a73d-37d828b6aeb9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:17.191929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf79638-0144-4f5d-ad87-dc5444969c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:17.192949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79638-0144-4f5d-ad87-dc5444969c7e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:17.193476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79638-0144-4f5d-ad87-dc5444969c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:17.193996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79638-0144-4f5d-ad87-dc5444969c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:17.204583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf79638-0144-4f5d-ad87-dc5444969c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:17.206490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf79638-0144-4f5d-ad87-dc5444969c7e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:17.218393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2837/5599] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:18.305325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:18.306664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:18.307139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:18.355147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] MFA Rules not processed for user `820f7a8210944546a2154db153fdd345`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:18.356530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:18.495710 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2763/5600] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:18.497678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755a7a4-14ea-4eb2-85f0-44e50f0e84de None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:18.498161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755a7a4-14ea-4eb2-85f0-44e50f0e84de None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:18.498299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755a7a4-14ea-4eb2-85f0-44e50f0e84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:18.528176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6755a7a4-14ea-4eb2-85f0-44e50f0e84de None None] MFA Rules not processed for user `820f7a8210944546a2154db153fdd345`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:18.529419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6755a7a4-14ea-4eb2-85f0-44e50f0e84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:18.538184 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2838/5601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:18.550423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:18.552192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:18.706194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100cce-2109-4af6-9d5f-7b6ae9b3c0a6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:18.718851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:18.720312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:18.720835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:18.721352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:18.738219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:18.740412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:18.755690 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2764/5602] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:21.098483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755a7a4-14ea-4eb2-85f0-44e50f0e84de None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:21.130929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755a7a4-14ea-4eb2-85f0-44e50f0e84de None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:21.165781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:21.167032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:21.168025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:21.168856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] PATH_INFO: `/v3/users/820f7a8210944546a2154db153fdd345` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:21.171059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820f7a8210944546a2154db153fdd345)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:21.179319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:21.358674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820f7a8210944546a2154db153fdd345'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:21.368464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820f7a8210944546a2154db153fdd345'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:21.384434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820f7a8210944546a2154db153fdd345'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:21.411329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820f7a8210944546a2154db153fdd345'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:21.412267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9f8832f-a36f-4512-a589-cd567c35eed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820f7a8210944546a2154db153fdd345'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:21.441318 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2839/5603] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:21 2022] DELETE /identity/v3/users/820f7a8210944546a2154db153fdd345 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:22.126753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:22.145076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8de1-e3e8-4fc9-9328-4d4adc53925f service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:22.339372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:22.340636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:22.341127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:22.341583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] PATH_INFO: `/v3/projects/42541b0a749141b597348fc70050086c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:22.343274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=42541b0a749141b597348fc70050086c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:22.346171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:22.426525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42541b0a749141b597348fc70050086c', 'request_id': 'req-18f348cf-1d17-41eb-a156-8abb1f20dbdf'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:22.434000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42541b0a749141b597348fc70050086c', 'request_id': 'req-18f348cf-1d17-41eb-a156-8abb1f20dbdf'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:22.446282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42541b0a749141b597348fc70050086c', 'request_id': 'req-18f348cf-1d17-41eb-a156-8abb1f20dbdf'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:22.461884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] The token cache is being invalidate because project 42541b0a749141b597348fc70050086c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:22.462152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:22.462813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f348cf-1d17-41eb-a156-8abb1f20dbdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:22.464480 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2765/5604] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:22 2022] DELETE /identity/v3/projects/42541b0a749141b597348fc70050086c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:22.469821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a86d-e1f7-456e-8fdf-93f073ac0623 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:22.470416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a86d-e1f7-456e-8fdf-93f073ac0623 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:22.470416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a86d-e1f7-456e-8fdf-93f073ac0623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:22.490980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3455a86d-e1f7-456e-8fdf-93f073ac0623 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:22.492413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3455a86d-e1f7-456e-8fdf-93f073ac0623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:22.591285 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2840/5605] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:22.599577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729eb7d-078d-478b-b3ac-ccf5bca52323 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:22.599897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729eb7d-078d-478b-b3ac-ccf5bca52323 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:22.600265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729eb7d-078d-478b-b3ac-ccf5bca52323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:22.619664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8729eb7d-078d-478b-b3ac-ccf5bca52323 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:22.622060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8729eb7d-078d-478b-b3ac-ccf5bca52323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:22.637565 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2766/5606] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:22.638884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455a86d-e1f7-456e-8fdf-93f073ac0623 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:22.655209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455a86d-e1f7-456e-8fdf-93f073ac0623 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:22.660362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:22.661208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:22.661591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:22.661986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:22.663150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:22.663803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:22.665566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:22.710461 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2841/5607] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:22.714762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729eb7d-078d-478b-b3ac-ccf5bca52323 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:22.741261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729eb7d-078d-478b-b3ac-ccf5bca52323 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:22.747543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:22.750828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:22.751115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:22.751392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:22.752098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:22.754086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:22.809794 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2767/5608] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:22 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:22.821074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:22.833285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cffcc-2fb5-4233-8624-1e40db81dea7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:23.035695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:23.036765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:23.037260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:23.037743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:23.038804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:23.041551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:23.093731 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2842/5609] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:22 2022] POST /identity/v3/users => generated 288 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:23.106490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:23.120674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c947b0-6470-4496-b651-123591a9a037 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:23.126604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:23.127359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:23.127966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:23.127966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:23.128640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:23.130387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:23.154498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:23.155544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2768/5610] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:23.170600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da4d80-a8f6-4b83-83f8-f4597caba08f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:23.177409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9fd0-8368-4767-8f37-3df45f360eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:23.178680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9fd0-8368-4767-8f37-3df45f360eaf admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:23.179139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9fd0-8368-4767-8f37-3df45f360eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:23.179601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9fd0-8368-4767-8f37-3df45f360eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:23.180582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9fd0-8368-4767-8f37-3df45f360eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:23.183062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9fd0-8368-4767-8f37-3df45f360eaf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:23.200319 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2843/5611] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:13:23.201197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:23.214886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b556945-c9d8-4f88-8042-3f5bb2ae9160 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:23.221613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:23.222866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:23.224366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:23.224882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] PATH_INFO: `/v3/projects/0016847f785b4c5f94459392b054c707/users/03b30d9ee570431a952d8b6f7b07b775/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:23.248756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0016847f785b4c5f94459392b054c707, user_id=03b30d9ee570431a952d8b6f7b07b775, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:23.252943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:23.275740 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2769/5612] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:23 2022] PUT /identity/v3/projects/0016847f785b4c5f94459392b054c707/users/03b30d9ee570431a952d8b6f7b07b775/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:23.314471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d58c2-af34-4c27-a95a-3a43fa5a6a66 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:23.314881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d58c2-af34-4c27-a95a-3a43fa5a6a66 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:23.320571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d58c2-af34-4c27-a95a-3a43fa5a6a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:23.399831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e47d58c2-af34-4c27-a95a-3a43fa5a6a66 None None] MFA Rules not processed for user `03b30d9ee570431a952d8b6f7b07b775`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:23.399831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e47d58c2-af34-4c27-a95a-3a43fa5a6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:23.646854 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2844/5613] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:23.659475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:23.661957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:23.855224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ddc54-394f-4f4f-9fd8-69929e6c954b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:23.873236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5a47f-6b86-4e97-ae60-cf140f09130d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:23.874256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a47f-6b86-4e97-ae60-cf140f09130d service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:23.875487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a47f-6b86-4e97-ae60-cf140f09130d service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:23.875934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a47f-6b86-4e97-ae60-cf140f09130d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:23.917209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5a47f-6b86-4e97-ae60-cf140f09130d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:23.940777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5a47f-6b86-4e97-ae60-cf140f09130d service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:23.963944 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2770/5614] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:25.120545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d58c2-af34-4c27-a95a-3a43fa5a6a66 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:25.241522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d58c2-af34-4c27-a95a-3a43fa5a6a66 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:25.278893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:25.280795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:25.281329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:25.281607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] PATH_INFO: `/v3/users/03b30d9ee570431a952d8b6f7b07b775` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:25.283093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b30d9ee570431a952d8b6f7b07b775)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:25.285529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:25.415771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b30d9ee570431a952d8b6f7b07b775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:25.416754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b30d9ee570431a952d8b6f7b07b775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:25.435903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b30d9ee570431a952d8b6f7b07b775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:25.461070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b30d9ee570431a952d8b6f7b07b775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:25.465118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b30d9ee570431a952d8b6f7b07b775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:25.507302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2845/5615] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:25 2022] DELETE /identity/v3/users/03b30d9ee570431a952d8b6f7b07b775 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:25.509789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:25.515109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:25.515734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:25.544098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:25.545514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:25.694896 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2771/5616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:25.706903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:25.709130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:25.889631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c9c31-42f8-4c11-b3fa-f800d1c93287 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:25.897411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c1dd-9f6a-4e23-95d4-53357c7f21ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:25.898108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c1dd-9f6a-4e23-95d4-53357c7f21ff service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:25.898391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c1dd-9f6a-4e23-95d4-53357c7f21ff service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:25.899031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c1dd-9f6a-4e23-95d4-53357c7f21ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:25.924816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c1dd-9f6a-4e23-95d4-53357c7f21ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:25.930717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c1dd-9f6a-4e23-95d4-53357c7f21ff service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:25.969902 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2846/5617] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:27.283938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:27.286540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:27.300867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46838b-f5ef-4789-a433-541bad231419 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:27.308257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:27.310556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:27.312348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:27.312934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] PATH_INFO: `/v3/projects/0016847f785b4c5f94459392b054c707` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:27.315393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0016847f785b4c5f94459392b054c707)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:27.317971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:27.482224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0016847f785b4c5f94459392b054c707', 'request_id': 'req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:27.500483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0016847f785b4c5f94459392b054c707', 'request_id': 'req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:27.515349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0016847f785b4c5f94459392b054c707', 'request_id': 'req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:27.555676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] The token cache is being invalidate because project 0016847f785b4c5f94459392b054c707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:27.555957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:27.557322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1c6bc8fb-b740-47f0-8351-da4596a3c9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:27.559996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2772/5618] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:27 2022] DELETE /identity/v3/projects/0016847f785b4c5f94459392b054c707 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:27.567842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82e45-e86d-40ff-9ac7-ae08a78b1137 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:27.567842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82e45-e86d-40ff-9ac7-ae08a78b1137 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:27.567842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82e45-e86d-40ff-9ac7-ae08a78b1137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:27.614899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bfd82e45-e86d-40ff-9ac7-ae08a78b1137 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:27.616919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bfd82e45-e86d-40ff-9ac7-ae08a78b1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:27.758014 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2847/5619] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:27.767091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bd125-7748-49a3-b06a-a826944d9c64 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:27.768144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bd125-7748-49a3-b06a-a826944d9c64 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:27.768681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bd125-7748-49a3-b06a-a826944d9c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:27.795403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a21bd125-7748-49a3-b06a-a826944d9c64 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:27.801765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a21bd125-7748-49a3-b06a-a826944d9c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:27.814854 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2773/5620] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:27.827040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82e45-e86d-40ff-9ac7-ae08a78b1137 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:27.840203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82e45-e86d-40ff-9ac7-ae08a78b1137 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:27.853955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:27.855212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:27.855672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:27.856204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:27.860621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:27.862865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:27.867309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:27.902972 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2848/5621] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:27.909133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bd125-7748-49a3-b06a-a826944d9c64 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:27.932887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bd125-7748-49a3-b06a-a826944d9c64 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:27.968947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:27.979688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:27.985517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:27.987164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:27.990406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:27.996046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:28.158325 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2774/5622] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:27 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:28.163376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:28.188576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eea34-a84a-43e3-9d85-64b76cd9364c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:28.275284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:28.276994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:28.277308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:28.277581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:28.278691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:28.280773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:28.310413 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2849/5623] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:28 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:28.311597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:28.323472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387034e8-bc71-47f5-b33a-3def16cb9e61 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:28.330577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:28.331532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:28.331983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:28.333594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:28.349356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:28.352401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:28.394168 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2775/5624] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:13:28.399632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:28.414284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cec3e-81cf-4b5d-83bc-795e5d44aef9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:28.424628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6c2a-38f5-4b9e-bd70-615a8f6b9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:28.424628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6c2a-38f5-4b9e-bd70-615a8f6b9bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:28.424628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6c2a-38f5-4b9e-bd70-615a8f6b9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:28.426940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6c2a-38f5-4b9e-bd70-615a8f6b9bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:28.428928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6c2a-38f5-4b9e-bd70-615a8f6b9bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:28.434093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6c2a-38f5-4b9e-bd70-615a8f6b9bf9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:28.458907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2850/5625] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:13:28.463670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:28.486034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bdd6b-c49e-4c79-a77d-feb8147ec03a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:28.503332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e30b0-de33-41cf-813b-f6925b090dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:28.505661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e30b0-de33-41cf-813b-f6925b090dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:28.505955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e30b0-de33-41cf-813b-f6925b090dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:28.506229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e30b0-de33-41cf-813b-f6925b090dbe admin admin] PATH_INFO: `/v3/projects/afe60be803264629bfc0736ee36a9dce/users/da4cee0d2cf84137bab421dc17bda695/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:28.545726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e30b0-de33-41cf-813b-f6925b090dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe60be803264629bfc0736ee36a9dce, user_id=da4cee0d2cf84137bab421dc17bda695, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:28.551112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e30b0-de33-41cf-813b-f6925b090dbe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:28.609357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2776/5626] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:28 2022] PUT /identity/v3/projects/afe60be803264629bfc0736ee36a9dce/users/da4cee0d2cf84137bab421dc17bda695/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:28.611546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6290-140f-4d2e-90a0-b85a211e4e2f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:28.612101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6290-140f-4d2e-90a0-b85a211e4e2f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:28.612229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6290-140f-4d2e-90a0-b85a211e4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:28.679613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-977a6290-140f-4d2e-90a0-b85a211e4e2f None None] MFA Rules not processed for user `da4cee0d2cf84137bab421dc17bda695`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:28.681609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-977a6290-140f-4d2e-90a0-b85a211e4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:28.807975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7a9e-beb5-414d-9410-d860b2b7e806 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:28.808528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7a9e-beb5-414d-9410-d860b2b7e806 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:28.809014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7a9e-beb5-414d-9410-d860b2b7e806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:28.834661 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2851/5627] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:28.838766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6290-140f-4d2e-90a0-b85a211e4e2f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:28.846304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9c7b7a9e-beb5-414d-9410-d860b2b7e806 None None] MFA Rules not processed for user `f2809b3bcbea4d2eb9ab6b360669fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:28.847972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9c7b7a9e-beb5-414d-9410-d860b2b7e806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:28.955228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6290-140f-4d2e-90a0-b85a211e4e2f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:28.961077 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2777/5628] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:28.965975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:28.966953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:28.967449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:28.967946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:28.968872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:28.971509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.031409 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2852/5629] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:28 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:29.032891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7a9e-beb5-414d-9410-d860b2b7e806 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.047920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7a9e-beb5-414d-9410-d860b2b7e806 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.182121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:29.182961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.183236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.183504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.184252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:29.186505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.208246 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2778/5630] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:29 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:29.212044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.222573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b48ee1-4bfb-4b67-9d95-622e4b3538de admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.227505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:29.228171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.228446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.228715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.229469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:29.231142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.245468 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2853/5631] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:29.246838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.257057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ec79c-9e5d-4f5f-b381-2899f2deab1e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.261768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:29.262699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.262973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.263271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] PATH_INFO: `/v3/projects/b6ffee7da7b44f25b8213771e1e87ec0/users/3d6aa064aec04c4eb20dca2c6401428b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.278836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ffee7da7b44f25b8213771e1e87ec0, user_id=3d6aa064aec04c4eb20dca2c6401428b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:29.281616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.297937 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2779/5632] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:29 2022] PUT /identity/v3/projects/b6ffee7da7b44f25b8213771e1e87ec0/users/3d6aa064aec04c4eb20dca2c6401428b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:29.302045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.314673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1d199-7939-45c9-bfd9-fdf421e31ece admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.384615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2071f5-c2ea-4157-a3c6-09c78b73bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:29.386023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2071f5-c2ea-4157-a3c6-09c78b73bac5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.386305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2071f5-c2ea-4157-a3c6-09c78b73bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.386587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2071f5-c2ea-4157-a3c6-09c78b73bac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.387615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2071f5-c2ea-4157-a3c6-09c78b73bac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:29.389782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2071f5-c2ea-4157-a3c6-09c78b73bac5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.405057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.414359 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2854/5633] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:29.416700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f80db-392a-409a-a19b-b2cd10a26e6e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.421731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:29.422662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.422930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.423204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] PATH_INFO: `/v3/projects/b6ffee7da7b44f25b8213771e1e87ec0/users/3d6aa064aec04c4eb20dca2c6401428b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.425378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ffee7da7b44f25b8213771e1e87ec0, user_id=3d6aa064aec04c4eb20dca2c6401428b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:29.430536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.458173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0b5d-21d9-4226-a005-779562206cec None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.458173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0b5d-21d9-4226-a005-779562206cec None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.458173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0b5d-21d9-4226-a005-779562206cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.458634 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2780/5634] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:29 2022] PUT /identity/v3/projects/b6ffee7da7b44f25b8213771e1e87ec0/users/3d6aa064aec04c4eb20dca2c6401428b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:29.509807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-250d0b5d-21d9-4226-a005-779562206cec None None] MFA Rules not processed for user `3d6aa064aec04c4eb20dca2c6401428b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:29.510744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-250d0b5d-21d9-4226-a005-779562206cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:29.610125 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2855/5635] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:29.610407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.622624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6acfc-4286-408c-86f3-efe262f25d20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.628654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:29.629908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.630510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.631068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.631985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:29.634066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.682857 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2781/5636] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:29 2022] POST /identity/v3/projects => generated 334 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:29.687978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0b5d-21d9-4226-a005-779562206cec None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.700871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0b5d-21d9-4226-a005-779562206cec None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.832297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:29.832974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:29.833343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:29.833619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:29.834300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:29.836651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:29.891244 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2856/5637] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:13:29 2022] POST /identity/v3/projects => generated 333 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:29.895348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.924418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101170a-5764-49a9-b8e4-b3e3c0e492cd tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:29.976195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:29.979328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:30.138094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237b989-281a-479d-9f09-c551cec47d37 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:30.158552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:30.159272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:30.159549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:30.159819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:30.168480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:30.200757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:30.204893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:30.209147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:30.209426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:30.211593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:30.213881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:30.216143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:30.217332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:30.257941 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2857/5638] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:13:30.333913 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2782/5639] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:29 2022] POST /identity/v3/projects => generated 358 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:30.338681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:30.355955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64d60-f7e4-488f-92dd-c462d5fbb8b7 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:30.555691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:30.556380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:30.556663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:30.556932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:30.572803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:30.579101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:30.631129 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2858/5640] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:13:30 2022] GET /identity/v3/projects => generated 7611 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:30.637109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:30.656099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b127-cb3a-4685-85c1-7c5443bad03f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:30.678439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:30.679241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:30.679811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:30.680186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:30.681186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:30.681598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:30.683078 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:30.683078 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:13:30.683078 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:13:30.686265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:30.726948 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2783/5641] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 21:13:30 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:30.732215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:30.750767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5bf6-1303-477a-8509-e63504e4974e tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:30.767730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:30.769833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:30.773462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:30.773983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:30.777173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Adding query filter params (parent_id=f022bfc0cf4344ca8fef0f120d1c79ab) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:30.778191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:30.785280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:30.840396 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2859/5642] 10.222.0.30 () {58 vars in 1215 bytes} [Sat Apr 9 21:13:30 2022] GET /identity/v3/projects?parent_id=f022bfc0cf4344ca8fef0f120d1c79ab => generated 498 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:30.845343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:30.858182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53d0c8-fb78-413f-89fc-b0cc3090ab1a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:30.864579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:30.865976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:30.866495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:30.867452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects/00bd06042c2746338f571625d2240a89` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:30.869090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:delete_project(project_id=00bd06042c2746338f571625d2240a89)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:30.871432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:30.977799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bd06042c2746338f571625d2240a89', 'request_id': 'req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:30.984950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bd06042c2746338f571625d2240a89', 'request_id': 'req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.019629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bd06042c2746338f571625d2240a89', 'request_id': 'req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.041424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] The token cache is being invalidate because project 00bd06042c2746338f571625d2240a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:31.042153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.043169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.047563 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2784/5643] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:30 2022] DELETE /identity/v3/projects/00bd06042c2746338f571625d2240a89 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:31.051460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:31.054163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:31.085028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca7a0-1991-4fad-87a9-31ef20ecdb4a tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:31.228435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:31.229521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:31.229907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:31.230322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects/f022bfc0cf4344ca8fef0f120d1c79ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:31.233866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f022bfc0cf4344ca8fef0f120d1c79ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:31.236297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:31.366072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f022bfc0cf4344ca8fef0f120d1c79ab', 'request_id': 'req-f3c199c3-f411-4816-b0ed-370972c00220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.374275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f022bfc0cf4344ca8fef0f120d1c79ab', 'request_id': 'req-f3c199c3-f411-4816-b0ed-370972c00220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.394216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f022bfc0cf4344ca8fef0f120d1c79ab', 'request_id': 'req-f3c199c3-f411-4816-b0ed-370972c00220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.431919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] The token cache is being invalidate because project f022bfc0cf4344ca8fef0f120d1c79ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:31.432485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.433610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.450703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:31.455499 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2860/5644] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:31 2022] DELETE /identity/v3/projects/f022bfc0cf4344ca8fef0f120d1c79ab => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:31.469600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726abab-5c62-4e2e-b7a0-773f2abe7ebb tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:31.646196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6aa064aec04c4eb20dca2c6401428b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ffee7da7b44f25b8213771e1e87ec0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:31.648208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:31.649373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:31.649677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] PATH_INFO: `/v3/projects/9f7ca91a327644dab1e93c1105f20f34` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:31.655269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f7ca91a327644dab1e93c1105f20f34)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:31.664883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:31.770431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7ca91a327644dab1e93c1105f20f34', 'request_id': 'req-c49ac2d5-f668-4556-ba86-250ea1e5053f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.782928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7ca91a327644dab1e93c1105f20f34', 'request_id': 'req-c49ac2d5-f668-4556-ba86-250ea1e5053f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.799316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7ca91a327644dab1e93c1105f20f34', 'request_id': 'req-c49ac2d5-f668-4556-ba86-250ea1e5053f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.835927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] The token cache is being invalidate because project 9f7ca91a327644dab1e93c1105f20f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:31.836220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.842873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c49ac2d5-f668-4556-ba86-250ea1e5053f tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:31.846899 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2785/5645] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:31 2022] DELETE /identity/v3/projects/9f7ca91a327644dab1e93c1105f20f34 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:31.852515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:31.858209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:32.038646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c199c3-f411-4816-b0ed-370972c00220 tempest-ListProjectsTestJSON-1297204221 tempest-ListProjectsTestJSON-1297204221-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:32.217352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:32.222239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:32.222528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:32.223535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] PATH_INFO: `/v3/users/da4cee0d2cf84137bab421dc17bda695` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:32.244740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4cee0d2cf84137bab421dc17bda695)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:32.255350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:32.373703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4cee0d2cf84137bab421dc17bda695'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:32.374542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4cee0d2cf84137bab421dc17bda695'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:32.389816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4cee0d2cf84137bab421dc17bda695'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:32.409662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4cee0d2cf84137bab421dc17bda695'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:32.410548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4cee0d2cf84137bab421dc17bda695'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:32.452289 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2861/5646] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:31 2022] DELETE /identity/v3/users/da4cee0d2cf84137bab421dc17bda695 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:32.461287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:32.463778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:32.464318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:32.550174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:32.551758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:32.719580 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2786/5647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:32.741726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:32.743320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:32.867922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8ed4-5722-4586-b809-c3e4aeab0863 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:32.872395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:32.873273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:32.873631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:32.874219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:32.887484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:32.889588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:32.902998 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2862/5648] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:35.907167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:35.909253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:35.932863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819df5f-67fa-4436-a7a9-c3cab0a546bd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:35.954641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:35.955530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:35.955806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:35.956482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] PATH_INFO: `/v3/projects/afe60be803264629bfc0736ee36a9dce` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:35.958233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe60be803264629bfc0736ee36a9dce)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:35.960458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:36.099333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe60be803264629bfc0736ee36a9dce', 'request_id': 'req-2d84bc25-8009-4ecd-9344-6816ed625108'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.106933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe60be803264629bfc0736ee36a9dce', 'request_id': 'req-2d84bc25-8009-4ecd-9344-6816ed625108'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.121444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe60be803264629bfc0736ee36a9dce', 'request_id': 'req-2d84bc25-8009-4ecd-9344-6816ed625108'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.146532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] The token cache is being invalidate because project afe60be803264629bfc0736ee36a9dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:36.147040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.148267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.154147 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2787/5649] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:35 2022] DELETE /identity/v3/projects/afe60be803264629bfc0736ee36a9dce => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:36.158182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:36.172774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d9a3-b315-49be-882f-1d885a0a159c service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:36.254028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:36.255177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:36.255524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:36.255863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] PATH_INFO: `/v3/users/3d6aa064aec04c4eb20dca2c6401428b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:36.257233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6aa064aec04c4eb20dca2c6401428b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:36.259261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:36.324926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6aa064aec04c4eb20dca2c6401428b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.326674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6aa064aec04c4eb20dca2c6401428b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.338701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6aa064aec04c4eb20dca2c6401428b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.369764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6aa064aec04c4eb20dca2c6401428b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.379960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a25d2b3-1313-40bb-9e0d-2a96e80275d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6aa064aec04c4eb20dca2c6401428b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:36.414204 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2863/5650] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:36 2022] DELETE /identity/v3/users/3d6aa064aec04c4eb20dca2c6401428b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:37.747525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:37.756783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:37.777303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84bc25-8009-4ecd-9344-6816ed625108 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:37.989401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:37.992522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:37.992746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:37.993310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] PATH_INFO: `/v3/projects/b6ffee7da7b44f25b8213771e1e87ec0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:37.995075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ffee7da7b44f25b8213771e1e87ec0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:37.997324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:38.140125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ffee7da7b44f25b8213771e1e87ec0', 'request_id': 'req-7245b514-2008-4868-ae1f-10b00d7adbf6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:38.168166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ffee7da7b44f25b8213771e1e87ec0', 'request_id': 'req-7245b514-2008-4868-ae1f-10b00d7adbf6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:38.202364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ffee7da7b44f25b8213771e1e87ec0', 'request_id': 'req-7245b514-2008-4868-ae1f-10b00d7adbf6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:38.237325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] The token cache is being invalidate because project b6ffee7da7b44f25b8213771e1e87ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:38.237938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:38.239059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7245b514-2008-4868-ae1f-10b00d7adbf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:38.247319 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2788/5651] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:37 2022] DELETE /identity/v3/projects/b6ffee7da7b44f25b8213771e1e87ec0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:38.252883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b0fc2-e94f-4574-9ffd-db1cd4cf2897 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:38.253462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b0fc2-e94f-4574-9ffd-db1cd4cf2897 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:38.253462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b0fc2-e94f-4574-9ffd-db1cd4cf2897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:38.298627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f14b0fc2-e94f-4574-9ffd-db1cd4cf2897 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:38.300301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f14b0fc2-e94f-4574-9ffd-db1cd4cf2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:38.401107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2864/5652] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:38.407675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4926a-72e7-46fe-8c3f-0f0b3bfafc76 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:38.408434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4926a-72e7-46fe-8c3f-0f0b3bfafc76 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:38.408939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4926a-72e7-46fe-8c3f-0f0b3bfafc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:38.498469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ea4926a-72e7-46fe-8c3f-0f0b3bfafc76 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:38.503341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ea4926a-72e7-46fe-8c3f-0f0b3bfafc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:38.516396 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2789/5653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:38.520809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b0fc2-e94f-4574-9ffd-db1cd4cf2897 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:38.534122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b0fc2-e94f-4574-9ffd-db1cd4cf2897 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:38.541608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:38.542763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:38.543310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:38.543892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:38.544870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:38.545432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:38.547887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:38.566020 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2865/5654] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:38.570746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4926a-72e7-46fe-8c3f-0f0b3bfafc76 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:38.588579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4926a-72e7-46fe-8c3f-0f0b3bfafc76 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:38.627798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:38.632408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:38.632783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:38.633111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:38.634005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:38.645415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:38.788638 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2790/5655] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:38 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:38.790055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:38.805590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026f52-f97b-4b47-9e1f-5222000b4f7f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:38.951829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:38.952832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:38.953465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:38.953833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:38.954753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:38.957470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:39.018606 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2866/5656] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:38 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:39.024080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:39.041394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640bac-3d30-4efe-a001-64f5b1bfd51c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:39.054853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:39.057983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:39.057983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:39.058615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:39.061278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:39.064195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:39.083410 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2791/5657] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:39.087416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:39.119858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45737a3-44fe-49eb-ab9e-da71501f635e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:39.130036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32c326-3645-43e5-9218-319a16edb7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:39.130964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32c326-3645-43e5-9218-319a16edb7cd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:39.133649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32c326-3645-43e5-9218-319a16edb7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:39.134160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32c326-3645-43e5-9218-319a16edb7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:39.135100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32c326-3645-43e5-9218-319a16edb7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:39.137124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32c326-3645-43e5-9218-319a16edb7cd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:39.165644 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2867/5658] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:39.170983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:39.183668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5081a-a78e-4088-af97-b1084448df0a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:39.199219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:39.200290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:39.200701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:39.201861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] PATH_INFO: `/v3/projects/8bfcf9af780d465795d7547a48a8ac18/users/c668f01362234acb8cad1ca1dbc6b4b7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:39.250714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfcf9af780d465795d7547a48a8ac18, user_id=c668f01362234acb8cad1ca1dbc6b4b7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:39.259591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:39.311112 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2792/5659] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:39 2022] PUT /identity/v3/projects/8bfcf9af780d465795d7547a48a8ac18/users/c668f01362234acb8cad1ca1dbc6b4b7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:39.334271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45872d9-5dbb-450c-aa1e-ba388a6f466d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:39.338846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45872d9-5dbb-450c-aa1e-ba388a6f466d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:39.339322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45872d9-5dbb-450c-aa1e-ba388a6f466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:39.383837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e45872d9-5dbb-450c-aa1e-ba388a6f466d None None] MFA Rules not processed for user `c668f01362234acb8cad1ca1dbc6b4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:39.386786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e45872d9-5dbb-450c-aa1e-ba388a6f466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:39.490452 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2868/5660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:39.495096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:39.749577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1f074-4aa5-4ac1-aeb5-533f47be03b4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:39.764688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:39.765622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:39.765912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:39.766191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:39.768331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:39.770384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:39.886468 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2793/5661] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:39 2022] POST /identity/v3/projects => generated 373 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:39.887371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45872d9-5dbb-450c-aa1e-ba388a6f466d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:39.913371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45872d9-5dbb-450c-aa1e-ba388a6f466d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:40.012821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:40.016548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.016834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.017175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.018328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:40.020578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:40.056831 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2869/5662] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:39 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:40.066650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:40.093716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b156c-5594-4678-9583-d40bc1b04993 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:40.111376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:40.113717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.114479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.117625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.121896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:40.136264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:40.175918 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2794/5663] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:40.183136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:40.199629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73acac-aa1c-44dd-b32e-b61c0f038960 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:40.207325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:40.208719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.209051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.209406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] PATH_INFO: `/v3/projects/e334865e74f84eba983a51f4951920ed/users/6a3edc4c44e34c2cba0f72cf086127d8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.242383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e334865e74f84eba983a51f4951920ed, user_id=6a3edc4c44e34c2cba0f72cf086127d8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:40.246322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:40.294140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2870/5664] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:40 2022] PUT /identity/v3/projects/e334865e74f84eba983a51f4951920ed/users/6a3edc4c44e34c2cba0f72cf086127d8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:40.297977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:40.319518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dba06-9db2-41c9-9fb3-c79c6da457b6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:40.416789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ce4e9-7bb2-436c-aad9-23a5917903ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:40.418400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ce4e9-7bb2-436c-aad9-23a5917903ed admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.418736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ce4e9-7bb2-436c-aad9-23a5917903ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.419015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ce4e9-7bb2-436c-aad9-23a5917903ed admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.419794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ce4e9-7bb2-436c-aad9-23a5917903ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:40.421793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ce4e9-7bb2-436c-aad9-23a5917903ed admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:40.438244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2795/5665] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:40.442601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:40.486939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee62ff0-e7ed-45c8-ad5c-396486f25ea1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:40.493652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:40.495351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.496555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.497355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] PATH_INFO: `/v3/projects/e334865e74f84eba983a51f4951920ed/users/6a3edc4c44e34c2cba0f72cf086127d8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.500996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e334865e74f84eba983a51f4951920ed, user_id=6a3edc4c44e34c2cba0f72cf086127d8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:40.504270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:40.523613 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2871/5666] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:40 2022] PUT /identity/v3/projects/e334865e74f84eba983a51f4951920ed/users/6a3edc4c44e34c2cba0f72cf086127d8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:40.535346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393b68-f8d9-4599-a635-b3195ec4ff59 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.535631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393b68-f8d9-4599-a635-b3195ec4ff59 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.535903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393b68-f8d9-4599-a635-b3195ec4ff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.658684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-04393b68-f8d9-4599-a635-b3195ec4ff59 None None] MFA Rules not processed for user `6a3edc4c44e34c2cba0f72cf086127d8`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:40.660551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-04393b68-f8d9-4599-a635-b3195ec4ff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:40.821831 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2796/5667] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:40.827164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:40.849779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287da20-3642-4696-94fc-196e3180c646 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:40.871626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:40.876402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.878251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.880392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.883990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:40.890220 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:40.890220 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:13:40.890220 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:13:40.891683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:40.958394 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2872/5668] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Apr 9 21:13:40 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:40.959092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393b68-f8d9-4599-a635-b3195ec4ff59 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:40.975454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393b68-f8d9-4599-a635-b3195ec4ff59 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:40.990992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:40.992465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:40.992935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:40.993731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ffdfedb35ff4a9b9a3032fab66314d9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:40.994630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4ffdfedb35ff4a9b9a3032fab66314d9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:40.997542 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:40.997542 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:13:40.997542 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:13:41.000855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.014944 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2797/5669] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:13:40 2022] GET /identity/v3/OS-OAUTH1/consumers/4ffdfedb35ff4a9b9a3032fab66314d9 => generated 220 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:41.018818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.032117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258a97-d17f-48d1-8669-b00d4cc35868 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.037595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.038703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.039180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.039678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ffdfedb35ff4a9b9a3032fab66314d9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.041716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4ffdfedb35ff4a9b9a3032fab66314d9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.042977 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:41.042977 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:13:41.042977 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:13:41.044335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.044772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invalidating token cache because consumer 4ffdfedb35ff4a9b9a3032fab66314d9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:41.045277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.046219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.076139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4ffdfedb35ff4a9b9a3032fab66314d9', 'request_id': 'req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.107854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.108769 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2873/5670] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:13:41 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4ffdfedb35ff4a9b9a3032fab66314d9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:41.110589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:41.127201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8bea-e17e-4100-8e60-bb7049b5de00 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.135546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.136530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.136988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.137531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.138489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.140274 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:41.140274 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:13:41.140274 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:13:41.141597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.171691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.180216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2798/5671] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Apr 9 21:13:41 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 264 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:41.186702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fb5f1-1bb6-48e1-afb3-1a1d786391c0 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.195125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.197852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.198611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.199081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.200091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=ced14bd587d54c5c831512368d581f2b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.201753 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:41.201753 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:13:41.201753 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:13:41.203775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.223265 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2874/5672] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:13:41 2022] GET /identity/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b => generated 218 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:41.226171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.241213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7f1dd-3a3b-4d61-b763-2daf71b9ea53 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.249197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.250925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.251446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.251941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.253938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ced14bd587d54c5c831512368d581f2b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.256916 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:41.256916 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:13:41.256916 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:13:41.260304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.260587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invalidating token cache because consumer ced14bd587d54c5c831512368d581f2b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:41.260884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.266807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.298151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'ced14bd587d54c5c831512368d581f2b', 'request_id': 'req-c9850f96-4813-475d-b6e9-77a951fb5e1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.326482 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2799/5673] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:13:41 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:41.331554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.335461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:41.357905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540434b4-a673-4b4b-8e04-da1e9c124837 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.364418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.366051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.366574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.367391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.367724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=ced14bd587d54c5c831512368d581f2b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.371870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.389688 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Apr 09 21:13:41.391625 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2875/5674] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:13:41 2022] GET /identity/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b => generated 74 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 21:13:41.397148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.410840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9850f96-4813-475d-b6e9-77a951fb5e1d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.417614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.419273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.419846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.420292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.421227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ced14bd587d54c5c831512368d581f2b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.423304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.423763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invalidating token cache because consumer ced14bd587d54c5c831512368d581f2b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:41.424301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.425305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.450755 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Apr 09 21:13:41.462178 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2800/5675] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:13:41 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ced14bd587d54c5c831512368d581f2b => generated 74 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 09 21:13:41.463165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.465829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:41.491110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02097c0-488e-47f6-89dc-f0626e75a255 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.499447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.507842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.508439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.508897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.509954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.512642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.537696 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2876/5676] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Apr 9 21:13:41 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:41.542371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.557874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a824-7df5-47b0-a86e-c676ccd6a416 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.572105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.573203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.573722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.574201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.576595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.578547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.618035 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2801/5677] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Apr 9 21:13:41 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:41.623407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.637845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3bc5d-bab9-4017-a4a3-d386825e185d tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.657284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.657996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.658289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.658576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.659432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.660608 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:41.660608 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:13:41.660608 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:13:41.662048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.676995 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2877/5678] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Apr 9 21:13:41 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:41.679045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.703785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b51e5-34f5-4807-91d2-c613a7d5cb88 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.710734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.711973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.712390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.712841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e959631bcde34a1b86f7b16ec04377e6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.713718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e959631bcde34a1b86f7b16ec04377e6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.716519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.716833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invalidating token cache because consumer e959631bcde34a1b86f7b16ec04377e6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:41.717254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.718214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.750847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e959631bcde34a1b86f7b16ec04377e6', 'request_id': 'req-45a929ea-aebc-491b-a6b1-46640b67db15'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.787537 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2802/5679] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:13:41 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e959631bcde34a1b86f7b16ec04377e6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:41.791704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.793805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:41.818574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a7bfe-79d2-48fb-9fac-39367a944f14 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.835554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.836858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.837241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.837613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/44a85b0491df4059a7c9df00d40c9609` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.838499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=44a85b0491df4059a7c9df00d40c9609)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.840298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.840665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invalidating token cache because consumer 44a85b0491df4059a7c9df00d40c9609 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:41.842559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.847003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.877969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '44a85b0491df4059a7c9df00d40c9609', 'request_id': 'req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:41.902922 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2878/5680] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:13:41 2022] DELETE /identity/v3/OS-OAUTH1/consumers/44a85b0491df4059a7c9df00d40c9609 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:41.910905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.922998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a929ea-aebc-491b-a6b1-46640b67db15 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:41.936059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:41.937099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:41.937602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:41.938097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:41.938798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:41.940450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:41.963723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2803/5681] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Apr 9 21:13:41 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:41.968381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:41.970885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:41.994450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7d6b2-0e61-46e5-ab13-c1cd04041eb3 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:42.002924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:42.004156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:42.004610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:42.005127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c0b89559339f41c8be7b445d983abb1c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:42.006077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=c0b89559339f41c8be7b445d983abb1c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:42.007325 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:42.007325 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:13:42.007325 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:13:42.013353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:42.041271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:42.048940 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2879/5682] 10.222.0.30 () {60 vars in 1284 bytes} [Sat Apr 9 21:13:41 2022] PATCH /identity/v3/OS-OAUTH1/consumers/c0b89559339f41c8be7b445d983abb1c => generated 221 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:42.056415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b46e-b144-4759-abbd-f60b4200c0dc tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:42.064293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:42.066090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:42.066862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:42.067314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c0b89559339f41c8be7b445d983abb1c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:42.068791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c0b89559339f41c8be7b445d983abb1c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:42.070959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:42.082107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:42.092352 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2804/5683] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:13:42 2022] GET /identity/v3/OS-OAUTH1/consumers/c0b89559339f41c8be7b445d983abb1c => generated 221 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:42.095171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d4b6-ea75-4c40-b8ff-bcb0d49c8d5e tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:42.102465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3edc4c44e34c2cba0f72cf086127d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e334865e74f84eba983a51f4951920ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:42.103766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:42.104231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:42.104673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c0b89559339f41c8be7b445d983abb1c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:42.105688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c0b89559339f41c8be7b445d983abb1c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:42.108047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:42.108499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invalidating token cache because consumer c0b89559339f41c8be7b445d983abb1c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:42.109152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.110143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.131319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-53d8831d-04c0-46f9-9e07-0b8579e51651 tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c0b89559339f41c8be7b445d983abb1c', 'request_id': 'req-53d8831d-04c0-46f9-9e07-0b8579e51651'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.153358 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2880/5684] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:13:42 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c0b89559339f41c8be7b445d983abb1c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:42.158949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:42.163509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:42.303988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393829a-91bb-4bc6-a973-a73886ed08ca tempest-OAUTHConsumersV3Test-61153536 tempest-OAUTHConsumersV3Test-61153536-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:42.309541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:42.310705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:42.311577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:42.312034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] PATH_INFO: `/v3/users/c668f01362234acb8cad1ca1dbc6b4b7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:42.313659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=c668f01362234acb8cad1ca1dbc6b4b7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:42.316184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:42.410157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c668f01362234acb8cad1ca1dbc6b4b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.413913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c668f01362234acb8cad1ca1dbc6b4b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.433809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c668f01362234acb8cad1ca1dbc6b4b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.436144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c668f01362234acb8cad1ca1dbc6b4b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.457819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c668f01362234acb8cad1ca1dbc6b4b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:42.496186 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2805/5685] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:42 2022] DELETE /identity/v3/users/c668f01362234acb8cad1ca1dbc6b4b7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:42.501426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:42.502029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:42.502029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:42.548240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:42.548839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:42.651422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2881/5686] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:42.688229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:42.689810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:42.795509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc5ab-6623-438b-af57-c9daf4fb9cde admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:42.807188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:42.807623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:42.807976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:42.808306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:42.823094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:42.825299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:42.840893 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2806/5687] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:44.064336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:44.066057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:44.084415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879604c-f91d-494e-97f6-6d7c5adddb7e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:44.090645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:44.091818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:44.092339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:44.092682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] PATH_INFO: `/v3/projects/8bfcf9af780d465795d7547a48a8ac18` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:44.094045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfcf9af780d465795d7547a48a8ac18)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:44.097519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:44.230604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfcf9af780d465795d7547a48a8ac18', 'request_id': 'req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.254677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfcf9af780d465795d7547a48a8ac18', 'request_id': 'req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.279627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfcf9af780d465795d7547a48a8ac18', 'request_id': 'req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.300568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] The token cache is being invalidate because project 8bfcf9af780d465795d7547a48a8ac18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:44.300868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.301998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.306524 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2882/5688] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:44 2022] DELETE /identity/v3/projects/8bfcf9af780d465795d7547a48a8ac18 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:44.310761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:44.328087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597d2f6-98bf-48ed-9149-d29caaadab80 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:44.420201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:44.421521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:44.421805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:44.422188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] PATH_INFO: `/v3/users/6a3edc4c44e34c2cba0f72cf086127d8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:44.423837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3edc4c44e34c2cba0f72cf086127d8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:44.426103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:44.513510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3edc4c44e34c2cba0f72cf086127d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.514544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3edc4c44e34c2cba0f72cf086127d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.524886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3edc4c44e34c2cba0f72cf086127d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.525843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3edc4c44e34c2cba0f72cf086127d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.538967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e5bf17c-7ff5-4991-8015-54d7ab2d8dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3edc4c44e34c2cba0f72cf086127d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:44.571273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2807/5689] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:44 2022] DELETE /identity/v3/users/6a3edc4c44e34c2cba0f72cf086127d8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:45.125931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:45.128422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:45.161657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4eae0-d08f-4044-ac40-18ae95ac46e7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:45.280287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:45.281926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:45.282851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:45.283135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] PATH_INFO: `/v3/projects/e334865e74f84eba983a51f4951920ed` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:45.285639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e334865e74f84eba983a51f4951920ed)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:45.288029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:45.390080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e334865e74f84eba983a51f4951920ed', 'request_id': 'req-ea82360a-67d8-462e-8629-5480842f2f79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:45.399368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e334865e74f84eba983a51f4951920ed', 'request_id': 'req-ea82360a-67d8-462e-8629-5480842f2f79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:45.428995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e334865e74f84eba983a51f4951920ed', 'request_id': 'req-ea82360a-67d8-462e-8629-5480842f2f79'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:45.459086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] The token cache is being invalidate because project e334865e74f84eba983a51f4951920ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:45.459704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:45.460859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea82360a-67d8-462e-8629-5480842f2f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:45.462987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2883/5690] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:45 2022] DELETE /identity/v3/projects/e334865e74f84eba983a51f4951920ed => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:45.469796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd627-ad30-459f-8d12-b41f73f62c51 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:45.470370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd627-ad30-459f-8d12-b41f73f62c51 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:45.470370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd627-ad30-459f-8d12-b41f73f62c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:45.495497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a8dfd627-ad30-459f-8d12-b41f73f62c51 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:45.497549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a8dfd627-ad30-459f-8d12-b41f73f62c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:45.587397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b7d4-c3eb-4372-a6ba-d6b6e2955b20 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:45.587976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b7d4-c3eb-4372-a6ba-d6b6e2955b20 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:45.588476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b7d4-c3eb-4372-a6ba-d6b6e2955b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:45.592193 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2808/5691] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:45.617590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-63e2b7d4-c3eb-4372-a6ba-d6b6e2955b20 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:45.619360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-63e2b7d4-c3eb-4372-a6ba-d6b6e2955b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:45.643063 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2884/5692] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:45.652181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd627-ad30-459f-8d12-b41f73f62c51 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:45.662348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd627-ad30-459f-8d12-b41f73f62c51 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:45.670456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:45.671793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:45.672202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:45.672472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:45.673735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:45.674933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:45.679588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:45.705338 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2809/5693] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:45.710221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2b7d4-c3eb-4372-a6ba-d6b6e2955b20 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:45.729395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2b7d4-c3eb-4372-a6ba-d6b6e2955b20 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:45.738164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:45.740207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:45.740757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:45.741305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:45.742363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:45.745439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:45.789923 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2885/5694] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:45 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:45.793695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:45.807531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31e11-6d2b-4c73-9b03-ff20288ce38c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:45.914111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:45.914808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:45.915089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:45.915362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:45.916110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:45.918209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:45.946386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2810/5695] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:45 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:45.950398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:45.963238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5693-1923-42c7-ba69-ac13a296bd93 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:45.971794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:45.973666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:45.974892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:45.975421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:45.976562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:45.979605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:45.999480 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2886/5696] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:13:46.007619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.019504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb83f62-b046-4b36-a327-2d19883f141d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:46.024951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b31b13-06f9-4079-837d-befe1e31f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:46.025699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b31b13-06f9-4079-837d-befe1e31f459 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.025977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b31b13-06f9-4079-837d-befe1e31f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.026242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b31b13-06f9-4079-837d-befe1e31f459 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.027552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b31b13-06f9-4079-837d-befe1e31f459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:46.029398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b31b13-06f9-4079-837d-befe1e31f459 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:46.045274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2811/5697] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:46.050015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.068900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8c504-924d-4d17-af93-7e40d19b4d50 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:46.075821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:46.077856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.078256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.078693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] PATH_INFO: `/v3/projects/f45b1017953240d4a746570c9fa6d64f/users/8d31683844da415fbfadfd3f0deab723/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.100728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45b1017953240d4a746570c9fa6d64f, user_id=8d31683844da415fbfadfd3f0deab723, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:46.103799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:46.126749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2887/5698] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:46 2022] PUT /identity/v3/projects/f45b1017953240d4a746570c9fa6d64f/users/8d31683844da415fbfadfd3f0deab723/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:46.140324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.141452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.141758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.179695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] MFA Rules not processed for user `8d31683844da415fbfadfd3f0deab723`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:46.181105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:46.311795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2812/5699] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:46.313872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.372441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.374229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:46.428899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bda7af-6c2c-45b9-9700-7c11007663d7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:46.435758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:46.436991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.437463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.437918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.438780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:46.441222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:46.509972 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2888/5700] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:46 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:46.513634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.528880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a18f0-4489-4012-821b-49e0da00b3ac None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:46.716808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412eec-88a0-4d15-a4a4-51e1e9af3156 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:46.730020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:46.731161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.731695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.732166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.733463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:46.737371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:46.740690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:46.745669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.745669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.745669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.745669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:46.791330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2889/5701] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:46 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:46.795901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.810424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4d3ce-438b-40a0-8deb-7b42d9b4fc5b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:46.816141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:46.817369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.817739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.818091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.819212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:46.821208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:46.845781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:46.846360 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2890/5702] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:46.851649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.852446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:46.865373 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2813/5703] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:13:46.880649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0fada-1f0c-490e-bfbf-73aaf7cd2415 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:46.894844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:46.896396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:46.897785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:46.898070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] PATH_INFO: `/v3/projects/52045466ff5a448bbe6bee3e973103e9/users/68705fab60834128b5815314347eb271/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:46.942053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52045466ff5a448bbe6bee3e973103e9, user_id=68705fab60834128b5815314347eb271, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:46.944948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:46.978686 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2891/5704] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:46 2022] PUT /identity/v3/projects/52045466ff5a448bbe6bee3e973103e9/users/68705fab60834128b5815314347eb271/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:46.979536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:46.994692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba2a8e-ab23-4913-81fb-9a929f6b29f1 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:47.112627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3647786-d01e-469e-b16e-4c001ce961ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:47.116037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647786-d01e-469e-b16e-4c001ce961ed admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.119918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647786-d01e-469e-b16e-4c001ce961ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.120170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647786-d01e-469e-b16e-4c001ce961ed admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.121243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3647786-d01e-469e-b16e-4c001ce961ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:47.124012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3647786-d01e-469e-b16e-4c001ce961ed admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:47.165702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2814/5705] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:47.170081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:47.189313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd9de-9018-4af1-93ec-0190f36dac8e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:47.202480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:47.206425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.206750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.207029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] PATH_INFO: `/v3/projects/52045466ff5a448bbe6bee3e973103e9/users/68705fab60834128b5815314347eb271/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.212175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52045466ff5a448bbe6bee3e973103e9, user_id=68705fab60834128b5815314347eb271, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:47.221138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:47.257455 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2892/5706] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:47 2022] PUT /identity/v3/projects/52045466ff5a448bbe6bee3e973103e9/users/68705fab60834128b5815314347eb271/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:47.263727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2d991-2b3d-44c7-9f93-0969ec8f4e37 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.264651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2d991-2b3d-44c7-9f93-0969ec8f4e37 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.265215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2d991-2b3d-44c7-9f93-0969ec8f4e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.304108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4fc2d991-2b3d-44c7-9f93-0969ec8f4e37 None None] MFA Rules not processed for user `68705fab60834128b5815314347eb271`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:47.308030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4fc2d991-2b3d-44c7-9f93-0969ec8f4e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:47.420848 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2815/5707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:47.422921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:47.441159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1670a5d-d327-46ad-a32a-44c5fef0b75e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:47.443452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:47.444469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.444914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.445414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.446698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:47.449008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:47.509649 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2893/5708] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:13:47 2022] POST /identity/v3/projects => generated 328 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:47.516666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2d991-2b3d-44c7-9f93-0969ec8f4e37 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:47.530746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2d991-2b3d-44c7-9f93-0969ec8f4e37 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:47.670807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:47.671211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.671554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.672073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.672841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:47.675109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:47.707273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2816/5709] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:47 2022] POST /identity/v3/users => generated 416 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:47.711506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:47.722195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d2d8-7850-4da7-b449-256694244ee6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:47.727816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:47.729629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.729629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.729629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.730538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:47.731894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:47.754839 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2894/5710] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:47 2022] POST /identity/v3/roles => generated 244 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:47.759035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:47.772559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a05e4-934e-4fdf-8ea7-4818e9b3365b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:47.777919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:47.778885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.779196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.779470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.780357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:47.782170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:47.806973 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2817/5711] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:47 2022] POST /identity/v3/roles => generated 247 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:47.812439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:47.827560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a4c9-5071-4b51-98ea-186696c73de3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:47.834712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:47.835655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:47.836082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:47.836398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/eb8990428c9b4e77a96155d0b7ebabd9/users/beec22e52b174d58805cb478d78a3204/roles/ca24328581804a63aabfdee57275867f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:47.866947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eb8990428c9b4e77a96155d0b7ebabd9, user_id=beec22e52b174d58805cb478d78a3204, role_id=ca24328581804a63aabfdee57275867f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:47.870285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:47.903730 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2895/5712] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:47 2022] PUT /identity/v3/projects/eb8990428c9b4e77a96155d0b7ebabd9/users/beec22e52b174d58805cb478d78a3204/roles/ca24328581804a63aabfdee57275867f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:47.909579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:47.928988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd254d8-0e76-443a-b311-3630c390b0d2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:48.021194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753133bc-bef5-4d05-8719-9e48ef761ada tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:48.022534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753133bc-bef5-4d05-8719-9e48ef761ada tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:48.022678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753133bc-bef5-4d05-8719-9e48ef761ada tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:48.023485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753133bc-bef5-4d05-8719-9e48ef761ada tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/eb8990428c9b4e77a96155d0b7ebabd9/users/beec22e52b174d58805cb478d78a3204/roles/11b0a4d356844d12be7085071ba0a273` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:48.026460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753133bc-bef5-4d05-8719-9e48ef761ada tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eb8990428c9b4e77a96155d0b7ebabd9, user_id=beec22e52b174d58805cb478d78a3204, role_id=11b0a4d356844d12be7085071ba0a273)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:48.030783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753133bc-bef5-4d05-8719-9e48ef761ada tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:48.055665 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2818/5713] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:47 2022] PUT /identity/v3/projects/eb8990428c9b4e77a96155d0b7ebabd9/users/beec22e52b174d58805cb478d78a3204/roles/11b0a4d356844d12be7085071ba0a273 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:48.060317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:48.076246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09af8c7-9258-40fe-9a79-a7ccfcc21a69 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:48.180415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c6e99-4049-475d-8fed-330c39345c9e tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:48.181253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c6e99-4049-475d-8fed-330c39345c9e tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:48.181405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c6e99-4049-475d-8fed-330c39345c9e tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:48.181673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c6e99-4049-475d-8fed-330c39345c9e tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:48.182646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c6e99-4049-475d-8fed-330c39345c9e tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:48.183703 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d74c6e99-4049-475d-8fed-330c39345c9e tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:48.183703 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:13:48.183703 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:13:48.184912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c6e99-4049-475d-8fed-330c39345c9e tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:48.236424 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2896/5714] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:48 2022] GET /identity/v3/users => generated 8639 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:48.243457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88cba2-29fe-47b6-890a-bc71219de057 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:48.243873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88cba2-29fe-47b6-890a-bc71219de057 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:48.244833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88cba2-29fe-47b6-890a-bc71219de057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:48.368867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2c88cba2-29fe-47b6-890a-bc71219de057 None None] MFA Rules not processed for user `beec22e52b174d58805cb478d78a3204`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:48.369832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2c88cba2-29fe-47b6-890a-bc71219de057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:48.481182 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2819/5715] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:48.487877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3740a0-2589-464e-bf10-303c711efb03 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:48.488286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3740a0-2589-464e-bf10-303c711efb03 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:48.488540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3740a0-2589-464e-bf10-303c711efb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:48.512047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bf3740a0-2589-464e-bf10-303c711efb03 None None] MFA Rules not processed for user `beec22e52b174d58805cb478d78a3204`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:48.514814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bf3740a0-2589-464e-bf10-303c711efb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:48.524193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2897/5716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:48.529551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88cba2-29fe-47b6-890a-bc71219de057 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:48.540179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88cba2-29fe-47b6-890a-bc71219de057 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:48.550545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beec22e52b174d58805cb478d78a3204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb8990428c9b4e77a96155d0b7ebabd9', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1232980583', 'tempest-DelegatedRole-1503604936'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:48.551609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:48.552156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:48.552459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:48.553299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] RBAC: Authorizing `identity:create_trust()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:48.554591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:48.929560 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2820/5717] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 21:13:48 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:48.931297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3740a0-2589-464e-bf10-303c711efb03 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:48.943487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3740a0-2589-464e-bf10-303c711efb03 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:48.948236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:48.948915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:48.949264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:48.949571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:48.950286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:48.951357 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:13:48.951357 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:13:48.951357 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:13:48.952441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:48.961100 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2898/5718] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 21:13:48 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:13:48.964223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:48.977544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649a5d-18bd-4c0f-b84d-058be6989572 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:48.982506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beec22e52b174d58805cb478d78a3204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb8990428c9b4e77a96155d0b7ebabd9', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1232980583', 'tempest-DelegatedRole-1503604936'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:48.983714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:48.984229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:48.984564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] PATH_INFO: `/v3/OS-TRUST/trusts/111e67bbb5904a268879989b8a7ead23` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:48.998200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] RBAC: Authorizing `identity:delete_trust(trust_id=111e67bbb5904a268879989b8a7ead23)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:49.000549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:49.038752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '111e67bbb5904a268879989b8a7ead23', 'request_id': 'req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.039757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '111e67bbb5904a268879989b8a7ead23', 'request_id': 'req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.040569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '111e67bbb5904a268879989b8a7ead23', 'request_id': 'req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.064566 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2821/5719] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:13:48 2022] DELETE /identity/v3/OS-TRUST/trusts/111e67bbb5904a268879989b8a7ead23 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:49.068569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:49.071559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:49.088613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6012eb-922b-403f-8ccf-42b427d53a16 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:49.094786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beec22e52b174d58805cb478d78a3204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb8990428c9b4e77a96155d0b7ebabd9', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1232980583', 'tempest-DelegatedRole-1503604936'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:49.095830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:49.096373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:49.097098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] PATH_INFO: `/v3/OS-TRUST/trusts/111e67bbb5904a268879989b8a7ead23` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:49.114871 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Could not find trust: 111e67bbb5904a268879989b8a7ead23.: keystone.exception.TrustNotFound: Could not find trust: 111e67bbb5904a268879989b8a7ead23. Apr 09 21:13:49.120029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2899/5720] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:13:49 2022] GET /identity/v3/OS-TRUST/trusts/111e67bbb5904a268879989b8a7ead23 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:13:49.122950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:49.124575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:49.147554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6ae3-6b62-4f2e-ae7f-5d99ff146943 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:49.152910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:49.153874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:49.154157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:49.154425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/11b0a4d356844d12be7085071ba0a273` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:49.156144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=11b0a4d356844d12be7085071ba0a273)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:49.157842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:49.217537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role 11b0a4d356844d12be7085071ba0a273 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:49.217891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.218987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.224924 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2822/5721] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:49 2022] DELETE /identity/v3/roles/11b0a4d356844d12be7085071ba0a273 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:49.226300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:49.228431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:49.250019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd3688-97a4-467e-b3eb-2353f5397488 tempest-TrustsV3TestJSON-136113960 tempest-user-1546646109] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:49.322020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:49.323047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:49.323533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:49.323828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/ca24328581804a63aabfdee57275867f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:49.325871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ca24328581804a63aabfdee57275867f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:49.327582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:49.376329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role ca24328581804a63aabfdee57275867f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:49.376884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.377766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.380165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2900/5722] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:49 2022] DELETE /identity/v3/roles/ca24328581804a63aabfdee57275867f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:49.385207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:49.398796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327936fd-4da3-4385-bb1e-45076cc70ca8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:49.498372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:49.499454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:49.499794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:49.500129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users/beec22e52b174d58805cb478d78a3204` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:49.502353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_user(user_id=beec22e52b174d58805cb478d78a3204)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:49.504775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:49.562827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beec22e52b174d58805cb478d78a3204'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.564056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beec22e52b174d58805cb478d78a3204'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.575008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beec22e52b174d58805cb478d78a3204'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.577587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beec22e52b174d58805cb478d78a3204'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.591086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beec22e52b174d58805cb478d78a3204'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.615176 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2823/5723] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:49 2022] DELETE /identity/v3/users/beec22e52b174d58805cb478d78a3204 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:49.619636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:49.621162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:49.635904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18075529-e5b6-4096-b9c7-a2204e2b674b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:49.777435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:49.794128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:49.794467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:49.794752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/eb8990428c9b4e77a96155d0b7ebabd9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:49.799842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eb8990428c9b4e77a96155d0b7ebabd9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:49.802306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:49.926992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8990428c9b4e77a96155d0b7ebabd9', 'request_id': 'req-af9244dc-a937-43ac-b38c-a98058621014'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.938426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8990428c9b4e77a96155d0b7ebabd9', 'request_id': 'req-af9244dc-a937-43ac-b38c-a98058621014'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.953673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8990428c9b4e77a96155d0b7ebabd9', 'request_id': 'req-af9244dc-a937-43ac-b38c-a98058621014'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.983200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] The token cache is being invalidate because project eb8990428c9b4e77a96155d0b7ebabd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:49.983501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.985764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:49.988186 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2901/5724] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:49 2022] DELETE /identity/v3/projects/eb8990428c9b4e77a96155d0b7ebabd9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:49.994030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:49.997264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:50.027686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4834f-5c49-4149-9400-014a7cce006f tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:50.145751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:50.147113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.147716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.147852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.149002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:50.154963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:50.203013 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2824/5725] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:13:49 2022] POST /identity/v3/projects => generated 328 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:50.204142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:50.205863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:50.223612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9244dc-a937-43ac-b38c-a98058621014 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:50.295246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:50.298008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.298492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.298939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.300152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:50.302150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:50.339498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2902/5726] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:50 2022] POST /identity/v3/users => generated 416 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:50.344116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:50.359541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7c516-5347-42cc-b91a-3442b40cbb41 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:50.369929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:50.370891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.371173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.371587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.372583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:50.374443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:50.394252 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2825/5727] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:50 2022] POST /identity/v3/roles => generated 244 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:50.398289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:50.420543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033fc9f-cf13-4cb3-ae74-8def0f0ccd50 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:50.429196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:50.430574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.431137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.431698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.434360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:50.438016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:50.468931 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2903/5728] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:50 2022] POST /identity/v3/roles => generated 247 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:50.469863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:50.482519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ebe01-55e4-4476-a4fb-c3636593fda2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:50.488484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:50.489504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.490059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.490328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/0a105b33414f425482981273ff8efd34/users/b19f123701674d989af8a57d6fc59aa6/roles/1a0b846edaa64b7cb65d3b427ee8f89a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.510514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0a105b33414f425482981273ff8efd34, user_id=b19f123701674d989af8a57d6fc59aa6, role_id=1a0b846edaa64b7cb65d3b427ee8f89a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:50.514339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:50.532813 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2826/5729] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:50 2022] PUT /identity/v3/projects/0a105b33414f425482981273ff8efd34/users/b19f123701674d989af8a57d6fc59aa6/roles/1a0b846edaa64b7cb65d3b427ee8f89a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:50.538035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:50.554986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb0ff-5f30-4c75-b069-15dfa8249a84 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:50.627854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a55e6-07ac-4efe-9fd2-bcbbd0000bd3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:50.628820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a55e6-07ac-4efe-9fd2-bcbbd0000bd3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.629142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a55e6-07ac-4efe-9fd2-bcbbd0000bd3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.629422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a55e6-07ac-4efe-9fd2-bcbbd0000bd3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/0a105b33414f425482981273ff8efd34/users/b19f123701674d989af8a57d6fc59aa6/roles/ac982961463345bca2336077084ce9f0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.650160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a55e6-07ac-4efe-9fd2-bcbbd0000bd3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0a105b33414f425482981273ff8efd34, user_id=b19f123701674d989af8a57d6fc59aa6, role_id=ac982961463345bca2336077084ce9f0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:50.653721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a55e6-07ac-4efe-9fd2-bcbbd0000bd3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:50.678866 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2904/5730] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:50 2022] PUT /identity/v3/projects/0a105b33414f425482981273ff8efd34/users/b19f123701674d989af8a57d6fc59aa6/roles/ac982961463345bca2336077084ce9f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:50.682941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:50.696413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4317d9-d6c8-4d44-9e50-f5d5e47c291d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:50.771324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecca121-415f-476d-a94a-be08a1ed7da8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:50.772234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecca121-415f-476d-a94a-be08a1ed7da8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.772522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecca121-415f-476d-a94a-be08a1ed7da8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.772805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecca121-415f-476d-a94a-be08a1ed7da8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.773632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecca121-415f-476d-a94a-be08a1ed7da8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:50.776240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecca121-415f-476d-a94a-be08a1ed7da8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:50.816008 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2827/5731] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:50 2022] GET /identity/v3/users => generated 8639 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:50.821322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332f4bd-be6b-44f2-9270-2a02a5435b52 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.821937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332f4bd-be6b-44f2-9270-2a02a5435b52 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.822225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332f4bd-be6b-44f2-9270-2a02a5435b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.872555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c332f4bd-be6b-44f2-9270-2a02a5435b52 None None] MFA Rules not processed for user `b19f123701674d989af8a57d6fc59aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:50.874060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c332f4bd-be6b-44f2-9270-2a02a5435b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:50.956932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115b76-1594-44a7-a148-129ac85fe66f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.957206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115b76-1594-44a7-a148-129ac85fe66f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.957479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115b76-1594-44a7-a148-129ac85fe66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:50.977508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d2115b76-1594-44a7-a148-129ac85fe66f None None] MFA Rules not processed for user `a6dcb8344fde4e4580e73efc09e633a7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:50.978727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d2115b76-1594-44a7-a148-129ac85fe66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:50.992727 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2905/5732] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:50.994504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5918-9e20-47f6-acd2-a950b0f07941 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:50.994802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5918-9e20-47f6-acd2-a950b0f07941 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:50.995083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5918-9e20-47f6-acd2-a950b0f07941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:51.022970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a1be5918-9e20-47f6-acd2-a950b0f07941 None None] MFA Rules not processed for user `b19f123701674d989af8a57d6fc59aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:51.024745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a1be5918-9e20-47f6-acd2-a950b0f07941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:51.056597 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2906/5733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:51.061267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be5918-9e20-47f6-acd2-a950b0f07941 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:51.086812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be5918-9e20-47f6-acd2-a950b0f07941 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:51.101546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b19f123701674d989af8a57d6fc59aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a105b33414f425482981273ff8efd34', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1602845203', 'tempest-NotDelegatedRole-1142088044'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:51.105069 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2828/5734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:51.105256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:51.105256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:51.105476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:51.106473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: Authorizing `identity:create_trust()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:51.109521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:51.225983 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2907/5735] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 21:13:51 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:51.229975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115b76-1594-44a7-a148-129ac85fe66f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:51.241783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115b76-1594-44a7-a148-129ac85fe66f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:51.248980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b19f123701674d989af8a57d6fc59aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a105b33414f425482981273ff8efd34', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1602845203', 'tempest-NotDelegatedRole-1142088044'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:51.250652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:51.251305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:51.251942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:51.252815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:51.254525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:51.282111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:51.285609 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2829/5736] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Apr 9 21:13:51 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=b19f123701674d989af8a57d6fc59aa6 => generated 611 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:51.300457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa7f2-f952-4c83-a8c7-9ed55eefc84f tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:51.313128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b19f123701674d989af8a57d6fc59aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a105b33414f425482981273ff8efd34', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1602845203', 'tempest-NotDelegatedRole-1142088044'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:51.314013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:51.314294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:51.314567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] PATH_INFO: `/v3/OS-TRUST/trusts/9277015da5bc44ca9ead77e7c0034b8d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:51.332169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: Authorizing `identity:delete_trust(trust_id=9277015da5bc44ca9ead77e7c0034b8d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:51.333979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:51.389937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9277015da5bc44ca9ead77e7c0034b8d', 'request_id': 'req-bf844437-1a95-4367-80af-980b9a6d5326'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:51.391496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '9277015da5bc44ca9ead77e7c0034b8d', 'request_id': 'req-bf844437-1a95-4367-80af-980b9a6d5326'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:51.407715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9277015da5bc44ca9ead77e7c0034b8d', 'request_id': 'req-bf844437-1a95-4367-80af-980b9a6d5326'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:51.423456 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2908/5737] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:13:51 2022] DELETE /identity/v3/OS-TRUST/trusts/9277015da5bc44ca9ead77e7c0034b8d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:51.436295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:51.442595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:51.466394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df83a28-4056-467a-9335-0836394a195e tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:51.482992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b19f123701674d989af8a57d6fc59aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a105b33414f425482981273ff8efd34', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1602845203', 'tempest-NotDelegatedRole-1142088044'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:51.484972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:51.485321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:51.485693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] PATH_INFO: `/v3/OS-TRUST/trusts/9277015da5bc44ca9ead77e7c0034b8d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:51.504833 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Could not find trust: 9277015da5bc44ca9ead77e7c0034b8d.: keystone.exception.TrustNotFound: Could not find trust: 9277015da5bc44ca9ead77e7c0034b8d. Apr 09 21:13:51.506433 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2830/5738] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:13:51 2022] GET /identity/v3/OS-TRUST/trusts/9277015da5bc44ca9ead77e7c0034b8d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:13:51.511112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:51.513284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:51.539038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844437-1a95-4367-80af-980b9a6d5326 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:51.547244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:51.549370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:51.550164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:51.550853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/ac982961463345bca2336077084ce9f0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:51.554649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ac982961463345bca2336077084ce9f0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:51.560805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:51.654973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role ac982961463345bca2336077084ce9f0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:51.655421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:51.656225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:51.659566 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2909/5739] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:51 2022] DELETE /identity/v3/roles/ac982961463345bca2336077084ce9f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:51.664375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:51.666947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:51.712798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e0df-43dd-4be8-a022-dc255d05ce84 tempest-TrustsV3TestJSON-937159355 tempest-user-1867012978] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:51.864907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:51.865999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:51.866220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:51.866464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/1a0b846edaa64b7cb65d3b427ee8f89a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:51.868021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1a0b846edaa64b7cb65d3b427ee8f89a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:51.876479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:51.964601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role 1a0b846edaa64b7cb65d3b427ee8f89a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:51.965115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:51.966057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:51.968195 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2831/5740] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:51 2022] DELETE /identity/v3/roles/1a0b846edaa64b7cb65d3b427ee8f89a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:51.972923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:52.008020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ef98-2340-458b-ab61-08bbcd9ff29c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:52.037179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:52.040232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:52.112144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:52.113248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:52.113874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:52.114355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users/b19f123701674d989af8a57d6fc59aa6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:52.116007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b19f123701674d989af8a57d6fc59aa6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:52.118582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:52.180453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2d18-08e9-4a96-a07f-e8855f6b0994 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:52.193350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:52.196938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:52.200584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:52.201985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] PATH_INFO: `/v3/users/74311b56951549df8388565bff4a5499` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:52.206792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=74311b56951549df8388565bff4a5499)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:52.213013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:52.228609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19f123701674d989af8a57d6fc59aa6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.229758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19f123701674d989af8a57d6fc59aa6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.252278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19f123701674d989af8a57d6fc59aa6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.273385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19f123701674d989af8a57d6fc59aa6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.274143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19f123701674d989af8a57d6fc59aa6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.312896 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2910/5741] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:51 2022] DELETE /identity/v3/users/b19f123701674d989af8a57d6fc59aa6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:52.314839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74311b56951549df8388565bff4a5499'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.317197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:52.317757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74311b56951549df8388565bff4a5499'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.321249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:52.334062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74311b56951549df8388565bff4a5499'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.349778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74311b56951549df8388565bff4a5499'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.369710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09f1eacd-5c83-49ab-970e-27c7df50e41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74311b56951549df8388565bff4a5499'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.411599 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2832/5742] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:52 2022] DELETE /identity/v3/users/74311b56951549df8388565bff4a5499 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:52.415861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:52.416399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:52.416944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:52.466406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:52.467675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:52.479246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff6199-a584-4466-b966-b8afd6fa5073 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:52.572191 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2833/5743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:52.580685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:52.581675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:52.582016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:52.582293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/0a105b33414f425482981273ff8efd34` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:52.583581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a105b33414f425482981273ff8efd34)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:52.585920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:52.593547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:52.595014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:52.715365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a105b33414f425482981273ff8efd34', 'request_id': 'req-c3a02feb-b4a1-44c0-92d3-6964324b9c30'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.731067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3ce62-6465-40bc-bab6-436a45c64a93 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:52.732451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a105b33414f425482981273ff8efd34', 'request_id': 'req-c3a02feb-b4a1-44c0-92d3-6964324b9c30'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.751409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a105b33414f425482981273ff8efd34', 'request_id': 'req-c3a02feb-b4a1-44c0-92d3-6964324b9c30'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.773853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] The token cache is being invalidate because project 0a105b33414f425482981273ff8efd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:52.774490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.777547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:52.784207 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2911/5744] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:52 2022] DELETE /identity/v3/projects/0a105b33414f425482981273ff8efd34 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:52.786909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:52.789118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:52.826658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:52.827336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:52.827617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:52.827890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:52.831975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:52.908621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a02feb-b4a1-44c0-92d3-6964324b9c30 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:52.914952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:52.915887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:52.916228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:52.916573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:52.917453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:52.926675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:52.949859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:52.951660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:52.965610 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2834/5745] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:52.979838 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2912/5746] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:13:52 2022] POST /identity/v3/projects => generated 329 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:52.982517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:52.999119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea430-5a77-4634-89c4-8bb4b1cef401 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:53.173445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:53.174155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:53.174440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:53.174715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:53.175428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:53.177438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:53.249119 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2835/5747] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:52 2022] POST /identity/v3/users => generated 416 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:53.252506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:53.275704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f681df6-35c3-475e-8078-645b3e0bb94a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:53.293478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:53.294194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:53.294480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:53.294761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:53.295532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:53.298781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:53.338238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:53.339029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2913/5748] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:53 2022] POST /identity/v3/roles => generated 243 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:53.359001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14024ace-c84e-492e-a704-3a96d54bca9a tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:53.364467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:53.365548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:53.366042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:53.366503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:53.367461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:53.369474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:53.402679 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2836/5749] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:53 2022] POST /identity/v3/roles => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:53.404018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:53.416088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b0001-5851-4da4-9066-cbab0f2526ae tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:53.422175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:53.423565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:53.424028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:53.426912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/4576c26b194b4c1bad6cfced14cbc23d/users/3cc80b9805a64d2c86d962c7e20a25b5/roles/9a58ff9aab1149279c198d36d4d4c086` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:53.451568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4576c26b194b4c1bad6cfced14cbc23d, user_id=3cc80b9805a64d2c86d962c7e20a25b5, role_id=9a58ff9aab1149279c198d36d4d4c086)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:53.455811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:53.489947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:53.495787 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2914/5750] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:53 2022] PUT /identity/v3/projects/4576c26b194b4c1bad6cfced14cbc23d/users/3cc80b9805a64d2c86d962c7e20a25b5/roles/9a58ff9aab1149279c198d36d4d4c086 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:53.503476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0afcb0-1ca1-441f-af4f-d6b884f89b39 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:53.598410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a247bee-0a67-455f-ae9a-997638f12d11 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:53.600541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247bee-0a67-455f-ae9a-997638f12d11 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:53.600541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247bee-0a67-455f-ae9a-997638f12d11 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:53.601221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247bee-0a67-455f-ae9a-997638f12d11 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/4576c26b194b4c1bad6cfced14cbc23d/users/3cc80b9805a64d2c86d962c7e20a25b5/roles/806afa03ead34424a1cdcb198738eccf` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:53.603844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247bee-0a67-455f-ae9a-997638f12d11 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4576c26b194b4c1bad6cfced14cbc23d, user_id=3cc80b9805a64d2c86d962c7e20a25b5, role_id=806afa03ead34424a1cdcb198738eccf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:53.607078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247bee-0a67-455f-ae9a-997638f12d11 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:53.666437 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2837/5751] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:53 2022] PUT /identity/v3/projects/4576c26b194b4c1bad6cfced14cbc23d/users/3cc80b9805a64d2c86d962c7e20a25b5/roles/806afa03ead34424a1cdcb198738eccf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:53.671230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:53.708490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118ed2-8eb2-4229-bbdd-aa3de6a7b597 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:53.790141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9a02c-fa9b-47d8-a1bf-6537c80cbafa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:53.791149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9a02c-fa9b-47d8-a1bf-6537c80cbafa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:53.791462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9a02c-fa9b-47d8-a1bf-6537c80cbafa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:53.791944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9a02c-fa9b-47d8-a1bf-6537c80cbafa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:53.792880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9a02c-fa9b-47d8-a1bf-6537c80cbafa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:53.795810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9a02c-fa9b-47d8-a1bf-6537c80cbafa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:53.854478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f76b-1bd6-46f3-990a-2a98fcb23f5d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:53.855072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f76b-1bd6-46f3-990a-2a98fcb23f5d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:53.855222 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2915/5752] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:53 2022] GET /identity/v3/users => generated 8361 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:53.855351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f76b-1bd6-46f3-990a-2a98fcb23f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:53.935830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3aa0f76b-1bd6-46f3-990a-2a98fcb23f5d None None] MFA Rules not processed for user `3cc80b9805a64d2c86d962c7e20a25b5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:53.937107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3aa0f76b-1bd6-46f3-990a-2a98fcb23f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:54.075679 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2838/5753] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:54.184203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.184552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.184748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.208994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] MFA Rules not processed for user `3cc80b9805a64d2c86d962c7e20a25b5`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:54.212202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:54.234725 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2916/5754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:54.235974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0f76b-1bd6-46f3-990a-2a98fcb23f5d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.250987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0f76b-1bd6-46f3-990a-2a98fcb23f5d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.265019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.265834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.266207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.266574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.267584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:create_trust()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.268873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.282254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.284072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:54.431544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2839/5755] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 21:13:54 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:54.435584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.452860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782eb93-ab65-41aa-8abf-acc0578a1d7c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.454771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa349c-f5d2-471d-9059-22123fb0b6b2 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.464788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.465366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.465742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.466109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.469077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.469987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.470260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.470530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] PATH_INFO: `/v3/projects/9bd28da6b23940dc816d678fc6f2b9db` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.472520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd28da6b23940dc816d678fc6f2b9db)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.473748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:get_trust(trust_id=847b1d63720245bcbbd2607b1b30b45f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.475681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.479856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.485807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2840/5756] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:13:54 2022] GET /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f => generated 858 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:54.489911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.503391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ccb2-aa68-4b5c-ba6b-cc608d7f05e4 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.510125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.511261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.512165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.512578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.520292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=847b1d63720245bcbbd2607b1b30b45f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.524891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.537811 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2841/5757] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:13:54 2022] GET /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:54.542584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.556498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc75a7-5b1a-4135-9c92-a308c34c1ee8 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.563818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.564998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.565531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.565905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/9a58ff9aab1149279c198d36d4d4c086` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.574247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:get_role_for_trust(trust_id=847b1d63720245bcbbd2607b1b30b45f, role_id=9a58ff9aab1149279c198d36d4d4c086)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.577065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.593880 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2842/5758] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Apr 9 21:13:54 2022] GET /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/9a58ff9aab1149279c198d36d4d4c086 => generated 243 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:54.609283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.614984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd28da6b23940dc816d678fc6f2b9db', 'request_id': 'req-47391026-5c21-4a8d-b173-ff68eb9b817f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:54.635605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7bc3-3cb6-4799-8c1a-5a588c2433e0 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.636533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd28da6b23940dc816d678fc6f2b9db', 'request_id': 'req-47391026-5c21-4a8d-b173-ff68eb9b817f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:54.652428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd28da6b23940dc816d678fc6f2b9db', 'request_id': 'req-47391026-5c21-4a8d-b173-ff68eb9b817f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:54.669024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] The token cache is being invalidate because project 9bd28da6b23940dc816d678fc6f2b9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:54.669482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:54.672419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-47391026-5c21-4a8d-b173-ff68eb9b817f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:54.674415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2917/5759] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:54 2022] DELETE /identity/v3/projects/9bd28da6b23940dc816d678fc6f2b9db => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:54.680087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad985d-9fcf-437c-bb84-b240ac0b4f01 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.680504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad985d-9fcf-437c-bb84-b240ac0b4f01 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.680895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad985d-9fcf-437c-bb84-b240ac0b4f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.714977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4aad985d-9fcf-437c-bb84-b240ac0b4f01 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:54.716362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4aad985d-9fcf-437c-bb84-b240ac0b4f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:54.764305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.765214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.765491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.765762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/9a58ff9aab1149279c198d36d4d4c086` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.777278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:get_role_for_trust(trust_id=847b1d63720245bcbbd2607b1b30b45f, role_id=9a58ff9aab1149279c198d36d4d4c086)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.782800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.800533 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2843/5760] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Apr 9 21:13:54 2022] HEAD /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/9a58ff9aab1149279c198d36d4d4c086 => generated 0 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 09 21:13:54.805088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.809625 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2918/5761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:54.817647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:54.818434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737293-df83-4314-b920-ee250ca528d1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.818732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737293-df83-4314-b920-ee250ca528d1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.819017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737293-df83-4314-b920-ee250ca528d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.839136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed666df-205f-4683-a6c8-68ec5821b36d tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.841750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d2737293-df83-4314-b920-ee250ca528d1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:54.843002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d2737293-df83-4314-b920-ee250ca528d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:54.850247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.851118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.853419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.853705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/806afa03ead34424a1cdcb198738eccf` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.861074 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2919/5762] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:54.861991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2737293-df83-4314-b920-ee250ca528d1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.868265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:get_role_for_trust(trust_id=847b1d63720245bcbbd2607b1b30b45f, role_id=806afa03ead34424a1cdcb198738eccf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.873229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.873591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2737293-df83-4314-b920-ee250ca528d1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.882186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.883423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.883729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.884011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.884772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:13:54.885121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.890056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.911634 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Could not find role: 806afa03ead34424a1cdcb198738eccf.: keystone.exception.RoleNotFound: Could not find role: 806afa03ead34424a1cdcb198738eccf. Apr 09 21:13:54.913397 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2844/5763] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Apr 9 21:13:54 2022] GET /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/806afa03ead34424a1cdcb198738eccf => generated 110 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:13:54.921949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2920/5764] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:13:54.926227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.928669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:54.939416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662d2f-8abe-4e3f-9818-75ae9e0b6e13 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.946944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.948015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.948365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.948847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.949149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c0122-8211-4e12-902b-499d7489f51e tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:54.949776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.951962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.961011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:54.962133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:54.963054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:54.963410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/806afa03ead34424a1cdcb198738eccf` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:54.970525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:get_role_for_trust(trust_id=847b1d63720245bcbbd2607b1b30b45f, role_id=806afa03ead34424a1cdcb198738eccf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:54.972701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:54.994044 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Could not find role: 806afa03ead34424a1cdcb198738eccf.: keystone.exception.RoleNotFound: Could not find role: 806afa03ead34424a1cdcb198738eccf. Apr 09 21:13:54.995716 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2845/5765] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Apr 9 21:13:54 2022] HEAD /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f/roles/806afa03ead34424a1cdcb198738eccf => generated 0 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:13:55.000000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.010902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb650578-e033-4caa-a54e-54f64649f612 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.011163 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2921/5766] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:13:54 2022] POST /identity/v3/projects => generated 397 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:55.012423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.074909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.075854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.076205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.076574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.083028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorizing `identity:delete_trust(trust_id=847b1d63720245bcbbd2607b1b30b45f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.084560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.092987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40500de-2912-4ac1-9b41-602878300881 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.098729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.099767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.100079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.100336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.101103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.103275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.103780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '847b1d63720245bcbbd2607b1b30b45f', 'request_id': 'req-75462fad-b4b2-4aba-a054-3cde12b99567'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.104945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '847b1d63720245bcbbd2607b1b30b45f', 'request_id': 'req-75462fad-b4b2-4aba-a054-3cde12b99567'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.105964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '847b1d63720245bcbbd2607b1b30b45f', 'request_id': 'req-75462fad-b4b2-4aba-a054-3cde12b99567'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.133217 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2922/5767] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:55 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:55.137361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.139418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.139590 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2846/5768] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:13:54 2022] DELETE /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:55.144067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.145657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.159849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acdc18-e040-4bd2-b9f7-4f103389f699 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.161314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462fad-b4b2-4aba-a054-3cde12b99567 tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.166027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.167505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.167816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cc80b9805a64d2c86d962c7e20a25b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4576c26b194b4c1bad6cfced14cbc23d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-278489039', 'tempest-NotDelegatedRole-1349892032'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.167975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.168266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.168806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.169000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.169148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.169381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] PATH_INFO: `/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.170733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.187534 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Could not find trust: 847b1d63720245bcbbd2607b1b30b45f.: keystone.exception.TrustNotFound: Could not find trust: 847b1d63720245bcbbd2607b1b30b45f. Apr 09 21:13:55.194009 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2923/5769] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:55 2022] GET /identity/v3/roles => generated 1892 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:55.194265 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2847/5770] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:13:55 2022] GET /identity/v3/OS-TRUST/trusts/847b1d63720245bcbbd2607b1b30b45f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:13:55.194382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.195205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.197047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.205161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91d8d-23c8-41d1-bec2-fb5ea211568a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.212580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.213537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.215676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.216042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.216965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.219029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.243387 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2924/5771] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:55 2022] GET /identity/v3/roles => generated 1892 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:13:55.247607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.258030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c91e-0e9d-48fe-a9e2-ffd525a84891 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.263624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e3c7b-237d-43e1-8aac-28a8f510ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.264990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3c7b-237d-43e1-8aac-28a8f510ee33 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.265404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3c7b-237d-43e1-8aac-28a8f510ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.265805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3c7b-237d-43e1-8aac-28a8f510ee33 admin admin] PATH_INFO: `/v3/projects/2a99dd8eb54240c69d3976399e19d953/users/db0c3b4e104d4040bf14e1e200deb2be/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.291648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e3c7b-237d-43e1-8aac-28a8f510ee33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a99dd8eb54240c69d3976399e19d953, user_id=db0c3b4e104d4040bf14e1e200deb2be, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.297935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e3c7b-237d-43e1-8aac-28a8f510ee33 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.307717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405370d-8238-41dd-8ad9-5f9a59b441ff tempest-TrustsV3TestJSON-1742673856 tempest-user-1252819269] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.323665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.324812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.325411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.325627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/806afa03ead34424a1cdcb198738eccf` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.328860 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2925/5772] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:55 2022] PUT /identity/v3/projects/2a99dd8eb54240c69d3976399e19d953/users/db0c3b4e104d4040bf14e1e200deb2be/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:55.329268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=806afa03ead34424a1cdcb198738eccf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.332637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.339823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.341083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.341709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.390481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] MFA Rules not processed for user `db0c3b4e104d4040bf14e1e200deb2be`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:55.393682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.410194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role 806afa03ead34424a1cdcb198738eccf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:55.410542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.411508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.414425 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2848/5773] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:55 2022] DELETE /identity/v3/roles/806afa03ead34424a1cdcb198738eccf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:55.419459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.420535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.503323 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2926/5774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:55.508388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596248d-90c7-40f7-b71c-6e03748aaef6 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.515849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.516501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.517004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.517575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.517721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/9a58ff9aab1149279c198d36d4d4c086` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.518756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.519330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9a58ff9aab1149279c198d36d4d4c086)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.521565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.590906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role 9a58ff9aab1149279c198d36d4d4c086 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:55.591189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.593183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.599388 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2849/5775] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:55 2022] DELETE /identity/v3/roles/9a58ff9aab1149279c198d36d4d4c086 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:55.602764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.607692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.648593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a989a-1548-4f71-84b3-d6dea5ce9918 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.731729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.732738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.733980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.736213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.741403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:55.767400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666994-5835-420d-b9f1-ef725344cf25 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:55.773448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:55.774649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:55.775136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:55.775639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users/3cc80b9805a64d2c86d962c7e20a25b5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:55.777547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3cc80b9805a64d2c86d962c7e20a25b5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.779733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.857204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:55.859061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:55.873163 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2927/5776] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:13:55.875724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc80b9805a64d2c86d962c7e20a25b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.876461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc80b9805a64d2c86d962c7e20a25b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.887212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc80b9805a64d2c86d962c7e20a25b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.888132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc80b9805a64d2c86d962c7e20a25b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.903659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc80b9805a64d2c86d962c7e20a25b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:55.947065 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2850/5777] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:55 2022] DELETE /identity/v3/users/3cc80b9805a64d2c86d962c7e20a25b5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:55.951226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:55.970174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bcf8a-2ad9-4c4d-81aa-eeb7079c363d service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:56.057810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:56.058783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:56.059065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:56.059335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/4576c26b194b4c1bad6cfced14cbc23d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:56.060708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4576c26b194b4c1bad6cfced14cbc23d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:56.062728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:56.157717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4576c26b194b4c1bad6cfced14cbc23d', 'request_id': 'req-96dee48f-d872-41b6-9a0f-fc4213c63797'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:56.171768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4576c26b194b4c1bad6cfced14cbc23d', 'request_id': 'req-96dee48f-d872-41b6-9a0f-fc4213c63797'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:56.190424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4576c26b194b4c1bad6cfced14cbc23d', 'request_id': 'req-96dee48f-d872-41b6-9a0f-fc4213c63797'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:56.207147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] The token cache is being invalidate because project 4576c26b194b4c1bad6cfced14cbc23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:56.207485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:56.209802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:56.213135 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2928/5778] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:55 2022] DELETE /identity/v3/projects/4576c26b194b4c1bad6cfced14cbc23d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:56.218940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:56.220385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:56.256236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b28e7-de33-4bfd-86bf-e4eff1132ee0 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:56.430553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:56.432733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:56.435235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:56.435235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:56.437474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:56.442747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:56.507680 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2851/5779] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:13:56 2022] POST /identity/v3/projects => generated 329 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:56.508622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:56.514978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:56.550601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee48f-d872-41b6-9a0f-fc4213c63797 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:56.712925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:56.714180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:56.715731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:56.717336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:56.718484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:56.724301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:56.790936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2929/5780] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:56 2022] POST /identity/v3/users => generated 413 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:56.795645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:56.810426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a94ca-7687-421f-9a19-4df9baf489de tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:56.818870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:56.819872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:56.820366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:56.820875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:56.822546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:56.824575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:56.859770 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2852/5781] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:56 2022] POST /identity/v3/roles => generated 244 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:56.865670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:56.885982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534977-44c5-4303-9694-6e6726fc9a6d tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:56.892820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:56.894227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:56.894579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:56.894914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:56.895843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:56.898230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:56.958300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:56.959181 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2930/5782] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:56 2022] POST /identity/v3/roles => generated 247 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:56.975824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff59e8-ff70-42c9-9029-cf1e06022385 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:56.986600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:56.987734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:56.990993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:56.991275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/041ef8ed9a6a49b588c1851411f46eb8/users/892737d6c112479780b3e91d5c2db3ab/roles/d25441af40b04928a54f801bc66c2846` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:57.034389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=041ef8ed9a6a49b588c1851411f46eb8, user_id=892737d6c112479780b3e91d5c2db3ab, role_id=d25441af40b04928a54f801bc66c2846)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:57.040389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:57.078087 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2853/5783] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:56 2022] PUT /identity/v3/projects/041ef8ed9a6a49b588c1851411f46eb8/users/892737d6c112479780b3e91d5c2db3ab/roles/d25441af40b04928a54f801bc66c2846 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:57.082457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:57.106462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507440eb-bcf1-4ffb-af97-773562b06b13 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:57.211430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3979-61f5-43ba-97e5-5f02a9585ec5 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:57.212316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3979-61f5-43ba-97e5-5f02a9585ec5 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:57.212605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3979-61f5-43ba-97e5-5f02a9585ec5 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:57.212882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3979-61f5-43ba-97e5-5f02a9585ec5 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/041ef8ed9a6a49b588c1851411f46eb8/users/892737d6c112479780b3e91d5c2db3ab/roles/bf7251c0c0c049fea8b4a4e79700e221` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:57.215957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3979-61f5-43ba-97e5-5f02a9585ec5 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=041ef8ed9a6a49b588c1851411f46eb8, user_id=892737d6c112479780b3e91d5c2db3ab, role_id=bf7251c0c0c049fea8b4a4e79700e221)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:57.218228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3979-61f5-43ba-97e5-5f02a9585ec5 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:57.240368 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2931/5784] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:57 2022] PUT /identity/v3/projects/041ef8ed9a6a49b588c1851411f46eb8/users/892737d6c112479780b3e91d5c2db3ab/roles/bf7251c0c0c049fea8b4a4e79700e221 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:57.244660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:57.260338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f705-723c-48b8-b721-58d551324c9b tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:57.374281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a0bae-79ac-4587-8f51-e51255999efa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:57.376856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0bae-79ac-4587-8f51-e51255999efa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:57.381645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0bae-79ac-4587-8f51-e51255999efa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:57.383483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0bae-79ac-4587-8f51-e51255999efa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:57.385937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a0bae-79ac-4587-8f51-e51255999efa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:57.392553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a0bae-79ac-4587-8f51-e51255999efa tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:57.465814 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2854/5785] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:57 2022] GET /identity/v3/users => generated 8648 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:57.470006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d934-4b76-4765-adba-0e25ab83ec15 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:57.470161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d934-4b76-4765-adba-0e25ab83ec15 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:57.470455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d934-4b76-4765-adba-0e25ab83ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:57.528161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a408d934-4b76-4765-adba-0e25ab83ec15 None None] MFA Rules not processed for user `892737d6c112479780b3e91d5c2db3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:57.530447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a408d934-4b76-4765-adba-0e25ab83ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:57.641282 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2932/5786] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:57.651468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589fca-b65b-4b27-a860-2701e5994f38 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:57.652112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589fca-b65b-4b27-a860-2701e5994f38 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:57.652402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589fca-b65b-4b27-a860-2701e5994f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:57.679839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1f589fca-b65b-4b27-a860-2701e5994f38 None None] MFA Rules not processed for user `892737d6c112479780b3e91d5c2db3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:57.684370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1f589fca-b65b-4b27-a860-2701e5994f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:57.710542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408d934-4b76-4765-adba-0e25ab83ec15 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:57.719393 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2855/5787] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:57.725456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408d934-4b76-4765-adba-0e25ab83ec15 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:57.732717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892737d6c112479780b3e91d5c2db3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041ef8ed9a6a49b588c1851411f46eb8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2137974552', 'tempest-DelegatedRole-1122308506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:57.734702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:57.737227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:57.738016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:57.744185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] RBAC: Authorizing `identity:create_trust()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:57.744185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:57.876313 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Apr 09 21:13:57.878611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2933/5788] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 21:13:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 168 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:13:57.884018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589fca-b65b-4b27-a860-2701e5994f38 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:57.906300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589fca-b65b-4b27-a860-2701e5994f38 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:57.934343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:57.935385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:57.935680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:57.937844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/bf7251c0c0c049fea8b4a4e79700e221` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:57.939463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bf7251c0c0c049fea8b4a4e79700e221)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:57.941525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:58.050051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role bf7251c0c0c049fea8b4a4e79700e221 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:58.050771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.052013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.065161 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2856/5789] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:57 2022] DELETE /identity/v3/roles/bf7251c0c0c049fea8b4a4e79700e221 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:58.066256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:58.072216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:58.109733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489d6dc-b30f-4934-b230-73d2a3093b85 tempest-TrustsV3TestJSON-1599623185 tempest-user-930510040] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:58.202939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:58.205415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:58.206802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:58.208894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/d25441af40b04928a54f801bc66c2846` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:58.210875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d25441af40b04928a54f801bc66c2846)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:58.212748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:58.274780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role d25441af40b04928a54f801bc66c2846 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:58.275065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.275739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.278442 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2934/5790] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:58 2022] DELETE /identity/v3/roles/d25441af40b04928a54f801bc66c2846 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:58.283324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:58.295098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee0ea1-ed13-4895-9778-4c5bca38b4ab tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:58.384918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:58.387498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:58.387872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:58.388342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users/892737d6c112479780b3e91d5c2db3ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:58.390440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_user(user_id=892737d6c112479780b3e91d5c2db3ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:58.394915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:58.458340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892737d6c112479780b3e91d5c2db3ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.459097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892737d6c112479780b3e91d5c2db3ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.466782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892737d6c112479780b3e91d5c2db3ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.467730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892737d6c112479780b3e91d5c2db3ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.477767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892737d6c112479780b3e91d5c2db3ab'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.499339 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2857/5791] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:13:58 2022] DELETE /identity/v3/users/892737d6c112479780b3e91d5c2db3ab => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:13:58.504198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:58.514721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:58.543161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5730955-e4d3-4024-8763-c736950c120c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:58.637860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:58.638787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:58.639194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:58.641988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/041ef8ed9a6a49b588c1851411f46eb8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:58.646060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=041ef8ed9a6a49b588c1851411f46eb8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:58.649120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:58.712236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041ef8ed9a6a49b588c1851411f46eb8', 'request_id': 'req-d842b991-394a-45ee-8664-11f7acaf1615'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.718443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041ef8ed9a6a49b588c1851411f46eb8', 'request_id': 'req-d842b991-394a-45ee-8664-11f7acaf1615'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.729358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041ef8ed9a6a49b588c1851411f46eb8', 'request_id': 'req-d842b991-394a-45ee-8664-11f7acaf1615'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.745335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] The token cache is being invalidate because project 041ef8ed9a6a49b588c1851411f46eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:13:58.745680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.746316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:13:58.748106 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2935/5792] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:13:58 2022] DELETE /identity/v3/projects/041ef8ed9a6a49b588c1851411f46eb8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:58.754291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:58.755823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:58.772048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10816a6-5084-4238-9fe8-155c34d71279 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:58.853063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:58.853994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:58.854280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:58.854553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:58.855266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:58.857840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:58.891979 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2858/5793] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:13:58 2022] POST /identity/v3/projects => generated 329 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:58.896069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:58.897674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:58.913146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842b991-394a-45ee-8664-11f7acaf1615 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:58.973233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:58.973804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:58.974433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:58.974704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:58.975413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:58.977404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:59.011193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2936/5794] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:13:58 2022] POST /identity/v3/users => generated 413 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:13:59.012638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:59.026575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ed1f-84ed-4905-ba1c-dea58a8ec998 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:59.032696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:59.033996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.034386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.034534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.035288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:59.036904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:59.066815 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2859/5795] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:59 2022] POST /identity/v3/roles => generated 243 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:59.068810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:59.085460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051439-ff48-4eb5-bbf5-f0cd07aa02b2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:59.097997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:59.098704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.099332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.099608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.100387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:59.102356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:59.130342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2937/5796] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:13:59 2022] POST /identity/v3/roles => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:13:59.134712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:59.149264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234f37-3938-4ddb-bb04-35fb385c7ecf tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:59.161818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:59.163268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.164046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.164574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/f1866e32365344239e46c4bbb46b7400/users/6fa13605ba5b4cc0a2f3876b9af23d2e/roles/d664075917b24a95b3a583ad00c3da0f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.195291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f1866e32365344239e46c4bbb46b7400, user_id=6fa13605ba5b4cc0a2f3876b9af23d2e, role_id=d664075917b24a95b3a583ad00c3da0f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:59.199644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:59.227564 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2860/5797] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:59 2022] PUT /identity/v3/projects/f1866e32365344239e46c4bbb46b7400/users/6fa13605ba5b4cc0a2f3876b9af23d2e/roles/d664075917b24a95b3a583ad00c3da0f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:59.232438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:59.260960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c3483-a84d-4509-8af9-ce3d58b3c4b3 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:59.355709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b2dfb-63d6-4ef9-804f-456d8a623210 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:59.358017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b2dfb-63d6-4ef9-804f-456d8a623210 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.358700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b2dfb-63d6-4ef9-804f-456d8a623210 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.359245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b2dfb-63d6-4ef9-804f-456d8a623210 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/f1866e32365344239e46c4bbb46b7400/users/6fa13605ba5b4cc0a2f3876b9af23d2e/roles/3f5ad9606ce445a7b182695c62fcd299` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.362790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b2dfb-63d6-4ef9-804f-456d8a623210 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f1866e32365344239e46c4bbb46b7400, user_id=6fa13605ba5b4cc0a2f3876b9af23d2e, role_id=3f5ad9606ce445a7b182695c62fcd299)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:59.369994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b2dfb-63d6-4ef9-804f-456d8a623210 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:59.404457 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2938/5798] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:13:59 2022] PUT /identity/v3/projects/f1866e32365344239e46c4bbb46b7400/users/6fa13605ba5b4cc0a2f3876b9af23d2e/roles/3f5ad9606ce445a7b182695c62fcd299 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:13:59.408202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:59.448557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c593e6-6597-43ff-8a72-e59df88533c1 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:59.592530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e037a3-654d-4eea-b50e-41f5dd365914 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:59.593527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e037a3-654d-4eea-b50e-41f5dd365914 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.593813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e037a3-654d-4eea-b50e-41f5dd365914 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.594087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e037a3-654d-4eea-b50e-41f5dd365914 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.594846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e037a3-654d-4eea-b50e-41f5dd365914 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:59.597608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e037a3-654d-4eea-b50e-41f5dd365914 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:13:59.676147 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2861/5799] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:13:59 2022] GET /identity/v3/users => generated 8648 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:13:59.678865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834eb41-5f58-40b9-b6fd-49646584247d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.679346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834eb41-5f58-40b9-b6fd-49646584247d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.679469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834eb41-5f58-40b9-b6fd-49646584247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.724820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5834eb41-5f58-40b9-b6fd-49646584247d None None] MFA Rules not processed for user `6fa13605ba5b4cc0a2f3876b9af23d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:59.726105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5834eb41-5f58-40b9-b6fd-49646584247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:59.837311 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2939/5800] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:13:59.848004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f39604-b334-4561-bcf5-d8efcde05d42 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.848475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f39604-b334-4561-bcf5-d8efcde05d42 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.848706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f39604-b334-4561-bcf5-d8efcde05d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.870003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-82f39604-b334-4561-bcf5-d8efcde05d42 None None] MFA Rules not processed for user `6fa13605ba5b4cc0a2f3876b9af23d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:13:59.871595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-82f39604-b334-4561-bcf5-d8efcde05d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:13:59.881807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2862/5801] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:13:59.886384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834eb41-5f58-40b9-b6fd-49646584247d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:13:59.897250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834eb41-5f58-40b9-b6fd-49646584247d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:13:59.903347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:13:59.904037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:13:59.904320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:13:59.904593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:13:59.905413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:create_trust()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:13:59.906733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.005106 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2940/5802] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 21:13:59 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:00.008214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f39604-b334-4561-bcf5-d8efcde05d42 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.018636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f39604-b334-4561-bcf5-d8efcde05d42 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.024660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.025891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.026332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.026763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.033411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:get_trust(trust_id=63c3d12bf5bf4027b57e41a2b5b88d64)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.034899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.042009 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2863/5803] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:14:00 2022] GET /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64 => generated 833 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:00.046357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.056039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750f5b6-01da-4afe-a6c6-72c7bc80a5a8 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.060373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.061207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.061490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.061764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.068484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=63c3d12bf5bf4027b57e41a2b5b88d64)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.070292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.078758 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2941/5804] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:14:00 2022] GET /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles => generated 370 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:00.083097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.093777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9a0ee-8ba7-488f-8b39-fdb2036ab005 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.102036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.103354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.103711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.104084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/d664075917b24a95b3a583ad00c3da0f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.110752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63c3d12bf5bf4027b57e41a2b5b88d64, role_id=d664075917b24a95b3a583ad00c3da0f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.112334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.119220 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2864/5805] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Apr 9 21:14:00 2022] GET /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/d664075917b24a95b3a583ad00c3da0f => generated 243 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:00.123479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.140423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbdb6-cf07-4ea6-92d5-0177a741868e tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.145281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.146650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.146939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.147219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/d664075917b24a95b3a583ad00c3da0f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.154117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63c3d12bf5bf4027b57e41a2b5b88d64, role_id=d664075917b24a95b3a583ad00c3da0f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.156272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.164014 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2942/5806] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Apr 9 21:14:00 2022] HEAD /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/d664075917b24a95b3a583ad00c3da0f => generated 0 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 09 21:14:00.168345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.178891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbed4e9-0307-44e3-88ce-b3cf6087ffff tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.184995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.186545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.186946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.187316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/3f5ad9606ce445a7b182695c62fcd299` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.195957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63c3d12bf5bf4027b57e41a2b5b88d64, role_id=3f5ad9606ce445a7b182695c62fcd299)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.197656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.214760 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Could not find role: 3f5ad9606ce445a7b182695c62fcd299.: keystone.exception.RoleNotFound: Could not find role: 3f5ad9606ce445a7b182695c62fcd299. Apr 09 21:14:00.216877 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2865/5807] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Apr 9 21:14:00 2022] GET /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/3f5ad9606ce445a7b182695c62fcd299 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:14:00.220964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.232208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609159c-8205-4742-a49f-e33cfee7f9d6 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.238482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.238791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.239138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.239474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/3f5ad9606ce445a7b182695c62fcd299` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.245907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63c3d12bf5bf4027b57e41a2b5b88d64, role_id=3f5ad9606ce445a7b182695c62fcd299)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.247623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.265474 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Could not find role: 3f5ad9606ce445a7b182695c62fcd299.: keystone.exception.RoleNotFound: Could not find role: 3f5ad9606ce445a7b182695c62fcd299. Apr 09 21:14:00.267030 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2943/5808] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Apr 9 21:14:00 2022] HEAD /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64/roles/3f5ad9606ce445a7b182695c62fcd299 => generated 0 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:14:00.271326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.296345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ff2c-8cd6-4bc0-aeca-4b385e6e5a7a tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.321381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.322263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.322550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.322826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.331985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorizing `identity:delete_trust(trust_id=63c3d12bf5bf4027b57e41a2b5b88d64)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.334556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.364483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '63c3d12bf5bf4027b57e41a2b5b88d64', 'request_id': 'req-dffb7184-e1e7-42f2-a766-dbce5e3540e1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.369657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '63c3d12bf5bf4027b57e41a2b5b88d64', 'request_id': 'req-dffb7184-e1e7-42f2-a766-dbce5e3540e1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.370490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '63c3d12bf5bf4027b57e41a2b5b88d64', 'request_id': 'req-dffb7184-e1e7-42f2-a766-dbce5e3540e1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.410616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2866/5809] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:14:00 2022] DELETE /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:00.415519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.417925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:00.448858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743336b-7c3b-4944-a553-1e3e0ba43e94 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.460182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa13605ba5b4cc0a2f3876b9af23d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1866e32365344239e46c4bbb46b7400', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1689536756', 'tempest-DelegatedRole-864142613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.461205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.461679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.462033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] PATH_INFO: `/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.476900 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Could not find trust: 63c3d12bf5bf4027b57e41a2b5b88d64.: keystone.exception.TrustNotFound: Could not find trust: 63c3d12bf5bf4027b57e41a2b5b88d64. Apr 09 21:14:00.478254 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2944/5810] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:14:00 2022] GET /identity/v3/OS-TRUST/trusts/63c3d12bf5bf4027b57e41a2b5b88d64 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:14:00.482638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.484236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:00.502169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb7184-e1e7-42f2-a766-dbce5e3540e1 tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.508798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.510744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.511324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.511907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/3f5ad9606ce445a7b182695c62fcd299` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.514320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3f5ad9606ce445a7b182695c62fcd299)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.516438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.589558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role 3f5ad9606ce445a7b182695c62fcd299 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:00.590207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.591208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.596656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2867/5811] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:00 2022] DELETE /identity/v3/roles/3f5ad9606ce445a7b182695c62fcd299 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:00.597901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.600554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:00.633530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099a6f6-9e40-41d6-9e74-32c84f3f27cf tempest-TrustsV3TestJSON-2050334166 tempest-user-935998748] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.727725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.728720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.729078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.729344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/d664075917b24a95b3a583ad00c3da0f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.732846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d664075917b24a95b3a583ad00c3da0f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.734809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.815239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role d664075917b24a95b3a583ad00c3da0f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:00.816119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.817523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.820661 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2945/5812] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:00 2022] DELETE /identity/v3/roles/d664075917b24a95b3a583ad00c3da0f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:00.824874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:00.840082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbdcd9-6aa9-4497-bed9-8272d5749c18 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:00.911605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:00.913469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:00.914066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:00.914570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users/6fa13605ba5b4cc0a2f3876b9af23d2e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:00.916008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6fa13605ba5b4cc0a2f3876b9af23d2e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:00.918360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:00.987851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa13605ba5b4cc0a2f3876b9af23d2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:00.990124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa13605ba5b4cc0a2f3876b9af23d2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.006530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa13605ba5b4cc0a2f3876b9af23d2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.008522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa13605ba5b4cc0a2f3876b9af23d2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.028225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa13605ba5b4cc0a2f3876b9af23d2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.090042 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2868/5813] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:00 2022] DELETE /identity/v3/users/6fa13605ba5b4cc0a2f3876b9af23d2e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:01.091380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.093068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:01.109798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ace20-5905-47e9-82c3-4774834b65cc tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.183887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.184891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.185310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.185656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/f1866e32365344239e46c4bbb46b7400` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.186942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1866e32365344239e46c4bbb46b7400)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.188982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.244929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1866e32365344239e46c4bbb46b7400', 'request_id': 'req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.252236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1866e32365344239e46c4bbb46b7400', 'request_id': 'req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.261253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1866e32365344239e46c4bbb46b7400', 'request_id': 'req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.277367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] The token cache is being invalidate because project f1866e32365344239e46c4bbb46b7400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:01.277653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.278301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.284828 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2946/5814] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:01 2022] DELETE /identity/v3/projects/f1866e32365344239e46c4bbb46b7400 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:01.286096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.287650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:01.301964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14f5f0-565f-439e-8ccb-12f95fcf02ee tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.361561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.362254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.362537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.362818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.363537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.365620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.398115 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2869/5815] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:14:01 2022] POST /identity/v3/projects => generated 328 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:01.399818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.401620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:01.414774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf80a0-3bdf-44e4-a311-3e9ef318b85c tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.460504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.462681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:01.485119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.485945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.486311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.486681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.488142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.491621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.521357 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2947/5816] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:01 2022] POST /identity/v3/users => generated 413 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:01.525438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.538135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9034cc-d2d9-46cd-a534-4fa861900525 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.543206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.543898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.544234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.544519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.544652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb89ac1-b9d4-48ee-a411-2c673cd41fb2 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.545304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.547006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.550928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.551833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.552110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.552382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] PATH_INFO: `/v3/users/db0c3b4e104d4040bf14e1e200deb2be` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.553790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0c3b4e104d4040bf14e1e200deb2be)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.555709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.562577 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2948/5817] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:14:01 2022] POST /identity/v3/roles => generated 244 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:14:01.566692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.577463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44817173-7cf3-4354-899a-7e560538b1ca tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.582774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.583484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.583752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.584028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.584772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.586492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.607582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2949/5818] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:14:01 2022] POST /identity/v3/roles => generated 246 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:14:01.608610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.609012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0c3b4e104d4040bf14e1e200deb2be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.609797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0c3b4e104d4040bf14e1e200deb2be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.617183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0c3b4e104d4040bf14e1e200deb2be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.617863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0c3b4e104d4040bf14e1e200deb2be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.627677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4336ffd5-5ae5-4afd-b50c-b26db56c37aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0c3b4e104d4040bf14e1e200deb2be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:01.628735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f5c2-e110-4b9c-a769-501d90849174 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.637451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.638550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.638830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.639095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/81beabe61d1e4be384b21c761ff420db/users/970c44c6aa174df78d8644a8bbf7ba19/roles/3bfff0e83c334defb6c20f50db999579` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.649175 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2870/5819] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:01 2022] DELETE /identity/v3/users/db0c3b4e104d4040bf14e1e200deb2be => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:01.651349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.651652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.651924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.656377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=81beabe61d1e4be384b21c761ff420db, user_id=970c44c6aa174df78d8644a8bbf7ba19, role_id=3bfff0e83c334defb6c20f50db999579)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.659087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.672914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:01.674289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:01.677302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2950/5820] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:01 2022] PUT /identity/v3/projects/81beabe61d1e4be384b21c761ff420db/users/970c44c6aa174df78d8644a8bbf7ba19/roles/3bfff0e83c334defb6c20f50db999579 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:01.681373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.683064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:01.749711 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2871/5821] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:01.756364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17d011-b641-4cf4-84eb-075acfbab4e8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.756860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.758042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:01.771975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.773452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.773801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.774148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/81beabe61d1e4be384b21c761ff420db/users/970c44c6aa174df78d8644a8bbf7ba19/roles/232ad7017add4a33b7d1728e8acf8ea0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.781409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=81beabe61d1e4be384b21c761ff420db, user_id=970c44c6aa174df78d8644a8bbf7ba19, role_id=232ad7017add4a33b7d1728e8acf8ea0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.781409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.805743 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2951/5822] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:01 2022] PUT /identity/v3/projects/81beabe61d1e4be384b21c761ff420db/users/970c44c6aa174df78d8644a8bbf7ba19/roles/232ad7017add4a33b7d1728e8acf8ea0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:01.808441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:01.833987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c619-2553-401a-8204-d34eb772a5e8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.895920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b87a6e-d44c-41c0-9a07-2bbad20a7d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.896591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b87a6e-d44c-41c0-9a07-2bbad20a7d93 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.897234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b87a6e-d44c-41c0-9a07-2bbad20a7d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.897234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b87a6e-d44c-41c0-9a07-2bbad20a7d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.903646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639808-2cd4-4226-bbaf-a2438d98a6b8 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:01.920081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a500c-5ced-47b6-8894-5464aa0d0f14 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:01.920983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a500c-5ced-47b6-8894-5464aa0d0f14 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.921376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a500c-5ced-47b6-8894-5464aa0d0f14 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.921724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a500c-5ced-47b6-8894-5464aa0d0f14 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:01.922571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a500c-5ced-47b6-8894-5464aa0d0f14 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.924555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a500c-5ced-47b6-8894-5464aa0d0f14 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.966959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b87a6e-d44c-41c0-9a07-2bbad20a7d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:01.968630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b87a6e-d44c-41c0-9a07-2bbad20a7d93 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:01.983194 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2952/5823] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:01 2022] GET /identity/v3/users => generated 8358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:01.983346 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2872/5824] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:14:01.986349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83085e-e285-4da4-b0bc-a4d71e578fa9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:01.986768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83085e-e285-4da4-b0bc-a4d71e578fa9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:01.987299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83085e-e285-4da4-b0bc-a4d71e578fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.046203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0f83085e-e285-4da4-b0bc-a4d71e578fa9 None None] MFA Rules not processed for user `970c44c6aa174df78d8644a8bbf7ba19`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:02.047618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0f83085e-e285-4da4-b0bc-a4d71e578fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.156832 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2953/5825] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:02.165676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.166231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.167596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.204371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] MFA Rules not processed for user `970c44c6aa174df78d8644a8bbf7ba19`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:02.205985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.215641 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2873/5826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:02.220431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83085e-e285-4da4-b0bc-a4d71e578fa9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.233326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83085e-e285-4da4-b0bc-a4d71e578fa9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.238334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.238995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.239255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.239509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.240254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:create_trust()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.241478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.314633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.316613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.342115 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2954/5827] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 21:14:02 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:02.342472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fb09-2b25-489a-859c-fb4c0732ef2f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.344395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.349720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.352050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.353286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.353816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] PATH_INFO: `/v3/projects/2a99dd8eb54240c69d3976399e19d953` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.355744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a99dd8eb54240c69d3976399e19d953)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.357509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9beb4e-35a2-42bc-be43-c5b0e6b1a510 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.359635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.362764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.364018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.364295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.364700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.372266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:get_trust(trust_id=6f2cd4da5753412d8b1e2f2913e0bf6f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.374195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.387367 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2955/5828] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f => generated 835 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:02.388495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.402603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78afaed-08e6-42cb-9280-7fb734c953f7 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.407713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.408857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.409184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.409461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.419944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6f2cd4da5753412d8b1e2f2913e0bf6f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.421754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.433796 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2956/5829] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles => generated 371 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:02.443728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.464046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22183db5-fc6e-4c54-8d2a-78d9ecd71b02 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.472200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a99dd8eb54240c69d3976399e19d953', 'request_id': 'req-13157d36-5f87-4072-b02c-440382a6917f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.482402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a99dd8eb54240c69d3976399e19d953', 'request_id': 'req-13157d36-5f87-4072-b02c-440382a6917f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.494042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a99dd8eb54240c69d3976399e19d953', 'request_id': 'req-13157d36-5f87-4072-b02c-440382a6917f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.512614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] The token cache is being invalidate because project 2a99dd8eb54240c69d3976399e19d953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:02.513001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.513716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13157d36-5f87-4072-b02c-440382a6917f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.515620 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2874/5830] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:02 2022] DELETE /identity/v3/projects/2a99dd8eb54240c69d3976399e19d953 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:02.523749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a82f7-53fc-4dc0-baf3-4f12a458bac8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.524315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a82f7-53fc-4dc0-baf3-4f12a458bac8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.524748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a82f7-53fc-4dc0-baf3-4f12a458bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.545472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2f5a82f7-53fc-4dc0-baf3-4f12a458bac8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:02.549951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.550423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.550701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.550977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/3bfff0e83c334defb6c20f50db999579` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.551717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2f5a82f7-53fc-4dc0-baf3-4f12a458bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.558320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6f2cd4da5753412d8b1e2f2913e0bf6f, role_id=3bfff0e83c334defb6c20f50db999579)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.560260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.569948 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2957/5831] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/3bfff0e83c334defb6c20f50db999579 => generated 244 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:02.574507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.576791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.591044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47d4c3-9022-4864-962c-e9a90b82eb36 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.597264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.598295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.598577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.599179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/3bfff0e83c334defb6c20f50db999579` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.606957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6f2cd4da5753412d8b1e2f2913e0bf6f, role_id=3bfff0e83c334defb6c20f50db999579)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.609820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.619498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2958/5832] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Apr 9 21:14:02 2022] HEAD /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/3bfff0e83c334defb6c20f50db999579 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 09 21:14:02.623690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.633069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bff64a-7ee3-4b31-91bd-3d73fa6f8c38 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.633292 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2875/5833] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:02.642725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95671db5-b6f8-493a-a97f-9361a5d05b0a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.643298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95671db5-b6f8-493a-a97f-9361a5d05b0a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.643595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95671db5-b6f8-493a-a97f-9361a5d05b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.644435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.646552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.646868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.647211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/232ad7017add4a33b7d1728e8acf8ea0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.657128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6f2cd4da5753412d8b1e2f2913e0bf6f, role_id=232ad7017add4a33b7d1728e8acf8ea0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.658917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.668183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-95671db5-b6f8-493a-a97f-9361a5d05b0a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:02.670084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95671db5-b6f8-493a-a97f-9361a5d05b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.676872 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Could not find role: 232ad7017add4a33b7d1728e8acf8ea0.: keystone.exception.RoleNotFound: Could not find role: 232ad7017add4a33b7d1728e8acf8ea0. Apr 09 21:14:02.681214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2959/5834] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/232ad7017add4a33b7d1728e8acf8ea0 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:14:02.683134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2876/5835] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:02.683781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.684086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95671db5-b6f8-493a-a97f-9361a5d05b0a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.693508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95671db5-b6f8-493a-a97f-9361a5d05b0a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.694482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76896f72-af88-4e4a-95a5-a44e8aaf8953 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.698717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.699536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.699878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.700245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.701068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:14:02.701454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.701657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.702468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.702744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.703010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/232ad7017add4a33b7d1728e8acf8ea0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.704104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.711105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6f2cd4da5753412d8b1e2f2913e0bf6f, role_id=232ad7017add4a33b7d1728e8acf8ea0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.712623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.719612 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2877/5836] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:02.724610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.729175 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Could not find role: 232ad7017add4a33b7d1728e8acf8ea0.: keystone.exception.RoleNotFound: Could not find role: 232ad7017add4a33b7d1728e8acf8ea0. Apr 09 21:14:02.733350 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2960/5837] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Apr 9 21:14:02 2022] HEAD /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f/roles/232ad7017add4a33b7d1728e8acf8ea0 => generated 0 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:14:02.735200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.742095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49e18-addd-42e3-a0c2-9e881652a311 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.746059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b03c2-6327-4a2c-8229-2242d2ac0389 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.747518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.748257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.748673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.749014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.749824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.752033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.754145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.755303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.755815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.756682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.765811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorizing `identity:delete_trust(trust_id=6f2cd4da5753412d8b1e2f2913e0bf6f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.767680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.789264 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2878/5838] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:02 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:02.791205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.794643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6f2cd4da5753412d8b1e2f2913e0bf6f', 'request_id': 'req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.795377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6f2cd4da5753412d8b1e2f2913e0bf6f', 'request_id': 'req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.807813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6f2cd4da5753412d8b1e2f2913e0bf6f', 'request_id': 'req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:02.822372 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2961/5839] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:14:02 2022] DELETE /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:02.823357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.825440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.841645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b92e8-635f-4fdf-91c9-4a4fddcc4e65 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.891460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beba6b1-d9f2-4db8-b4f2-2be8f7310d46 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.896664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.897757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.898080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.898412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.899137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.901164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.912253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '970c44c6aa174df78d8644a8bbf7ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81beabe61d1e4be384b21c761ff420db', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-264494974', 'tempest-DelegatedRole-2036008370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.912977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.913315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.913593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] PATH_INFO: `/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.923553 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2879/5840] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:02 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:14:02.926683 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Could not find trust: 6f2cd4da5753412d8b1e2f2913e0bf6f.: keystone.exception.TrustNotFound: Could not find trust: 6f2cd4da5753412d8b1e2f2913e0bf6f. Apr 09 21:14:02.927974 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2962/5841] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/OS-TRUST/trusts/6f2cd4da5753412d8b1e2f2913e0bf6f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:14:02.928394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.931886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.933705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.933846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:02.945851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48b0ae-3cab-4b14-beb0-5fe3398cd6f9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.950433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.951105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.951384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.951653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.952367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.953999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:02.964842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2880/5842] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/roles => generated 1892 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:14:02.968812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:02.978917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81f6c-b035-4b14-8e8c-86aeae1d3df4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:02.983709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:02.984372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:02.984651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:02.984914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:02.986683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:02.988284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:03.004427 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2881/5843] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:02 2022] GET /identity/v3/roles => generated 1892 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:14:03.005631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:03.008850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0129d9b-cef4-4e0f-a9e1-cbd7f51a9ae3 tempest-TrustsV3TestJSON-600767673 tempest-user-766580439] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:03.014006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:03.015094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.015448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.015818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/232ad7017add4a33b7d1728e8acf8ea0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.017431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=232ad7017add4a33b7d1728e8acf8ea0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:03.018599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8423525-60c8-4a7b-a127-d1f2c5c23a2f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:03.019570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:03.024574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688e09-9524-4dbf-ac1f-16e4ef347173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:03.025580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688e09-9524-4dbf-ac1f-16e4ef347173 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.025928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688e09-9524-4dbf-ac1f-16e4ef347173 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.026262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688e09-9524-4dbf-ac1f-16e4ef347173 admin admin] PATH_INFO: `/v3/projects/8fe14a0717bc4da1b5b0a8a79cc45ee1/users/02f94fd5c3894a26b9abd6abca1e4932/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.043141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688e09-9524-4dbf-ac1f-16e4ef347173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe14a0717bc4da1b5b0a8a79cc45ee1, user_id=02f94fd5c3894a26b9abd6abca1e4932, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:03.046204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688e09-9524-4dbf-ac1f-16e4ef347173 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:03.068402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role 232ad7017add4a33b7d1728e8acf8ea0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:03.068713 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2882/5844] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:03 2022] PUT /identity/v3/projects/8fe14a0717bc4da1b5b0a8a79cc45ee1/users/02f94fd5c3894a26b9abd6abca1e4932/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:03.069641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.072705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.074149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.074428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.074711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.075881 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2963/5845] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:02 2022] DELETE /identity/v3/roles/232ad7017add4a33b7d1728e8acf8ea0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:03.079680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:03.084010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:03.093419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:03.094813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:03.180056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490230a-f285-4919-a3df-e6689d933543 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:03.186348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:03.187425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.187589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.187985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/roles/3bfff0e83c334defb6c20f50db999579` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.189737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3bfff0e83c334defb6c20f50db999579)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:03.191605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:03.203597 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2883/5846] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:03.218422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:03.220965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:03.262211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invalidating the token cache because role 3bfff0e83c334defb6c20f50db999579 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:03.262573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.266979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.277177 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2964/5847] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:03 2022] DELETE /identity/v3/roles/3bfff0e83c334defb6c20f50db999579 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:03.278400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:03.281107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:03.335398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ff7ca-6987-4f11-8fc5-644cf8af928a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:03.394914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743fa22-a931-448e-a662-02dee92479bb tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:03.412166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:03.413135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.414702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.415640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/users/970c44c6aa174df78d8644a8bbf7ba19` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.416574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_user(user_id=970c44c6aa174df78d8644a8bbf7ba19)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:03.419809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:03.459442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:03.460420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.460701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.460976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.462862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:03.500721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970c44c6aa174df78d8644a8bbf7ba19'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.501469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970c44c6aa174df78d8644a8bbf7ba19'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.514512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970c44c6aa174df78d8644a8bbf7ba19'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.529398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970c44c6aa174df78d8644a8bbf7ba19'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.530346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970c44c6aa174df78d8644a8bbf7ba19'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.557676 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2965/5848] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:03 2022] DELETE /identity/v3/users/970c44c6aa174df78d8644a8bbf7ba19 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:03.561648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:03.564236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:03.565741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:03.567497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:03.580236 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2884/5849] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:03.670824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492d194-2f24-44bc-aeee-9146ae531083 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:03.676839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68705fab60834128b5815314347eb271', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52045466ff5a448bbe6bee3e973103e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:03.678046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.678403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.678777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] PATH_INFO: `/v3/projects/81beabe61d1e4be384b21c761ff420db` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.680344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=81beabe61d1e4be384b21c761ff420db)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:03.682305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:03.758917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81beabe61d1e4be384b21c761ff420db', 'request_id': 'req-aeababee-df01-487b-853f-ad8c1a082367'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.771056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81beabe61d1e4be384b21c761ff420db', 'request_id': 'req-aeababee-df01-487b-853f-ad8c1a082367'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.786739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81beabe61d1e4be384b21c761ff420db', 'request_id': 'req-aeababee-df01-487b-853f-ad8c1a082367'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.803333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] The token cache is being invalidate because project 81beabe61d1e4be384b21c761ff420db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:03.803666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.804358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeababee-df01-487b-853f-ad8c1a082367 tempest-TrustsV3TestJSON-743325378 tempest-TrustsV3TestJSON-743325378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:03.807510 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2966/5850] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:03 2022] DELETE /identity/v3/projects/81beabe61d1e4be384b21c761ff420db => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:03.814211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:03.815464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:03.829487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c81907-5ec9-40c3-ba82-f7bd8c95f14c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:03.913787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:03.915387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:03.915683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:03.916265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] PATH_INFO: `/v3/users/8d31683844da415fbfadfd3f0deab723` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:03.918904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d31683844da415fbfadfd3f0deab723)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:03.921309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:04.020882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d31683844da415fbfadfd3f0deab723'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:04.028392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d31683844da415fbfadfd3f0deab723'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:04.038641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d31683844da415fbfadfd3f0deab723'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:04.039588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d31683844da415fbfadfd3f0deab723'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:04.058928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d31683844da415fbfadfd3f0deab723'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:04.092608 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2885/5851] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:03 2022] DELETE /identity/v3/users/8d31683844da415fbfadfd3f0deab723 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:04.094502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71de7e-b492-4c55-b3ad-8beac2c90667 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:04.094855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71de7e-b492-4c55-b3ad-8beac2c90667 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:04.095299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71de7e-b492-4c55-b3ad-8beac2c90667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:04.120347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5a71de7e-b492-4c55-b3ad-8beac2c90667 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:04.124071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5a71de7e-b492-4c55-b3ad-8beac2c90667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:04.304425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2967/5852] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:04.322326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:04.324967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:04.424647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191978c-22ae-47ef-a754-a65892614551 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:04.430016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:04.430795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:04.431083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:04.431713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:04.469114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:04.470728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:04.482742 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2886/5853] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:05.104069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764b4d-05e9-4695-b040-148f21a1222a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:05.104652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764b4d-05e9-4695-b040-148f21a1222a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:05.104652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764b4d-05e9-4695-b040-148f21a1222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:05.139032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2c764b4d-05e9-4695-b040-148f21a1222a None None] MFA Rules not processed for user `02f94fd5c3894a26b9abd6abca1e4932`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:05.140646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2c764b4d-05e9-4695-b040-148f21a1222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:05.261958 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2968/5854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:05.268230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.269820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:05.295060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba852-9199-4b4e-9204-bf2f5044e096 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:05.306322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:05.307526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:05.308937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:05.309393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:05.315779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:05.315779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:05.391595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2887/5855] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:05 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:05.398087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c764b4d-05e9-4695-b040-148f21a1222a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.426290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c764b4d-05e9-4695-b040-148f21a1222a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:05.547617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:05.548557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:05.548963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:05.549488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:05.550407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:05.553907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:05.578468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.583663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:05.595527 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2969/5856] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:05 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:05.596812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.617796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef28dde-b828-4cb9-b6d9-054be42f5783 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:05.626208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:05.627189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:05.627577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:05.628021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:05.629055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:05.632705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:05.638182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215ed6a-67a3-452d-97ba-0dcc697b5400 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:05.645140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:05.646041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:05.646572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:05.646842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] PATH_INFO: `/v3/projects/f45b1017953240d4a746570c9fa6d64f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:05.648248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45b1017953240d4a746570c9fa6d64f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:05.650440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:05.653365 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2970/5857] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:05.654454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.668293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6110c2-e4a5-42a7-8ec8-33e5b48a315b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:05.696121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:05.697899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:05.698477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:05.699059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] PATH_INFO: `/v3/projects/5c98f02c9d934501a24a94390aceebe6/users/abbe45bd32824d3f941fb7ea08c2ea94/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:05.725256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c98f02c9d934501a24a94390aceebe6, user_id=abbe45bd32824d3f941fb7ea08c2ea94, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:05.728903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:05.753534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45b1017953240d4a746570c9fa6d64f', 'request_id': 'req-0fead3f9-b4f8-471f-8d3f-768758d7eba6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:05.762823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45b1017953240d4a746570c9fa6d64f', 'request_id': 'req-0fead3f9-b4f8-471f-8d3f-768758d7eba6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:05.782237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45b1017953240d4a746570c9fa6d64f', 'request_id': 'req-0fead3f9-b4f8-471f-8d3f-768758d7eba6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:05.786980 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2971/5858] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:05 2022] PUT /identity/v3/projects/5c98f02c9d934501a24a94390aceebe6/users/abbe45bd32824d3f941fb7ea08c2ea94/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:05.788630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.823008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] The token cache is being invalidate because project f45b1017953240d4a746570c9fa6d64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:05.823383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:05.824846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:05.840520 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2888/5859] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:05 2022] DELETE /identity/v3/projects/f45b1017953240d4a746570c9fa6d64f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:05.859931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.865552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:05.934716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e77b-face-466a-93ab-7e4ea377e3af admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:05.940161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:05.940948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:05.941333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:05.941672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:05.942466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:05.944405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:05.975697 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2972/5860] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:05.979955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:05.983230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:06.016890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b744-3a05-4650-b633-1114b4aea264 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:06.017506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead3f9-b4f8-471f-8d3f-768758d7eba6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:06.024703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:06.025620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:06.026509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:06.026702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:06.026835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:06.027051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] PATH_INFO: `/v3/projects/5c98f02c9d934501a24a94390aceebe6/users/abbe45bd32824d3f941fb7ea08c2ea94/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:06.027202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:06.027515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] PATH_INFO: `/v3/users/68705fab60834128b5815314347eb271` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:06.029698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68705fab60834128b5815314347eb271)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:06.029837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c98f02c9d934501a24a94390aceebe6, user_id=abbe45bd32824d3f941fb7ea08c2ea94, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:06.032396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:06.033598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:06.047540 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2973/5861] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:05 2022] PUT /identity/v3/projects/5c98f02c9d934501a24a94390aceebe6/users/abbe45bd32824d3f941fb7ea08c2ea94/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:06.066796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:06.072142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:06.134014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68705fab60834128b5815314347eb271'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:06.134914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68705fab60834128b5815314347eb271'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:06.147829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68705fab60834128b5815314347eb271'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:06.149786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68705fab60834128b5815314347eb271'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:06.167520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68705fab60834128b5815314347eb271'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:06.210374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2889/5862] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:05 2022] DELETE /identity/v3/users/68705fab60834128b5815314347eb271 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:06.287477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b21a5-991b-4acc-acbb-fe64d833703c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:06.383013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:06.383699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:06.383978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:06.384255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:06.386276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:06.406545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:06.408296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:06.422332 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2974/5863] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:06.754410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:06.756494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:06.849573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c584523-4ee3-48a3-8001-c9d75065126a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:06.853332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca0e9a-dec9-42c5-b084-25d56aafb6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:06.854008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0e9a-dec9-42c5-b084-25d56aafb6bf service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:06.854285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0e9a-dec9-42c5-b084-25d56aafb6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:06.854556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0e9a-dec9-42c5-b084-25d56aafb6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:06.856676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33ca0e9a-dec9-42c5-b084-25d56aafb6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:06.872092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca0e9a-dec9-42c5-b084-25d56aafb6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:06.873615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca0e9a-dec9-42c5-b084-25d56aafb6bf service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:06.885551 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2890/5864] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:07.022940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:07.024617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.067970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e0da-5055-4e03-9324-9d467bf70c1a None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.068677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e0da-5055-4e03-9324-9d467bf70c1a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.069158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e0da-5055-4e03-9324-9d467bf70c1a None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.072055 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2891/5865] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:14:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:14:07.077984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.078315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.078595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.110262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:07.112822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.141652 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2892/5866] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:07.153130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:07.155240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.162710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88144d3-cc02-45e6-863f-603ef5b9922d service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:07.184443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beadd15-fcc0-4e19-985b-9fe3e9943870 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:07.195278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:07.196616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.197684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.198401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] PATH_INFO: `/v3/projects/52045466ff5a448bbe6bee3e973103e9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.201077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cc266-d8dd-4b09-b4e4-6aa91326aa5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:07.201504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc266-d8dd-4b09-b4e4-6aa91326aa5a service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.201804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc266-d8dd-4b09-b4e4-6aa91326aa5a service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.202080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc266-d8dd-4b09-b4e4-6aa91326aa5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.203375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52045466ff5a448bbe6bee3e973103e9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:07.206703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:07.230237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cc266-d8dd-4b09-b4e4-6aa91326aa5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:07.233485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cc266-d8dd-4b09-b4e4-6aa91326aa5a service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:07.256296 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2893/5867] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:07.310756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52045466ff5a448bbe6bee3e973103e9', 'request_id': 'req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:07.318264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3f93-acf5-4b8b-bb69-cce00d8b8421 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.318836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3f93-acf5-4b8b-bb69-cce00d8b8421 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.320046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3f93-acf5-4b8b-bb69-cce00d8b8421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.327307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52045466ff5a448bbe6bee3e973103e9', 'request_id': 'req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:07.340354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52045466ff5a448bbe6bee3e973103e9', 'request_id': 'req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:07.357661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] The token cache is being invalidate because project 52045466ff5a448bbe6bee3e973103e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:07.358110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:07.358939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9060be7-5c81-4c97-9d90-9a5e29e9ed88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:07.361792 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2975/5868] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:07 2022] DELETE /identity/v3/projects/52045466ff5a448bbe6bee3e973103e9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:07.377833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bbdc9-13c1-4de0-bcd9-5b8b03aff94d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.378567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bbdc9-13c1-4de0-bcd9-5b8b03aff94d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.378940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bbdc9-13c1-4de0-bcd9-5b8b03aff94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.414032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2c6bbdc9-13c1-4de0-bcd9-5b8b03aff94d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:07.415885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2c6bbdc9-13c1-4de0-bcd9-5b8b03aff94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.418076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-924d3f93-acf5-4b8b-bb69-cce00d8b8421 None None] MFA Rules not processed for user `abbe45bd32824d3f941fb7ea08c2ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:07.419378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-924d3f93-acf5-4b8b-bb69-cce00d8b8421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.522626 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2976/5869] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:07.523885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865130-4d77-4046-8ded-8002ca2d4898 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.524268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865130-4d77-4046-8ded-8002ca2d4898 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.524456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865130-4d77-4046-8ded-8002ca2d4898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.579437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c9865130-4d77-4046-8ded-8002ca2d4898 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:07.582944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c9865130-4d77-4046-8ded-8002ca2d4898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.607044 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2977/5870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:07.609606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865130-4d77-4046-8ded-8002ca2d4898 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:07.617994 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2894/5871] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:07.619896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.620192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.620619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.632585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865130-4d77-4046-8ded-8002ca2d4898 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:07.644193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] MFA Rules not processed for user `02f94fd5c3894a26b9abd6abca1e4932`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:07.645499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.672696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:07.675971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.677282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.677775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.680017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:14:07.681455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:07.687661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:07.713220 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2895/5872] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:07.729875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:07.731329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:07.749266 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2978/5873] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:07.757108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:07.794818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce901cf-4370-4b3a-b1f1-c478e07e6970 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:07.811008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:07.812378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:07.812919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:07.815227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:07.816079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:07.818778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:07.875800 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2979/5874] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:07 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:14:07.878472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:07.925752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06390db6-4bbb-4428-a647-610e5a2ac8a2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:08.029070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7b11-9865-4053-8b51-1629f7da0f1d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:08.037610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:08.038585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:08.039002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:08.039346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:08.040349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:08.043194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:08.082692 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2980/5875] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:07 2022] POST /identity/v3/users => generated 280 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:08.084079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:08.099792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab190ca-79b6-4e55-8dd1-0b00c49f5b07 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:08.107681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:08.108481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:08.108817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:08.109128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:08.110124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:08.112630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:08.113553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494af00-17d0-47b0-93a5-b32858b7dea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:08.116314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494af00-17d0-47b0-93a5-b32858b7dea3 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:08.116702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494af00-17d0-47b0-93a5-b32858b7dea3 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:08.117619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494af00-17d0-47b0-93a5-b32858b7dea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:08.120950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2494af00-17d0-47b0-93a5-b32858b7dea3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:08.133580 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2981/5876] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:08.136537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:08.157547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4fa9-86fa-4cbc-a3c5-cb5c9fc13260 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:08.163631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:08.165254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:08.165535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:08.165807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:08.166537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:08.168495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:08.186936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2982/5877] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:08.188030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:08.235378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecb5f5-0129-4de7-8069-158600f0352e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:08.235378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:08.235676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494af00-17d0-47b0-93a5-b32858b7dea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:08.235759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:08.235825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494af00-17d0-47b0-93a5-b32858b7dea3 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:08.235886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:08.235886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] PATH_INFO: `/v3/projects/2e869ce33e9d489b9d98a5069f561d9d/users/76e611a128894c32bf30746fd9f6a930/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:08.251132 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2896/5878] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:14:08.261908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e869ce33e9d489b9d98a5069f561d9d, user_id=76e611a128894c32bf30746fd9f6a930, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:08.265230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:08.297861 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2983/5879] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:08 2022] PUT /identity/v3/projects/2e869ce33e9d489b9d98a5069f561d9d/users/76e611a128894c32bf30746fd9f6a930/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:08.299777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:08.300269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:08.300527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:08.337713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] MFA Rules not processed for user `76e611a128894c32bf30746fd9f6a930`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:08.338986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:08.417467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2897/5880] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:08.450256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:08.452325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:08.536669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd20b-399e-41de-9239-96d090b7192e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:08.541615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:08.542400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:08.542774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:08.543138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:08.557522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:08.559050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:08.571008 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2984/5881] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:35.803871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:35.806130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:35.904653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36066e0-832d-4e91-b2c5-8ae55fb5170a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:35.911685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1f28c-e617-448f-b45f-1b6a42a0de60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:35.912456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f28c-e617-448f-b45f-1b6a42a0de60 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:35.912834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f28c-e617-448f-b45f-1b6a42a0de60 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:35.913416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f28c-e617-448f-b45f-1b6a42a0de60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:35.915348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78c1f28c-e617-448f-b45f-1b6a42a0de60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:36.004119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1f28c-e617-448f-b45f-1b6a42a0de60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:36.005811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1f28c-e617-448f-b45f-1b6a42a0de60 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:36.023134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2898/5882] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:45.461931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:45.562605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6e84e-3ce6-41e2-a459-6f4df5fcf7d5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:45.567483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:45.568408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:45.568685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:45.568961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] PATH_INFO: `/v3/users/76e611a128894c32bf30746fd9f6a930` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:45.570187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e611a128894c32bf30746fd9f6a930)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:45.572145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:45.630266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e611a128894c32bf30746fd9f6a930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.630970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e611a128894c32bf30746fd9f6a930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.640884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e611a128894c32bf30746fd9f6a930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.652744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e611a128894c32bf30746fd9f6a930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.653537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e611a128894c32bf30746fd9f6a930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.678123 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2985/5883] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:45 2022] DELETE /identity/v3/users/76e611a128894c32bf30746fd9f6a930 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:45.682791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:45.683683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:45.684163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:45.706108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:45.707923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:45.752134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:45.754694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:45.796183 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2899/5884] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:45.813730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:45.815503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:45.856761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebe0ae-b3bd-415a-9b7a-4b71e7898ddf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:45.862061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:45.863188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:45.863460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:45.863735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] PATH_INFO: `/v3/users/02f94fd5c3894a26b9abd6abca1e4932` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:45.865244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f94fd5c3894a26b9abd6abca1e4932)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:45.867196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:45.905350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf73be-177a-4db9-934c-0a301002c6d8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:45.910251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:45.911250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:45.911727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:45.912872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:45.926794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:45.928648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:45.948046 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2900/5885] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:45.962348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f94fd5c3894a26b9abd6abca1e4932'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.963059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f94fd5c3894a26b9abd6abca1e4932'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.971228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f94fd5c3894a26b9abd6abca1e4932'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.984762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f94fd5c3894a26b9abd6abca1e4932'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:45.986019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f94fd5c3894a26b9abd6abca1e4932'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:46.019936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2986/5886] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:45 2022] DELETE /identity/v3/users/02f94fd5c3894a26b9abd6abca1e4932 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:47.025460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.026994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:47.040774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86bcff-95d2-4518-a746-c15833fdc94b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.102529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.104081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.104766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.105219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] PATH_INFO: `/v3/projects/2e869ce33e9d489b9d98a5069f561d9d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.106747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e869ce33e9d489b9d98a5069f561d9d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.109092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.144980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.146550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:47.177446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5f31-2b09-4cf8-86ce-ef1756642907 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.181028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e869ce33e9d489b9d98a5069f561d9d', 'request_id': 'req-e6dc5230-0f4e-4672-9836-23723d86fded'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.187830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e869ce33e9d489b9d98a5069f561d9d', 'request_id': 'req-e6dc5230-0f4e-4672-9836-23723d86fded'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.201287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e869ce33e9d489b9d98a5069f561d9d', 'request_id': 'req-e6dc5230-0f4e-4672-9836-23723d86fded'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.226561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] The token cache is being invalidate because project 2e869ce33e9d489b9d98a5069f561d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:47.226853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.227667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6dc5230-0f4e-4672-9836-23723d86fded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.232680 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2901/5887] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:47 2022] DELETE /identity/v3/projects/2e869ce33e9d489b9d98a5069f561d9d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:47.239535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc695-7dcc-4506-a379-3e56d1b0f8dc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.239828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc695-7dcc-4506-a379-3e56d1b0f8dc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.240112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc695-7dcc-4506-a379-3e56d1b0f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.276537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fdfbc695-7dcc-4506-a379-3e56d1b0f8dc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:47.278868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fdfbc695-7dcc-4506-a379-3e56d1b0f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:47.295890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.297713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.298272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.298765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] PATH_INFO: `/v3/projects/8fe14a0717bc4da1b5b0a8a79cc45ee1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.300623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe14a0717bc4da1b5b0a8a79cc45ee1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.304550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.346762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2902/5888] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:47.354770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58dd6-8fb2-4374-b881-d602dfc4315b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.355138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58dd6-8fb2-4374-b881-d602dfc4315b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.355475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58dd6-8fb2-4374-b881-d602dfc4315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.394994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a9d58dd6-8fb2-4374-b881-d602dfc4315b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:47.395946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'request_id': 'req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.403662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a9d58dd6-8fb2-4374-b881-d602dfc4315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:47.412612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'request_id': 'req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.436858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'request_id': 'req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.461847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] The token cache is being invalidate because project 8fe14a0717bc4da1b5b0a8a79cc45ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:47.463093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.464528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.467690 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2987/5889] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:47 2022] DELETE /identity/v3/projects/8fe14a0717bc4da1b5b0a8a79cc45ee1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:47.471956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.476869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:47.507768 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2903/5890] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:47.514077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58dd6-8fb2-4374-b881-d602dfc4315b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.524319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58dd6-8fb2-4374-b881-d602dfc4315b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.542293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.543346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.544450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.544907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.545874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:14:47.546363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.548190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.569822 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2904/5891] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:14:47.573985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.585534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02a15-d08b-4d63-936b-9758102dc920 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.592829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.593804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.594263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.594711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.595642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.598161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.631418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2905/5892] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:47 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:47.636849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.643110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33b27-6441-4cff-84fa-2d85d5e0f3b1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.788146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.789481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.789588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce86ea4-64d3-4920-ab30-1cf59fc83ac3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.790058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.791145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] PATH_INFO: `/v3/users/abbe45bd32824d3f941fb7ea08c2ea94` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.792964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abbe45bd32824d3f941fb7ea08c2ea94)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.796560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.797403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.797798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.798188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.799026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.799221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.801992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.843076 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2906/5893] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:47 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:47.848670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.861485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c04a52-6561-4d19-abee-9c289d67dfd4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.868062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.869189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.869618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.870329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.872741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.875058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.899236 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2907/5894] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:47.900745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.913888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abbe45bd32824d3f941fb7ea08c2ea94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.914750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8f93-d8d1-4d32-8640-18708a9b62c5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:47.915354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abbe45bd32824d3f941fb7ea08c2ea94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.924417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abbe45bd32824d3f941fb7ea08c2ea94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.927270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:47.928066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:47.928347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:47.928618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:47.929888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:47.931701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:47.937055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abbe45bd32824d3f941fb7ea08c2ea94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.937941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c0fee14-fd88-46db-b2be-a19fa5bf24c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abbe45bd32824d3f941fb7ea08c2ea94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:47.955993 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2908/5895] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:47.960422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:47.962732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:47.971771 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2988/5896] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:47 2022] DELETE /identity/v3/users/abbe45bd32824d3f941fb7ea08c2ea94 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:47.985505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f96673-2668-49b4-a895-e79ff85eac2b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:48.245595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:48.246772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:48.247152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:48.247523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] PATH_INFO: `/v3/projects/7481284e0b1f45d19d72d9516afcd39c/users/cc67ec2bc218441283689bfbb19087fb/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:48.282276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7481284e0b1f45d19d72d9516afcd39c, user_id=cc67ec2bc218441283689bfbb19087fb, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:48.286638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:48.317548 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2909/5897] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:47 2022] PUT /identity/v3/projects/7481284e0b1f45d19d72d9516afcd39c/users/cc67ec2bc218441283689bfbb19087fb/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:48.328693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:48.329240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:48.329312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:48.387262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] MFA Rules not processed for user `cc67ec2bc218441283689bfbb19087fb`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:48.390686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:48.406617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:48.408589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:48.567948 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2989/5898] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:48.581734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0f9a5-1782-4816-a3ed-dbbb9a486c61 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:48.588071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:48.588789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:48.589557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:48.590003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:48.590390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:48.591151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] PATH_INFO: `/v3/projects/5c98f02c9d934501a24a94390aceebe6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:48.592968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c98f02c9d934501a24a94390aceebe6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:48.595517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:48.703640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c98f02c9d934501a24a94390aceebe6', 'request_id': 'req-acac1363-8c1f-4908-8cae-842dcec7867b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:48.704822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b94311-3e14-4c1f-b6ed-f6c6c740e7ba None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:48.710666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c98f02c9d934501a24a94390aceebe6', 'request_id': 'req-acac1363-8c1f-4908-8cae-842dcec7867b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:48.722466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c98f02c9d934501a24a94390aceebe6', 'request_id': 'req-acac1363-8c1f-4908-8cae-842dcec7867b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:48.757889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] The token cache is being invalidate because project 5c98f02c9d934501a24a94390aceebe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:48.759339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:48.761153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-acac1363-8c1f-4908-8cae-842dcec7867b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:48.769737 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2910/5899] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:48 2022] DELETE /identity/v3/projects/5c98f02c9d934501a24a94390aceebe6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:48.776945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a017a4-0a78-4c5e-9a6f-8d175bd3cb32 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:48.777539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a017a4-0a78-4c5e-9a6f-8d175bd3cb32 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:48.777921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a017a4-0a78-4c5e-9a6f-8d175bd3cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:48.784588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:48.786344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:48.786813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:48.787239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:48.789724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:48.806093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-82a017a4-0a78-4c5e-9a6f-8d175bd3cb32 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:48.808788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-82a017a4-0a78-4c5e-9a6f-8d175bd3cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:48.886267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:48.888115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:48.920145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2911/5900] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:48.921584 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2990/5901] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:14:48.926764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347adb15-4711-48af-a851-3bcbf173d345 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:48.927047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347adb15-4711-48af-a851-3bcbf173d345 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:48.927317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347adb15-4711-48af-a851-3bcbf173d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:48.960172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-347adb15-4711-48af-a851-3bcbf173d345 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:48.962205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-347adb15-4711-48af-a851-3bcbf173d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:48.980059 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2912/5902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:48.981589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:48.992678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024b0cb-1583-498b-a433-5a7e1af2c33a service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:48.997762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:48.998453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:48.998730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:48.999098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:48.999716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:14:49.000005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.001969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.025013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2991/5903] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:49.027642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347adb15-4711-48af-a851-3bcbf173d345 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.043930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347adb15-4711-48af-a851-3bcbf173d345 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.056643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.060158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.060863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.061282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.061444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.062469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.064681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.067452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.098009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84205e-ec63-40f1-8f11-07d7702808ef admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.108544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.126024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.126315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.126598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] PATH_INFO: `/v3/users/f164063f73da486abe2f2772e8db47f9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.127977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f164063f73da486abe2f2772e8db47f9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.129995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.136748 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2913/5904] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:49 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:49.137903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.222475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f164063f73da486abe2f2772e8db47f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.223267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f164063f73da486abe2f2772e8db47f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.233650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f164063f73da486abe2f2772e8db47f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.252881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f164063f73da486abe2f2772e8db47f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.253804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cfb841ce-96ce-4c69-af6e-3c6cd90fa7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f164063f73da486abe2f2772e8db47f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.292992 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2992/5905] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:49 2022] DELETE /identity/v3/users/f164063f73da486abe2f2772e8db47f9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:49.297659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.297950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.298237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.333167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:49.346788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae0a2-468e-44b6-a912-7788fa8a40a2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.350612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.495596 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2993/5906] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:49.516378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.517833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.519562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.521359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.522374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.527505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.528448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.530643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.564669 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2914/5907] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:49 2022] POST /identity/v3/users => generated 292 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:49.567176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.571033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.585706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ec2df-7ce6-4865-83fc-b4217af1ce3c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.593894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.594877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.595903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.596185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] PATH_INFO: `/v3/users/cc67ec2bc218441283689bfbb19087fb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.597454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc67ec2bc218441283689bfbb19087fb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.600406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.629009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17035-d0a2-4c84-9c43-bee8264df1a2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.635016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.636244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.637047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.637856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.654553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.656519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.668345 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2994/5908] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:49.669648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.671304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.677859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc67ec2bc218441283689bfbb19087fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.678536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc67ec2bc218441283689bfbb19087fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.687551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549a8b1-2707-4472-911c-44e0d22b7d00 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.694476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.695480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.695985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.696458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.697561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.699620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.701621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc67ec2bc218441283689bfbb19087fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.702398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc67ec2bc218441283689bfbb19087fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.715405 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2995/5909] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:49.719753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.722257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.722684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1b2d5f76-7cd6-4640-b49f-40602bb278bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc67ec2bc218441283689bfbb19087fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:49.746796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe120d3-2024-4860-97d9-be6edf6e8c06 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.751674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2915/5910] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:14:49 2022] DELETE /identity/v3/users/cc67ec2bc218441283689bfbb19087fb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:49.757002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.757333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.757607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.761644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.764401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.764788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.765194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.766178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.773024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.787661 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2996/5911] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:49.787853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:49.787853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.788981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.801293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f0839-3241-4d3c-83c6-8686d1459996 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:49.869242 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2916/5912] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:49.897543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:49.899545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:49.903151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89bd6c-9130-498a-9cc0-824540613998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:49.904162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89bd6c-9130-498a-9cc0-824540613998 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.904517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89bd6c-9130-498a-9cc0-824540613998 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.904916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89bd6c-9130-498a-9cc0-824540613998 admin admin] PATH_INFO: `/v3/projects/a2e537a0863d43df811118a31e20609c/users/8303163dfe6c44dc8552919975c72eba/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:49.932258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89bd6c-9130-498a-9cc0-824540613998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e537a0863d43df811118a31e20609c, user_id=8303163dfe6c44dc8552919975c72eba, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:49.936495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89bd6c-9130-498a-9cc0-824540613998 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:49.967720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2997/5913] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:49 2022] PUT /identity/v3/projects/a2e537a0863d43df811118a31e20609c/users/8303163dfe6c44dc8552919975c72eba/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:49.974789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:49.975268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:49.975685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.020392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:50.022943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:50.042607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385f60b-073d-46f7-b77e-60bd5a15f18a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.131652 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2998/5914] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:50.131652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.131652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:50.133483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.134473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.134834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.135255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.145858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353c9a5-8ccd-4526-9a53-13d10ae2a044 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.147317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.149144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.152511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.153461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.153727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.153997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] PATH_INFO: `/v3/projects/97758c81f2fc433ca44911e9cdcf79e7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.155708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=97758c81f2fc433ca44911e9cdcf79e7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.160057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.167716 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2917/5915] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:50.168767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.181608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560860d-7554-420c-8b5f-ddc3146fb7e0 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.185968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14141be-8fcf-4c80-8075-7abfd31d0eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.186674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14141be-8fcf-4c80-8075-7abfd31d0eda service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.186958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14141be-8fcf-4c80-8075-7abfd31d0eda service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.187273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14141be-8fcf-4c80-8075-7abfd31d0eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.200999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14141be-8fcf-4c80-8075-7abfd31d0eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.202777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14141be-8fcf-4c80-8075-7abfd31d0eda service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.221964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2918/5916] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:50.238772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97758c81f2fc433ca44911e9cdcf79e7', 'request_id': 'req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:50.245973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97758c81f2fc433ca44911e9cdcf79e7', 'request_id': 'req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:50.258705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97758c81f2fc433ca44911e9cdcf79e7', 'request_id': 'req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:50.272515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] The token cache is being invalidate because project 97758c81f2fc433ca44911e9cdcf79e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:50.272920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:50.273861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc84f8db-ebdf-400b-9db2-e01ec27d31bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:50.275712 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 2999/5917] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:50 2022] DELETE /identity/v3/projects/97758c81f2fc433ca44911e9cdcf79e7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:50.282663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fb5e8-71bf-474d-b6ce-808ce798f00a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.282868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fb5e8-71bf-474d-b6ce-808ce798f00a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.283309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fb5e8-71bf-474d-b6ce-808ce798f00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.316274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-638fb5e8-71bf-474d-b6ce-808ce798f00a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:50.317560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-638fb5e8-71bf-474d-b6ce-808ce798f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:50.415331 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2919/5918] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:50.423570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910af52-6b48-4e32-99b9-cdb2903c074b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.424029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910af52-6b48-4e32-99b9-cdb2903c074b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.424119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910af52-6b48-4e32-99b9-cdb2903c074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.456483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2910af52-6b48-4e32-99b9-cdb2903c074b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:50.457646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2910af52-6b48-4e32-99b9-cdb2903c074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:50.466271 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3000/5919] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:50.470671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fb5e8-71bf-474d-b6ce-808ce798f00a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.481615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fb5e8-71bf-474d-b6ce-808ce798f00a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.492679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.493112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.493396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.493681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.494484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:14:50.494723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.496555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.513481 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2920/5920] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:50.516575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910af52-6b48-4e32-99b9-cdb2903c074b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.528259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910af52-6b48-4e32-99b9-cdb2903c074b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.534994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.535459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.535745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.536132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.536795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.538850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.576013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3001/5921] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:50 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:50.576207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.588011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137a60c-6e65-4cad-b8cb-4ef97e48ee43 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.703514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.704745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.705309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.705838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.723179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.733913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.776106 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2921/5922] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:50 2022] POST /identity/v3/users => generated 281 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:14:50.778802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.796908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f80a7e-278b-4345-ae46-635f57ed250d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.809859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.810566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.810847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.811114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.811844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.813531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.835131 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3002/5923] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:50.839352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.864111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bda4ff-1617-4d3b-99ae-a82eb3121dcc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.880834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.881937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.882461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.882821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.883784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.888386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.910943 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2922/5924] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:14:50.914800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.929391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85961c2-b0de-43c4-905e-ea98c829cd5a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.937849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:50.940919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:50.942371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788dcc9-12a2-414e-8075-122c4adbcd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.943411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788dcc9-12a2-414e-8075-122c4adbcd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.943780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788dcc9-12a2-414e-8075-122c4adbcd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.944147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788dcc9-12a2-414e-8075-122c4adbcd7f admin admin] PATH_INFO: `/v3/projects/5c3d71a0e0874df6bff9cee258aae5c7/users/ff17ae35e6544ab38966ede763417ab1/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.959740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e3370-9ce9-47d4-9355-07c157379150 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:50.966933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:50.968521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:50.968811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:50.969135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] PATH_INFO: `/v3/projects/7481284e0b1f45d19d72d9516afcd39c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:50.974292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788dcc9-12a2-414e-8075-122c4adbcd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3d71a0e0874df6bff9cee258aae5c7, user_id=ff17ae35e6544ab38966ede763417ab1, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.977140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788dcc9-12a2-414e-8075-122c4adbcd7f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.983747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7481284e0b1f45d19d72d9516afcd39c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:50.986149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:50.999208 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3003/5925] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:50 2022] PUT /identity/v3/projects/5c3d71a0e0874df6bff9cee258aae5c7/users/ff17ae35e6544ab38966ede763417ab1/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:51.010072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.010363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.010719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.058859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] MFA Rules not processed for user `ff17ae35e6544ab38966ede763417ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:51.060629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:51.103018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7481284e0b1f45d19d72d9516afcd39c', 'request_id': 'req-04cb93b4-60a0-4da8-bffb-73e9fa326023'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:51.120367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7481284e0b1f45d19d72d9516afcd39c', 'request_id': 'req-04cb93b4-60a0-4da8-bffb-73e9fa326023'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:51.135339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7481284e0b1f45d19d72d9516afcd39c', 'request_id': 'req-04cb93b4-60a0-4da8-bffb-73e9fa326023'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:51.161935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] The token cache is being invalidate because project 7481284e0b1f45d19d72d9516afcd39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:14:51.162230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:51.162915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-04cb93b4-60a0-4da8-bffb-73e9fa326023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:14:51.170483 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2923/5926] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:14:50 2022] DELETE /identity/v3/projects/7481284e0b1f45d19d72d9516afcd39c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:14:51.172605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e2e3-742f-4a4b-8bce-a1c25188ce0b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.173174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e2e3-742f-4a4b-8bce-a1c25188ce0b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.173461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e2e3-742f-4a4b-8bce-a1c25188ce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.199472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-19d0e2e3-742f-4a4b-8bce-a1c25188ce0b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:51.200814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-19d0e2e3-742f-4a4b-8bce-a1c25188ce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:51.207274 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3004/5927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:51.221609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:51.225115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:51.292829 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2924/5928] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:14:51.300633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee936f21-1034-4499-a0e8-9bb62fae12ca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:51.302370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c31cc-a788-4132-b99c-6e6e9b46bd87 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.302729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c31cc-a788-4132-b99c-6e6e9b46bd87 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.303102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c31cc-a788-4132-b99c-6e6e9b46bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.329563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-132c31cc-a788-4132-b99c-6e6e9b46bd87 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:51.331889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-132c31cc-a788-4132-b99c-6e6e9b46bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:51.353480 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2925/5929] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:51.354916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c31cc-a788-4132-b99c-6e6e9b46bd87 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:51.393835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:51.395853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.395853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.395853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.398959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c31cc-a788-4132-b99c-6e6e9b46bd87 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:51.416456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:51.417294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.417514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.417946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.418522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:14:51.418831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:51.424416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:51.471262 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2926/5930] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:14:51.472189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:51.497630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265488-4754-466f-8ba0-c3afd78df7e6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:51.516237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24e09-053c-46ed-805b-73520bd470f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:51.516929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24e09-053c-46ed-805b-73520bd470f0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.517239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24e09-053c-46ed-805b-73520bd470f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.517518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24e09-053c-46ed-805b-73520bd470f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.518222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24e09-053c-46ed-805b-73520bd470f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:51.520165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24e09-053c-46ed-805b-73520bd470f0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:51.543410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:51.545193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:51.558657 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3005/5931] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:14:51.591727 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2927/5932] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:51 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:51.595861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:51.618214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f64d-a82c-47cc-a7fc-216f90b7afd0 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:51.760365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:51.761819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.762326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.762919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.763934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:51.766369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:51.774327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7561c4-284b-429e-b223-e648b9c2c12b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.774430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7561c4-284b-429e-b223-e648b9c2c12b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.774659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7561c4-284b-429e-b223-e648b9c2c12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.800138 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3006/5933] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:51 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:51.801259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:51.811457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ab7561c4-284b-429e-b223-e648b9c2c12b None None] MFA Rules not processed for user `7ce296c1004c4976930f46de34be880d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:51.812691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab7561c4-284b-429e-b223-e648b9c2c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:51.822537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47949c1-81bf-4a0b-a2f1-96f301b482f4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:51.838543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:51.840915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.851514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.851514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.851514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:51.851514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:51.878753 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3007/5934] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:51.883342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:51.905888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a7ac-0c22-4350-a5e1-1d715cf9b5c4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:51.912659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:51.914359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.914719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.915122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:51.915925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:51.918191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:51.939337 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3008/5935] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:14:51.941088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:51.970518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebd64e-b212-437e-99e8-4e3d03f29708 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:51.973337 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2928/5936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:51.980848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:51.982511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:51.982828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:51.983107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] PATH_INFO: `/v3/projects/ad80e69d669c4aa4a514f7cd412693c3/users/4b3a49ce38cd4a7f9265af18b61702ce/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:52.004314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad80e69d669c4aa4a514f7cd412693c3, user_id=4b3a49ce38cd4a7f9265af18b61702ce, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:52.007306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:52.025075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3009/5937] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:51 2022] PUT /identity/v3/projects/ad80e69d669c4aa4a514f7cd412693c3/users/4b3a49ce38cd4a7f9265af18b61702ce/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:14:52.036599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7babf1e-1027-40b9-8e03-29c915de1524 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:52.037305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7babf1e-1027-40b9-8e03-29c915de1524 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:52.038274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7babf1e-1027-40b9-8e03-29c915de1524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:52.074451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a7babf1e-1027-40b9-8e03-29c915de1524 None None] MFA Rules not processed for user `4b3a49ce38cd4a7f9265af18b61702ce`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:52.075934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a7babf1e-1027-40b9-8e03-29c915de1524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:52.178453 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2929/5938] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:52.189253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:52.191026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:52.254629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e2d00-a091-4721-a881-4432fe969806 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:52.261134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a260-43c2-487c-9c8a-44ff9876ac20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:52.263070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a260-43c2-487c-9c8a-44ff9876ac20 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:52.263070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a260-43c2-487c-9c8a-44ff9876ac20 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:52.263243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a260-43c2-487c-9c8a-44ff9876ac20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:52.277460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945a260-43c2-487c-9c8a-44ff9876ac20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:52.280110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945a260-43c2-487c-9c8a-44ff9876ac20 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:52.293318 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3010/5939] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:14:58.786443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7babf1e-1027-40b9-8e03-29c915de1524 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:58.848536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7babf1e-1027-40b9-8e03-29c915de1524 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:58.876114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:58.876921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:58.877231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:58.877507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:58.880455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:59.055474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7c2f-25a6-420f-b93e-09deb3961af5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:59.056741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7c2f-25a6-420f-b93e-09deb3961af5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:59.057885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7c2f-25a6-420f-b93e-09deb3961af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:59.154632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-73ba7c2f-25a6-420f-b93e-09deb3961af5 None None] MFA Rules not processed for user `8303163dfe6c44dc8552919975c72eba`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:14:59.164100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-73ba7c2f-25a6-420f-b93e-09deb3961af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:59.304507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:59.306054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:59.339867 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2930/5940] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:14:59.348574 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3011/5941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:14:59.353632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:59.355100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:14:59.608897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514214e9-eb54-4fcd-995e-4cd208231958 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:59.619258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:59.620846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:59.623247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:59.623639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:59.624463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:59.634172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:59.698525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba7c2f-25a6-420f-b93e-09deb3961af5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:59.712210 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2931/5942] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:14:59 2022] POST /identity/v3/projects => generated 383 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:59.716758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba7c2f-25a6-420f-b93e-09deb3961af5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:59.864435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:59.865453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:59.865726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:59.866015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:59.866699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:59.872830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:59.905726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:59.916145 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3012/5943] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:14:59 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:14:59.919849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a473d8-6e0f-4783-88db-5cb8267bcbef admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:14:59.926712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:14:59.927459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:14:59.927737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:14:59.928057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:14:59.928787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:14:59.931952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:14:59.955487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:14:59.980182 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2932/5944] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:14:59.989380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138820a-0679-4083-9307-b65f45ba140d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:00.002074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:00.003662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:00.004085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:00.004394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] PATH_INFO: `/v3/projects/a704e92a3e354728af3cc4e133464f97/users/41e80feebae146f2bb61569f716aaf45/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:00.044490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a704e92a3e354728af3cc4e133464f97, user_id=41e80feebae146f2bb61569f716aaf45, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:00.048676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:00.077981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:00.078431 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3013/5945] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:14:59 2022] PUT /identity/v3/projects/a704e92a3e354728af3cc4e133464f97/users/41e80feebae146f2bb61569f716aaf45/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:15:00.089474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c4235-c99c-4092-9dc0-342aef634183 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:00.230941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:00.231832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:00.232274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:00.232687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:00.233613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:00.235510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:00.262591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:00.263027 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2933/5946] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:15:00.273609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f2df1-3491-47d3-bb24-0c96cf491288 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:00.282538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:00.283872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:00.283872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:00.284055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] PATH_INFO: `/v3/projects/a704e92a3e354728af3cc4e133464f97/users/41e80feebae146f2bb61569f716aaf45/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:00.288030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a704e92a3e354728af3cc4e133464f97, user_id=41e80feebae146f2bb61569f716aaf45, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:00.293746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:00.314115 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3014/5947] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:15:00 2022] PUT /identity/v3/projects/a704e92a3e354728af3cc4e133464f97/users/41e80feebae146f2bb61569f716aaf45/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:15:01.295622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:01.489501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74228088-1dc2-4f54-9fbe-1289486c3a14 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:01.665553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb44233-0d82-4f00-980a-54bc71d0a318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:01.666236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44233-0d82-4f00-980a-54bc71d0a318 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:01.666555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44233-0d82-4f00-980a-54bc71d0a318 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:01.666834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44233-0d82-4f00-980a-54bc71d0a318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:01.681976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0fb44233-0d82-4f00-980a-54bc71d0a318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:01.908380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb44233-0d82-4f00-980a-54bc71d0a318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:01.918615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb44233-0d82-4f00-980a-54bc71d0a318 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:01.938609 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2934/5948] 10.222.0.30 () {60 vars in 1396 bytes} [Sat Apr 9 21:15:01 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:04.280105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:04.298233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92463cd5-a3a7-4718-aecf-48c2c9ba60a1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:04.313060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:04.313778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:04.314059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:04.314340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:04.321523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:04.550760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:04.552167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:04.574579 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3015/5949] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:11.862680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:11.864932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:11.865434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:11.903656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] MFA Rules not processed for user `a6dcb8344fde4e4580e73efc09e633a7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:11.907688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:12.058873 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2935/5950] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:15:13.502527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:13.518295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea79c3-1e14-454f-828a-043fe4f5bb15 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:13.523272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35c5da-da9c-4c21-8d32-3515a1fcc5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:13.524211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c5da-da9c-4c21-8d32-3515a1fcc5eb service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:13.524497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c5da-da9c-4c21-8d32-3515a1fcc5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:13.524975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c5da-da9c-4c21-8d32-3515a1fcc5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:13.527281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2c35c5da-da9c-4c21-8d32-3515a1fcc5eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:13.673048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35c5da-da9c-4c21-8d32-3515a1fcc5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:13.676394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35c5da-da9c-4c21-8d32-3515a1fcc5eb service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:13.696315 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3016/5951] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:18.099979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:18.105065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:18.147535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf35406-106d-45ac-a276-f7eeb060b036 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:18.158689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:18.161923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:18.162222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:18.169582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:18.171914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:18.204571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:18.206474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:18.231108 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2936/5952] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:18.897484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8b7a-ce63-476d-aded-66416a230151 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:18.898017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8b7a-ce63-476d-aded-66416a230151 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:18.898759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8b7a-ce63-476d-aded-66416a230151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:18.958869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a6ae8b7a-ce63-476d-aded-66416a230151 None None] MFA Rules not processed for user `41e80feebae146f2bb61569f716aaf45`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:18.960154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a6ae8b7a-ce63-476d-aded-66416a230151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:19.075790 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3017/5953] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:19.089739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:19.091646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:19.206933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fdae1-5e32-4453-91df-ff47454035b1 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:19.216767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029e3f7-338e-461c-8494-864ac6fa98c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:19.217764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029e3f7-338e-461c-8494-864ac6fa98c2 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:19.218677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029e3f7-338e-461c-8494-864ac6fa98c2 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:19.218677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029e3f7-338e-461c-8494-864ac6fa98c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:19.335745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029e3f7-338e-461c-8494-864ac6fa98c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:19.337441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029e3f7-338e-461c-8494-864ac6fa98c2 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:19.347753 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2937/5954] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:20.211739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8b7a-ce63-476d-aded-66416a230151 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:20.236448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8b7a-ce63-476d-aded-66416a230151 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:20.250217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:20.251383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:20.253118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:20.254558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:20.259875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:20.336165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:20.340097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:20.369566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:20.370146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:20.370146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:20.371024 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3018/5955] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:20.403747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:20.405282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:20.507964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2938/5956] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:15:20.578001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:20.579940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:20.725745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73dc96-41f5-452f-bfb6-ec7c9ffc99f4 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:20.740827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:20.742026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:20.742816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:20.743260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:20.755264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:20.757745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:20.808729 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3019/5957] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:15:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:15:41.533411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:41.535575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:41.603261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633df03c-b79a-4373-bc7a-2bccec2b7d73 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:41.641304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:41.642815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:41.643234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:41.644137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] PATH_INFO: `/v3/users/e2b92cb8d21d42eea56146d7935a74e8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:41.645843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b92cb8d21d42eea56146d7935a74e8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:41.668547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:41.914531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b92cb8d21d42eea56146d7935a74e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:41.916433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b92cb8d21d42eea56146d7935a74e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:41.994386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b92cb8d21d42eea56146d7935a74e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:42.000540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b92cb8d21d42eea56146d7935a74e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:42.058208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fd800caa-6aef-43cd-84be-7befc4a00769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b92cb8d21d42eea56146d7935a74e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:42.153898 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2939/5958] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:15:41 2022] DELETE /identity/v3/users/e2b92cb8d21d42eea56146d7935a74e8 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:15:43.012511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:43.037166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e2b1a-6330-4430-b4b4-f29b2f339d5a service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:43.182998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:43.184563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:43.184563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:43.184563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] PATH_INFO: `/v3/users/4b3a49ce38cd4a7f9265af18b61702ce` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:43.188644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3a49ce38cd4a7f9265af18b61702ce)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:43.190849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:43.331898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3a49ce38cd4a7f9265af18b61702ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.332786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3a49ce38cd4a7f9265af18b61702ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.352575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3a49ce38cd4a7f9265af18b61702ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.367790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3a49ce38cd4a7f9265af18b61702ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.368600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3a49ce38cd4a7f9265af18b61702ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.405293 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3020/5959] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:15:43 2022] DELETE /identity/v3/users/4b3a49ce38cd4a7f9265af18b61702ce => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:15:43.407505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:43.408422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:43.408984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:43.495137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:43.497360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:43.530454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:43.533089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:43.604181 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2940/5960] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:43.618021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:43.622644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:43.698541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f895-9c48-4c58-a1eb-719ef8e2e6f4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:43.711504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:43.712822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:43.713290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:43.714116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] PATH_INFO: `/v3/projects/60eee2c55ed842f78ac0fa9e1b400fbf` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:43.718531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eee2c55ed842f78ac0fa9e1b400fbf)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:43.720821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:43.728673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387e8a-a1b0-465e-9e0d-7b8753bcd598 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:43.780209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:43.780911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:43.781294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:43.781638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:43.810168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:43.811932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:43.831037 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2941/5961] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:43.880082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eee2c55ed842f78ac0fa9e1b400fbf', 'request_id': 'req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.906374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eee2c55ed842f78ac0fa9e1b400fbf', 'request_id': 'req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.933584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eee2c55ed842f78ac0fa9e1b400fbf', 'request_id': 'req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.963262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] The token cache is being invalidate because project 60eee2c55ed842f78ac0fa9e1b400fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:15:43.963611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.965496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:43.968705 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3021/5962] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:15:43 2022] DELETE /identity/v3/projects/60eee2c55ed842f78ac0fa9e1b400fbf => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:15:43.974153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:43.998474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c29ffd-9ba0-4498-aa70-27ea43083586 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:44.207290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:44.210282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:44.210767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:44.211167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] PATH_INFO: `/v3/users/68fbae6daff840b9a7c1e1473c798064` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:44.212710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fbae6daff840b9a7c1e1473c798064)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:44.215542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:44.342575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fbae6daff840b9a7c1e1473c798064'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:44.343262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fbae6daff840b9a7c1e1473c798064'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:44.372574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fbae6daff840b9a7c1e1473c798064'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:44.373248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fbae6daff840b9a7c1e1473c798064'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:44.403089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fbae6daff840b9a7c1e1473c798064'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:44.441332 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2942/5963] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:15:43 2022] DELETE /identity/v3/users/68fbae6daff840b9a7c1e1473c798064 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:15:45.028167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:45.029721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:45.060989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842e3d-f473-4813-a6e8-d7ab7c6f08e3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:45.235098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:45.238055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:45.238338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:45.240277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] PATH_INFO: `/v3/projects/ad80e69d669c4aa4a514f7cd412693c3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:45.244613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad80e69d669c4aa4a514f7cd412693c3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:45.251849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:45.356594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:45.358621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:45.393078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7815bdb-acd3-4b35-8fe5-2b6b1ea5ba7f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:45.410409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad80e69d669c4aa4a514f7cd412693c3', 'request_id': 'req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.428348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad80e69d669c4aa4a514f7cd412693c3', 'request_id': 'req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.451913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad80e69d669c4aa4a514f7cd412693c3', 'request_id': 'req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.481520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] The token cache is being invalidate because project ad80e69d669c4aa4a514f7cd412693c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:15:45.481845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.482500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-963e1353-4e85-4f9a-99cf-c0ad1b5de3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.489589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3022/5964] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:15:45 2022] DELETE /identity/v3/projects/ad80e69d669c4aa4a514f7cd412693c3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:15:45.491595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840186-1927-412d-9d00-c42375ffe695 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:45.491923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840186-1927-412d-9d00-c42375ffe695 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:45.492476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840186-1927-412d-9d00-c42375ffe695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:45.613447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:45.615191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:45.615692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:45.616169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] PATH_INFO: `/v3/projects/4d6801916c224eb9adffbc6ac35c6e54` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:45.618025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6801916c224eb9adffbc6ac35c6e54)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:45.620521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:45.631729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-38840186-1927-412d-9d00-c42375ffe695 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:45.633146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-38840186-1927-412d-9d00-c42375ffe695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:45.660469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3023/5965] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:45.662325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c6dff-8475-4ba1-8f03-9297042ef7a9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:45.662615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c6dff-8475-4ba1-8f03-9297042ef7a9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:45.663532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c6dff-8475-4ba1-8f03-9297042ef7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:45.702148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7b1c6dff-8475-4ba1-8f03-9297042ef7a9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:45.705630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b1c6dff-8475-4ba1-8f03-9297042ef7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:45.731888 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3024/5966] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:45.736212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c6dff-8475-4ba1-8f03-9297042ef7a9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:45.756204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c6dff-8475-4ba1-8f03-9297042ef7a9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:45.779170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6801916c224eb9adffbc6ac35c6e54', 'request_id': 'req-249f20a5-07c8-4274-9358-c9e58c4ea3fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.789949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6801916c224eb9adffbc6ac35c6e54', 'request_id': 'req-249f20a5-07c8-4274-9358-c9e58c4ea3fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.840807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6801916c224eb9adffbc6ac35c6e54', 'request_id': 'req-249f20a5-07c8-4274-9358-c9e58c4ea3fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.863566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] The token cache is being invalidate because project 4d6801916c224eb9adffbc6ac35c6e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:15:45.863983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.864942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-249f20a5-07c8-4274-9358-c9e58c4ea3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:15:45.867687 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2943/5967] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:15:45 2022] DELETE /identity/v3/projects/4d6801916c224eb9adffbc6ac35c6e54 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:15:45.872792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b55819-9a6e-40b7-a968-3e7202caa1ca None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:45.873220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b55819-9a6e-40b7-a968-3e7202caa1ca None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:45.891345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b55819-9a6e-40b7-a968-3e7202caa1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:45.916109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-65b55819-9a6e-40b7-a968-3e7202caa1ca None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:45.917512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-65b55819-9a6e-40b7-a968-3e7202caa1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:45.935388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:45.936087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:45.936368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:45.936641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:45.941867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:15:45.942228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:45.946073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.011315 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3025/5968] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:15:46.016514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.018588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:46.038278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450ad61-5238-4b60-a886-5d8e182801fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.053805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.054695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.055007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.055284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.056029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:46.058612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.148996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2944/5969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:15:46.159765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d567de-6030-459a-bcb4-7746b35fadd7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.160926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d567de-6030-459a-bcb4-7746b35fadd7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.161251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3026/5970] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:15:46 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:15:46.161671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d567de-6030-459a-bcb4-7746b35fadd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.167761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.210353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a6d567de-6030-459a-bcb4-7746b35fadd7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:46.211948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a6d567de-6030-459a-bcb4-7746b35fadd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:46.334699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991c49-16bc-4570-88f3-435c42869af6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.356130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.356790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.357137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.357412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.358114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:46.360184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.396240 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2945/5971] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:46.406952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d567de-6030-459a-bcb4-7746b35fadd7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.417177 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3027/5972] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:15:46 2022] POST /identity/v3/users => generated 280 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:15:46.419915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.424535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d567de-6030-459a-bcb4-7746b35fadd7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.434720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae809-e816-404d-b85d-fb7845ecc31b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.452162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.453702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.453702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.453897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.454966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:46.470431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.483981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.484236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3028/5973] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:15:46.484319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.484319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.484319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.484319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:15:46.485350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.488669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:46.491426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.510033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdec676-fb13-4082-82e7-0c0fd92439f1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.523229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.524015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.524300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.524650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.526439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:46.528440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.548666 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2946/5974] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:15:46.550019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.566433 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3029/5975] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:15:46.568790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.578717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1a2c-d3b1-47a1-a332-3af0aa5f5102 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.599913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.602326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c2e71-21aa-4265-a3df-da788b661641 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.605777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.606052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.606498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.607422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:46.611458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.621283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.624156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.624439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.624722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] PATH_INFO: `/v3/projects/03b5ab67a84641838022ecaaf3d2ec57/users/ad4860526ad9487bb48c4a59f3693d01/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.700363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b5ab67a84641838022ecaaf3d2ec57, user_id=ad4860526ad9487bb48c4a59f3693d01, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:46.702164 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2947/5976] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:15:46 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:15:46.704494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:46.707614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.712714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:46.757865 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3030/5977] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:15:46 2022] PUT /identity/v3/projects/03b5ab67a84641838022ecaaf3d2ec57/users/ad4860526ad9487bb48c4a59f3693d01/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:15:46.762241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:46.887910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d251b-388b-4bfe-a2c2-1a13849bf676 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.961628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70bc7e-0a52-4bce-9935-8d6943211438 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:46.983371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:46.983371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:46.983371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:46.983839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:46.984222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:47.005195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:47.006022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9284250-4718-4330-8355-835b658af72b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:47.006707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284250-4718-4330-8355-835b658af72b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.006995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284250-4718-4330-8355-835b658af72b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.007269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284250-4718-4330-8355-835b658af72b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.013116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c9284250-4718-4330-8355-835b658af72b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:47.041678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9284250-4718-4330-8355-835b658af72b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:47.045545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9284250-4718-4330-8355-835b658af72b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:47.093363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3031/5978] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:15:46 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:15:47.094252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:47.095964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2948/5979] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:47.097531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785944-d7bc-45de-bab2-6ea41b35ae88 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.097663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785944-d7bc-45de-bab2-6ea41b35ae88 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.097883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785944-d7bc-45de-bab2-6ea41b35ae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.101739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:47.150363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c21bc-c1b8-4ca8-b64d-d8b6a0956a7a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:47.165008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:47.166058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.166410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.170845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.180530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-62785944-d7bc-45de-bab2-6ea41b35ae88 None None] MFA Rules not processed for user `ad4860526ad9487bb48c4a59f3693d01`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:47.182032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62785944-d7bc-45de-bab2-6ea41b35ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:47.199576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:47.201225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:47.228654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3032/5980] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:47.229517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:47.269447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536785c-c646-46c5-a4be-384b2971324c service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:47.295724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:47.296425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.296704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.296979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.297740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:47.299737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:47.320696 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3033/5981] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:15:47.321106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:47.352149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa249-8c31-4687-8481-6c1411d0863e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:47.366994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443a247-e5ec-4e4e-b67b-396feead80dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:47.367708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a247-e5ec-4e4e-b67b-396feead80dc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.367983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a247-e5ec-4e4e-b67b-396feead80dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.368266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a247-e5ec-4e4e-b67b-396feead80dc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.369712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443a247-e5ec-4e4e-b67b-396feead80dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:47.373940 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2949/5982] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:47.380020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443a247-e5ec-4e4e-b67b-396feead80dc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:47.421694 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3034/5983] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:15:47.423308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785944-d7bc-45de-bab2-6ea41b35ae88 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:47.440481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785944-d7bc-45de-bab2-6ea41b35ae88 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:47.474089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:47.475292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.475728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.476692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] PATH_INFO: `/v3/projects/7525a2e03c554c339134407c220d5499/users/5145fae3fdfd41f0ad5f1e1fe59558f0/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.553142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7525a2e03c554c339134407c220d5499, user_id=5145fae3fdfd41f0ad5f1e1fe59558f0, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:47.562236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:47.616635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2950/5984] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:15:47 2022] PUT /identity/v3/projects/7525a2e03c554c339134407c220d5499/users/5145fae3fdfd41f0ad5f1e1fe59558f0/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:15:47.620830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefa0cb-0793-444a-9808-03171c71ce54 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.621215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefa0cb-0793-444a-9808-03171c71ce54 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.621491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefa0cb-0793-444a-9808-03171c71ce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.653555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:47.663896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ebefa0cb-0793-444a-9808-03171c71ce54 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:47.673918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ebefa0cb-0793-444a-9808-03171c71ce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:47.862929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0d9a0-8334-4b47-9089-7a5712c8f476 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:47.868450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:47.869493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:47.870255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:47.871023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:47.877538 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3035/5985] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:48.006712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefa0cb-0793-444a-9808-03171c71ce54 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:48.026750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefa0cb-0793-444a-9808-03171c71ce54 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:48.035614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb03ba-1456-4380-81ce-eba5e1cf6e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:48.036500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb03ba-1456-4380-81ce-eba5e1cf6e1e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:48.036870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb03ba-1456-4380-81ce-eba5e1cf6e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:48.037869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb03ba-1456-4380-81ce-eba5e1cf6e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:48.058644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:48.062864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:48.083193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb03ba-1456-4380-81ce-eba5e1cf6e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:48.087116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb03ba-1456-4380-81ce-eba5e1cf6e1e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:48.100760 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2951/5986] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:15:48.117940 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3036/5987] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:15:49.000091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:49.002490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:49.241627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6730f-f5d9-40da-b3ff-1e775ac7e87e service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:49.248957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df35bd5-e57b-4cdb-beb9-333f2eb659d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:49.250102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df35bd5-e57b-4cdb-beb9-333f2eb659d4 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:49.250687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df35bd5-e57b-4cdb-beb9-333f2eb659d4 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:49.251193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df35bd5-e57b-4cdb-beb9-333f2eb659d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:49.254174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0df35bd5-e57b-4cdb-beb9-333f2eb659d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:49.280223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df35bd5-e57b-4cdb-beb9-333f2eb659d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:49.282895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df35bd5-e57b-4cdb-beb9-333f2eb659d4 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:49.300616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2952/5988] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:52.614061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:52.616252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:52.616252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:52.660908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] MFA Rules not processed for user `5145fae3fdfd41f0ad5f1e1fe59558f0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:52.662781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:52.835611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3037/5989] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:52.846179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:52.846681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:52.846798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:52.867053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] MFA Rules not processed for user `5145fae3fdfd41f0ad5f1e1fe59558f0`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:52.868394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:52.931865 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2953/5990] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:15:52.946710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:52.949867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:52.980628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13af75-3fe7-46f0-86a8-ce89641ef686 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:53.008249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:53.008991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:53.009462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:53.010034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:53.021392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:53.023631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:53.038672 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3038/5991] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:54.165868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:54.167388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:54.303959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4939faa-d25e-4d8c-8276-cf56d8f9061c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:54.308466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:54.309271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:54.309548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:54.309820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:54.312060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:54.330121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:54.331937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:54.349448 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2954/5992] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:54.670728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:54.698828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb56552-99bf-4214-9352-c7fd7b7d60f4 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:54.704004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:54.705102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:54.705582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:54.705993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:54.709480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:54.737077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:54.740625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:54.763973 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3039/5993] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:54.977584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:54.979430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:55.004809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:15:55.006532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:55.207606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624991-f79b-418f-a4cd-023959717ef2 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:55.222385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c395b-b804-4099-ba3c-66a712706b59 service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:15:55.222875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:55.223534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:55.224249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:55.224635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:55.230044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:55.240466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaaa87-e173-452e-ae4e-9c4975f60fd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:15:55.241309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaaa87-e173-452e-ae4e-9c4975f60fd4 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:55.241708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaaa87-e173-452e-ae4e-9c4975f60fd4 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:55.242742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaaa87-e173-452e-ae4e-9c4975f60fd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:55.264312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:55.268096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaaa87-e173-452e-ae4e-9c4975f60fd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:15:55.270329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:55.273527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaaa87-e173-452e-ae4e-9c4975f60fd4 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:15:55.303218 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2955/5994] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:15:55.319334 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3040/5995] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:15:55.647825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c6804-e865-4463-9ff1-d857e177581d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:15:55.648122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c6804-e865-4463-9ff1-d857e177581d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:15:55.648412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c6804-e865-4463-9ff1-d857e177581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:15:55.698306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-031c6804-e865-4463-9ff1-d857e177581d None None] MFA Rules not processed for user `8303163dfe6c44dc8552919975c72eba`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:15:55.700633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-031c6804-e865-4463-9ff1-d857e177581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:15:55.916618 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2956/5996] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:01.149834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:01.176867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e878-c0fc-4f1b-9ae5-621b56ca3c27 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:01.191361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:01.192448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:01.192896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:01.193342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:01.197422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:01.227815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:01.230746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:01.248193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3041/5997] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:06.019749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26e76-42af-48e3-97a4-ebf10766b257 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:06.020304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26e76-42af-48e3-97a4-ebf10766b257 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:06.020304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26e76-42af-48e3-97a4-ebf10766b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:06.083561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8df26e76-42af-48e3-97a4-ebf10766b257 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:06.085007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8df26e76-42af-48e3-97a4-ebf10766b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:06.161802 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2957/5998] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:16:06.182422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:06.185323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:06.309526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e28fd-6563-4f88-ba59-0f1a741772c6 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:06.316179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:06.316866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:06.317178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:06.317460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:06.331686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:06.333668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:06.355314 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3042/5999] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:16:15.137068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24e220-3d45-41cf-8f7d-dee5faf3e459 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:15.138719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24e220-3d45-41cf-8f7d-dee5faf3e459 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:15.139602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24e220-3d45-41cf-8f7d-dee5faf3e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:15.191840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cf24e220-3d45-41cf-8f7d-dee5faf3e459 None None] MFA Rules not processed for user `b5534646a6384067bda99af7c864d494`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:15.196569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cf24e220-3d45-41cf-8f7d-dee5faf3e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:15.381573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2958/6000] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:16.808116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:16.824962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d807-2611-4c34-843a-15acf89fdcc5 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:16.840392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:16.841411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:16.841692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:16.841969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] PATH_INFO: `/v3/users/ad4860526ad9487bb48c4a59f3693d01` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:16.843626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4860526ad9487bb48c4a59f3693d01)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:16.845699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:16.956816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4860526ad9487bb48c4a59f3693d01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:16.957923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4860526ad9487bb48c4a59f3693d01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:16.968847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4860526ad9487bb48c4a59f3693d01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:16.985371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4860526ad9487bb48c4a59f3693d01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:16.986382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4860526ad9487bb48c4a59f3693d01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:17.021924 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3043/6001] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:16 2022] DELETE /identity/v3/users/ad4860526ad9487bb48c4a59f3693d01 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:17.026316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:17.026916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:17.026916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:17.054676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:17.057182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:17.147139 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2959/6002] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:17.221561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:17.224068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:17.434204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635163-48ec-4c2d-a5fb-3b866ad794f0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:17.453312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1474-a1e6-4b23-9a1c-708f7a03bafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:17.454290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1474-a1e6-4b23-9a1c-708f7a03bafc service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:17.454643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1474-a1e6-4b23-9a1c-708f7a03bafc service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:17.454922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1474-a1e6-4b23-9a1c-708f7a03bafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:17.483160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1474-a1e6-4b23-9a1c-708f7a03bafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:17.487863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1474-a1e6-4b23-9a1c-708f7a03bafc service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:17.524000 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3044/6003] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:18.953813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:18.956335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:18.992189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5b40c-d75d-4833-84d9-bfb9883d8177 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:19.027488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:19.028405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:19.028829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:19.037491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] PATH_INFO: `/v3/projects/03b5ab67a84641838022ecaaf3d2ec57` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:19.040158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b5ab67a84641838022ecaaf3d2ec57)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:19.043730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:19.277497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b5ab67a84641838022ecaaf3d2ec57', 'request_id': 'req-4a1a1104-0362-44f2-820f-1cfa47f1cfca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:19.292604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b5ab67a84641838022ecaaf3d2ec57', 'request_id': 'req-4a1a1104-0362-44f2-820f-1cfa47f1cfca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:19.314183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b5ab67a84641838022ecaaf3d2ec57', 'request_id': 'req-4a1a1104-0362-44f2-820f-1cfa47f1cfca'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:19.340311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] The token cache is being invalidate because project 03b5ab67a84641838022ecaaf3d2ec57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:19.341301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:19.343906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4a1a1104-0362-44f2-820f-1cfa47f1cfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:19.349008 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2960/6004] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:18 2022] DELETE /identity/v3/projects/03b5ab67a84641838022ecaaf3d2ec57 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:19.354544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400c69-b462-4880-bca2-8d35298024ee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:19.355578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400c69-b462-4880-bca2-8d35298024ee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:19.356104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400c69-b462-4880-bca2-8d35298024ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:19.407509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-92400c69-b462-4880-bca2-8d35298024ee None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:19.414312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-92400c69-b462-4880-bca2-8d35298024ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:19.595547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781c05-e394-45ac-8dab-e08f9d18345e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:19.596177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781c05-e394-45ac-8dab-e08f9d18345e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:19.596704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781c05-e394-45ac-8dab-e08f9d18345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:19.600337 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3045/6005] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:19.656228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-93781c05-e394-45ac-8dab-e08f9d18345e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:19.656228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-93781c05-e394-45ac-8dab-e08f9d18345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:19.659570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2961/6006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:19.664632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92400c69-b462-4880-bca2-8d35298024ee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:19.695416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92400c69-b462-4880-bca2-8d35298024ee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:19.701930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:19.703230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:19.703784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:19.704440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:19.706545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:16:19.706940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:19.708868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:19.726778 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3046/6007] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:19.747308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93781c05-e394-45ac-8dab-e08f9d18345e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:19.776148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93781c05-e394-45ac-8dab-e08f9d18345e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:19.796679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:19.798547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:19.798547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:19.798796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:19.799494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:19.805666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:19.868614 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2962/6008] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:19 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:19.868936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:19.895478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cdc43-2aab-45fa-b15e-640dcff15e82 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:20.186384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:20.187190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:20.187476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:20.187900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:20.188647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:20.196207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:20.245244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:20.253280 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3047/6009] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:19 2022] POST /identity/v3/users => generated 287 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:20.260763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26baf5-a977-42ad-a1ba-e157acd153ad admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:20.269432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:20.270600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:20.271194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:20.271665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:20.273579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:20.276486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:20.296696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:20.301267 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2963/6010] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:20.313857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5f4c-0780-48de-ab1e-36057bcea103 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:20.322005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876255e-f9ed-4f0d-952c-0c3b65e8daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:20.322881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876255e-f9ed-4f0d-952c-0c3b65e8daf6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:20.330064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876255e-f9ed-4f0d-952c-0c3b65e8daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:20.330761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876255e-f9ed-4f0d-952c-0c3b65e8daf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:20.331769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876255e-f9ed-4f0d-952c-0c3b65e8daf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:20.333785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876255e-f9ed-4f0d-952c-0c3b65e8daf6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:20.357345 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3048/6011] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:20.358218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:20.373890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da01ad-fe8c-4cd3-9697-70225310b990 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:20.385292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:20.386578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:20.386872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:20.388532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] PATH_INFO: `/v3/projects/f234ccc5ee424fe0bf15c107e7e21b18/users/f5b62ba1fccd4521a1a0aa76459b94d0/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:20.444176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f234ccc5ee424fe0bf15c107e7e21b18, user_id=f5b62ba1fccd4521a1a0aa76459b94d0, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:20.453727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:20.495205 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2964/6012] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:20 2022] PUT /identity/v3/projects/f234ccc5ee424fe0bf15c107e7e21b18/users/f5b62ba1fccd4521a1a0aa76459b94d0/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:20.508997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec754-7436-4c70-8c1b-4c23d63cd8d2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:20.509610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec754-7436-4c70-8c1b-4c23d63cd8d2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:20.509888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec754-7436-4c70-8c1b-4c23d63cd8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:20.568006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6e8ec754-7436-4c70-8c1b-4c23d63cd8d2 None None] MFA Rules not processed for user `f5b62ba1fccd4521a1a0aa76459b94d0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:20.570887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e8ec754-7436-4c70-8c1b-4c23d63cd8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:20.802214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3049/6013] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:16:20.854901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:20.859165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:21.088912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f6fbd-04df-467a-b344-f9923cbdcefc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:21.098854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:21.099596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:21.099820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:21.100091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:21.133834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:21.136020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:21.165373 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2965/6014] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:21.232115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec754-7436-4c70-8c1b-4c23d63cd8d2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:21.440801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec754-7436-4c70-8c1b-4c23d63cd8d2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:21.457844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:21.459063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:21.459691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:21.460890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] PATH_INFO: `/v3/users/f5b62ba1fccd4521a1a0aa76459b94d0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:21.465210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b62ba1fccd4521a1a0aa76459b94d0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:21.469814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:21.505655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:21.522289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b41d43-49cb-4420-88b2-130cd58d2555 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:21.531016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c8b78-25fe-4ad3-8a00-4bee2e813a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:21.532951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c8b78-25fe-4ad3-8a00-4bee2e813a73 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:21.537977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c8b78-25fe-4ad3-8a00-4bee2e813a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:21.538579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c8b78-25fe-4ad3-8a00-4bee2e813a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:21.541652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-853c8b78-25fe-4ad3-8a00-4bee2e813a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:21.578114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c8b78-25fe-4ad3-8a00-4bee2e813a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:21.578486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b62ba1fccd4521a1a0aa76459b94d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:21.579957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b62ba1fccd4521a1a0aa76459b94d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:21.582775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c8b78-25fe-4ad3-8a00-4bee2e813a73 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:21.600971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b62ba1fccd4521a1a0aa76459b94d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:21.622233 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2966/6015] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:16:21.626408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b62ba1fccd4521a1a0aa76459b94d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:21.627156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b62ba1fccd4521a1a0aa76459b94d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:21.654702 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3050/6016] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:21 2022] DELETE /identity/v3/users/f5b62ba1fccd4521a1a0aa76459b94d0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:21.659306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:21.659805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:21.660086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:21.682976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:21.684533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:21.776930 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2967/6017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:21.827639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:21.831754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:22.034739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed864-dd09-4b8a-b32c-22e23a5874da admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:22.040773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:22.041309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:22.041803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:22.042175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:22.056455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:22.059496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:22.082931 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3051/6018] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:22.207600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:22.209302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:22.237502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e3fdf-3b27-48b2-8a79-46963e30a619 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:22.246213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73f87e-42b3-4914-b834-db10ac92bb18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:22.247762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f87e-42b3-4914-b834-db10ac92bb18 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:22.248263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f87e-42b3-4914-b834-db10ac92bb18 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:22.248819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f87e-42b3-4914-b834-db10ac92bb18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:22.251316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-af73f87e-42b3-4914-b834-db10ac92bb18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:22.456201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73f87e-42b3-4914-b834-db10ac92bb18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:22.457977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73f87e-42b3-4914-b834-db10ac92bb18 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:22.472201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2968/6019] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:23.374019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:23.375718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:23.408951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b16dd-88e3-4fce-95b2-91601aa9d6fc service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:23.429576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:23.430779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:23.430895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:23.431126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] PATH_INFO: `/v3/projects/f234ccc5ee424fe0bf15c107e7e21b18` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:23.436383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f234ccc5ee424fe0bf15c107e7e21b18)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:23.438468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:23.588841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f234ccc5ee424fe0bf15c107e7e21b18', 'request_id': 'req-b85c81e4-5a88-4eb6-ba4f-175d8916226c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:23.597189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f234ccc5ee424fe0bf15c107e7e21b18', 'request_id': 'req-b85c81e4-5a88-4eb6-ba4f-175d8916226c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:23.609219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f234ccc5ee424fe0bf15c107e7e21b18', 'request_id': 'req-b85c81e4-5a88-4eb6-ba4f-175d8916226c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:23.624095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] The token cache is being invalidate because project f234ccc5ee424fe0bf15c107e7e21b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:23.624391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:23.625214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b85c81e4-5a88-4eb6-ba4f-175d8916226c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:23.627309 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3052/6020] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:23 2022] DELETE /identity/v3/projects/f234ccc5ee424fe0bf15c107e7e21b18 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:23.632648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f4e6-83fd-4b0a-b009-3694a73735ad None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:23.633189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f4e6-83fd-4b0a-b009-3694a73735ad None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:23.633189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f4e6-83fd-4b0a-b009-3694a73735ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:23.674533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6516f4e6-83fd-4b0a-b009-3694a73735ad None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:23.678092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6516f4e6-83fd-4b0a-b009-3694a73735ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:23.835969 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2969/6021] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:23.843902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f67489-6242-49c0-a14a-7fdd1147688d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:23.844185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f67489-6242-49c0-a14a-7fdd1147688d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:23.844456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f67489-6242-49c0-a14a-7fdd1147688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:23.867281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-45f67489-6242-49c0-a14a-7fdd1147688d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:23.869261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-45f67489-6242-49c0-a14a-7fdd1147688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:23.884195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3053/6022] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:23.885308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516f4e6-83fd-4b0a-b009-3694a73735ad None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:23.901889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516f4e6-83fd-4b0a-b009-3694a73735ad None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:23.910941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:23.911941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:23.912478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:23.912914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:23.913916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:16:23.914649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:23.916423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:23.938058 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2970/6023] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:23.942332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f67489-6242-49c0-a14a-7fdd1147688d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:23.955405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f67489-6242-49c0-a14a-7fdd1147688d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:23.976156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:23.980691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:23.980691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:23.980691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:23.980691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:23.980691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:24.036195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3054/6024] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:23 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:24.037661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:24.063014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f77f-52a0-4444-b597-2a736fbf28ab admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:24.183868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:24.185356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:24.185356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:24.185356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:24.185863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:24.188516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:24.217998 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2971/6025] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:24 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:24.221772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:24.253845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f1c5b-1d7c-406b-9401-169f551b29fb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:24.264504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:24.265720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:24.266070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:24.266536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:24.267456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:24.270279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:24.289468 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3055/6026] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:24.290932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:24.315785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb50c-c353-4da8-bd1c-beab8a89eb31 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:24.322495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde85df-9830-4082-9210-4d1bf02c5e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:24.324710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde85df-9830-4082-9210-4d1bf02c5e9c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:24.325206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde85df-9830-4082-9210-4d1bf02c5e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:24.333217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde85df-9830-4082-9210-4d1bf02c5e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:24.334312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde85df-9830-4082-9210-4d1bf02c5e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:24.336249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde85df-9830-4082-9210-4d1bf02c5e9c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:24.362037 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2972/6027] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:24.363258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:24.377426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c322-28cf-469d-acea-21cdec686038 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:24.384574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:24.385916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:24.386149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:24.386623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] PATH_INFO: `/v3/projects/a31494f80b324170a12c3a0149fa5bfe/users/e3cf36d20bf94591bf669e2b09411827/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:24.425914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31494f80b324170a12c3a0149fa5bfe, user_id=e3cf36d20bf94591bf669e2b09411827, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:24.429146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:24.472492 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3056/6028] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:24 2022] PUT /identity/v3/projects/a31494f80b324170a12c3a0149fa5bfe/users/e3cf36d20bf94591bf669e2b09411827/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:24.474974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728525f-6cbc-4f78-9042-e445e52593ef None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:24.475411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728525f-6cbc-4f78-9042-e445e52593ef None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:24.476045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728525f-6cbc-4f78-9042-e445e52593ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:24.583704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4728525f-6cbc-4f78-9042-e445e52593ef None None] MFA Rules not processed for user `e3cf36d20bf94591bf669e2b09411827`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:24.585320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4728525f-6cbc-4f78-9042-e445e52593ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:24.763532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2973/6029] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:24.770828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:24.887099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3410-67f4-4434-a29d-43adcf921251 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:24.917701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:24.918465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:24.918749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:24.919011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:24.919707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:24.921900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:24.987313 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3057/6030] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:24 2022] POST /identity/v3/projects => generated 403 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:24.991673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728525f-6cbc-4f78-9042-e445e52593ef None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:25.008669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728525f-6cbc-4f78-9042-e445e52593ef None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:25.097437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:25.099259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:25.101899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:25.102320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:25.103259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:25.106938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:25.139820 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2974/6031] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:24 2022] POST /identity/v3/users => generated 308 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:25.143641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:25.160165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2330df-d502-4b5d-8112-2bd795ad101b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:25.165338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:25.166037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:25.166317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:25.166598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:25.167343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:25.169216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:25.185412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3058/6032] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:25.187090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:25.202957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab58a3-2060-4761-b6af-1d8642289d09 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:25.208595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:25.209949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:25.210450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:25.210923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] PATH_INFO: `/v3/projects/ca651df12dc844c28c0eb014688ef8b9/users/94176b20e2ea4a16986dbfd9e6766b08/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:25.236141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca651df12dc844c28c0eb014688ef8b9, user_id=94176b20e2ea4a16986dbfd9e6766b08, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:25.241018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:25.279944 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2975/6033] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:25 2022] PUT /identity/v3/projects/ca651df12dc844c28c0eb014688ef8b9/users/94176b20e2ea4a16986dbfd9e6766b08/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:25.280807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:25.291728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d7a6-324f-4c3e-b1c2-56861d5e0ff8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:25.393287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0752a-5899-4b4d-b860-b60581ee313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:25.394493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0752a-5899-4b4d-b860-b60581ee313a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:25.394879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0752a-5899-4b4d-b860-b60581ee313a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:25.395297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0752a-5899-4b4d-b860-b60581ee313a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:25.396254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0752a-5899-4b4d-b860-b60581ee313a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:25.398904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0752a-5899-4b4d-b860-b60581ee313a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:25.420146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:25.442383 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3059/6034] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:25.446113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c8d6-92e5-46b1-9a77-df2c631dc4d8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:25.467482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:25.468605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:25.468989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:25.469470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] PATH_INFO: `/v3/projects/ca651df12dc844c28c0eb014688ef8b9/users/94176b20e2ea4a16986dbfd9e6766b08/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:25.471986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca651df12dc844c28c0eb014688ef8b9, user_id=94176b20e2ea4a16986dbfd9e6766b08, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:25.478278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:25.512429 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2976/6035] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:25 2022] PUT /identity/v3/projects/ca651df12dc844c28c0eb014688ef8b9/users/94176b20e2ea4a16986dbfd9e6766b08/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:25.524866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7749502-d610-414d-9329-63bba716bac5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:25.524866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7749502-d610-414d-9329-63bba716bac5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:25.525424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7749502-d610-414d-9329-63bba716bac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:25.589647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c7749502-d610-414d-9329-63bba716bac5 None None] MFA Rules not processed for user `94176b20e2ea4a16986dbfd9e6766b08`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:25.592195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c7749502-d610-414d-9329-63bba716bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:25.752885 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3060/6036] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:25.762641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:25.764407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:25.915039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c56c9-4ce5-43f9-8c33-b4b773e05004 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:25.923447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084da481-7ca3-451e-8fb1-87f6675d9c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:25.924583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084da481-7ca3-451e-8fb1-87f6675d9c50 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:25.925008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084da481-7ca3-451e-8fb1-87f6675d9c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:25.925459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084da481-7ca3-451e-8fb1-87f6675d9c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:25.944504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084da481-7ca3-451e-8fb1-87f6675d9c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:25.945964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084da481-7ca3-451e-8fb1-87f6675d9c50 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:25.960318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2977/6037] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:26.192383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7749502-d610-414d-9329-63bba716bac5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:26.332205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7749502-d610-414d-9329-63bba716bac5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:26.342842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:26.343924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:26.344214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:26.344541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] PATH_INFO: `/v3/users/e3cf36d20bf94591bf669e2b09411827` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:26.346870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cf36d20bf94591bf669e2b09411827)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:26.349585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:26.456878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cf36d20bf94591bf669e2b09411827'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:26.458332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cf36d20bf94591bf669e2b09411827'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:26.467939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cf36d20bf94591bf669e2b09411827'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:26.483065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cf36d20bf94591bf669e2b09411827'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:26.484482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cf36d20bf94591bf669e2b09411827'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:26.515513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3061/6038] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:26 2022] DELETE /identity/v3/users/e3cf36d20bf94591bf669e2b09411827 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:26.520205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d910ab-2eb3-46e4-9088-ab5c3f74e367 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:26.520853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d910ab-2eb3-46e4-9088-ab5c3f74e367 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:26.521304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d910ab-2eb3-46e4-9088-ab5c3f74e367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:26.567218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a2d910ab-2eb3-46e4-9088-ab5c3f74e367 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:26.571831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a2d910ab-2eb3-46e4-9088-ab5c3f74e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:26.698331 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2978/6039] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:26.736056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:26.738675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:26.852036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e56930-e683-4827-ba69-cd7bb51a6e02 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:26.857453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:26.859174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:26.859396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:26.859686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:26.874484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:26.877760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:26.893192 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3062/6040] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:27.613290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a5db-a209-4476-ba6e-6cc3f50dbd6d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:27.613835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a5db-a209-4476-ba6e-6cc3f50dbd6d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:27.617256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a5db-a209-4476-ba6e-6cc3f50dbd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:27.653663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7a43a5db-a209-4476-ba6e-6cc3f50dbd6d None None] MFA Rules not processed for user `5145fae3fdfd41f0ad5f1e1fe59558f0`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:27.654892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7a43a5db-a209-4476-ba6e-6cc3f50dbd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:27.774386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2979/6041] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:28.029775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:28.032102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:28.045767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3e7f-e1ac-4112-b9e1-340a276fe0ca service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:28.052212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:28.053921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:28.054442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:28.054950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] PATH_INFO: `/v3/projects/a31494f80b324170a12c3a0149fa5bfe` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:28.059753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31494f80b324170a12c3a0149fa5bfe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:28.062568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:28.135634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31494f80b324170a12c3a0149fa5bfe', 'request_id': 'req-1ae521fd-f84b-4ffd-a482-d932f536615e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.146023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31494f80b324170a12c3a0149fa5bfe', 'request_id': 'req-1ae521fd-f84b-4ffd-a482-d932f536615e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.157614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31494f80b324170a12c3a0149fa5bfe', 'request_id': 'req-1ae521fd-f84b-4ffd-a482-d932f536615e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.172572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] The token cache is being invalidate because project a31494f80b324170a12c3a0149fa5bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:28.173279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.174117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.176441 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3063/6042] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:28 2022] DELETE /identity/v3/projects/a31494f80b324170a12c3a0149fa5bfe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:28.180302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43a5db-a209-4476-ba6e-6cc3f50dbd6d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:28.191579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43a5db-a209-4476-ba6e-6cc3f50dbd6d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:28.294626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:28.295514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:28.295817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:28.296086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] PATH_INFO: `/v3/users/94176b20e2ea4a16986dbfd9e6766b08` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:28.297477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94176b20e2ea4a16986dbfd9e6766b08)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:28.299396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:28.361189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94176b20e2ea4a16986dbfd9e6766b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.362417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94176b20e2ea4a16986dbfd9e6766b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.376209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94176b20e2ea4a16986dbfd9e6766b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.376981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94176b20e2ea4a16986dbfd9e6766b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.385936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94176b20e2ea4a16986dbfd9e6766b08'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:28.404332 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2980/6043] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:28 2022] DELETE /identity/v3/users/94176b20e2ea4a16986dbfd9e6766b08 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:28.662661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:28.668659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:28.947026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae521fd-f84b-4ffd-a482-d932f536615e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:29.072243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:29.073153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:29.073440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:29.073761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:29.076196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:29.093510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:29.096952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:29.117444 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3064/6044] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:29.704246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:29.705954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:29.889560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:29.891934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:29.928626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05765-efe5-4aed-a010-e01e921b3f0c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:29.943972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:29.944886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:29.945200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:29.945534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] PATH_INFO: `/v3/projects/ca651df12dc844c28c0eb014688ef8b9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:29.946875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca651df12dc844c28c0eb014688ef8b9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:29.948827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.008136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f345-e973-4075-9136-8842282afb67 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.013836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.015416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.015812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.016225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] PATH_INFO: `/v3/users/7ce296c1004c4976930f46de34be880d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.021258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce296c1004c4976930f46de34be880d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.023366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.056399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca651df12dc844c28c0eb014688ef8b9', 'request_id': 'req-a94b9218-7269-4842-b22b-0962c6acb00d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.063235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca651df12dc844c28c0eb014688ef8b9', 'request_id': 'req-a94b9218-7269-4842-b22b-0962c6acb00d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.086415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca651df12dc844c28c0eb014688ef8b9', 'request_id': 'req-a94b9218-7269-4842-b22b-0962c6acb00d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.091239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce296c1004c4976930f46de34be880d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.092787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce296c1004c4976930f46de34be880d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.105929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce296c1004c4976930f46de34be880d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.110946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] The token cache is being invalidate because project ca651df12dc844c28c0eb014688ef8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:30.112022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.113356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a94b9218-7269-4842-b22b-0962c6acb00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.115600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2981/6045] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:29 2022] DELETE /identity/v3/projects/ca651df12dc844c28c0eb014688ef8b9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:30.122853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce296c1004c4976930f46de34be880d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.123009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56953c70-57e6-4d6a-ad8f-7d3f20983b25 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.123595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56953c70-57e6-4d6a-ad8f-7d3f20983b25 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.123810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63ca71c9-df85-437a-9766-d37422505e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce296c1004c4976930f46de34be880d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.124118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56953c70-57e6-4d6a-ad8f-7d3f20983b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.151695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-56953c70-57e6-4d6a-ad8f-7d3f20983b25 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:30.153101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-56953c70-57e6-4d6a-ad8f-7d3f20983b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:30.165112 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3065/6046] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:29 2022] DELETE /identity/v3/users/7ce296c1004c4976930f46de34be880d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:30.220547 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2982/6047] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:16:30.228873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35c67-71de-4841-844b-1ede3dffe9bb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.229351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35c67-71de-4841-844b-1ede3dffe9bb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.229745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35c67-71de-4841-844b-1ede3dffe9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.252767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-96b35c67-71de-4841-844b-1ede3dffe9bb None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:30.254187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-96b35c67-71de-4841-844b-1ede3dffe9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:30.329170 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3066/6048] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:30.331067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56953c70-57e6-4d6a-ad8f-7d3f20983b25 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:30.342948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56953c70-57e6-4d6a-ad8f-7d3f20983b25 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.351980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.352757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.353026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.353382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.354754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:16:30.354754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.356213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.377005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b35c67-71de-4841-844b-1ede3dffe9bb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:30.381179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2983/6049] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:30.387045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b35c67-71de-4841-844b-1ede3dffe9bb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.392783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.393628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.393908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.394179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.394866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.396807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.466194 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3067/6050] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:30 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:30.470712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:30.485493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea00a50-ae29-4a83-90dd-fdcd14b9e53b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.539758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:30.542139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:30.608817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.609637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.610068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.610809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.611131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.613658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.644047 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2984/6051] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:30 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:30.648184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:30.658291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e67c4-6bac-4aab-8b6b-ddac79a7e912 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.665595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba90a-f65a-49f6-9db6-28854cdca11d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.666071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.667396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.667872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.668304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] PATH_INFO: `/v3/projects/fdd53d98faf74d6a92cdfabace62b088` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.670329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd53d98faf74d6a92cdfabace62b088)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.670534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.671266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.671559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.671834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.672544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.673116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.674247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.691068 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2985/6052] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:30.692673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:30.708678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb7c36-bf77-4291-add8-9b0644f5ea37 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.715412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.716096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.716375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.716647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.717530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.719540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:30.768570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2986/6053] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:30.772493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:30.783976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd53d98faf74d6a92cdfabace62b088', 'request_id': 'req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.797460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd53d98faf74d6a92cdfabace62b088', 'request_id': 'req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.817874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb68ab-13c9-4a6a-ba37-d258165693e0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:30.819239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd53d98faf74d6a92cdfabace62b088', 'request_id': 'req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.874174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] The token cache is being invalidate because project fdd53d98faf74d6a92cdfabace62b088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:30.876968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.880503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-43ec9f42-2e91-48b3-b240-28d2b25ba5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:30.892614 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3068/6054] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:30 2022] DELETE /identity/v3/projects/fdd53d98faf74d6a92cdfabace62b088 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:30.894150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583090-86fe-4341-9e32-f570337a335b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.894434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583090-86fe-4341-9e32-f570337a335b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.894709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583090-86fe-4341-9e32-f570337a335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.951728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-08583090-86fe-4341-9e32-f570337a335b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:30.953263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-08583090-86fe-4341-9e32-f570337a335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:30.956343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad2b28-f715-411d-a968-d6e3faa140f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:30.957293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad2b28-f715-411d-a968-d6e3faa140f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.958187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad2b28-f715-411d-a968-d6e3faa140f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.958466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad2b28-f715-411d-a968-d6e3faa140f5 admin admin] PATH_INFO: `/v3/projects/ab125314b81b4857adcc9feb375aee7f/users/55f5b5f4f9834b349cbd3beec29d88a2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.972296 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3069/6055] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:30.974745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f35432-838e-4d44-9cc6-9fdf46cb6e7b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:30.975134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f35432-838e-4d44-9cc6-9fdf46cb6e7b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:30.975742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f35432-838e-4d44-9cc6-9fdf46cb6e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:30.987610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad2b28-f715-411d-a968-d6e3faa140f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab125314b81b4857adcc9feb375aee7f, user_id=55f5b5f4f9834b349cbd3beec29d88a2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:30.990607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad2b28-f715-411d-a968-d6e3faa140f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.000362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f9f35432-838e-4d44-9cc6-9fdf46cb6e7b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:31.002078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f9f35432-838e-4d44-9cc6-9fdf46cb6e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:31.024623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2987/6056] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:30 2022] PUT /identity/v3/projects/ab125314b81b4857adcc9feb375aee7f/users/55f5b5f4f9834b349cbd3beec29d88a2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:31.026749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.027059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.027214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.029214 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3070/6057] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:31.030311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f35432-838e-4d44-9cc6-9fdf46cb6e7b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.061267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f35432-838e-4d44-9cc6-9fdf46cb6e7b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.107135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] MFA Rules not processed for user `55f5b5f4f9834b349cbd3beec29d88a2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:31.111297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:31.213915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.214712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.215063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.215509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.216449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:16:31.219372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.224370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.251180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3071/6058] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:31.258158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.273306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7dff7-f5ec-42a9-bfff-a44a9ce447c8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.278689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.279363 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2988/6059] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:31.279765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.280329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.280767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.281641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.284870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.287986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.292872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:31.326090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41c3b-4a1b-4075-a16e-db270af31a61 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.334326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.336098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.336543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.336956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.337855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.340004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.356081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3072/6060] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:31 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:31.359924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.398248 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2989/6061] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:31 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:31.402107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.542767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61607-20c8-4301-a85b-583bdd2828a0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.601859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b4889-daf6-40c8-a69d-400eea96ab45 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.607570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.608526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.608950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.609408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.610244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.612554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.640514 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2990/6062] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:31 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:31.645257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.665931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d76120-19a1-4909-8b6f-054dfa8f654f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.679276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.680386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.680848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.681414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.682623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.684874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.695356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.696331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.697011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.699150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.699996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.704116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.734921 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2991/6063] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:16:31.736150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.753608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3073/6064] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:31 2022] POST /identity/v3/users => generated 285 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:31.755095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.761606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eccbc-d97c-43f3-94f8-40b707fd43e7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.773642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b8447-c070-4156-98d9-7e24738aefcd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.778566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.779742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.780230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.780670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] PATH_INFO: `/v3/projects/1899fdb5f4e14e0cb6bf9817cac1e42f/users/c66581dce5054afbb5eda237377adb9f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.786927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.788063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.788462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:31.789597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:31.789911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.791677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.814765 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3074/6065] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:31.820650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.826097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1899fdb5f4e14e0cb6bf9817cac1e42f, user_id=c66581dce5054afbb5eda237377adb9f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:31.831168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:31.855183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1902-af1d-4f5f-b192-97cf355b3514 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:31.856378 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2992/6066] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:31 2022] PUT /identity/v3/projects/1899fdb5f4e14e0cb6bf9817cac1e42f/users/c66581dce5054afbb5eda237377adb9f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:31.860549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:31.998187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:31.999596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:31.999950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.000293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.007840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:32.014192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8ff6-8711-4d0f-9a16-d10c3f95c9fe admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:32.015726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:32.026912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:32.027864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:32.028287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.028731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.029636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:32.031406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:32.048093 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3075/6067] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:32.050947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:32.058440 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2993/6068] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:16:32.062441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:32.083522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ba5b4-f933-49ff-93a3-b1b942b36838 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:32.084023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba4784-634a-42b9-aec3-5cfe4319d9df admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:32.095575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb015a2e-4810-4467-b854-873fdcdaf829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:32.097787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2326de-b40b-44dc-83a2-8ad06c5d8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:32.099180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015a2e-4810-4467-b854-873fdcdaf829 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:32.101385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2326de-b40b-44dc-83a2-8ad06c5d8449 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:32.102854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2326de-b40b-44dc-83a2-8ad06c5d8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.103487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2326de-b40b-44dc-83a2-8ad06c5d8449 admin admin] PATH_INFO: `/v3/projects/0a53a71717164e288c284b7087507123/users/0c1369f138a14529910e9d928579e672/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.106090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015a2e-4810-4467-b854-873fdcdaf829 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.107281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015a2e-4810-4467-b854-873fdcdaf829 admin admin] PATH_INFO: `/v3/projects/1899fdb5f4e14e0cb6bf9817cac1e42f/users/c66581dce5054afbb5eda237377adb9f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.113462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb015a2e-4810-4467-b854-873fdcdaf829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1899fdb5f4e14e0cb6bf9817cac1e42f, user_id=c66581dce5054afbb5eda237377adb9f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:32.126576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb015a2e-4810-4467-b854-873fdcdaf829 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:32.174402 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2994/6069] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:32 2022] PUT /identity/v3/projects/1899fdb5f4e14e0cb6bf9817cac1e42f/users/c66581dce5054afbb5eda237377adb9f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:32.176578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:32.176854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2326de-b40b-44dc-83a2-8ad06c5d8449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a53a71717164e288c284b7087507123, user_id=0c1369f138a14529910e9d928579e672, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:32.177520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.178015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.201665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2326de-b40b-44dc-83a2-8ad06c5d8449 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:32.278281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] MFA Rules not processed for user `c66581dce5054afbb5eda237377adb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:32.279262 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3076/6070] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:32 2022] PUT /identity/v3/projects/0a53a71717164e288c284b7087507123/users/0c1369f138a14529910e9d928579e672/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:32.281260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:32.291857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde6fb-3b52-49e8-ad36-a64ac75dbd1a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:32.292419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde6fb-3b52-49e8-ad36-a64ac75dbd1a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.294007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde6fb-3b52-49e8-ad36-a64ac75dbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.385695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d0bde6fb-3b52-49e8-ad36-a64ac75dbd1a None None] MFA Rules not processed for user `0c1369f138a14529910e9d928579e672`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:32.386959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0bde6fb-3b52-49e8-ad36-a64ac75dbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:32.409951 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2995/6071] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:32.415961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:32.419333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:32.542287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc9aaa-f7a9-48a2-9327-c51e2c8c6a13 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:32.576799 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3077/6072] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:32.578701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde6fb-3b52-49e8-ad36-a64ac75dbd1a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:32.584683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:32.585959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:32.586737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.587458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.721363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde6fb-3b52-49e8-ad36-a64ac75dbd1a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:32.728055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:32.728780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:32.729249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:32.729393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:32.729527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:32.730928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:32.732275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:32.734093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:32.754477 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2996/6073] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:32.789444 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3078/6074] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:32 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:32.793977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:32.822699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914dfb-1e5a-43d9-841c-f6f609527857 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:33.012191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:33.014893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:33.015272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:33.016165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:33.018788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:33.026925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:33.091660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2997/6075] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:32 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:33.096964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:33.120586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f41c33-3e1c-4121-9fdc-4251a6679323 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:33.153844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:33.156630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:33.158287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:33.160130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:33.163041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:33.169105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:33.215072 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3079/6076] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:33.219896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:33.234750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf925-61f2-479c-8a39-d0e54941bdc3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:33.254280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:33.258674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:33.259043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:33.260902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] PATH_INFO: `/v3/projects/f3a4ff3326af44129021661d75b42c1c/users/e4cad3a3e5d94f08b40062970df8ba4c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:33.302140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a4ff3326af44129021661d75b42c1c, user_id=e4cad3a3e5d94f08b40062970df8ba4c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:33.309590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:33.342100 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2998/6077] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:33 2022] PUT /identity/v3/projects/f3a4ff3326af44129021661d75b42c1c/users/e4cad3a3e5d94f08b40062970df8ba4c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:33.343065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:33.358697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79016e-5f69-4f3f-99b3-ce35cc1b5447 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:33.570858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa953b9-376b-4e02-a2f5-c81323e01030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:33.572107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa953b9-376b-4e02-a2f5-c81323e01030 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:33.572532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa953b9-376b-4e02-a2f5-c81323e01030 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:33.572907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa953b9-376b-4e02-a2f5-c81323e01030 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:33.573801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa953b9-376b-4e02-a2f5-c81323e01030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:33.576249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa953b9-376b-4e02-a2f5-c81323e01030 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:33.591170 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3080/6078] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:16:33.595887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:33.612332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c6968-924b-48d2-bc81-00cedb809196 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:33.623262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:33.624310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:33.627657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:33.628623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] PATH_INFO: `/v3/projects/f3a4ff3326af44129021661d75b42c1c/users/e4cad3a3e5d94f08b40062970df8ba4c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:33.631026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a4ff3326af44129021661d75b42c1c, user_id=e4cad3a3e5d94f08b40062970df8ba4c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:33.634423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:33.653573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 2999/6079] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:33 2022] PUT /identity/v3/projects/f3a4ff3326af44129021661d75b42c1c/users/e4cad3a3e5d94f08b40062970df8ba4c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:33.665211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8602bbd-999d-4d4a-b436-d0c6b58556b7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:33.665654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8602bbd-999d-4d4a-b436-d0c6b58556b7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:33.666063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8602bbd-999d-4d4a-b436-d0c6b58556b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:33.755895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c8602bbd-999d-4d4a-b436-d0c6b58556b7 None None] MFA Rules not processed for user `e4cad3a3e5d94f08b40062970df8ba4c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:33.762364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c8602bbd-999d-4d4a-b436-d0c6b58556b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:33.915354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3081/6080] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:33.921459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:33.944992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d30ade-74ce-4206-a0a6-6c57a8aee2ae admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:33.951812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb99bc-a3bb-48f0-bd7a-90e8c0f7e443 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:33.953078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb99bc-a3bb-48f0-bd7a-90e8c0f7e443 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:33.953203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb99bc-a3bb-48f0-bd7a-90e8c0f7e443 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:33.953427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb99bc-a3bb-48f0-bd7a-90e8c0f7e443 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:33.955926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb99bc-a3bb-48f0-bd7a-90e8c0f7e443 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:33.959486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb99bc-a3bb-48f0-bd7a-90e8c0f7e443 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:34.012053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8602bbd-999d-4d4a-b436-d0c6b58556b7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:34.026124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3000/6081] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:16:33 2022] POST /identity/v3/domains => generated 275 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:34.035341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8602bbd-999d-4d4a-b436-d0c6b58556b7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:34.179104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023cf6-59f2-4319-a3e4-5bee88d259e7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.179388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023cf6-59f2-4319-a3e4-5bee88d259e7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.179704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023cf6-59f2-4319-a3e4-5bee88d259e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.236697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e3023cf6-59f2-4319-a3e4-5bee88d259e7 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:34.239448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e3023cf6-59f2-4319-a3e4-5bee88d259e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:34.243201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:34.244188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.244790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.245109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.246972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:34.252039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:34.317119 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3082/6082] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:34 2022] POST /identity/v3/groups => generated 279 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:34.318987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:34.342508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c258eb-91e4-4cec-a67b-aa8c3b961f5d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:34.352877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:34.353847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.354137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.355246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/df0e851e778343abaab6612afe7c72a2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.361304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:update_group(group_id=df0e851e778343abaab6612afe7c72a2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:34.362949 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:34.362949 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:16:34.362949 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:16:34.365689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:34.407581 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3083/6083] 10.222.0.30 () {60 vars in 1246 bytes} [Sat Apr 9 21:16:34 2022] PATCH /identity/v3/groups/df0e851e778343abaab6612afe7c72a2 => generated 291 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:16:34.409225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:34.412465 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3001/6084] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:34.422828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f0a1-393e-441f-9947-6919508efc41 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:34.430439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:34.431330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.431330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.431577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/df0e851e778343abaab6612afe7c72a2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.440110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:get_group(group_id=df0e851e778343abaab6612afe7c72a2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:34.441264 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:34.441264 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:16:34.441264 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:16:34.442523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:34.449150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3023cf6-59f2-4319-a3e4-5bee88d259e7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:34.465151 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3084/6085] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:34 2022] GET /identity/v3/groups/df0e851e778343abaab6612afe7c72a2 => generated 291 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:34.473179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3023cf6-59f2-4319-a3e4-5bee88d259e7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:34.478779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:34.480532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:34.483856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:34.485101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.485544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.486941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/df0e851e778343abaab6612afe7c72a2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.489917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:update_group(group_id=df0e851e778343abaab6612afe7c72a2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:34.491535 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:34.491535 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:16:34.491535 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:16:34.495772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:34.543522 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3002/6086] 10.222.0.30 () {60 vars in 1245 bytes} [Sat Apr 9 21:16:34 2022] PATCH /identity/v3/groups/df0e851e778343abaab6612afe7c72a2 => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:34.548719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:34.572120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2873ec4-1cfd-49b7-9051-75bdccb317cd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:34.590680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:34.591575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.591853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.592125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/df0e851e778343abaab6612afe7c72a2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.604501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=df0e851e778343abaab6612afe7c72a2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:34.606284 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:34.606284 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:16:34.606284 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:16:34.607485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:34.656699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01843c77-fb47-428a-b609-4aaa96602d39 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:34.664297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:34.665369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.665749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.666960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.677291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:34.679238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:34.711529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3085/6087] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:16:34.772967 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3003/6088] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:34 2022] DELETE /identity/v3/groups/df0e851e778343abaab6612afe7c72a2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:34.778092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:34.811043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4d58-59f7-4fe9-a7b2-68521855fb73 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:34.968391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:34.968891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:34.973187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:34.973881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:34.974618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:34.984576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:35.027139 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3086/6089] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:34 2022] POST /identity/v3/groups => generated 326 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:35.028652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:35.047298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba13f52-85c1-4bbe-8e34-ea8b0323a793 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:35.053334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:35.054304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:35.054769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:35.055185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:35.056920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:35.059234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:35.115828 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3004/6090] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:35 2022] POST /identity/v3/users => generated 321 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:35.120630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:35.141569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f456-c00b-4bca-a95e-cac1779f71d0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:35.150690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:35.153296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:35.153995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:35.154526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/49cc9ed0167d4986a0179e74a75201d3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:35.196278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=49cc9ed0167d4986a0179e74a75201d3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:35.197760 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:35.197760 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:16:35.197760 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:16:35.199299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:35.259249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3087/6091] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:16:35 2022] PUT /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/49cc9ed0167d4986a0179e74a75201d3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:35.263386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:35.275568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0a15-da22-48e7-91c9-4031a9f66b5b tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:35.460581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:35.461587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:35.461966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:35.462339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:35.463139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:35.467619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:35.546422 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3005/6092] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:35 2022] POST /identity/v3/users => generated 319 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:35.550340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:35.569014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c29c-3ce6-4f20-88ea-3d2188fe8fb2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:35.589067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:35.590408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:35.591718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:35.593285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/3a8e3758bdba43848bf8c1989b617b40` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:35.643217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=3a8e3758bdba43848bf8c1989b617b40)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:35.656733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:35.739193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3088/6093] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:16:35 2022] PUT /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/3a8e3758bdba43848bf8c1989b617b40 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:35.740830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:35.759954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6d5dd-b79e-4ec0-bc86-7f02d3e252b4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:35.862118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:35.863518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:35.864163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:35.864490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:35.865340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:35.870721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:35.934588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3006/6094] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:35 2022] POST /identity/v3/users => generated 323 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:35.936811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:35.955336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebb072-b198-4cd4-a0ea-bcd29699d7d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:35.970686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:35.971651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:35.971937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:35.972216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/5dbd7ea4edec428ab1d34b362d03ee94` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.009798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=5dbd7ea4edec428ab1d34b362d03ee94)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.023319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.065241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.108221 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3089/6095] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:16:35 2022] PUT /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/5dbd7ea4edec428ab1d34b362d03ee94 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:36.112492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.171684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0071-d0c1-41de-bff5-048a787534b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.218123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab92c-47e9-4e37-9eb4-8d2e142fc85a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.225387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.226383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.227051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.232841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.234453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=1bbf3955434a469a878a196d81b37f5a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.235991 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:36.235991 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:16:36.235991 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:16:36.237784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.242543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.243489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.245277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.246401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.263803 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3090/6096] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:16:36 2022] GET /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users => generated 1079 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:36.268571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.284795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d22fb-6994-4d6f-8d6a-783c52f05376 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.298737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.299792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.301389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.301688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/49cc9ed0167d4986a0179e74a75201d3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.306717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=49cc9ed0167d4986a0179e74a75201d3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.310916 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:36.310916 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:16:36.310916 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:16:36.312208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.338766 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3091/6097] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Apr 9 21:16:36 2022] HEAD /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/49cc9ed0167d4986a0179e74a75201d3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:36.342734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.349957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.352592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.359393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d120-2f25-42ff-878c-bbe01234d0c8 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.364537 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3007/6098] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:36.368413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.369751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.370291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.371343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/49cc9ed0167d4986a0179e74a75201d3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.372627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=49cc9ed0167d4986a0179e74a75201d3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.374009 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:36.374009 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:16:36.374009 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:16:36.375593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.393262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49cc9ed0167d4986a0179e74a75201d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:36.469794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3092/6099] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:16:36 2022] DELETE /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/49cc9ed0167d4986a0179e74a75201d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:36.471214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.491216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7988e97-1079-4363-8886-72038f223caf service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.613898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.616768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.617584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.618095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/3a8e3758bdba43848bf8c1989b617b40` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.620757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=3a8e3758bdba43848bf8c1989b617b40)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.622510 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:36.622510 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:16:36.622510 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:16:36.624197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.656376 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3008/6100] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Apr 9 21:16:36 2022] HEAD /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/3a8e3758bdba43848bf8c1989b617b40 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:36.659297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.671613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f8c4-4605-4a9d-b752-d711980e6989 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.678981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.680060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.680342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.683298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/3a8e3758bdba43848bf8c1989b617b40` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.685681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=3a8e3758bdba43848bf8c1989b617b40)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.687645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.699548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3a8e3758bdba43848bf8c1989b617b40'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:36.720570 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3093/6101] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:16:36 2022] DELETE /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/3a8e3758bdba43848bf8c1989b617b40 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:36.725181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.738415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da63abc-1cf2-46d3-b123-fed67a119723 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.892940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.895910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.897159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.897464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/5dbd7ea4edec428ab1d34b362d03ee94` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.901683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=5dbd7ea4edec428ab1d34b362d03ee94)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.903579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.924929 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3009/6102] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Apr 9 21:16:36 2022] HEAD /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/5dbd7ea4edec428ab1d34b362d03ee94 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:36.929681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:36.948252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7140466-899e-4f38-adde-f2f3e65a787d tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:36.957732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:36.958681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:36.959228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:36.959513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/5dbd7ea4edec428ab1d34b362d03ee94` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:36.964161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=1bbf3955434a469a878a196d81b37f5a, user_id=5dbd7ea4edec428ab1d34b362d03ee94)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:36.970659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:36.983347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5dbd7ea4edec428ab1d34b362d03ee94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.016583 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3094/6103] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:16:36 2022] DELETE /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users/5dbd7ea4edec428ab1d34b362d03ee94 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:37.020495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:37.034717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb96842-7115-4227-909e-81fad3c2c3bc tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:37.165834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:37.166584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:37.166922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:37.167220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:37.168528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=1bbf3955434a469a878a196d81b37f5a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:37.172145 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:37.172145 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:16:37.172145 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:16:37.183323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:37.205197 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3010/6104] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:16:37 2022] GET /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a/users => generated 145 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:16:37.206837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:37.219066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026f959-52a8-491d-8f11-3b496f9d52a0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:37.224482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:37.226183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:37.226753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:37.227241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users/5dbd7ea4edec428ab1d34b362d03ee94` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:37.228774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5dbd7ea4edec428ab1d34b362d03ee94)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:37.230978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:37.309787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbd7ea4edec428ab1d34b362d03ee94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.310797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbd7ea4edec428ab1d34b362d03ee94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.320902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbd7ea4edec428ab1d34b362d03ee94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.336821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbd7ea4edec428ab1d34b362d03ee94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.337591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbd7ea4edec428ab1d34b362d03ee94'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.371236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3095/6105] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:37 2022] DELETE /identity/v3/users/5dbd7ea4edec428ab1d34b362d03ee94 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:37.372822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:37.379207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:37.397523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e220c-215a-46ce-983e-65bafec71119 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:37.518494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:37.519495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:37.519773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:37.520043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users/3a8e3758bdba43848bf8c1989b617b40` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:37.522879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3a8e3758bdba43848bf8c1989b617b40)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:37.525269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:37.605971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8e3758bdba43848bf8c1989b617b40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.606915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8e3758bdba43848bf8c1989b617b40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.620682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8e3758bdba43848bf8c1989b617b40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.621748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8e3758bdba43848bf8c1989b617b40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.644271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8e3758bdba43848bf8c1989b617b40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.676705 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3011/6106] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:37 2022] DELETE /identity/v3/users/3a8e3758bdba43848bf8c1989b617b40 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:37.680772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:37.702088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77fd96-fdc4-4b8f-8831-74c075bebf97 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:37.797825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:37.798914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:37.800266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:37.800528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users/49cc9ed0167d4986a0179e74a75201d3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:37.806262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49cc9ed0167d4986a0179e74a75201d3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:37.808461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:37.928353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cc9ed0167d4986a0179e74a75201d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.929776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cc9ed0167d4986a0179e74a75201d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.940507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cc9ed0167d4986a0179e74a75201d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.960727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cc9ed0167d4986a0179e74a75201d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:37.967672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cc9ed0167d4986a0179e74a75201d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:38.025489 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3096/6107] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:37 2022] DELETE /identity/v3/users/49cc9ed0167d4986a0179e74a75201d3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:38.026415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:38.034181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:38.060396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda84c58-7893-4c7a-9341-c77b9e9818b0 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:38.161163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:38.162062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:38.162351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:38.162630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/1bbf3955434a469a878a196d81b37f5a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:38.163966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1bbf3955434a469a878a196d81b37f5a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:38.165949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:38.233471 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3012/6108] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:38 2022] DELETE /identity/v3/groups/1bbf3955434a469a878a196d81b37f5a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:38.239676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:38.241184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:38.262135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e379be-efe2-4dab-82d8-f4d4cf8d4f22 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:38.364554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:38.365483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:38.366157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:38.366682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:38.367725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:38.370268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:38.396367 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3097/6109] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:38 2022] POST /identity/v3/groups => generated 326 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:38.400193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:38.416007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc844-c142-4e02-98f7-e3b8472bcdea tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:38.424464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:38.425999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:38.433638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:38.433926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:38.443244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:38.444349 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:38.444349 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:16:38.444349 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:16:38.445647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:38.489723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3013/6110] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:38 2022] POST /identity/v3/groups => generated 326 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:38.493906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:38.512061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601c2e7-b672-43f4-8166-0c1553a36775 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:38.517790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:38.518504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:38.518788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:38.519103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:38.519811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:38.521827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:38.563656 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3098/6111] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:38 2022] POST /identity/v3/groups => generated 326 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:38.568075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:38.585168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f395ca-03b0-43ee-95bf-f0d793ba94f2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:38.608769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:38.611739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:38.612191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:38.612568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:38.613507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:38.618360 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:38.618360 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:16:38.618360 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:16:38.620282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:38.634060 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3014/6112] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:16:38 2022] GET /identity/v3/groups => generated 1488 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:38.638136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:38.649597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340986-0919-49be-a882-aaf67f54bdc4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:38.656530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:38.657658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:38.657948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:38.658541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/0c5c915ad5b54938a204e045aa234b30` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:38.676714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0c5c915ad5b54938a204e045aa234b30)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:38.678702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:38.740384 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3099/6113] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:38 2022] DELETE /identity/v3/groups/0c5c915ad5b54938a204e045aa234b30 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:38.744395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:38.761344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc706-5b95-451c-8672-e25554d0493f tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:38.875690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:38.877188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:38.878432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:38.878888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/961a1bc53cc04db38425462b8c5e183e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:38.888824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=961a1bc53cc04db38425462b8c5e183e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:38.893251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:38.982089 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3015/6114] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:38 2022] DELETE /identity/v3/groups/961a1bc53cc04db38425462b8c5e183e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:38.987464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:39.021189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b288-0d11-4a3d-8fe2-451c61f50feb tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:39.179231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:39.180201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:39.180494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:39.180767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/72b9e6feed2d446693eea201c1adc9a4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:39.186733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=72b9e6feed2d446693eea201c1adc9a4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:39.189890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:39.250029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3100/6115] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:38 2022] DELETE /identity/v3/groups/72b9e6feed2d446693eea201c1adc9a4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:39.255197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:39.268044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2f2f-c755-465d-b606-d726b36b14ba tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:39.332194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:39.333150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:39.334179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:39.335274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:39.337797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:39.340569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:39.387833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:39.389244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3016/6116] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:39 2022] POST /identity/v3/users => generated 323 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:39.405920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a9389-773e-497c-a158-ec871a5e54d2 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:39.413371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:39.414942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:39.424233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:39.425108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:39.426615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:39.430142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:39.459608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3101/6117] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:39 2022] POST /identity/v3/groups => generated 325 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:39.461196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:39.484221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dfe82-206c-4085-acf6-d6e202ce3a88 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:39.507862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:39.514478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:39.515355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:39.515936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/bf6bc3ed3a294a76881724479e990824/users/bc929ef1b3b64dd198e292be042aa0b0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:39.573877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bf6bc3ed3a294a76881724479e990824, user_id=bc929ef1b3b64dd198e292be042aa0b0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:39.576083 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:39.576083 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:16:39.576083 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:16:39.578743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:39.680937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:39.681095 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3017/6118] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:16:39 2022] PUT /identity/v3/groups/bf6bc3ed3a294a76881724479e990824/users/bc929ef1b3b64dd198e292be042aa0b0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:39.698632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ce262-d54b-493f-81aa-e525f79bc124 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:39.838899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:39.839633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:39.839633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:39.840461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:39.841970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:39.845574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:39.876474 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3102/6119] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:39 2022] POST /identity/v3/groups => generated 325 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:39.878005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:39.892823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea407-6adf-4365-9070-5789cb7a25d9 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:39.904382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:39.905363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:39.905654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:39.905933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/cc2a7ca7bd7748179c4aad297d223bcc/users/bc929ef1b3b64dd198e292be042aa0b0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:39.918886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cc2a7ca7bd7748179c4aad297d223bcc, user_id=bc929ef1b3b64dd198e292be042aa0b0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:39.921419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:39.978977 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3018/6120] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:16:39 2022] PUT /identity/v3/groups/cc2a7ca7bd7748179c4aad297d223bcc/users/bc929ef1b3b64dd198e292be042aa0b0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:39.983043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:40.030264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb24de-d6fb-471d-b872-8a28924d0245 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:40.131312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:40.132713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:40.133016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:40.133501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users/bc929ef1b3b64dd198e292be042aa0b0/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:40.135827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=bc929ef1b3b64dd198e292be042aa0b0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:40.138588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:40.161351 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3103/6121] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:16:39 2022] GET /identity/v3/users/bc929ef1b3b64dd198e292be042aa0b0/groups => generated 836 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:40.165559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:40.179091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573553c-aee7-4f17-9e97-174e00267efd tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:40.184828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:40.186944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:40.187082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:40.187503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/cc2a7ca7bd7748179c4aad297d223bcc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:40.188972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cc2a7ca7bd7748179c4aad297d223bcc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:40.191231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:40.327507 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3019/6122] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:40 2022] DELETE /identity/v3/groups/cc2a7ca7bd7748179c4aad297d223bcc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:40.331912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:40.349172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bcc47-27dc-48d8-9c5a-82f920eee4a3 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:40.428365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:40.429462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:40.429997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:40.430307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/groups/bf6bc3ed3a294a76881724479e990824` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:40.431868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bf6bc3ed3a294a76881724479e990824)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:40.434488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:40.502995 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3104/6123] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:40 2022] DELETE /identity/v3/groups/bf6bc3ed3a294a76881724479e990824 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:40.508269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:40.524526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9981d9-3bf1-4a16-b7c9-2cdecd947150 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:40.588705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:40.589902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:40.590198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:40.590471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/users/bc929ef1b3b64dd198e292be042aa0b0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:40.591940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bc929ef1b3b64dd198e292be042aa0b0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:40.593936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:40.643710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc929ef1b3b64dd198e292be042aa0b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.644761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc929ef1b3b64dd198e292be042aa0b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.652720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc929ef1b3b64dd198e292be042aa0b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.654427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc929ef1b3b64dd198e292be042aa0b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.698543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc929ef1b3b64dd198e292be042aa0b0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.729523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3020/6124] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:40 2022] DELETE /identity/v3/users/bc929ef1b3b64dd198e292be042aa0b0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:40.730207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:40.732101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:40.753896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3d19-483c-41bf-bdf1-348beb74223a tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:40.858263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:40.860154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:40.860803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:40.862314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/domains/b321d80fe5b04afcba5af50bbfd985e9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:40.865363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b321d80fe5b04afcba5af50bbfd985e9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:40.868367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:40.894631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.895584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.935199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.936028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:40.939898 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3105/6125] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:40 2022] PATCH /identity/v3/domains/b321d80fe5b04afcba5af50bbfd985e9 => generated 276 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:16:40.945482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:40.961816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3240b6-7787-42c4-bd2a-5c35b1677248 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:41.061803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4cad3a3e5d94f08b40062970df8ba4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a4ff3326af44129021661d75b42c1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:41.062724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:41.063827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:41.064115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] PATH_INFO: `/v3/domains/b321d80fe5b04afcba5af50bbfd985e9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:41.090881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b321d80fe5b04afcba5af50bbfd985e9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:41.093129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:41.126420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.142974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.237016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9', 'request_id': 'req-1aca7351-0cc1-4abb-b276-9209bb1581d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.256074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9', 'request_id': 'req-1aca7351-0cc1-4abb-b276-9209bb1581d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.267804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9', 'request_id': 'req-1aca7351-0cc1-4abb-b276-9209bb1581d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.283347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] The token cache is being invalidate because project b321d80fe5b04afcba5af50bbfd985e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:41.284009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.285835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.298016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9', 'request_id': 'req-1aca7351-0cc1-4abb-b276-9209bb1581d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.298918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9', 'request_id': 'req-1aca7351-0cc1-4abb-b276-9209bb1581d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.304049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1aca7351-0cc1-4abb-b276-9209bb1581d4 tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b321d80fe5b04afcba5af50bbfd985e9', 'request_id': 'req-1aca7351-0cc1-4abb-b276-9209bb1581d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.311922 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3021/6126] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:16:40 2022] DELETE /identity/v3/domains/b321d80fe5b04afcba5af50bbfd985e9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:41.317589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:41.319596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:41.426258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32211473-8a9a-413c-85a9-ccb2885590de tempest-GroupsV3TestJSON-1145883656 tempest-GroupsV3TestJSON-1145883656-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:41.497221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:41.498040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:41.498316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:41.498767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] PATH_INFO: `/v3/users/0c1369f138a14529910e9d928579e672` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:41.500020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1369f138a14529910e9d928579e672)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:41.502228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:41.560354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1369f138a14529910e9d928579e672'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.561394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1369f138a14529910e9d928579e672'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.569995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1369f138a14529910e9d928579e672'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.579342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1369f138a14529910e9d928579e672'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.580132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1369f138a14529910e9d928579e672'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:41.601929 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3106/6127] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:41 2022] DELETE /identity/v3/users/0c1369f138a14529910e9d928579e672 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:41.604102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:41.604554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:41.604632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:41.622283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:41.623868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:41.690583 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3022/6128] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:41.709079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:41.710826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:41.781882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc413f-ed70-40d9-b4c7-84dde39ce698 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:41.786235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:41.786902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:41.787179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:41.787448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:41.798069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:41.799546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:41.809971 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3107/6129] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:16:42.488957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:42.490877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:42.505505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817f137-24c0-412b-b4b0-f04dd71e56ba None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:42.518908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:42.520260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:42.520702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:42.521165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] PATH_INFO: `/v3/projects/0a53a71717164e288c284b7087507123` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:42.527526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a53a71717164e288c284b7087507123)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:42.541132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:42.628883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a53a71717164e288c284b7087507123', 'request_id': 'req-4636709c-818c-46ca-9df1-be58c349309f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.638830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a53a71717164e288c284b7087507123', 'request_id': 'req-4636709c-818c-46ca-9df1-be58c349309f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.650236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a53a71717164e288c284b7087507123', 'request_id': 'req-4636709c-818c-46ca-9df1-be58c349309f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.672216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] The token cache is being invalidate because project 0a53a71717164e288c284b7087507123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:42.672818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.674680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.678235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3023/6130] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:42 2022] DELETE /identity/v3/projects/0a53a71717164e288c284b7087507123 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:42.681922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:42.694234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11f7a4-e40c-4e96-99e3-c0de116179b1 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:42.772750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:42.774081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:42.774363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:42.774816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] PATH_INFO: `/v3/users/e4cad3a3e5d94f08b40062970df8ba4c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:42.775896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cad3a3e5d94f08b40062970df8ba4c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:42.778316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:42.858036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cad3a3e5d94f08b40062970df8ba4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.859037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cad3a3e5d94f08b40062970df8ba4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.871866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cad3a3e5d94f08b40062970df8ba4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.886764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cad3a3e5d94f08b40062970df8ba4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.887837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a121b18-7671-4dd5-bf3e-03dbb837db4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cad3a3e5d94f08b40062970df8ba4c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:42.912780 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3108/6131] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:42 2022] DELETE /identity/v3/users/e4cad3a3e5d94f08b40062970df8ba4c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:44.050220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:44.052371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:44.070429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636709c-818c-46ca-9df1-be58c349309f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:44.172963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:44.174143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:44.174432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:44.175068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] PATH_INFO: `/v3/projects/f3a4ff3326af44129021661d75b42c1c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:44.176336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a4ff3326af44129021661d75b42c1c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:44.178873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:44.287873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a4ff3326af44129021661d75b42c1c', 'request_id': 'req-c97f77f5-b96a-4b28-bd2e-799999bd01a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:44.297845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a4ff3326af44129021661d75b42c1c', 'request_id': 'req-c97f77f5-b96a-4b28-bd2e-799999bd01a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:44.312775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a4ff3326af44129021661d75b42c1c', 'request_id': 'req-c97f77f5-b96a-4b28-bd2e-799999bd01a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:44.333167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] The token cache is being invalidate because project f3a4ff3326af44129021661d75b42c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:44.333429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:44.334449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c97f77f5-b96a-4b28-bd2e-799999bd01a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:44.337068 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3024/6132] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:44 2022] DELETE /identity/v3/projects/f3a4ff3326af44129021661d75b42c1c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:44.341700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83cf4-8ad2-4904-90bb-731ea0aab5ed None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:44.342111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83cf4-8ad2-4904-90bb-731ea0aab5ed None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:44.342268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83cf4-8ad2-4904-90bb-731ea0aab5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:44.364098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c8e83cf4-8ad2-4904-90bb-731ea0aab5ed None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:44.365649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c8e83cf4-8ad2-4904-90bb-731ea0aab5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:44.488066 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3109/6133] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:44.495825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aa155-d8d4-47d5-aa85-2f3f0dd9bf5c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:44.496117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aa155-d8d4-47d5-aa85-2f3f0dd9bf5c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:44.496375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aa155-d8d4-47d5-aa85-2f3f0dd9bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:44.546183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8e4aa155-d8d4-47d5-aa85-2f3f0dd9bf5c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:44.552907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8e4aa155-d8d4-47d5-aa85-2f3f0dd9bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:44.585247 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3025/6134] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:44.589299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83cf4-8ad2-4904-90bb-731ea0aab5ed None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:44.605006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83cf4-8ad2-4904-90bb-731ea0aab5ed None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:44.616694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:44.618327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:44.618622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:44.618908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:44.619657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:16:44.619973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:44.622173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:44.645501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aa155-d8d4-47d5-aa85-2f3f0dd9bf5c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:44.655268 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3110/6135] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:44.656297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aa155-d8d4-47d5-aa85-2f3f0dd9bf5c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:44.664122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:44.664878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:44.665192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:44.665604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:44.666434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:44.668554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:44.709583 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3026/6136] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:44 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:44.714301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:44.730724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887705a0-245e-400a-85e4-1b6f2d8f1891 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:44.948815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:44.949998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:44.950589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:44.950731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:44.961328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:44.991746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.033623 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3111/6137] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:44 2022] POST /identity/v3/users => generated 284 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:45.036839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.052345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7b54c-d9b1-4e0b-804a-e02249cc92c3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.068133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.068965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.069272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.069710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.070629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:45.072436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.090354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.096848 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3027/6138] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:45.101463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403568b-dd5d-4f5f-aec9-2c782b2a93e4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.108843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8fd44-df80-485f-8979-84e86a28450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.110018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8fd44-df80-485f-8979-84e86a28450a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.110716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8fd44-df80-485f-8979-84e86a28450a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.111173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8fd44-df80-485f-8979-84e86a28450a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.112108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8fd44-df80-485f-8979-84e86a28450a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:45.114034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8fd44-df80-485f-8979-84e86a28450a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.138513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3112/6139] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:45.140672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.153165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfc1d8-6f7a-41af-a718-61b5efb68d0e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.165791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.167167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.168289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.168735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] PATH_INFO: `/v3/projects/32787d00a39648a7bb4797e6a5841b8e/users/794a5939e00441d1aab451fd798f4c4e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.192777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=32787d00a39648a7bb4797e6a5841b8e, user_id=794a5939e00441d1aab451fd798f4c4e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:45.198628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.223699 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3028/6140] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:45 2022] PUT /identity/v3/projects/32787d00a39648a7bb4797e6a5841b8e/users/794a5939e00441d1aab451fd798f4c4e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:45.244425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263338ae-2f86-4bca-afcb-548e349c6722 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.245812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263338ae-2f86-4bca-afcb-548e349c6722 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.246707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263338ae-2f86-4bca-afcb-548e349c6722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.295700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-263338ae-2f86-4bca-afcb-548e349c6722 None None] MFA Rules not processed for user `794a5939e00441d1aab451fd798f4c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:45.298110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-263338ae-2f86-4bca-afcb-548e349c6722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:45.405676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.407809 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3113/6141] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:45.498767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ff6f6-4ef1-4b81-a70e-c018ea9fe7dd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.505579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.506470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.506827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.507176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.508480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:45.510579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.544478 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3029/6142] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:45 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:45.549779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263338ae-2f86-4bca-afcb-548e349c6722 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.564992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263338ae-2f86-4bca-afcb-548e349c6722 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.657673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.658808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.659202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.659419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.660671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:45.664115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.722048 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3114/6143] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:45 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:45.729386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.743958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8316bb7-15fa-4bc4-96d0-1fbfe2e0511e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.759074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.759945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.760319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.760935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.762545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:45.763955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.788304 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3030/6144] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:45.789731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.807922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d330d-67cc-49df-9654-d9662c314a78 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.814963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.819279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.819279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.819279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] PATH_INFO: `/v3/projects/8ead5d618a394bffa0f56dce3109b590/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.838610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ead5d618a394bffa0f56dce3109b590, user_id=7d44390e230845a4b4974503a2379c68, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:45.842408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:45.876768 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3115/6145] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:45 2022] PUT /identity/v3/projects/8ead5d618a394bffa0f56dce3109b590/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:45.881880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:45.897402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f043a-555c-424c-a621-38c207490b78 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:45.994453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6849e-9c1a-41b6-a1e6-9af32b600ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:45.995252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6849e-9c1a-41b6-a1e6-9af32b600ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:45.995783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6849e-9c1a-41b6-a1e6-9af32b600ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:45.996383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6849e-9c1a-41b6-a1e6-9af32b600ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:45.997589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6849e-9c1a-41b6-a1e6-9af32b600ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:46.000697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6849e-9c1a-41b6-a1e6-9af32b600ce0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:46.015360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3031/6146] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:46.019898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:46.034346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09a841-cbec-4f03-8cdf-18623f206b35 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:46.043157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:46.044395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.044757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.045057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] PATH_INFO: `/v3/projects/8ead5d618a394bffa0f56dce3109b590/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.047908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ead5d618a394bffa0f56dce3109b590, user_id=7d44390e230845a4b4974503a2379c68, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:46.052975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:46.078512 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3116/6147] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:46 2022] PUT /identity/v3/projects/8ead5d618a394bffa0f56dce3109b590/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:46.085260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8073516-b2a8-47e6-9f74-4bffdba2c159 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.086428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8073516-b2a8-47e6-9f74-4bffdba2c159 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.087020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8073516-b2a8-47e6-9f74-4bffdba2c159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.159095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a8073516-b2a8-47e6-9f74-4bffdba2c159 None None] MFA Rules not processed for user `7d44390e230845a4b4974503a2379c68`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:46.161180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a8073516-b2a8-47e6-9f74-4bffdba2c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:46.311901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3032/6148] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:46.318223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:46.450052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb35f-05bb-44bb-99cc-cf39314c7e0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:46.466870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:46.469296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.469834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.471550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.474746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:46.478407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:46.592979 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3117/6149] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:46 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:46.594828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8073516-b2a8-47e6-9f74-4bffdba2c159 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:46.626063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8073516-b2a8-47e6-9f74-4bffdba2c159 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:46.726565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:46.727741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.728278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.728810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.730312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:46.733408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:46.768354 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3033/6150] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:46 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:46.772019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:46.786454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af64ea-c322-43c3-bf3a-e1c566ef74c6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:46.795107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:46.796123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.796610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.797142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.798266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:46.800217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:46.814291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3118/6151] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:46.819374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:46.836975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df2cce-e8b2-48fa-b6b7-f7e20830cb6a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:46.843347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b9df4-e424-4fcd-82e6-d3e6cb24b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:46.844724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9df4-e424-4fcd-82e6-d3e6cb24b4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.845070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9df4-e424-4fcd-82e6-d3e6cb24b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.845396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9df4-e424-4fcd-82e6-d3e6cb24b4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.846210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b9df4-e424-4fcd-82e6-d3e6cb24b4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:46.850411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b9df4-e424-4fcd-82e6-d3e6cb24b4c6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:46.868405 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3034/6152] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:16:46.872875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:46.885553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372017f0-d2b0-4d98-8720-04b86ff5047f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:46.894226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:46.895190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.895463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.895865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] PATH_INFO: `/v3/projects/f592e970bba04b929d7e5988ac63ed51/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.916513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f592e970bba04b929d7e5988ac63ed51, user_id=b384a01b440a4c8fb1e7a760ebaa964f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:46.919622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:46.943403 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3119/6153] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:46 2022] PUT /identity/v3/projects/f592e970bba04b929d7e5988ac63ed51/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:46.954209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0231a9-0622-4330-b10d-e329d7ce6745 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:46.954666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0231a9-0622-4330-b10d-e329d7ce6745 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:46.954927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0231a9-0622-4330-b10d-e329d7ce6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:46.987671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fb0231a9-0622-4330-b10d-e329d7ce6745 None None] MFA Rules not processed for user `b384a01b440a4c8fb1e7a760ebaa964f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:46.989265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fb0231a9-0622-4330-b10d-e329d7ce6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:47.107051 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3035/6154] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:47.114102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:47.204354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0337d-79d7-4e5e-9438-16ed9503f06c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:47.210630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:47.213117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:47.213117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:47.213117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:47.213117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:47.214876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:47.238654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3120/6155] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:16:47 2022] POST /identity/v3/domains => generated 275 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:47.239884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0231a9-0622-4330-b10d-e329d7ce6745 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:47.252081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0231a9-0622-4330-b10d-e329d7ce6745 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:47.386566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:47.387517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:47.387883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:47.388179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:47.389759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:47.390843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:47.420636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3036/6156] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:16:47 2022] POST /identity/v3/roles => generated 239 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:47.423521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:47.443610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300dd5-8e4e-4e39-999c-da974704e953 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:47.450887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:47.452631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:47.453215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:47.453760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/5f80cf1f59694dedb5bf363abc574412/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/fdaf59a57d65453d9dfe69f70cbc3418` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:47.470176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5f80cf1f59694dedb5bf363abc574412, user_id=b384a01b440a4c8fb1e7a760ebaa964f, role_id=fdaf59a57d65453d9dfe69f70cbc3418)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:47.473267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:47.497563 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3121/6157] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Apr 9 21:16:47 2022] PUT /identity/v3/domains/5f80cf1f59694dedb5bf363abc574412/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/fdaf59a57d65453d9dfe69f70cbc3418 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:47.502843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:47.522197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7962-3acd-418f-9b1b-3653ce6db0cc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:47.708138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:47.708836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:47.709169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:47.709508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:47.710592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:47.712534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:47.736525 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3037/6158] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:16:47 2022] POST /identity/v3/domains => generated 276 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:47.740842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:47.760778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247febb6-3b23-462d-9766-31450795e03f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:47.944202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:47.945170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:47.945465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:47.945743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:47.946533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:47.953070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:47.979564 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3122/6159] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:16:47 2022] POST /identity/v3/roles => generated 239 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:47.986058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:48.002762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0fa0e-2e1d-4ac2-9d57-17458cf72e24 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:48.013928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:48.014750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:48.016261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:48.016711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:48.017450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:48.025100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:48.084037 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3038/6160] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:47 2022] POST /identity/v3/groups => generated 326 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:48.091857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:48.114205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfa3a3-ec09-4bb2-9694-bedbcf653b66 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:48.123319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:48.124834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:48.125555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:48.125798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups/ed385ceff1a640ccad4307614dfddab5/users/b384a01b440a4c8fb1e7a760ebaa964f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:48.147015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ed385ceff1a640ccad4307614dfddab5, user_id=b384a01b440a4c8fb1e7a760ebaa964f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:48.150643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:48.198854 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3123/6161] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:16:48 2022] PUT /identity/v3/groups/ed385ceff1a640ccad4307614dfddab5/users/b384a01b440a4c8fb1e7a760ebaa964f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:48.203429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:48.214464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170cb99-02c0-487c-9f7b-f00a0c10f7e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:48.334938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:48.336477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:48.336800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:48.337062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866/groups/ed385ceff1a640ccad4307614dfddab5/roles/531000dd902a4223973d0b7b3fd68381` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:48.339755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2d9cd8dd3c45419b9eaf4e2b4b555866, group_id=ed385ceff1a640ccad4307614dfddab5, role_id=531000dd902a4223973d0b7b3fd68381)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:48.342542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:48.361273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3039/6162] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:48 2022] PUT /identity/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866/groups/ed385ceff1a640ccad4307614dfddab5/roles/531000dd902a4223973d0b7b3fd68381 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:48.365457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:48.380588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b3a8-a0b2-416f-b2bf-34e7d72ed43d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:48.525122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:48.525972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:48.526480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:48.526960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:48.528060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:48.530555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:48.567453 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3124/6163] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:16:48 2022] POST /identity/v3/domains => generated 275 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:48.572457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:48.598252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f8865-82ca-4f32-86ce-ff19cac2fa9d tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:48.777350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:48.780318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:48.780602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:48.780885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:48.785355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:48.787188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:48.825178 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3040/6164] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:16:48 2022] POST /identity/v3/roles => generated 239 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:48.829719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:48.842832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d739bb-a8bc-4f9c-b941-f6557ea392ed tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:48.850940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:48.853462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:48.853809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:48.854094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/ea3171223b1446e8a832c5fc3f063f21` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:48.890799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c8fbbc78363b4a24b5ae6eccc7e51e89, user_id=b384a01b440a4c8fb1e7a760ebaa964f, role_id=ea3171223b1446e8a832c5fc3f063f21)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:48.894948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:48.919853 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3125/6165] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Apr 9 21:16:48 2022] PUT /identity/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/ea3171223b1446e8a832c5fc3f063f21 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:48.924266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:48.940313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48ce2c-ec4c-43a4-a7f3-480d49eb9fb6 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:49.059937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:49.060787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:49.061103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:49.061425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:49.062645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:49.082315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:49.125024 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3041/6166] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:16:48 2022] POST /identity/v3/domains => generated 276 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:49.128353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:49.141445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7882d-4f79-45d4-9d17-17511d72dec4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:49.301443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:49.302196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:49.309316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:49.309609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:49.310435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:49.312844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:49.333534 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3126/6167] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:16:49 2022] POST /identity/v3/roles => generated 240 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:49.338770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:49.355471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd79fb-91cd-4e40-b568-48165e1d17b8 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:49.370117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:49.370963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:49.371112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:49.371379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:49.372201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:49.385871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:49.463105 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3042/6168] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:49 2022] POST /identity/v3/groups => generated 326 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:49.466731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:49.489282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad64b7-94e0-42a8-a32d-f21d04598dd4 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:49.502057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:49.503013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:49.503294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:49.503561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups/bce9284bf39147fd9fd059a8205239b7/users/b384a01b440a4c8fb1e7a760ebaa964f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:49.533958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bce9284bf39147fd9fd059a8205239b7, user_id=b384a01b440a4c8fb1e7a760ebaa964f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:49.535949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:49.584692 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3127/6169] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:16:49 2022] PUT /identity/v3/groups/bce9284bf39147fd9fd059a8205239b7/users/b384a01b440a4c8fb1e7a760ebaa964f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:49.588803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:49.616929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f6a6f-0759-499f-817d-f08254282646 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:49.695196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:49.697814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:49.698417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:49.698912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe/groups/bce9284bf39147fd9fd059a8205239b7/roles/0a84e24d05f44152a5fc7415dd1a9415` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:49.702058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=716ba8e0099c41feb2b47c6dbb985ebe, group_id=bce9284bf39147fd9fd059a8205239b7, role_id=0a84e24d05f44152a5fc7415dd1a9415)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:49.705469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:49.727873 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3043/6170] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:49 2022] PUT /identity/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe/groups/bce9284bf39147fd9fd059a8205239b7/roles/0a84e24d05f44152a5fc7415dd1a9415 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:49.732975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:49.954713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6761-8748-4fed-8812-a82bb2500ed9 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:50.162597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b384a01b440a4c8fb1e7a760ebaa964f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f592e970bba04b929d7e5988ac63ed51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:50.163290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:50.163607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:50.163890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] PATH_INFO: `/v3/auth/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:50.164533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:50.165889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:50.285203 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3128/6171] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 21:16:49 2022] GET /identity/v3/auth/domains => generated 1170 bytes in 554 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:50.289314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:50.413587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4181-c099-410d-8a7f-de7051d3a0a2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:50.424000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:50.425150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:50.426695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:50.427377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe/groups/bce9284bf39147fd9fd059a8205239b7/roles/0a84e24d05f44152a5fc7415dd1a9415` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:50.431574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=716ba8e0099c41feb2b47c6dbb985ebe, group_id=bce9284bf39147fd9fd059a8205239b7, role_id=0a84e24d05f44152a5fc7415dd1a9415)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:50.434866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:50.454672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role 0a84e24d05f44152a5fc7415dd1a9415 was removed from group bce9284bf39147fd9fd059a8205239b7 on domain 716ba8e0099c41feb2b47c6dbb985ebe. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:50.455235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:50.458263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:50.511099 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3044/6172] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Apr 9 21:16:50 2022] DELETE /identity/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe/groups/bce9284bf39147fd9fd059a8205239b7/roles/0a84e24d05f44152a5fc7415dd1a9415 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:50.515782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:50.518840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:50.547459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f379c-c361-4c4a-9f81-82ada9498314 tempest-TokensV3TestJSON-1221870862 tempest-TokensV3TestJSON-1221870862-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:50.749425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:50.750653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:50.751160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:50.751491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups/bce9284bf39147fd9fd059a8205239b7/users/b384a01b440a4c8fb1e7a760ebaa964f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:50.754060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=bce9284bf39147fd9fd059a8205239b7, user_id=b384a01b440a4c8fb1e7a760ebaa964f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:50.760048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:50.782528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b384a01b440a4c8fb1e7a760ebaa964f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:50.813111 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3129/6173] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:16:50 2022] DELETE /identity/v3/groups/bce9284bf39147fd9fd059a8205239b7/users/b384a01b440a4c8fb1e7a760ebaa964f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:50.817354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:50.838342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c499-b709-43ee-b7cb-555f5d2b95a1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:50.983372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:50.983372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:50.983372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:50.992577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups/bce9284bf39147fd9fd059a8205239b7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:50.995620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bce9284bf39147fd9fd059a8205239b7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:51.001347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:51.095617 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3045/6174] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:50 2022] DELETE /identity/v3/groups/bce9284bf39147fd9fd059a8205239b7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:51.099347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:51.123888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51b804-33b2-4a50-887d-a00d3e72acc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:51.230089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:51.231535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:51.231535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:51.231741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles/0a84e24d05f44152a5fc7415dd1a9415` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:51.233455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0a84e24d05f44152a5fc7415dd1a9415)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:51.235296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:51.309362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role 0a84e24d05f44152a5fc7415dd1a9415 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:51.310582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.314252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.316950 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3130/6175] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:51 2022] DELETE /identity/v3/roles/0a84e24d05f44152a5fc7415dd1a9415 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:51.321983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:51.323862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:51.343403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b862590-0857-40ee-b391-dd717376f7cd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:51.433879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:51.435338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:51.435615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:51.436195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:51.438340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=716ba8e0099c41feb2b47c6dbb985ebe)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:51.440551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:51.488283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.489645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.533955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.536095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.540774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3046/6176] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:51 2022] PATCH /identity/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe => generated 277 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:51.544969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:51.566349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e5ca-40d8-47fa-8a51-0a71f41804fd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:51.666598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:51.667517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:51.668201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:51.668942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:51.684159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=716ba8e0099c41feb2b47c6dbb985ebe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:51.686199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:51.724080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.729073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.793194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe', 'request_id': 'req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.801266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe', 'request_id': 'req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.815534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe', 'request_id': 'req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.848881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] The token cache is being invalidate because project 716ba8e0099c41feb2b47c6dbb985ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:51.848881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.849378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.867611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe', 'request_id': 'req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.875116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe', 'request_id': 'req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.876245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '716ba8e0099c41feb2b47c6dbb985ebe', 'request_id': 'req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:51.885680 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3131/6177] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:16:51 2022] DELETE /identity/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:51.891276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:51.899677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:51.927697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1999f94-2783-4a8b-8e7b-d61465eda386 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:52.015371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:52.016459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:52.016617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:52.016924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/ea3171223b1446e8a832c5fc3f063f21` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:52.019268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c8fbbc78363b4a24b5ae6eccc7e51e89, user_id=b384a01b440a4c8fb1e7a760ebaa964f, role_id=ea3171223b1446e8a832c5fc3f063f21)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:52.022149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:52.033592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role ea3171223b1446e8a832c5fc3f063f21 was removed from user b384a01b440a4c8fb1e7a760ebaa964f on domain c8fbbc78363b4a24b5ae6eccc7e51e89. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:52.033592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.034896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.057084 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3047/6178] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Apr 9 21:16:51 2022] DELETE /identity/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/ea3171223b1446e8a832c5fc3f063f21 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:52.061206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:52.063953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:52.080398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b852f-1442-406c-8dd4-8d8f5dd08cc2 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:52.126613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:52.128245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:52.183846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:52.185772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:52.186319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:52.186925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles/ea3171223b1446e8a832c5fc3f063f21` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:52.189545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ea3171223b1446e8a832c5fc3f063f21)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:52.192615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:52.262400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d482363-fd0b-4d7d-864d-60bcd77f1cd7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:52.269977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:52.271064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:52.271383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:52.271788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] PATH_INFO: `/v3/users/55f5b5f4f9834b349cbd3beec29d88a2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:52.274299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f5b5f4f9834b349cbd3beec29d88a2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:52.279165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:52.303706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role ea3171223b1446e8a832c5fc3f063f21 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:52.303935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.304820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.314223 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3132/6179] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:52 2022] DELETE /identity/v3/roles/ea3171223b1446e8a832c5fc3f063f21 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:52.314809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:52.318438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:52.371411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f5b5f4f9834b349cbd3beec29d88a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.372051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f5b5f4f9834b349cbd3beec29d88a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.397660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f5b5f4f9834b349cbd3beec29d88a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.398720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f5b5f4f9834b349cbd3beec29d88a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.429811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c39af213-29ab-422f-a5b4-29ac89861105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f5b5f4f9834b349cbd3beec29d88a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.458185 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3048/6180] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:52 2022] DELETE /identity/v3/users/55f5b5f4f9834b349cbd3beec29d88a2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:52.463810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bb777-2115-4b4c-921a-caf94e4c8605 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:52.467260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:52.467853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:52.468555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:52.495189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:52.497990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:52.556786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:52.558980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:52.559714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:52.562690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:52.566888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c8fbbc78363b4a24b5ae6eccc7e51e89)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:52.568721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:52.601207 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3049/6181] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:52.607753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.609788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.613130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:52.615011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:52.649188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.650357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.654701 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3133/6182] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:52 2022] PATCH /identity/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89 => generated 276 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:16:52.659716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:52.662398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:52.741266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d66dee-2ccb-4b50-a681-7174c22f4cb2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:52.827207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaab21-b6a8-4024-b6d6-1121dacb1153 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:52.852096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:52.853098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:52.853839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:52.854278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:52.854595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:52.854716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:52.855124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:52.855856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:52.867482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:52.892503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c8fbbc78363b4a24b5ae6eccc7e51e89)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:52.894883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:52.930143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:52.935403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.019998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:53.022631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:53.033232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89', 'request_id': 'req-0a4f2598-446f-461f-8858-ba2078c26387'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.043003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89', 'request_id': 'req-0a4f2598-446f-461f-8858-ba2078c26387'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.049706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3050/6183] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:16:53.055924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89', 'request_id': 'req-0a4f2598-446f-461f-8858-ba2078c26387'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.073844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] The token cache is being invalidate because project c8fbbc78363b4a24b5ae6eccc7e51e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:53.075832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.076883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.088829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89', 'request_id': 'req-0a4f2598-446f-461f-8858-ba2078c26387'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.094264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89', 'request_id': 'req-0a4f2598-446f-461f-8858-ba2078c26387'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.095127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c8fbbc78363b4a24b5ae6eccc7e51e89', 'request_id': 'req-0a4f2598-446f-461f-8858-ba2078c26387'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.109249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3134/6184] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:16:52 2022] DELETE /identity/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:53.114489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:53.145792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40681fc-140a-4a3d-9e46-2e3f683e4077 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:53.265279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:53.266238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:53.266727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:53.267556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866/groups/ed385ceff1a640ccad4307614dfddab5/roles/531000dd902a4223973d0b7b3fd68381` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:53.271897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2d9cd8dd3c45419b9eaf4e2b4b555866, group_id=ed385ceff1a640ccad4307614dfddab5, role_id=531000dd902a4223973d0b7b3fd68381)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:53.275319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:53.283768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role 531000dd902a4223973d0b7b3fd68381 was removed from group ed385ceff1a640ccad4307614dfddab5 on domain 2d9cd8dd3c45419b9eaf4e2b4b555866. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:53.284137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.285359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.322674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3051/6185] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Apr 9 21:16:53 2022] DELETE /identity/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866/groups/ed385ceff1a640ccad4307614dfddab5/roles/531000dd902a4223973d0b7b3fd68381 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:53.326982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:53.329959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:53.346673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f2598-446f-461f-8858-ba2078c26387 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:53.420332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:53.421679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:53.422142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:53.422717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups/ed385ceff1a640ccad4307614dfddab5/users/b384a01b440a4c8fb1e7a760ebaa964f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:53.425950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ed385ceff1a640ccad4307614dfddab5, user_id=b384a01b440a4c8fb1e7a760ebaa964f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:53.428177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:53.446867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b384a01b440a4c8fb1e7a760ebaa964f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.476668 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3135/6186] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:16:53 2022] DELETE /identity/v3/groups/ed385ceff1a640ccad4307614dfddab5/users/b384a01b440a4c8fb1e7a760ebaa964f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:53.480586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:53.482123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:53.497462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99609ce-d036-4707-ba1a-84a5db4f366c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:53.511812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:53.517794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:53.625260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:53.630497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:53.631008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:53.631304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/groups/ed385ceff1a640ccad4307614dfddab5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:53.637679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ed385ceff1a640ccad4307614dfddab5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:53.637679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:53.670499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ca8c6-b974-48bd-8960-d9983751007f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:53.683816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:53.685592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:53.686816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:53.687734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] PATH_INFO: `/v3/projects/ab125314b81b4857adcc9feb375aee7f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:53.690362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab125314b81b4857adcc9feb375aee7f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:53.699001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:53.739406 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3052/6187] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:16:53 2022] DELETE /identity/v3/groups/ed385ceff1a640ccad4307614dfddab5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:53.740535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:53.784370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab125314b81b4857adcc9feb375aee7f', 'request_id': 'req-a31fc5bd-c57a-4653-9514-10ddfbdf4143'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.802937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab125314b81b4857adcc9feb375aee7f', 'request_id': 'req-a31fc5bd-c57a-4653-9514-10ddfbdf4143'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.820604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab125314b81b4857adcc9feb375aee7f', 'request_id': 'req-a31fc5bd-c57a-4653-9514-10ddfbdf4143'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.838289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] The token cache is being invalidate because project ab125314b81b4857adcc9feb375aee7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:53.838289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.841154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:53.844041 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3136/6188] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:53 2022] DELETE /identity/v3/projects/ab125314b81b4857adcc9feb375aee7f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:53.848826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:53.850384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:53.916971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aead12-4cef-4c8c-a296-cbe391d491e7 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:54.000310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fc5bd-c57a-4653-9514-10ddfbdf4143 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:54.011139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:54.013399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:54.013691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:54.014001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] PATH_INFO: `/v3/users/c66581dce5054afbb5eda237377adb9f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:54.015517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66581dce5054afbb5eda237377adb9f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:54.017590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:54.027148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:54.029670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:54.030048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:54.033605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles/531000dd902a4223973d0b7b3fd68381` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:54.036198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_role(role_id=531000dd902a4223973d0b7b3fd68381)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:54.044239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:54.108611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role 531000dd902a4223973d0b7b3fd68381 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:54.109385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66581dce5054afbb5eda237377adb9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.109879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.110568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66581dce5054afbb5eda237377adb9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.112129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.118364 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3053/6189] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:53 2022] DELETE /identity/v3/roles/531000dd902a4223973d0b7b3fd68381 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:54.119493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:54.121180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:54.131067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66581dce5054afbb5eda237377adb9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.141362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66581dce5054afbb5eda237377adb9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.142005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66581dce5054afbb5eda237377adb9f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.174360 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3137/6190] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:53 2022] DELETE /identity/v3/users/c66581dce5054afbb5eda237377adb9f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:54.268915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308968b6-07ee-461a-bc5a-4e33a54d134f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:54.438408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:54.439444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:54.439731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:54.440258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:54.443453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2d9cd8dd3c45419b9eaf4e2b4b555866)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:54.448876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:54.501402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.502648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.578719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.579391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.585559 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3054/6191] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:54 2022] PATCH /identity/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866 => generated 277 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:54.589697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:54.591310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:54.610252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ef405-1d06-41ae-b66f-f4b195027d92 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:54.689923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:54.692492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:54.696451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:54.696951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:54.703598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:54.705549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:54.716331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2d9cd8dd3c45419b9eaf4e2b4b555866)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:54.718998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:54.749305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.754206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.828787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866', 'request_id': 'req-1a8562ba-981c-4a11-81ed-c1965fe4f3be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.840647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866', 'request_id': 'req-1a8562ba-981c-4a11-81ed-c1965fe4f3be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.847237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b243c8-56b1-47d4-8b3c-e1554d7318ca tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:54.852408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866', 'request_id': 'req-1a8562ba-981c-4a11-81ed-c1965fe4f3be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.873692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] The token cache is being invalidate because project 2d9cd8dd3c45419b9eaf4e2b4b555866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:54.874137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.876103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.886648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866', 'request_id': 'req-1a8562ba-981c-4a11-81ed-c1965fe4f3be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.892837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866', 'request_id': 'req-1a8562ba-981c-4a11-81ed-c1965fe4f3be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.893761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2d9cd8dd3c45419b9eaf4e2b4b555866', 'request_id': 'req-1a8562ba-981c-4a11-81ed-c1965fe4f3be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:54.903138 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3138/6192] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:16:54 2022] DELETE /identity/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:54.908676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:54.917296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:54.956719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:54.957910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:54.958349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:54.958684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] PATH_INFO: `/v3/projects/1899fdb5f4e14e0cb6bf9817cac1e42f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:54.960201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1899fdb5f4e14e0cb6bf9817cac1e42f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:54.963052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:55.036206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1899fdb5f4e14e0cb6bf9817cac1e42f', 'request_id': 'req-ca89c50f-6095-4803-947d-61227a79a25e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.044554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1899fdb5f4e14e0cb6bf9817cac1e42f', 'request_id': 'req-ca89c50f-6095-4803-947d-61227a79a25e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.048513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8562ba-981c-4a11-81ed-c1965fe4f3be tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:55.059842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1899fdb5f4e14e0cb6bf9817cac1e42f', 'request_id': 'req-ca89c50f-6095-4803-947d-61227a79a25e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.080035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] The token cache is being invalidate because project 1899fdb5f4e14e0cb6bf9817cac1e42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:55.080526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.081481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ca89c50f-6095-4803-947d-61227a79a25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.084865 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3055/6193] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:54 2022] DELETE /identity/v3/projects/1899fdb5f4e14e0cb6bf9817cac1e42f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:55.092758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc07c-e677-45a9-8501-8eddd609f7d2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.093494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc07c-e677-45a9-8501-8eddd609f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.093900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc07c-e677-45a9-8501-8eddd609f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.123195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d82bc07c-e677-45a9-8501-8eddd609f7d2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:55.124566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d82bc07c-e677-45a9-8501-8eddd609f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:55.128256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:55.128930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.129357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.129700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/5f80cf1f59694dedb5bf363abc574412/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/fdaf59a57d65453d9dfe69f70cbc3418` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.131850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5f80cf1f59694dedb5bf363abc574412, user_id=b384a01b440a4c8fb1e7a760ebaa964f, role_id=fdaf59a57d65453d9dfe69f70cbc3418)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:55.133006 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:16:55.133006 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:16:55.133006 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:16:55.135198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:55.142833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role fdaf59a57d65453d9dfe69f70cbc3418 was removed from user b384a01b440a4c8fb1e7a760ebaa964f on domain 5f80cf1f59694dedb5bf363abc574412. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:55.143208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.143842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.170556 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3139/6194] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Apr 9 21:16:54 2022] DELETE /identity/v3/domains/5f80cf1f59694dedb5bf363abc574412/users/b384a01b440a4c8fb1e7a760ebaa964f/roles/fdaf59a57d65453d9dfe69f70cbc3418 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:55.172364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:55.175751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:55.210901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3056/6195] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:55.222739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89716a71-078b-4548-b1f4-6cbc0ce54fe3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.223746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89716a71-078b-4548-b1f4-6cbc0ce54fe3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.224246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89716a71-078b-4548-b1f4-6cbc0ce54fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.253471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-89716a71-078b-4548-b1f4-6cbc0ce54fe3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:55.255221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-89716a71-078b-4548-b1f4-6cbc0ce54fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:55.302804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e1b3-6886-4eed-bfa4-f4dec686a244 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:55.312575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:55.315055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.317754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.318216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles/fdaf59a57d65453d9dfe69f70cbc3418` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.322597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fdaf59a57d65453d9dfe69f70cbc3418)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:55.327213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:55.358582 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3057/6196] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:16:55.363573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89716a71-078b-4548-b1f4-6cbc0ce54fe3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:55.378289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89716a71-078b-4548-b1f4-6cbc0ce54fe3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:55.385110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:55.385393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.385870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.385870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.387309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:16:55.387832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:55.390167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:55.408775 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3058/6197] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:16:55.416651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:55.445283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role fdaf59a57d65453d9dfe69f70cbc3418 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:55.445648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.446511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.448706 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3140/6198] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:55 2022] DELETE /identity/v3/roles/fdaf59a57d65453d9dfe69f70cbc3418 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:55.452253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88e10-ff86-4eac-8a4b-23794c4a0bc6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:55.453312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:55.456176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:55.532266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:55.532972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.533291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.533563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.534260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:55.536505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:55.576890 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3059/6199] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:55 2022] POST /identity/v3/projects => generated 389 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:55.579697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:55.581591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fde24-bafd-4b65-afc0-ab627dd67a0c tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:55.582320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:55.661792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:55.663369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.664219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.664219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/5f80cf1f59694dedb5bf363abc574412` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.666162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5f80cf1f59694dedb5bf363abc574412)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:55.668447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:55.735669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5f80cf1f59694dedb5bf363abc574412'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.737741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5f80cf1f59694dedb5bf363abc574412'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.769336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d68f-617f-4030-b0d6-287ebd0a1cce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:55.803158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5f80cf1f59694dedb5bf363abc574412'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.811113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5f80cf1f59694dedb5bf363abc574412'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:55.816422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3141/6200] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:55 2022] PATCH /identity/v3/domains/5f80cf1f59694dedb5bf363abc574412 => generated 276 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:16:55.821642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:55.825581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:55.897892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:55.899027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.900691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.901372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.902862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:55.907819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:55.947802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f590ba-c2da-4b5f-945e-59d8e4973d03 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:55.954699 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3060/6201] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:55 2022] POST /identity/v3/users => generated 295 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:55.959108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:55.962594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:55.966631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:55.967893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:55.971023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:55.971556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/5f80cf1f59694dedb5bf363abc574412` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:55.998215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132bfcf-7b31-4c60-9c00-86d6a5602b0b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:56.010988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5f80cf1f59694dedb5bf363abc574412)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.011546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:56.012540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.012656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.014539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.015621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.016604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.023364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.047684 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3061/6202] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:56.056804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.064816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5f80cf1f59694dedb5bf363abc574412'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.074267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5f80cf1f59694dedb5bf363abc574412'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.086091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2842b5-484c-4449-84dc-e05664a76d67 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:56.100867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:56.101954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.101954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.102333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.102983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.104662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.129764 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3062/6203] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:56.134627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.155722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b430da-5459-449b-872d-0d501685fa95 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:56.175750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f80cf1f59694dedb5bf363abc574412', 'request_id': 'req-f6f8fad6-c835-48ed-828c-8ca9ce204320'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.183096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f80cf1f59694dedb5bf363abc574412', 'request_id': 'req-f6f8fad6-c835-48ed-828c-8ca9ce204320'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.203548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f80cf1f59694dedb5bf363abc574412', 'request_id': 'req-f6f8fad6-c835-48ed-828c-8ca9ce204320'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.225008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] The token cache is being invalidate because project 5f80cf1f59694dedb5bf363abc574412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:56.225357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.228057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.250517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5f80cf1f59694dedb5bf363abc574412', 'request_id': 'req-f6f8fad6-c835-48ed-828c-8ca9ce204320'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.258852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5f80cf1f59694dedb5bf363abc574412', 'request_id': 'req-f6f8fad6-c835-48ed-828c-8ca9ce204320'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.260440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5f80cf1f59694dedb5bf363abc574412', 'request_id': 'req-f6f8fad6-c835-48ed-828c-8ca9ce204320'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:56.271203 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3142/6204] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:16:55 2022] DELETE /identity/v3/domains/5f80cf1f59694dedb5bf363abc574412 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:56.277565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.279261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:56.308485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe79c-6f19-448d-af8a-33859dd86ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:56.309472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe79c-6f19-448d-af8a-33859dd86ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.309788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe79c-6f19-448d-af8a-33859dd86ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.310014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe79c-6f19-448d-af8a-33859dd86ca9 admin admin] PATH_INFO: `/v3/projects/16696c728a2f408e87553e249fcc66c7/users/b0f22ab288c34abcbdb4c698daf53852/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.345943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe79c-6f19-448d-af8a-33859dd86ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16696c728a2f408e87553e249fcc66c7, user_id=b0f22ab288c34abcbdb4c698daf53852, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.349067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe79c-6f19-448d-af8a-33859dd86ca9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.381155 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3063/6205] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:56 2022] PUT /identity/v3/projects/16696c728a2f408e87553e249fcc66c7/users/b0f22ab288c34abcbdb4c698daf53852/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:56.390763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.391052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.391579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.425948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] MFA Rules not processed for user `b0f22ab288c34abcbdb4c698daf53852`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:56.427515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:56.432834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8fad6-c835-48ed-828c-8ca9ce204320 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:56.533364 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3064/6206] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:16:56.537564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.539383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:56.540247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.540367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:56.540609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.540923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.541957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.544262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.558265 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3143/6207] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:56.565144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.582092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a770b-f9ed-4a88-9cc5-6b62121658a5 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:56.589981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:56.591417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.591786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.592378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects/32787d00a39648a7bb4797e6a5841b8e/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.595119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32787d00a39648a7bb4797e6a5841b8e, user_id=7d44390e230845a4b4974503a2379c68, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.599291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.619720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3144/6208] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:56 2022] PUT /identity/v3/projects/32787d00a39648a7bb4797e6a5841b8e/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:56.624072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.680692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2ced9-3794-4d12-983e-f931bd477d99 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:56.763901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f1bd-711e-4a71-afcf-fcbe5a243695 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:56.779288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:56.780217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.780668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.782208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.783034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.785709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.834374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:56.835284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:56.835561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:56.835833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:56.840597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:56.842623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:56.894711 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3145/6209] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:16:56 2022] GET /identity/v3/auth/projects => generated 824 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:16:56.903356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.911441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3065/6210] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:56 2022] POST /identity/v3/projects => generated 387 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:56.913106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:56.928755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea03f2-27eb-40aa-a5d5-ad52c5f16749 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.031284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32692a8-9346-4d85-b57b-30f256b06576 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.038769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.039855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.040555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.041101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.042123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.044249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.048255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.049373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.049663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.050095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects/32787d00a39648a7bb4797e6a5841b8e/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.055395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=32787d00a39648a7bb4797e6a5841b8e, user_id=7d44390e230845a4b4974503a2379c68, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.058617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.070257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role 342abca02a8e4f5b9ce622af865ffa78 was removed from user 7d44390e230845a4b4974503a2379c68 on project 32787d00a39648a7bb4797e6a5841b8e. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:57.070602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:57.071359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:57.089143 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3066/6211] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:56 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:57.091176 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3146/6212] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Apr 9 21:16:56 2022] DELETE /identity/v3/projects/32787d00a39648a7bb4797e6a5841b8e/users/7d44390e230845a4b4974503a2379c68/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:57.093772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.098124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:57.100282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.102817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:57.119023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70158e3b-0a47-4ae9-9ba8-4c35af8a9111 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.234906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ac81-2677-43ca-8b2e-28621bfa36af tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.243655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.244476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.245100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.245476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.246282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.249313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.255914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.256674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.256962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.257326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.258106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.259794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.278211 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3067/6213] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:16:57.280231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.291520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3147/6214] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:16:57 2022] POST /identity/v3/users => generated 321 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:16:57.295342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.297421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b6df6-c1c0-4b7d-8ba7-388f837f4d7b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.303998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.305312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.305617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.305948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] PATH_INFO: `/v3/projects/f4fdc0f9509e4440832992eaa3144d39/users/c894bfa8bea44c6ebbd9b4560511990b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.315809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414dc8-af96-4ff5-92fe-b8e3ef161f7f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.324046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fdc0f9509e4440832992eaa3144d39, user_id=c894bfa8bea44c6ebbd9b4560511990b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.326951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.330235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.331715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.332352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.332607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.339686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.339686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.361439 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3068/6215] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:57 2022] PUT /identity/v3/projects/f4fdc0f9509e4440832992eaa3144d39/users/c894bfa8bea44c6ebbd9b4560511990b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:57.363181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.381180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3148/6216] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:57 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:57.383866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.488023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c650a9e-7a3f-4460-a86d-748b514a8f5b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.496422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70b975-26bb-483a-87b9-00bf50c848bd tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.502512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.503063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.503530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.504678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.505709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.508256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.555706 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3149/6217] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:16:57 2022] POST /identity/v3/projects => generated 362 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:57.559728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.587716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.588727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.588959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.590101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.596837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.602230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.623158 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3069/6218] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:16:57.624213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.643491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc41e4-396e-4dfb-a7d9-39586e7aeb1e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.661185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949ecd-583f-4253-8f1b-a16303a8a67f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.669291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.670118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.670472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.670942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.672239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.674339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.697851 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3150/6219] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:16:57 2022] POST /identity/v3/roles => generated 240 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:16:57.698944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.711946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f235f6-b57e-4e90-810e-fc3c0f0422fc tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.718066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.719120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.719586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.719957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects/6e17e8d9fddc4f03b2192e4b7b9d0119/users/6519e5457cb64b8c809587411a4360ac/roles/f7ed3efa02ec41b69c96e0c6bae7e1e2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.741133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e17e8d9fddc4f03b2192e4b7b9d0119, user_id=6519e5457cb64b8c809587411a4360ac, role_id=f7ed3efa02ec41b69c96e0c6bae7e1e2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.744394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.754396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f340f4-89a9-4989-861f-910c8b6e27ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.755492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f340f4-89a9-4989-861f-910c8b6e27ec admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.756094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f340f4-89a9-4989-861f-910c8b6e27ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.756438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f340f4-89a9-4989-861f-910c8b6e27ec admin admin] PATH_INFO: `/v3/projects/f4fdc0f9509e4440832992eaa3144d39/users/c894bfa8bea44c6ebbd9b4560511990b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.759207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f340f4-89a9-4989-861f-910c8b6e27ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fdc0f9509e4440832992eaa3144d39, user_id=c894bfa8bea44c6ebbd9b4560511990b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.763644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f340f4-89a9-4989-861f-910c8b6e27ec admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.766138 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3151/6220] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:57 2022] PUT /identity/v3/projects/6e17e8d9fddc4f03b2192e4b7b9d0119/users/6519e5457cb64b8c809587411a4360ac/roles/f7ed3efa02ec41b69c96e0c6bae7e1e2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:57.770367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.779114 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3070/6221] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:57 2022] PUT /identity/v3/projects/f4fdc0f9509e4440832992eaa3144d39/users/c894bfa8bea44c6ebbd9b4560511990b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:57.791006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.792917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.793379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.838478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] MFA Rules not processed for user `c894bfa8bea44c6ebbd9b4560511990b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:57.840835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:57.879294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306f95c-8b60-4d2b-beb3-e4ead3dc2226 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:57.933140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3071/6222] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:16:57.945521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1cb5-d907-4420-93e4-af88923bac79 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:57.946892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1cb5-d907-4420-93e4-af88923bac79 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.947362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1cb5-d907-4420-93e4-af88923bac79 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.947706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1cb5-d907-4420-93e4-af88923bac79 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects/3bede8bf02f64f1baea039618ec9b5bb/users/6519e5457cb64b8c809587411a4360ac/roles/f7ed3efa02ec41b69c96e0c6bae7e1e2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:57.947878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:57.949457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:57.950594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a1cb5-d907-4420-93e4-af88923bac79 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3bede8bf02f64f1baea039618ec9b5bb, user_id=6519e5457cb64b8c809587411a4360ac, role_id=f7ed3efa02ec41b69c96e0c6bae7e1e2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:57.955004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a1cb5-d907-4420-93e4-af88923bac79 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:57.978595 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3152/6223] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:16:57 2022] PUT /identity/v3/projects/3bede8bf02f64f1baea039618ec9b5bb/users/6519e5457cb64b8c809587411a4360ac/roles/f7ed3efa02ec41b69c96e0c6bae7e1e2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:57.984802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5772-08d5-4c9f-b8bd-cbfead047087 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:57.984802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5772-08d5-4c9f-b8bd-cbfead047087 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:57.984802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5772-08d5-4c9f-b8bd-cbfead047087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.011544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-368a5772-08d5-4c9f-b8bd-cbfead047087 None None] MFA Rules not processed for user `6519e5457cb64b8c809587411a4360ac`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:58.012754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-368a5772-08d5-4c9f-b8bd-cbfead047087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.019368 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3153/6224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:57 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:16:58.021313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46fb2-bf23-406b-9eb2-4b8abc9d7978 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.021615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46fb2-bf23-406b-9eb2-4b8abc9d7978 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.022018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46fb2-bf23-406b-9eb2-4b8abc9d7978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.024194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2164-6b88-486c-a0b9-6f532188b4c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.035422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-08b46fb2-bf23-406b-9eb2-4b8abc9d7978 None None] MFA Rules not processed for user `6519e5457cb64b8c809587411a4360ac`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:58.038270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-08b46fb2-bf23-406b-9eb2-4b8abc9d7978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.101857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1225da1-f9c8-4d55-aca2-2c9b153d4be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.102641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1225da1-f9c8-4d55-aca2-2c9b153d4be9 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.103018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1225da1-f9c8-4d55-aca2-2c9b153d4be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.103687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1225da1-f9c8-4d55-aca2-2c9b153d4be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.119387 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3154/6225] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 09 21:16:58.123485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46fb2-bf23-406b-9eb2-4b8abc9d7978 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:58.171026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1225da1-f9c8-4d55-aca2-2c9b153d4be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.172492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1225da1-f9c8-4d55-aca2-2c9b153d4be9 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:58.182938 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3072/6226] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:16:58.193811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46fb2-bf23-406b-9eb2-4b8abc9d7978 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.199127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.199540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.199821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.200097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.215243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.217558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:58.241711 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3155/6227] 10.222.0.30 () {56 vars in 1307 bytes} [Sat Apr 9 21:16:58 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:58.245994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8bd32-4d5c-4750-85e4-65f3c34aa2c3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.246292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8bd32-4d5c-4750-85e4-65f3c34aa2c3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.247258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8bd32-4d5c-4750-85e4-65f3c34aa2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.261711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a8a8bd32-4d5c-4750-85e4-65f3c34aa2c3 None None] MFA Rules not processed for user `6519e5457cb64b8c809587411a4360ac`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:58.263016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a8a8bd32-4d5c-4750-85e4-65f3c34aa2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.328557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:58.342697 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3073/6228] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 09 21:16:58.346618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8bd32-4d5c-4750-85e4-65f3c34aa2c3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:58.359368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8bd32-4d5c-4750-85e4-65f3c34aa2c3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.364109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.365157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.365500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.365836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/roles/f7ed3efa02ec41b69c96e0c6bae7e1e2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.367523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f7ed3efa02ec41b69c96e0c6bae7e1e2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.369386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:58.397415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ae47e-8ded-4278-a580-c83511172048 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.403901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.405150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.405533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.406028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] PATH_INFO: `/v3/users/b0f22ab288c34abcbdb4c698daf53852` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.407419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f22ab288c34abcbdb4c698daf53852)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.409679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:58.414804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invalidating the token cache because role f7ed3efa02ec41b69c96e0c6bae7e1e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:58.415228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.415974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.418722 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3074/6229] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:58 2022] DELETE /identity/v3/roles/f7ed3efa02ec41b69c96e0c6bae7e1e2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:58.423636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:58.425388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.508815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f22ab288c34abcbdb4c698daf53852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.509671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f22ab288c34abcbdb4c698daf53852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.523431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f22ab288c34abcbdb4c698daf53852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.536899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f22ab288c34abcbdb4c698daf53852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.538524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1c3e7c2c-f59d-4926-b94b-08f076b76a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f22ab288c34abcbdb4c698daf53852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.545531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdbeb7-dd8a-4472-a10c-e6711aff0cda tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.551514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.552593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.553213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.553352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects/3bede8bf02f64f1baea039618ec9b5bb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.555087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3bede8bf02f64f1baea039618ec9b5bb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.557313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:58.562459 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3156/6230] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:58 2022] DELETE /identity/v3/users/b0f22ab288c34abcbdb4c698daf53852 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:16:58.566906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.567259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.567537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.585913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:16:58.587213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.620894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bede8bf02f64f1baea039618ec9b5bb', 'request_id': 'req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.629022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bede8bf02f64f1baea039618ec9b5bb', 'request_id': 'req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.642662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bede8bf02f64f1baea039618ec9b5bb', 'request_id': 'req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.666964 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3157/6231] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:16:58.673794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] The token cache is being invalidate because project 3bede8bf02f64f1baea039618ec9b5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:58.674134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.674969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:58.676968 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3075/6232] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:58 2022] DELETE /identity/v3/projects/3bede8bf02f64f1baea039618ec9b5bb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:58.681508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:58.682919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.714220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:58.717381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.766965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338f9fc-7a9b-42f9-90db-3b3c42c8339d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.822444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1741-9b33-4dc0-a579-f96dfa8b46f1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.837718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.838652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.839077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.839495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.847401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.878923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.879746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.880247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.880522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects/3bede8bf02f64f1baea039618ec9b5bb` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.889935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3bede8bf02f64f1baea039618ec9b5bb)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.892834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:58.913155 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Could not find project: 3bede8bf02f64f1baea039618ec9b5bb.: keystone.exception.ProjectNotFound: Could not find project: 3bede8bf02f64f1baea039618ec9b5bb. Apr 09 21:16:58.915663 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3158/6233] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:58 2022] DELETE /identity/v3/projects/3bede8bf02f64f1baea039618ec9b5bb => generated 113 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:16:58.919637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:58.925168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:58.937988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.940075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:58.941254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb61f04-6e78-4d13-a80a-b362cb1397c1 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:58.948115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:58.949664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:58.950156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:58.950643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/projects/6e17e8d9fddc4f03b2192e4b7b9d0119` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:58.952558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e17e8d9fddc4f03b2192e4b7b9d0119)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:58.954044 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3076/6234] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:16:58.955065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:59.009639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e17e8d9fddc4f03b2192e4b7b9d0119', 'request_id': 'req-8bc605fd-5f0a-483e-93a7-ca33ee36e510'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.016184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e17e8d9fddc4f03b2192e4b7b9d0119', 'request_id': 'req-8bc605fd-5f0a-483e-93a7-ca33ee36e510'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.027070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e17e8d9fddc4f03b2192e4b7b9d0119', 'request_id': 'req-8bc605fd-5f0a-483e-93a7-ca33ee36e510'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.040341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] The token cache is being invalidate because project 6e17e8d9fddc4f03b2192e4b7b9d0119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:16:59.040731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.041485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.043360 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3159/6235] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:16:58 2022] DELETE /identity/v3/projects/6e17e8d9fddc4f03b2192e4b7b9d0119 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:59.047852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:59.060783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d032e-ac58-4a77-8ca5-097d899aa4d0 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:59.152502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:59.153594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:59.154232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:59.154508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/users/6519e5457cb64b8c809587411a4360ac` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:59.155770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6519e5457cb64b8c809587411a4360ac)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:59.157899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:16:59.295998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6519e5457cb64b8c809587411a4360ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.297722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6519e5457cb64b8c809587411a4360ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.310580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6519e5457cb64b8c809587411a4360ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.311672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6519e5457cb64b8c809587411a4360ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.327905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6519e5457cb64b8c809587411a4360ac'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:16:59.356920 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3077/6236] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:59 2022] DELETE /identity/v3/users/6519e5457cb64b8c809587411a4360ac => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:16:59.365162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:59.367989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:59.386609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc605fd-5f0a-483e-93a7-ca33ee36e510 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:59.498743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:59.500379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:59.500840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:59.501268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:59.514059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:16:59.527994 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Could not find domain: 716ba8e0099c41feb2b47c6dbb985ebe.: keystone.exception.DomainNotFound: Could not find domain: 716ba8e0099c41feb2b47c6dbb985ebe. Apr 09 21:16:59.530054 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3160/6237] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:59 2022] PATCH /identity/v3/domains/716ba8e0099c41feb2b47c6dbb985ebe => generated 112 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:16:59.536510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:59.538378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:59.554480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa18ccb-fc17-439f-990d-ec9dab2cbc84 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:59.560874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:59.562100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:59.562562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:59.562950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:59.574330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:16:59.586891 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Could not find domain: c8fbbc78363b4a24b5ae6eccc7e51e89.: keystone.exception.DomainNotFound: Could not find domain: c8fbbc78363b4a24b5ae6eccc7e51e89. Apr 09 21:16:59.593250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:59.601525 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3078/6238] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:59 2022] PATCH /identity/v3/domains/c8fbbc78363b4a24b5ae6eccc7e51e89 => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:16:59.607335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f5a47-0e8b-4713-a0ba-1358feed3297 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:59.615582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:59.616910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:59.617429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:59.617716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:59.627992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:16:59.638252 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Could not find domain: 2d9cd8dd3c45419b9eaf4e2b4b555866.: keystone.exception.DomainNotFound: Could not find domain: 2d9cd8dd3c45419b9eaf4e2b4b555866. Apr 09 21:16:59.644741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:59.654986 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3161/6239] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:59 2022] PATCH /identity/v3/domains/2d9cd8dd3c45419b9eaf4e2b4b555866 => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:16:59.675511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89f0a-6a1d-4ff7-b0fa-799341271310 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:59.685333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d44390e230845a4b4974503a2379c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead5d618a394bffa0f56dce3109b590', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:59.687145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:59.687864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:59.688873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] PATH_INFO: `/v3/domains/5f80cf1f59694dedb5bf363abc574412` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:59.732399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:16:59.754644 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Could not find domain: 5f80cf1f59694dedb5bf363abc574412.: keystone.exception.DomainNotFound: Could not find domain: 5f80cf1f59694dedb5bf363abc574412. Apr 09 21:16:59.758193 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3079/6240] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:16:59 2022] PATCH /identity/v3/domains/5f80cf1f59694dedb5bf363abc574412 => generated 112 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:16:59.763340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:16:59.767078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:16:59.944918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56140-08e5-4660-a867-3e78888e4081 tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:16:59.952734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:16:59.954524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:16:59.955333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:16:59.956199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] PATH_INFO: `/v3/users/794a5939e00441d1aab451fd798f4c4e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:16:59.958111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=794a5939e00441d1aab451fd798f4c4e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:16:59.962562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:00.051060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794a5939e00441d1aab451fd798f4c4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.051824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794a5939e00441d1aab451fd798f4c4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.062290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794a5939e00441d1aab451fd798f4c4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.080380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794a5939e00441d1aab451fd798f4c4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.082420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d67e1b2e-07e4-4021-be27-8afb168668ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794a5939e00441d1aab451fd798f4c4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.127832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:00.130293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:00.176790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899a060-7e77-4894-9a0d-609ae51f087f tempest-TokensV3TestJSON-144914103 tempest-TokensV3TestJSON-144914103-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:00.178430 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3162/6241] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:16:59 2022] DELETE /identity/v3/users/794a5939e00441d1aab451fd798f4c4e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:00.183588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:00.183962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:00.184310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:00.269816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:00.273835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:00.278567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:00.279502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:00.280378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:00.281573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] PATH_INFO: `/v3/projects/16696c728a2f408e87553e249fcc66c7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:00.283240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16696c728a2f408e87553e249fcc66c7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:00.286553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:00.295309 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3163/6242] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:00.308986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:00.311009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:00.437171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d06cd-175d-46cb-bfc4-02b715f3b725 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:00.445006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16696c728a2f408e87553e249fcc66c7', 'request_id': 'req-c11f128a-a47b-4254-bc6d-d3b035fc0403'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.455481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16696c728a2f408e87553e249fcc66c7', 'request_id': 'req-c11f128a-a47b-4254-bc6d-d3b035fc0403'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.472415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16696c728a2f408e87553e249fcc66c7', 'request_id': 'req-c11f128a-a47b-4254-bc6d-d3b035fc0403'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.504460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] The token cache is being invalidate because project 16696c728a2f408e87553e249fcc66c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:00.506578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.508358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.517891 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3080/6243] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:00 2022] DELETE /identity/v3/projects/16696c728a2f408e87553e249fcc66c7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:00.519145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:00.521409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:00.560897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:00.562870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:00.563167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:00.565379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:00.570909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:00.713934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:00.715923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:00.743523 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3164/6244] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:00.766656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f128a-a47b-4254-bc6d-d3b035fc0403 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:00.796438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:00.804181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:00.805495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:00.806295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] PATH_INFO: `/v3/users/c894bfa8bea44c6ebbd9b4560511990b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:00.810269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c894bfa8bea44c6ebbd9b4560511990b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:00.820121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:00.942714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c894bfa8bea44c6ebbd9b4560511990b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.943695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c894bfa8bea44c6ebbd9b4560511990b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.955835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c894bfa8bea44c6ebbd9b4560511990b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.956959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c894bfa8bea44c6ebbd9b4560511990b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:00.975413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c894bfa8bea44c6ebbd9b4560511990b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.021630 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3081/6245] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:00 2022] DELETE /identity/v3/users/c894bfa8bea44c6ebbd9b4560511990b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:01.353302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:01.357167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:01.404674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137188-e297-44b8-8d8a-123b1e2ee14b service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:01.540019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:01.541957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:01.542299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:01.542724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] PATH_INFO: `/v3/projects/32787d00a39648a7bb4797e6a5841b8e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:01.545081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32787d00a39648a7bb4797e6a5841b8e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:01.547267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:01.627514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32787d00a39648a7bb4797e6a5841b8e', 'request_id': 'req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.634681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32787d00a39648a7bb4797e6a5841b8e', 'request_id': 'req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.663500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32787d00a39648a7bb4797e6a5841b8e', 'request_id': 'req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.704796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] The token cache is being invalidate because project 32787d00a39648a7bb4797e6a5841b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:01.706181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.707394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.715366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:01.716415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3165/6246] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:01 2022] DELETE /identity/v3/projects/32787d00a39648a7bb4797e6a5841b8e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:01.717863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:01.741226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955431db-36dc-4f0b-9854-bf93216f067d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:01.858512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:01.860680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:01.879729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:01.880933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:01.881466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:01.882080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] PATH_INFO: `/v3/users/7d44390e230845a4b4974503a2379c68` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:01.883453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d44390e230845a4b4974503a2379c68)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:01.886121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:01.978809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a257c-7c8c-440e-a83f-14c80f3e4f8e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:01.985573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:01.987382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:01.987879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:01.988072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] PATH_INFO: `/v3/projects/f4fdc0f9509e4440832992eaa3144d39` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:01.989339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d44390e230845a4b4974503a2379c68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.990389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fdc0f9509e4440832992eaa3144d39)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:01.990507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d44390e230845a4b4974503a2379c68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:01.994205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:02.011777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d44390e230845a4b4974503a2379c68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.014172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d44390e230845a4b4974503a2379c68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.032326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc308895-c40b-4d3b-abd0-d27bace1e2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d44390e230845a4b4974503a2379c68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.078585 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3082/6247] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:01 2022] DELETE /identity/v3/users/7d44390e230845a4b4974503a2379c68 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:02.084259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fdc0f9509e4440832992eaa3144d39', 'request_id': 'req-c0b99381-8288-419e-88fa-a74356de8ee4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.092119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fdc0f9509e4440832992eaa3144d39', 'request_id': 'req-c0b99381-8288-419e-88fa-a74356de8ee4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.103768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fdc0f9509e4440832992eaa3144d39', 'request_id': 'req-c0b99381-8288-419e-88fa-a74356de8ee4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.121868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] The token cache is being invalidate because project f4fdc0f9509e4440832992eaa3144d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:02.122450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.123156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c0b99381-8288-419e-88fa-a74356de8ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:02.127081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3166/6248] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:01 2022] DELETE /identity/v3/projects/f4fdc0f9509e4440832992eaa3144d39 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:02.131615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120a5d-d3f9-4d59-af02-52ddbf65e7b6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.132290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120a5d-d3f9-4d59-af02-52ddbf65e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.132775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120a5d-d3f9-4d59-af02-52ddbf65e7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.157859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bb120a5d-d3f9-4d59-af02-52ddbf65e7b6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:02.160030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bb120a5d-d3f9-4d59-af02-52ddbf65e7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:02.267816 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3083/6249] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:02.277080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2176c8-f4fa-488e-b7a9-214833450f24 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.277479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2176c8-f4fa-488e-b7a9-214833450f24 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.277828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2176c8-f4fa-488e-b7a9-214833450f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.342059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-de2176c8-f4fa-488e-b7a9-214833450f24 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:02.344852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de2176c8-f4fa-488e-b7a9-214833450f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:02.369264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120a5d-d3f9-4d59-af02-52ddbf65e7b6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:02.378244 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3167/6250] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:02.384809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120a5d-d3f9-4d59-af02-52ddbf65e7b6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:02.393722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:02.395416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.395913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.396413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.399741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:02.400523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:02.402405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:02.439352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2176c8-f4fa-488e-b7a9-214833450f24 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:02.454590 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3084/6251] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:02.456761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2176c8-f4fa-488e-b7a9-214833450f24 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:02.465737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:02.467060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.467668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.468210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.469623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:02.472046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:02.556983 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3168/6252] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:02 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:02.561806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:02.575821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02babe6c-5120-494a-afa7-95ff169f59fd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:02.771276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:02.772049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.779537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.780132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.781073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:02.790043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:02.828512 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3085/6253] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:02 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:02.833767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:02.861205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75f1ec-7041-4716-9dc7-ee58d89b0d35 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:02.890553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:02.891517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.893810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.893810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.893810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:02.894626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:02.921322 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3169/6254] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:02.924300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:02.926383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:02.926759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:02.941713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74379362-7f21-48d0-868b-c330cccb0770 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:02.951842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:02.953773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.954170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.954643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.955953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:02.958372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:02.966661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e68c5d-b883-4e08-8949-7b7905d401a3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:02.981514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:02.982622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:02.982764 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3170/6255] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:02.983089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:02.983257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] PATH_INFO: `/v3/projects/8ead5d618a394bffa0f56dce3109b590` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:02.986953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ead5d618a394bffa0f56dce3109b590)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:02.987143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:02.997532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:03.005098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f32e1-7aa6-46f9-b379-443ec2fdb063 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:03.012693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b90d1-e502-494c-9ae5-dc7d29f108b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:03.014544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b90d1-e502-494c-9ae5-dc7d29f108b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:03.015092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b90d1-e502-494c-9ae5-dc7d29f108b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:03.015572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b90d1-e502-494c-9ae5-dc7d29f108b6 admin admin] PATH_INFO: `/v3/projects/64ba9004eeb14af2bdd911347781558e/users/403fab294a264e46bd42ebd6ee9784f6/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:03.044399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b90d1-e502-494c-9ae5-dc7d29f108b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ba9004eeb14af2bdd911347781558e, user_id=403fab294a264e46bd42ebd6ee9784f6, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:03.049161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b90d1-e502-494c-9ae5-dc7d29f108b6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:03.072612 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3171/6256] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:02 2022] PUT /identity/v3/projects/64ba9004eeb14af2bdd911347781558e/users/403fab294a264e46bd42ebd6ee9784f6/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:03.085500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ead5d618a394bffa0f56dce3109b590', 'request_id': 'req-3adbf09c-8107-49c1-9c25-ad2c1939ce62'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.085775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:03.088766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:03.089185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:03.095010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ead5d618a394bffa0f56dce3109b590', 'request_id': 'req-3adbf09c-8107-49c1-9c25-ad2c1939ce62'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.107526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ead5d618a394bffa0f56dce3109b590', 'request_id': 'req-3adbf09c-8107-49c1-9c25-ad2c1939ce62'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.132691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] MFA Rules not processed for user `403fab294a264e46bd42ebd6ee9784f6`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:03.134597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:03.136467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] The token cache is being invalidate because project 8ead5d618a394bffa0f56dce3109b590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:03.136838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.137663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.141789 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3086/6257] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:02 2022] DELETE /identity/v3/projects/8ead5d618a394bffa0f56dce3109b590 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:03.144203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:03.149630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:03.270906 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3172/6258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:03.286398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:03.288031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:03.304349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf09c-8107-49c1-9c25-ad2c1939ce62 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:03.437767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:03.438882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:03.439252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:03.439568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] PATH_INFO: `/v3/users/b384a01b440a4c8fb1e7a760ebaa964f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:03.441548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b384a01b440a4c8fb1e7a760ebaa964f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:03.445559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:03.446396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8698-ac16-4e43-9264-ac788c18fdb0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:03.454928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:03.455892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:03.456093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:03.456361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:03.478005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:03.480072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:03.491905 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3173/6259] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:03.492841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:03.494601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:03.517371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a180467-0b3c-487e-808c-12fa09463a73 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:03.525579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:03.528050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:03.528050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:03.528050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] PATH_INFO: `/v3/users/5145fae3fdfd41f0ad5f1e1fe59558f0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:03.530189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5145fae3fdfd41f0ad5f1e1fe59558f0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:03.532665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:03.561296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b384a01b440a4c8fb1e7a760ebaa964f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.563108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b384a01b440a4c8fb1e7a760ebaa964f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.582765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b384a01b440a4c8fb1e7a760ebaa964f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.584058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b384a01b440a4c8fb1e7a760ebaa964f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.599302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b384a01b440a4c8fb1e7a760ebaa964f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.632219 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3087/6260] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:03 2022] DELETE /identity/v3/users/b384a01b440a4c8fb1e7a760ebaa964f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:03.636823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5145fae3fdfd41f0ad5f1e1fe59558f0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.636963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:03.637792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5145fae3fdfd41f0ad5f1e1fe59558f0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.639080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:03.654250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5145fae3fdfd41f0ad5f1e1fe59558f0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.667097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5145fae3fdfd41f0ad5f1e1fe59558f0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.668732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-562a8e03-5958-49f5-9062-b9afd6050224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5145fae3fdfd41f0ad5f1e1fe59558f0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.711553 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3174/6261] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:03 2022] DELETE /identity/v3/users/5145fae3fdfd41f0ad5f1e1fe59558f0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:03.736818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2fd2-baf1-4cc5-b5c8-531c18728c87 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:03.857175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:03.858404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:03.858843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:03.859276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] PATH_INFO: `/v3/users/403fab294a264e46bd42ebd6ee9784f6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:03.861363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] RBAC: Authorizing `identity:delete_user(user_id=403fab294a264e46bd42ebd6ee9784f6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:03.863867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:03.967874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403fab294a264e46bd42ebd6ee9784f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.972715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403fab294a264e46bd42ebd6ee9784f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.987004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403fab294a264e46bd42ebd6ee9784f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.988778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403fab294a264e46bd42ebd6ee9784f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:03.999948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403fab294a264e46bd42ebd6ee9784f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:04.027445 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3088/6262] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:03 2022] DELETE /identity/v3/users/403fab294a264e46bd42ebd6ee9784f6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:04.032841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.033186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.033462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.056730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:04.058116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:04.126115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:04.127671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:04.211168 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3175/6263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:04.229000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:04.234292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:04.256940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cb3f1-e48d-43cd-aac9-f666203c439b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:04.265629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:04.267534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.268633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.269383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] PATH_INFO: `/v3/projects/7525a2e03c554c339134407c220d5499` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.272012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7525a2e03c554c339134407c220d5499)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:04.275792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:04.360482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bcb4-e49f-4a4e-b1ad-a7f74aa5e048 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:04.400265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7525a2e03c554c339134407c220d5499', 'request_id': 'req-8e58e8c3-0497-45f1-8081-40e03aa941fa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:04.418305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7525a2e03c554c339134407c220d5499', 'request_id': 'req-8e58e8c3-0497-45f1-8081-40e03aa941fa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:04.439189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7525a2e03c554c339134407c220d5499', 'request_id': 'req-8e58e8c3-0497-45f1-8081-40e03aa941fa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:04.451599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85812282-6fde-481c-9bb4-a0bf0baf0e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:04.452536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85812282-6fde-481c-9bb4-a0bf0baf0e87 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.452536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85812282-6fde-481c-9bb4-a0bf0baf0e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.452838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85812282-6fde-481c-9bb4-a0bf0baf0e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.460198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] The token cache is being invalidate because project 7525a2e03c554c339134407c220d5499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:04.460565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:04.461981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e58e8c3-0497-45f1-8081-40e03aa941fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:04.465972 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3089/6264] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:04 2022] DELETE /identity/v3/projects/7525a2e03c554c339134407c220d5499 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:04.471497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6adb-3772-4880-8e7b-bfad65265149 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.471817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6adb-3772-4880-8e7b-bfad65265149 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.472052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6adb-3772-4880-8e7b-bfad65265149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.520124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-febd6adb-3772-4880-8e7b-bfad65265149 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:04.523209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-febd6adb-3772-4880-8e7b-bfad65265149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:04.604941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85812282-6fde-481c-9bb4-a0bf0baf0e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:04.606550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85812282-6fde-481c-9bb4-a0bf0baf0e87 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:04.624996 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3176/6265] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:04.649100 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3090/6266] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:04.656602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f720-55f2-4bef-86f0-6454b6d0c15b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.656943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f720-55f2-4bef-86f0-6454b6d0c15b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.657193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f720-55f2-4bef-86f0-6454b6d0c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.683226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5183f720-55f2-4bef-86f0-6454b6d0c15b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:04.684915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5183f720-55f2-4bef-86f0-6454b6d0c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:04.696142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3177/6267] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:04.701828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6adb-3772-4880-8e7b-bfad65265149 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:04.720198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6adb-3772-4880-8e7b-bfad65265149 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:04.726760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:04.727486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.727788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.728046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.729610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:04.729938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:04.731733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:04.748355 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3091/6268] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:04.754143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f720-55f2-4bef-86f0-6454b6d0c15b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:04.774645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f720-55f2-4bef-86f0-6454b6d0c15b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:04.781955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:04.783031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.784285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.784905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.786085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:04.788543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:04.834299 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3178/6269] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:04 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:04.839043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:04.852724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4906-165b-4317-a8f3-58e65e02d385 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:04.906293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:04.908962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:04.994282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:04.996346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:04.997225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:04.998434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:04.999350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.003329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.046280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a77f0-b761-464b-9bf6-642137cf4b00 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.052771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.054048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.054500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.054809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] PATH_INFO: `/v3/projects/f592e970bba04b929d7e5988ac63ed51` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.056641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f592e970bba04b929d7e5988ac63ed51)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.059502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.083325 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3092/6270] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:04 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:05.087807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.112286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179ce6-a38d-4dd6-ba49-0bd90c6e0261 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.118707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.120046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.120329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.120655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.121588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.125083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.144909 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3093/6271] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:05.146856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.160444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4ac6-413f-41f1-9464-a3bc454008c2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.171342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f592e970bba04b929d7e5988ac63ed51', 'request_id': 'req-13e63df6-25ff-413f-9a96-dd12a04bc930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.200164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f592e970bba04b929d7e5988ac63ed51', 'request_id': 'req-13e63df6-25ff-413f-9a96-dd12a04bc930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.220145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f592e970bba04b929d7e5988ac63ed51', 'request_id': 'req-13e63df6-25ff-413f-9a96-dd12a04bc930'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.231846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.232738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.232899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.233227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.233963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.235717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.253484 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3094/6272] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:05.253693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] The token cache is being invalidate because project f592e970bba04b929d7e5988ac63ed51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:05.254592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.257184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.258193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13e63df6-25ff-413f-9a96-dd12a04bc930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.263401 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3179/6273] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:04 2022] DELETE /identity/v3/projects/f592e970bba04b929d7e5988ac63ed51 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:05.268771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.269259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.269536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.282841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303439e-ab66-4ecf-bfc7-ef6fd0bb39fa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.296328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4f686-56b9-4043-b2ed-af07efbdfdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.297723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f686-56b9-4043-b2ed-af07efbdfdab admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.298215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f686-56b9-4043-b2ed-af07efbdfdab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.298935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f686-56b9-4043-b2ed-af07efbdfdab admin admin] PATH_INFO: `/v3/projects/006419bf3bf84fd6807cd78e0ad59ef6/users/1d343c69635a4412bf9ffcd9dec5c13b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.328097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:05.343638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4f686-56b9-4043-b2ed-af07efbdfdab admin admin] RBAC: Authorizing `identity:create_grant(project_id=006419bf3bf84fd6807cd78e0ad59ef6, user_id=1d343c69635a4412bf9ffcd9dec5c13b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.346936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.353203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4f686-56b9-4043-b2ed-af07efbdfdab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.378560 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3180/6274] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:05.379477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.381557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.395536 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3095/6275] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:05 2022] PUT /identity/v3/projects/006419bf3bf84fd6807cd78e0ad59ef6/users/1d343c69635a4412bf9ffcd9dec5c13b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:05.398849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb317a-3278-41f3-b6d7-99adb5829c70 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.400357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb317a-3278-41f3-b6d7-99adb5829c70 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.400860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb317a-3278-41f3-b6d7-99adb5829c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.402543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae960c0-958c-49dc-b36e-e9bad309da32 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.457444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-50fb317a-3278-41f3-b6d7-99adb5829c70 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:05.459260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-50fb317a-3278-41f3-b6d7-99adb5829c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.516491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.518570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.519285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.519665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] PATH_INFO: `/v3/projects/64ba9004eeb14af2bdd911347781558e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.521637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ba9004eeb14af2bdd911347781558e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.523914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.566558 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3096/6276] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:05.569401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9498-bfc6-4c12-9c06-5ab21a7e3789 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.569772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9498-bfc6-4c12-9c06-5ab21a7e3789 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.570245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9498-bfc6-4c12-9c06-5ab21a7e3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.597621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-89ab9498-bfc6-4c12-9c06-5ab21a7e3789 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:05.598626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ba9004eeb14af2bdd911347781558e', 'request_id': 'req-309fd85c-c1df-4408-a769-a6bd84a10a01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.599195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-89ab9498-bfc6-4c12-9c06-5ab21a7e3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.611798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ba9004eeb14af2bdd911347781558e', 'request_id': 'req-309fd85c-c1df-4408-a769-a6bd84a10a01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.623803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ba9004eeb14af2bdd911347781558e', 'request_id': 'req-309fd85c-c1df-4408-a769-a6bd84a10a01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.640317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] The token cache is being invalidate because project 64ba9004eeb14af2bdd911347781558e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:05.640716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.641589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:05.643871 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3181/6277] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:05 2022] DELETE /identity/v3/projects/64ba9004eeb14af2bdd911347781558e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:05.644975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.648962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.689491 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3097/6278] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:05.705291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.705830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.706328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.753173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:05.753814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd85c-c1df-4408-a769-a6bd84a10a01 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.754831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.761271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e586272-e4b6-4ab8-8135-56c593e3166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.762950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586272-e4b6-4ab8-8135-56c593e3166e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.763236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586272-e4b6-4ab8-8135-56c593e3166e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.763518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586272-e4b6-4ab8-8135-56c593e3166e admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.764329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586272-e4b6-4ab8-8135-56c593e3166e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:05.764660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586272-e4b6-4ab8-8135-56c593e3166e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.767676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586272-e4b6-4ab8-8135-56c593e3166e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.776900 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3098/6279] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:05.782827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.785100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.805228 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3182/6280] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:05.805228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee76ba-f584-4448-bf17-97545d769d2c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.805228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee76ba-f584-4448-bf17-97545d769d2c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.805228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee76ba-f584-4448-bf17-97545d769d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.831824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a9ee76ba-f584-4448-bf17-97545d769d2c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:05.833534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a9ee76ba-f584-4448-bf17-97545d769d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:05.845938 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3183/6281] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:05.847003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee76ba-f584-4448-bf17-97545d769d2c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.864373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee76ba-f584-4448-bf17-97545d769d2c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.868399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ad188-01cb-48be-918a-ebe5aab64fee None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.870681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.871447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.871796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.872143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.872957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.873564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:05.874226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:05.874515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:05.874829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:05.875212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.887376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:05.889083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:05.905167 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3099/6282] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:05.906168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:05.916708 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3184/6283] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:05 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:05.921642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953309c-76a0-4fc9-822c-72aa511daa05 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:05.922071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.034064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b696-93e0-43e1-b097-aaa7d75bfbc2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.040585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.041593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.042604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.043093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.045016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.048006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.059602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.061700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.061997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.062591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.063577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:06.063870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.065868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.084089 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3185/6284] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:05 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:06.088695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.114123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b623e28-96d0-4756-be36-29ad12866781 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.120659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.121684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.122119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.122844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.123859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.125791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.128988 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3100/6285] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:06.131405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.139957 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3186/6286] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:06.144215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.158015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b18-0938-4388-9364-c2dfbc3006a5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.160344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774fb81-dc67-4173-b968-212a50780fd3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.163904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.165630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.166015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.166390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.167320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.169156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.171995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.173135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.173650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.174150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.175126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.177691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.185667 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3187/6287] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:06.192826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.219147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bae837-be29-46d3-93ed-ceae7feade32 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.240545 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3101/6288] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:06 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:06.242921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.243852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700690-cb86-48fe-8839-4ab6d10b990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.245375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700690-cb86-48fe-8839-4ab6d10b990d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.245762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700690-cb86-48fe-8839-4ab6d10b990d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.246672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700690-cb86-48fe-8839-4ab6d10b990d admin admin] PATH_INFO: `/v3/projects/c0093268543e43b09b1fc7020c6addcf/users/86cbfa8b68b04c8abeb2f59899079432/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.278269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e700690-cb86-48fe-8839-4ab6d10b990d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0093268543e43b09b1fc7020c6addcf, user_id=86cbfa8b68b04c8abeb2f59899079432, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.283786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e700690-cb86-48fe-8839-4ab6d10b990d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.313764 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3188/6289] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:06 2022] PUT /identity/v3/projects/c0093268543e43b09b1fc7020c6addcf/users/86cbfa8b68b04c8abeb2f59899079432/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:06.327143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8690-eba1-45a5-b21b-d5ddd6a7e74e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.328094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8690-eba1-45a5-b21b-d5ddd6a7e74e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.328590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8690-eba1-45a5-b21b-d5ddd6a7e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.369075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2823f5-1986-4b19-894c-221367760930 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.400378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3e7f8690-eba1-45a5-b21b-d5ddd6a7e74e None None] MFA Rules not processed for user `86cbfa8b68b04c8abeb2f59899079432`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:06.401917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3e7f8690-eba1-45a5-b21b-d5ddd6a7e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:06.490363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.504889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.505345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.505982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.506923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.509769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.540178 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3102/6290] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:06 2022] POST /identity/v3/users => generated 285 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:06.546673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.556938 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3189/6291] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:06.558504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8690-eba1-45a5-b21b-d5ddd6a7e74e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.571771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc766ac-9e22-465f-9a0e-a467a601e8b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.578760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.579595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.580407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.580762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.581612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.583845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.590962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8690-eba1-45a5-b21b-d5ddd6a7e74e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.597817 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3103/6292] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:06.602158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.604078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.604998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.605830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.609021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.609994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.612973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.614942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0c11-d108-4daf-8cc2-c1e189fc5f26 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.622554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.623936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.624297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.624680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.625711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.627570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.644919 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3104/6293] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:06.650053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.666002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88372e1a-36ce-4e54-9de2-457fcfe059a6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.672043 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3190/6294] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:06 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:06.673145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.673319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b677ca4-20cc-45ab-a1cf-5de3e999e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.674303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677ca4-20cc-45ab-a1cf-5de3e999e8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.674718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677ca4-20cc-45ab-a1cf-5de3e999e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.675084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677ca4-20cc-45ab-a1cf-5de3e999e8e4 admin admin] PATH_INFO: `/v3/projects/8e98e94619914b85b016c86eb40f5420/users/27b4fa7216b7461f90cdc072fb0885ce/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.698563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b677ca4-20cc-45ab-a1cf-5de3e999e8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e98e94619914b85b016c86eb40f5420, user_id=27b4fa7216b7461f90cdc072fb0885ce, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.703710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b677ca4-20cc-45ab-a1cf-5de3e999e8e4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.727459 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3105/6295] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:06 2022] PUT /identity/v3/projects/8e98e94619914b85b016c86eb40f5420/users/27b4fa7216b7461f90cdc072fb0885ce/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:06.738960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.740001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.740753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.783131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8ed7a-c05a-4df1-a4c9-0f33b1ffa45d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.815204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] MFA Rules not processed for user `27b4fa7216b7461f90cdc072fb0885ce`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:06.816648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:06.911954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.916532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.918025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.918415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.925585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.932462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:06.962461 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3106/6296] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:06.967369 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3191/6297] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:06 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:06.968812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.975370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:06.976909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:06.981756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919c99d-3fba-4abb-baaf-57076d489355 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:06.989306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:06.990286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:06.991269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:06.991269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:06.992004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:06.994263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.007193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3192/6298] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:07.011526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.026675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d042-1429-48b6-b2b4-a9813f216251 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.034305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.035515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.035905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.036371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] PATH_INFO: `/v3/projects/cb286a9007b445c4b1b8db9304474c16/users/a13e2f08475040a5a2edfff90939217b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.055119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278505-2511-495f-b6b5-d400b9f2ca1b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.061004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.061708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.061993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.062266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.063830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb286a9007b445c4b1b8db9304474c16, user_id=a13e2f08475040a5a2edfff90939217b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.068358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.072878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.075267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.087472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3107/6299] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:07.093434 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3193/6300] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:07 2022] PUT /identity/v3/projects/cb286a9007b445c4b1b8db9304474c16/users/a13e2f08475040a5a2edfff90939217b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:07.098525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.114156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467acf46-be0f-42e2-ac87-b3d284a018d3 service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.200405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43c23-c3c2-4848-bc74-ff88cc696c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.203110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43c23-c3c2-4848-bc74-ff88cc696c8b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.203110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43c23-c3c2-4848-bc74-ff88cc696c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.203110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43c23-c3c2-4848-bc74-ff88cc696c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.203986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43c23-c3c2-4848-bc74-ff88cc696c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.206351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43c23-c3c2-4848-bc74-ff88cc696c8b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.226950 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3108/6301] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:07.231313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.246131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e37221-0a2c-46d2-b30a-8b2a27c99c1b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.253878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.255022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.255312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.255595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] PATH_INFO: `/v3/projects/cb286a9007b445c4b1b8db9304474c16/users/a13e2f08475040a5a2edfff90939217b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.259458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb286a9007b445c4b1b8db9304474c16, user_id=a13e2f08475040a5a2edfff90939217b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.263061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.283393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3194/6302] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:07 2022] PUT /identity/v3/projects/cb286a9007b445c4b1b8db9304474c16/users/a13e2f08475040a5a2edfff90939217b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:07.294276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5d59-7220-4e9f-bccd-7a4ca65b3555 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.294959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5d59-7220-4e9f-bccd-7a4ca65b3555 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.295394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5d59-7220-4e9f-bccd-7a4ca65b3555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.348062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ff2b5d59-7220-4e9f-bccd-7a4ca65b3555 None None] MFA Rules not processed for user `a13e2f08475040a5a2edfff90939217b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:07.350000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ff2b5d59-7220-4e9f-bccd-7a4ca65b3555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:07.385125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.387450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:07.536851 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3109/6303] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:07.538191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b5d59-7220-4e9f-bccd-7a4ca65b3555 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.560601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb526-6eb8-4396-81cb-b8db0745d479 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.561576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b5d59-7220-4e9f-bccd-7a4ca65b3555 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.574260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.576280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13e2f08475040a5a2edfff90939217b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb286a9007b445c4b1b8db9304474c16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.577165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.578199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.578665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] PATH_INFO: `/v3/users/ff17ae35e6544ab38966ede763417ab1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.579379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.579724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.580018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.583123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff17ae35e6544ab38966ede763417ab1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.583603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.587453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.589206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.664140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3110/6304] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:07 2022] POST /identity/v3/projects => generated 358 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:07.666541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.684232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff17ae35e6544ab38966ede763417ab1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:07.685183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff17ae35e6544ab38966ede763417ab1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:07.701964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff17ae35e6544ab38966ede763417ab1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:07.725794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff17ae35e6544ab38966ede763417ab1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:07.726972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f13af353-781c-446d-a057-58f201422bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff17ae35e6544ab38966ede763417ab1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:07.760030 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3195/6305] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:07 2022] DELETE /identity/v3/users/ff17ae35e6544ab38966ede763417ab1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:07.762142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.762792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.763366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.765727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee886aa-cbcd-4961-a691-0689df00aa44 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.789861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:07.791236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:07.866009 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3196/6306] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:07.882678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.882802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13e2f08475040a5a2edfff90939217b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb286a9007b445c4b1b8db9304474c16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.882802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.882802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.883059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.884293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:07.884636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.887293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:07.943006 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3111/6307] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:07 2022] POST /identity/v3/users => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:07.948669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:07.959115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:07.968287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212b1f5-1b02-4e58-8bf5-3b46f005d498 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:07.975429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:07.978100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:07.978564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:07.978938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:07.993627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:07.995540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:08.003612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f4f26-2223-4c4d-adca-4d3b2fac95cf tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:08.019070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0ade9-456c-4ba8-a28a-afdd314640f7 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13e2f08475040a5a2edfff90939217b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb286a9007b445c4b1b8db9304474c16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:08.019782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ade9-456c-4ba8-a28a-afdd314640f7 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.020068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ade9-456c-4ba8-a28a-afdd314640f7 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.020256 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3197/6308] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:08.020363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ade9-456c-4ba8-a28a-afdd314640f7 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.024406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0ade9-456c-4ba8-a28a-afdd314640f7 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:08.024707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0ade9-456c-4ba8-a28a-afdd314640f7 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:08.030202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0ade9-456c-4ba8-a28a-afdd314640f7 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:08.095452 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3112/6309] 10.222.0.30 () {58 vars in 1156 bytes} [Sat Apr 9 21:17:07 2022] GET /identity/v3/users?domain_id=default => generated 8032 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:08.100344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:08.128846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75ea1d-3bd1-4dcb-b3f6-3bae83a4eb42 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:08.140932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13e2f08475040a5a2edfff90939217b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb286a9007b445c4b1b8db9304474c16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:08.143863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.144149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.146305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] PATH_INFO: `/v3/users/1a7ca8e63f334aeb95c99b4a84d8655a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.177588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorizing `identity:update_user(user_id=1a7ca8e63f334aeb95c99b4a84d8655a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:08.181674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:08.276161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1a7ca8e63f334aeb95c99b4a84d8655a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.291265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invalidating the token cache because user 1a7ca8e63f334aeb95c99b4a84d8655a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:08.291721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.292313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.297879 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3198/6310] 10.222.0.30 () {60 vars in 1243 bytes} [Sat Apr 9 21:17:08 2022] PATCH /identity/v3/users/1a7ca8e63f334aeb95c99b4a84d8655a => generated 485 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:08.300296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.300677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.300917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.331772 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.auth.plugins.core [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] User is disabled: 1a7ca8e63f334aeb95c99b4a84d8655a: AssertionError: User is disabled: 1a7ca8e63f334aeb95c99b4a84d8655a Apr 09 21:17:08.343871 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 09 21:17:08.346131 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3113/6311] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:08 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 47 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 09 21:17:08.351691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:08.354325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:08.367664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:08.370899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:08.380534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0f5e-93fe-486a-9f16-4f9ded5b7099 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:08.392623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13e2f08475040a5a2edfff90939217b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb286a9007b445c4b1b8db9304474c16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:08.394189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.395280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.396018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] PATH_INFO: `/v3/users/1a7ca8e63f334aeb95c99b4a84d8655a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.400796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9df6-02e2-414b-bab7-8863caf60825 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:08.408425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:08.409680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.409962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.410316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] PATH_INFO: `/v3/projects/5c3d71a0e0874df6bff9cee258aae5c7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.412474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3d71a0e0874df6bff9cee258aae5c7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:08.415623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:08.418670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1a7ca8e63f334aeb95c99b4a84d8655a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:08.420834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:08.498209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7ca8e63f334aeb95c99b4a84d8655a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.499152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7ca8e63f334aeb95c99b4a84d8655a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.510102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7ca8e63f334aeb95c99b4a84d8655a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.525997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7ca8e63f334aeb95c99b4a84d8655a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.526802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7ca8e63f334aeb95c99b4a84d8655a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.533443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3d71a0e0874df6bff9cee258aae5c7', 'request_id': 'req-89bdd337-4ed9-4f42-857d-35c13a0fead1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.545842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3d71a0e0874df6bff9cee258aae5c7', 'request_id': 'req-89bdd337-4ed9-4f42-857d-35c13a0fead1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.559617 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3199/6312] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:08 2022] DELETE /identity/v3/users/1a7ca8e63f334aeb95c99b4a84d8655a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:08.564667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:08.565375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3d71a0e0874df6bff9cee258aae5c7', 'request_id': 'req-89bdd337-4ed9-4f42-857d-35c13a0fead1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.566680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:08.591674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] The token cache is being invalidate because project 5c3d71a0e0874df6bff9cee258aae5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:08.591964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.596392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-89bdd337-4ed9-4f42-857d-35c13a0fead1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.600763 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3114/6313] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:08 2022] DELETE /identity/v3/projects/5c3d71a0e0874df6bff9cee258aae5c7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:08.606642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c653-6a23-4ba3-8faf-0f4bb09d8f07 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.607012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c653-6a23-4ba3-8faf-0f4bb09d8f07 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.607244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c653-6a23-4ba3-8faf-0f4bb09d8f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.650464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5155c653-6a23-4ba3-8faf-0f4bb09d8f07 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:08.652071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5155c653-6a23-4ba3-8faf-0f4bb09d8f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:08.736858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef04b95-9dcd-49da-b3c9-6f9ddaded372 tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:08.755098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13e2f08475040a5a2edfff90939217b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb286a9007b445c4b1b8db9304474c16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:08.757679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.758039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.758778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] PATH_INFO: `/v3/projects/bd7f80e0c327472d970234997bde4ba5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.761928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd7f80e0c327472d970234997bde4ba5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:08.766206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:08.799955 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3115/6314] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:08.808772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f64d-eab6-4994-9c1e-6b4a81394598 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.809105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f64d-eab6-4994-9c1e-6b4a81394598 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.809437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f64d-eab6-4994-9c1e-6b4a81394598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.831143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2562f64d-eab6-4994-9c1e-6b4a81394598 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:08.837537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2562f64d-eab6-4994-9c1e-6b4a81394598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:08.856753 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3116/6315] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:08.858403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562f64d-eab6-4994-9c1e-6b4a81394598 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:08.876308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562f64d-eab6-4994-9c1e-6b4a81394598 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:08.898016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:08.901213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:08.901511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:08.901771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:08.902530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:08.902835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:08.909818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:08.928696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7f80e0c327472d970234997bde4ba5', 'request_id': 'req-78136119-3f8c-493c-bb69-e20235c8b3ab'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.938120 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3117/6316] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:08.939700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7f80e0c327472d970234997bde4ba5', 'request_id': 'req-78136119-3f8c-493c-bb69-e20235c8b3ab'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.940035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:08.955415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7f80e0c327472d970234997bde4ba5', 'request_id': 'req-78136119-3f8c-493c-bb69-e20235c8b3ab'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.958628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82005dd5-c7d1-4a8c-9bb1-59e73786b5a5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:08.995115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] The token cache is being invalidate because project bd7f80e0c327472d970234997bde4ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:08.995478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.997564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:08.999760 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3200/6317] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:08 2022] DELETE /identity/v3/projects/bd7f80e0c327472d970234997bde4ba5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:09.008352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.010844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:09.054939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.055692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.056616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.057915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.058791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.066379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.131467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3118/6318] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:08 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:09.139024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.141271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136119-3f8c-493c-bb69-e20235c8b3ab tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.143021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:09.233449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13e2f08475040a5a2edfff90939217b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb286a9007b445c4b1b8db9304474c16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.234271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.234630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.234983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.236077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.238595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.242640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb463747-e8d8-44cd-8aa8-833c70c9acbf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.249648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.250493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.250779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.251114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.251900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.252732 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Could not find domain: 0caa01e6fe414996b42c92e62fd5ebe4.: keystone.exception.DomainNotFound: Could not find domain: 0caa01e6fe414996b42c92e62fd5ebe4. Apr 09 21:17:09.254452 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3201/6319] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:09 2022] POST /identity/v3/users => generated 112 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:17:09.258398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.260515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.268955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:09.288870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5385a1-d5e9-4bae-bcc7-62133b2d4a4d tempest-UsersNegativeTest-1676250473 tempest-UsersNegativeTest-1676250473-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.292828 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3119/6320] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:09 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:09.294028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.298838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.299772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.300259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.300541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] PATH_INFO: `/v3/users/86cbfa8b68b04c8abeb2f59899079432` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.302202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86cbfa8b68b04c8abeb2f59899079432)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.304751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.309077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d593231-0521-4cd2-b56f-1069d41c119a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.316614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.318007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.318296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.318633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.320271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.322095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.343825 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3120/6321] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:09.350419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.364048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d32e6-f674-4928-86ab-fdde9eaa9439 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.370152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.370739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.371113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.371370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.372145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.373976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.381286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86cbfa8b68b04c8abeb2f59899079432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:09.382204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86cbfa8b68b04c8abeb2f59899079432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:09.389076 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3121/6322] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:09.390956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86cbfa8b68b04c8abeb2f59899079432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:09.393523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.401299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86cbfa8b68b04c8abeb2f59899079432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:09.402148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dab3a5b7-9faa-415c-a5ec-6b6639089b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86cbfa8b68b04c8abeb2f59899079432'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:09.409986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc75f4b-34a7-4920-95c6-319efeea2d38 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.415509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa008e-33d3-475d-b97d-ad1ed34380fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.416434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa008e-33d3-475d-b97d-ad1ed34380fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.416729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa008e-33d3-475d-b97d-ad1ed34380fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.417016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa008e-33d3-475d-b97d-ad1ed34380fb admin admin] PATH_INFO: `/v3/projects/181502de10414412a8e5f105bdbcb6b0/users/50a301cd542543ab9bbb34b8b3a6f806/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.435335 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3202/6323] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:09 2022] DELETE /identity/v3/users/86cbfa8b68b04c8abeb2f59899079432 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:09.440471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.441850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.441850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.443864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa008e-33d3-475d-b97d-ad1ed34380fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=181502de10414412a8e5f105bdbcb6b0, user_id=50a301cd542543ab9bbb34b8b3a6f806, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.455318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa008e-33d3-475d-b97d-ad1ed34380fb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.481091 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3122/6324] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:09 2022] PUT /identity/v3/projects/181502de10414412a8e5f105bdbcb6b0/users/50a301cd542543ab9bbb34b8b3a6f806/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:09.498058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.501105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.501105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.503346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:09.505308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:09.535829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] MFA Rules not processed for user `50a301cd542543ab9bbb34b8b3a6f806`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:09.537152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:09.617723 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3203/6325] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:09.634344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.636611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:09.648808 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3123/6326] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:09.661630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:09.663554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:09.751128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689875f-636e-48ea-9420-b7089ecda925 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.763854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.765159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.765538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.766176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.769823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c41c-9179-47d9-b1ad-fd036671d825 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:09.780712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.783236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.785404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:09.787268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:09.787595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:09.788408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:09.799047 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3204/6327] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:09.808146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:09.810221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:09.822730 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3124/6328] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:10.635779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:10.637546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:10.674221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d12bc5-80cd-42d2-9d7d-7afde73a50cf service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:10.692296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:10.693348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:10.693696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:10.694029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] PATH_INFO: `/v3/projects/c0093268543e43b09b1fc7020c6addcf` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:10.696951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0093268543e43b09b1fc7020c6addcf)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:10.699153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:10.814835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:10.818320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0093268543e43b09b1fc7020c6addcf', 'request_id': 'req-66e2a683-45e1-47ec-8c40-5d6d3f575041'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:10.821012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:10.834369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0093268543e43b09b1fc7020c6addcf', 'request_id': 'req-66e2a683-45e1-47ec-8c40-5d6d3f575041'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:10.860236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0093268543e43b09b1fc7020c6addcf', 'request_id': 'req-66e2a683-45e1-47ec-8c40-5d6d3f575041'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:10.874732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee7aa-b91f-4c33-a2ea-5842d887ea1b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:10.887873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] The token cache is being invalidate because project c0093268543e43b09b1fc7020c6addcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:10.888227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:10.893338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:10.897434 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3205/6329] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:10 2022] DELETE /identity/v3/projects/c0093268543e43b09b1fc7020c6addcf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:10.903293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:10.904995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:10.963283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:10.964134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:10.964524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:10.964940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:10.967044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:11.066943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2a683-45e1-47ec-8c40-5d6d3f575041 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:11.069915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:11.073688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:11.073864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:11.074768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:11.075256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:11.075595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] PATH_INFO: `/v3/users/a13e2f08475040a5a2edfff90939217b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:11.077327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13e2f08475040a5a2edfff90939217b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:11.079761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:11.107713 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3125/6330] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:11.180043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13e2f08475040a5a2edfff90939217b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:11.181683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13e2f08475040a5a2edfff90939217b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:11.202756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13e2f08475040a5a2edfff90939217b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:11.223600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13e2f08475040a5a2edfff90939217b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:11.224663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-77f648f9-51ac-48d0-9a48-33820f7f80f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13e2f08475040a5a2edfff90939217b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:11.265116 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3206/6331] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:10 2022] DELETE /identity/v3/users/a13e2f08475040a5a2edfff90939217b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:12.737623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:12.771175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8724-eae3-4403-8571-0f6292f18ce5 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:13.031503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:13.034269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:13.034806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:13.035401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] PATH_INFO: `/v3/projects/cb286a9007b445c4b1b8db9304474c16` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:13.039023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb286a9007b445c4b1b8db9304474c16)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:13.044253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:13.183882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb286a9007b445c4b1b8db9304474c16', 'request_id': 'req-f2b80175-6a52-4642-9a61-a52da4064540'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:13.203769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb286a9007b445c4b1b8db9304474c16', 'request_id': 'req-f2b80175-6a52-4642-9a61-a52da4064540'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:13.226605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb286a9007b445c4b1b8db9304474c16', 'request_id': 'req-f2b80175-6a52-4642-9a61-a52da4064540'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:13.258170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] The token cache is being invalidate because project cb286a9007b445c4b1b8db9304474c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:13.258473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:13.265734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2b80175-6a52-4642-9a61-a52da4064540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:13.274735 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3126/6332] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:12 2022] DELETE /identity/v3/projects/cb286a9007b445c4b1b8db9304474c16 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:13.280007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32db93-4f0f-4b5e-94f7-732ce29aa50c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:13.280523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32db93-4f0f-4b5e-94f7-732ce29aa50c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:13.280664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32db93-4f0f-4b5e-94f7-732ce29aa50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:13.306936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9e32db93-4f0f-4b5e-94f7-732ce29aa50c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:13.309080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9e32db93-4f0f-4b5e-94f7-732ce29aa50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:13.477737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:13.478037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:13.478310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:13.508907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3207/6333] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:13.516548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1b27-30bc-4b43-bead-9dac58486a04 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:13.516996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1b27-30bc-4b43-bead-9dac58486a04 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:13.517390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1b27-30bc-4b43-bead-9dac58486a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:13.544800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] MFA Rules not processed for user `1d343c69635a4412bf9ffcd9dec5c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:13.546538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:13.559547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fcbc1b27-30bc-4b43-bead-9dac58486a04 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:13.566659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fcbc1b27-30bc-4b43-bead-9dac58486a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:13.591720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3208/6334] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:13.595622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc1b27-30bc-4b43-bead-9dac58486a04 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:13.618908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc1b27-30bc-4b43-bead-9dac58486a04 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:13.640084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:13.641958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:13.642248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:13.646761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:13.649602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:13.649940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:13.651636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:13.686516 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3209/6335] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:13.687571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:13.712538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1897d-335a-4e54-873b-df51477ea846 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:13.724797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:13.727151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:13.727441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:13.727718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:13.729532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:13.731609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:13.748656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3127/6336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:13.750452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:13.753593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:13.824113 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3210/6337] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:13 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:13.828043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:13.915786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb965e-21bf-4eab-99d7-4e29aa606555 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:13.980010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3761-f1c0-45c5-8f4c-f03a3c7bcdac admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:13.998608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:13.999819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.000619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.000619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.001715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:14.004461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:14.024689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:14.025447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.025917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.026212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.076039 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3211/6338] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:13 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:14.080125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:14.093262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65fd6a-cd34-4923-8ffb-59fac49ce113 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:14.099895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:14.101453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.101976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.102466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.103528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:14.105501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:14.118722 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3212/6339] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:14.122931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:14.138321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50a17c-d3fc-4a60-9e3e-f472d0a33ca6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:14.142530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:14.145750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:14.146659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44038d-dad1-479d-8042-7ed1a7384b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:14.147844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44038d-dad1-479d-8042-7ed1a7384b37 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.148396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44038d-dad1-479d-8042-7ed1a7384b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.148912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44038d-dad1-479d-8042-7ed1a7384b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.149892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44038d-dad1-479d-8042-7ed1a7384b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:14.152429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44038d-dad1-479d-8042-7ed1a7384b37 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:14.166488 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3128/6340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:14.182793 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3213/6341] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:14.188929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:14.206712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d902-571b-4cb2-b3df-0e831c6256e2 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:14.215172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:14.218977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.219400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.219782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] PATH_INFO: `/v3/projects/9dd86ff511804ca0a8323bb08a4c9c99/users/d858a1a3e17f41c68b00adb26e1fafa2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.259403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd86ff511804ca0a8323bb08a4c9c99, user_id=d858a1a3e17f41c68b00adb26e1fafa2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:14.262245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:14.303310 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3129/6342] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:14 2022] PUT /identity/v3/projects/9dd86ff511804ca0a8323bb08a4c9c99/users/d858a1a3e17f41c68b00adb26e1fafa2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:14.304625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc64a7-3c85-48aa-ac0f-deb88dd38b96 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.305519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc64a7-3c85-48aa-ac0f-deb88dd38b96 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.305845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc64a7-3c85-48aa-ac0f-deb88dd38b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.377018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c5dc64a7-3c85-48aa-ac0f-deb88dd38b96 None None] MFA Rules not processed for user `d858a1a3e17f41c68b00adb26e1fafa2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:14.386860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c5dc64a7-3c85-48aa-ac0f-deb88dd38b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:14.522432 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3214/6343] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:14.523400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:14.542249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011623b-201e-4606-9142-aeb0c1648b52 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:14.563153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:14.564149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.564426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.564692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.565475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:create_application_credential(user_id=d858a1a3e17f41c68b00adb26e1fafa2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:14.566851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:14.909302 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3130/6344] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Apr 9 21:17:14 2022] POST /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials => generated 921 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:14.911076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc64a7-3c85-48aa-ac0f-deb88dd38b96 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:14.926850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc64a7-3c85-48aa-ac0f-deb88dd38b96 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:14.937512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:14.939220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:14.940900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:14.941240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules/4aec3872be584069b0de547b68fd6d76` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:14.943120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d858a1a3e17f41c68b00adb26e1fafa2, access_rule_id=4aec3872be584069b0de547b68fd6d76)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:14.953278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.071639 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Apr 09 21:17:15.080436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.088384 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3215/6345] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Apr 9 21:17:14 2022] DELETE /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules/4aec3872be584069b0de547b68fd6d76 => generated 89 bytes in 178 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Apr 09 21:17:15.118851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f325ba0-354e-4955-bbde-9bb0a7a0a851 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.134949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.138141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.141515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.143578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials/fb7bacdb47d6458ab9e7886c475c27e0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.179068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d858a1a3e17f41c68b00adb26e1fafa2, application_credential_id=fb7bacdb47d6458ab9e7886c475c27e0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.182445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.234204 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3131/6346] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Apr 9 21:17:15 2022] DELETE /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials/fb7bacdb47d6458ab9e7886c475c27e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:15.238470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.256905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f71d4-9222-47b2-9e94-970e11df57dd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.262692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.263922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.264536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.265643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.267682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:list_access_rules(user_id=d858a1a3e17f41c68b00adb26e1fafa2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.270771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.281124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3216/6347] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:17:15 2022] GET /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules => generated 369 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:17:15.283603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.297864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353d39a-78a4-4c65-8beb-197a560f5ad2 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.308110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.309859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.310301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.310762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules/4aec3872be584069b0de547b68fd6d76` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.312343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d858a1a3e17f41c68b00adb26e1fafa2, access_rule_id=4aec3872be584069b0de547b68fd6d76)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.315906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.349886 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3132/6348] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Apr 9 21:17:15 2022] DELETE /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules/4aec3872be584069b0de547b68fd6d76 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:15.354412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.377552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74473-3aeb-4adb-98e4-b49c79cd0cd9 tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.398584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.399790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.400224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.400654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.402282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:list_access_rules(user_id=d858a1a3e17f41c68b00adb26e1fafa2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.404047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.410123 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3217/6349] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:17:15 2022] GET /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules => generated 158 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:15.415725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.431092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe926f-51de-41d9-8b1f-9a5c78cc217d tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.437733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.439070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.439357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.439641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.440832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:create_application_credential(user_id=d858a1a3e17f41c68b00adb26e1fafa2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.442539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.586118 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3133/6350] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Apr 9 21:17:15 2022] POST /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials => generated 919 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:15.588901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.599616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4265a-6284-4e53-9739-129a7cf9436a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.604843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.606480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.607847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.608361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.609955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:list_access_rules(user_id=d858a1a3e17f41c68b00adb26e1fafa2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.611717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.618687 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3218/6351] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:17:15 2022] GET /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules => generated 369 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:15.627038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.646257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e25e-e28b-4892-b0a5-2e8b215781bd tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.654559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.657124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.657837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.658902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.659971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:create_application_credential(user_id=d858a1a3e17f41c68b00adb26e1fafa2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.662241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.789262 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3134/6352] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Apr 9 21:17:15 2022] POST /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/application_credentials => generated 921 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:15.793783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:15.820327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91dbc8-adb6-431a-88ad-f207286ed03b tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:15.832347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ff9b-da98-4bad-af30-dbb4eb5bd69e tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd858a1a3e17f41c68b00adb26e1fafa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd86ff511804ca0a8323bb08a4c9c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:15.834829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ff9b-da98-4bad-af30-dbb4eb5bd69e tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:15.840231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ff9b-da98-4bad-af30-dbb4eb5bd69e tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:15.842257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ff9b-da98-4bad-af30-dbb4eb5bd69e tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules/57fc8300dfa349bd86e36fd3f49ab319` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:15.847656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71ff9b-da98-4bad-af30-dbb4eb5bd69e tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorizing `identity:get_access_rule(user_id=d858a1a3e17f41c68b00adb26e1fafa2, access_rule_id=57fc8300dfa349bd86e36fd3f49ab319)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:15.854429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71ff9b-da98-4bad-af30-dbb4eb5bd69e tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:15.889001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3219/6353] 10.222.0.30 () {58 vars in 1358 bytes} [Sat Apr 9 21:17:15 2022] GET /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2/access_rules/57fc8300dfa349bd86e36fd3f49ab319 => generated 229 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:15.894215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:16.024934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d00797-2a94-4c77-8c03-7b441e078c5a tempest-AccessRulesV3Test-1738570162 tempest-AccessRulesV3Test-1738570162-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:16.044010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:16.045240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:16.045796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:16.046260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] PATH_INFO: `/v3/users/d858a1a3e17f41c68b00adb26e1fafa2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:16.049611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d858a1a3e17f41c68b00adb26e1fafa2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:16.055852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:16.220425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd858a1a3e17f41c68b00adb26e1fafa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:16.226380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd858a1a3e17f41c68b00adb26e1fafa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:16.272723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd858a1a3e17f41c68b00adb26e1fafa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:16.273767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd858a1a3e17f41c68b00adb26e1fafa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:16.304337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd858a1a3e17f41c68b00adb26e1fafa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:16.510515 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3135/6354] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:15 2022] DELETE /identity/v3/users/d858a1a3e17f41c68b00adb26e1fafa2 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:16.515319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:16.515851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:16.515851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:16.622373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:16.627023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:16.849707 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3220/6355] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:16.949420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:16.951516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:17.057723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc5fd-7b7f-475d-9d72-8a44bcf61963 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:17.064819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e238d7-ae8d-4286-8883-2710e8a439f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:17.065075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e238d7-ae8d-4286-8883-2710e8a439f6 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:17.065314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e238d7-ae8d-4286-8883-2710e8a439f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:17.065536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e238d7-ae8d-4286-8883-2710e8a439f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:17.092816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e238d7-ae8d-4286-8883-2710e8a439f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:17.095457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e238d7-ae8d-4286-8883-2710e8a439f6 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:17.113282 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3136/6356] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:18.983388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:18.986003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:19.033679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523587aa-2aee-4fdd-845d-45fffe32f8c8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:19.066703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:19.068808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:19.069247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:19.069732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] PATH_INFO: `/v3/projects/9dd86ff511804ca0a8323bb08a4c9c99` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:19.072503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd86ff511804ca0a8323bb08a4c9c99)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:19.078013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:19.201183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd86ff511804ca0a8323bb08a4c9c99', 'request_id': 'req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:19.209192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd86ff511804ca0a8323bb08a4c9c99', 'request_id': 'req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:19.238283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd86ff511804ca0a8323bb08a4c9c99', 'request_id': 'req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:19.270705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] The token cache is being invalidate because project 9dd86ff511804ca0a8323bb08a4c9c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:19.272394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:19.273950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8f6eef67-a3c7-4ad4-a0ab-0464962b2f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:19.279391 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3221/6357] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:18 2022] DELETE /identity/v3/projects/9dd86ff511804ca0a8323bb08a4c9c99 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:19.285551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c2f5-ba8c-4256-a7d8-a7eec5d5c6fd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:19.286066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c2f5-ba8c-4256-a7d8-a7eec5d5c6fd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:19.286173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c2f5-ba8c-4256-a7d8-a7eec5d5c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:19.325585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-49e9c2f5-ba8c-4256-a7d8-a7eec5d5c6fd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:19.326610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-49e9c2f5-ba8c-4256-a7d8-a7eec5d5c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:19.553591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3137/6358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:19.561863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142080-4522-43e9-9967-530aa793f6e7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:19.562291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142080-4522-43e9-9967-530aa793f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:19.563248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142080-4522-43e9-9967-530aa793f6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:19.658190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-46142080-4522-43e9-9967-530aa793f6e7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:19.659803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46142080-4522-43e9-9967-530aa793f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:19.682304 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3222/6359] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:19.686997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9c2f5-ba8c-4256-a7d8-a7eec5d5c6fd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:19.712313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9c2f5-ba8c-4256-a7d8-a7eec5d5c6fd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:19.727729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:19.729287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:19.729906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:19.730555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:19.747649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:19.748261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:19.756336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:19.796294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3138/6360] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:19.802428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142080-4522-43e9-9967-530aa793f6e7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:19.824606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142080-4522-43e9-9967-530aa793f6e7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:19.831987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:19.833077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:19.833769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:19.834213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:19.836203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:19.838767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:19.886723 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3223/6361] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:19 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:19.891252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:19.907203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d1549-60cb-4c69-ab06-313d6c1f5021 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:20.071569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:20.072474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:20.072761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:20.073054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:20.076645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:20.078926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:20.189619 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3139/6362] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:19 2022] POST /identity/v3/users => generated 299 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:20.193967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:20.216499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b656-6853-416b-a5ae-f74c31fb4717 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:20.244526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:20.245981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:20.246456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:20.247040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:20.248041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:20.253445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:20.351563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:20.352969 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3224/6363] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:20.365889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a1994-657a-493e-83a3-7ca43d9da278 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:20.384580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:20.385130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:20.385703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:20.386118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] PATH_INFO: `/v3/projects/5e893fd6711e4587bb4315bd77247f32/users/bc188897a6164896be4f814dfc973d75/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:20.433483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e893fd6711e4587bb4315bd77247f32, user_id=bc188897a6164896be4f814dfc973d75, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:20.439539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:20.495579 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3140/6364] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:20 2022] PUT /identity/v3/projects/5e893fd6711e4587bb4315bd77247f32/users/bc188897a6164896be4f814dfc973d75/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:20.500948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:20.520321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2cd7a-7f80-4fdb-a90c-fdcc3499bc83 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:20.720351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fbb31-37d7-488f-b76d-766fdee96ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:20.721516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fbb31-37d7-488f-b76d-766fdee96ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:20.721983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fbb31-37d7-488f-b76d-766fdee96ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:20.722672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fbb31-37d7-488f-b76d-766fdee96ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:20.724632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fbb31-37d7-488f-b76d-766fdee96ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:20.726916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fbb31-37d7-488f-b76d-766fdee96ec8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:20.751765 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3225/6365] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:20.755861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:20.772574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda003da-0ca1-4f9c-be11-7253a64c5ce5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:20.791374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:20.792440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:20.792743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:20.793000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] PATH_INFO: `/v3/projects/5e893fd6711e4587bb4315bd77247f32/users/bc188897a6164896be4f814dfc973d75/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:20.800592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e893fd6711e4587bb4315bd77247f32, user_id=bc188897a6164896be4f814dfc973d75, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:20.803929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:20.844412 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3141/6366] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:20 2022] PUT /identity/v3/projects/5e893fd6711e4587bb4315bd77247f32/users/bc188897a6164896be4f814dfc973d75/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:20.857758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34266a-afcd-4e5d-9149-e54b3d7b4f9c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:20.858244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34266a-afcd-4e5d-9149-e54b3d7b4f9c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:20.858617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34266a-afcd-4e5d-9149-e54b3d7b4f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:20.924601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2b34266a-afcd-4e5d-9149-e54b3d7b4f9c None None] MFA Rules not processed for user `bc188897a6164896be4f814dfc973d75`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:20.928170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2b34266a-afcd-4e5d-9149-e54b3d7b4f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:21.130047 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3226/6367] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:21.134664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:21.302484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858427d-c786-476a-abc5-74c4c550cb50 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:21.316411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:21.317397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:21.317678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:21.317953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:21.318655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:21.323115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:21.395261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3142/6368] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:21 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:21.396971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34266a-afcd-4e5d-9149-e54b3d7b4f9c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:21.421422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34266a-afcd-4e5d-9149-e54b3d7b4f9c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:21.591575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:21.594497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:21.594930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:21.595236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:21.596726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:21.607483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:21.640459 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3227/6369] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:21 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:21.645259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:21.679032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb640fa8-ae35-4430-a912-499d8ff2be40 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:21.696116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:21.697543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:21.697981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:21.698405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:21.699416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:21.701345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:21.717982 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3143/6370] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:21.722163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:21.752307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c3c82-57fc-472b-8d92-a2a5c075b8e4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:21.780401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03688ae1-6645-4ceb-984b-fd0c1dc05456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:21.782573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688ae1-6645-4ceb-984b-fd0c1dc05456 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:21.783627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688ae1-6645-4ceb-984b-fd0c1dc05456 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:21.784863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688ae1-6645-4ceb-984b-fd0c1dc05456 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:21.798646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688ae1-6645-4ceb-984b-fd0c1dc05456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:21.801630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688ae1-6645-4ceb-984b-fd0c1dc05456 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:21.846698 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3228/6371] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:21.851612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:21.866167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da303e-7393-4d2d-b267-a2218b7464ce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:21.876877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:21.879094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:21.879568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:21.879994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] PATH_INFO: `/v3/projects/0abc4a1289004f6aa4a018856a84bc94/users/4080c0476e8c4459b312a0ab62846c9a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:21.912214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abc4a1289004f6aa4a018856a84bc94, user_id=4080c0476e8c4459b312a0ab62846c9a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:21.916264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:21.958886 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3144/6372] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:21 2022] PUT /identity/v3/projects/0abc4a1289004f6aa4a018856a84bc94/users/4080c0476e8c4459b312a0ab62846c9a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:22.076260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:22.076780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:22.077908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:22.140732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] MFA Rules not processed for user `4080c0476e8c4459b312a0ab62846c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:22.142820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:22.314611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3229/6373] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:22.327919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:22.330058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:22.462898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c769d6-ca19-4e0e-b37c-ce4fda4d5b52 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:22.477209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:22.478046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:22.480035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:22.480879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:22.670798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:22.672365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:22.687454 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3145/6374] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:23.100147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:23.101654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:23.234212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a879bf-34bf-4b24-8596-444cb769166a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:23.240195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82110d70-838d-4888-9144-fe75f675fadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:23.242352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82110d70-838d-4888-9144-fe75f675fadc service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:23.242352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82110d70-838d-4888-9144-fe75f675fadc service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:23.242728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82110d70-838d-4888-9144-fe75f675fadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:23.245480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-82110d70-838d-4888-9144-fe75f675fadc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:23.283447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82110d70-838d-4888-9144-fe75f675fadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:23.289434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82110d70-838d-4888-9144-fe75f675fadc service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:23.324465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3230/6375] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:23.986219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:24.025361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab068fd-b0eb-4661-a17e-7769b3267765 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:24.025918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab068fd-b0eb-4661-a17e-7769b3267765 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:24.026341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab068fd-b0eb-4661-a17e-7769b3267765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:24.075226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3ab068fd-b0eb-4661-a17e-7769b3267765 None None] MFA Rules not processed for user `1d343c69635a4412bf9ffcd9dec5c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:24.076511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3ab068fd-b0eb-4661-a17e-7769b3267765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:24.186849 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3231/6376] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:24.195701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39e80-e911-4b11-b3d8-70db219737c2 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:24.198839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39e80-e911-4b11-b3d8-70db219737c2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:24.199271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39e80-e911-4b11-b3d8-70db219737c2 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:24.200604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076666-209e-42d7-824e-1dd533c2823b service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:24.203546 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3232/6377] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:17:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:17:24.210111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:24.210655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:24.212516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:24.230900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:24.233695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:24.250398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:24.261393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] PATH_INFO: `/v3/users/bc188897a6164896be4f814dfc973d75` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:24.262907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc188897a6164896be4f814dfc973d75)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:24.265863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:24.309318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:24.310781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:24.387749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc188897a6164896be4f814dfc973d75'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:24.389555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc188897a6164896be4f814dfc973d75'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:24.407105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc188897a6164896be4f814dfc973d75'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:24.408239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc188897a6164896be4f814dfc973d75'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:24.432221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-551b95f3-92d4-4377-8b06-43fbe4c4ddb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc188897a6164896be4f814dfc973d75'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:24.462398 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3233/6378] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:24.497365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:24.500782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:24.526344 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3146/6379] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:23 2022] DELETE /identity/v3/users/bc188897a6164896be4f814dfc973d75 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:24.530752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:24.531291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:24.533499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:24.557829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a104a-3eea-4faf-993b-2723438b955c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:24.602543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:24.609276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:24.746990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:24.747684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:24.747962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:24.750356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:24.777241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:24.779287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3147/6380] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:24.783671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:24.812841 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3234/6381] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:24.871098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:24.872787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:25.045911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:25.047577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:25.086371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6da8-4905-40bd-84eb-be68ff631bab None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:25.094833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:25.097621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:25.098488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:25.098910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:25.150293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:25.153293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:25.198125 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3148/6382] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:25.246012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:25.282124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13065faf-bef4-4c54-8bb4-f99ead3b66fd service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:25.291353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2664b4-a313-45fd-8449-c880762e34f4 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:25.301440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:25.302101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:25.302546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:25.302973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:25.304865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:25.307098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:25.308294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:25.308890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:25.309661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:25.315018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:25.357845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:25.367543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:25.393306 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3235/6383] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:25.537231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:25.542040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:25.568590 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3149/6384] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:26.258421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:26.263955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:26.272702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:26.274373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:26.286520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7438b8-2d3a-43d2-9c2e-1fd6017330e1 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:26.293743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:26.295268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:26.295696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:26.296145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] PATH_INFO: `/v3/projects/5e893fd6711e4587bb4315bd77247f32` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:26.302212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c2466-dd38-4cff-8e6c-73a00495d0c3 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:26.309118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:26.310372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e893fd6711e4587bb4315bd77247f32)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:26.311666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:26.311959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:26.312375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] PATH_INFO: `/v3/users/27b4fa7216b7461f90cdc072fb0885ce` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:26.314049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:26.315820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b4fa7216b7461f90cdc072fb0885ce)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:26.320382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:26.396532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b4fa7216b7461f90cdc072fb0885ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.397636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b4fa7216b7461f90cdc072fb0885ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.406875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b4fa7216b7461f90cdc072fb0885ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.408180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b4fa7216b7461f90cdc072fb0885ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.423438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e893fd6711e4587bb4315bd77247f32', 'request_id': 'req-a7220552-208a-469c-b2ed-e00e57044d17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.430647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b4fa7216b7461f90cdc072fb0885ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.433635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e893fd6711e4587bb4315bd77247f32', 'request_id': 'req-a7220552-208a-469c-b2ed-e00e57044d17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.459489 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3150/6385] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:26 2022] DELETE /identity/v3/users/27b4fa7216b7461f90cdc072fb0885ce => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:26.460686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:26.461955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e893fd6711e4587bb4315bd77247f32', 'request_id': 'req-a7220552-208a-469c-b2ed-e00e57044d17'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.463301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:26.476067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] The token cache is being invalidate because project 5e893fd6711e4587bb4315bd77247f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:26.476668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.477513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a7220552-208a-469c-b2ed-e00e57044d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.479175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3236/6386] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:26 2022] DELETE /identity/v3/projects/5e893fd6711e4587bb4315bd77247f32 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:26.480648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:26.481112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:26.481532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:26.500268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:26.501841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:26.561492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee32f89-34a5-4d97-9f61-ee8455fe7905 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:26.572547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:26.573542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:26.573818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:26.574088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] PATH_INFO: `/v3/users/a6dcb8344fde4e4580e73efc09e633a7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:26.575321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6dcb8344fde4e4580e73efc09e633a7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:26.577292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:26.596415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3237/6387] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:26.598311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:26.602781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:26.628549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33b35-9c50-4382-b83e-3bbe020d5c58 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:26.640159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:26.641526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6dcb8344fde4e4580e73efc09e633a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.641984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:26.642457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6dcb8344fde4e4580e73efc09e633a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.642582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:26.642759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] PATH_INFO: `/v3/users/4080c0476e8c4459b312a0ab62846c9a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:26.645070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4080c0476e8c4459b312a0ab62846c9a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:26.649128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:26.655247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6dcb8344fde4e4580e73efc09e633a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.656262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6dcb8344fde4e4580e73efc09e633a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.672660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6dcb8344fde4e4580e73efc09e633a7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.732058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4080c0476e8c4459b312a0ab62846c9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.733353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4080c0476e8c4459b312a0ab62846c9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.742606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4080c0476e8c4459b312a0ab62846c9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.753945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4080c0476e8c4459b312a0ab62846c9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.757352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4080c0476e8c4459b312a0ab62846c9a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:26.785242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3238/6388] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:26 2022] DELETE /identity/v3/users/4080c0476e8c4459b312a0ab62846c9a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:26.787099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:26.788954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:26.795879 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3151/6389] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:26 2022] DELETE /identity/v3/users/a6dcb8344fde4e4580e73efc09e633a7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:26.865970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f3ee-00a4-4c3f-80a0-39596dfe6589 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:26.932099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851983e7-ab6c-4550-a1de-0483aedab854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:26.932923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851983e7-ab6c-4550-a1de-0483aedab854 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:26.933234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851983e7-ab6c-4550-a1de-0483aedab854 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:26.933573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851983e7-ab6c-4550-a1de-0483aedab854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:26.939082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-851983e7-ab6c-4550-a1de-0483aedab854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:27.099198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851983e7-ab6c-4550-a1de-0483aedab854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:27.100728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851983e7-ab6c-4550-a1de-0483aedab854 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:27.111574 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3239/6390] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:27.423542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:27.425603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:27.455148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb9d9-fc93-4209-a1dd-805504780bf9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:27.470685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:27.471789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:27.472150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:27.472510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] PATH_INFO: `/v3/projects/0abc4a1289004f6aa4a018856a84bc94` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:27.477740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abc4a1289004f6aa4a018856a84bc94)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:27.480704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:27.585897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abc4a1289004f6aa4a018856a84bc94', 'request_id': 'req-00f3b12f-6608-46d1-bc02-eea3fb602314'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:27.591344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abc4a1289004f6aa4a018856a84bc94', 'request_id': 'req-00f3b12f-6608-46d1-bc02-eea3fb602314'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:27.604754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abc4a1289004f6aa4a018856a84bc94', 'request_id': 'req-00f3b12f-6608-46d1-bc02-eea3fb602314'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:27.621107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] The token cache is being invalidate because project 0abc4a1289004f6aa4a018856a84bc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:27.621663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:27.622613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00f3b12f-6608-46d1-bc02-eea3fb602314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:27.624313 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3152/6391] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:27 2022] DELETE /identity/v3/projects/0abc4a1289004f6aa4a018856a84bc94 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:27.629818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888dde0-a508-4e27-a3dc-c05d98b26784 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:27.630329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888dde0-a508-4e27-a3dc-c05d98b26784 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:27.630473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888dde0-a508-4e27-a3dc-c05d98b26784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:27.658511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b888dde0-a508-4e27-a3dc-c05d98b26784 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:27.660245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b888dde0-a508-4e27-a3dc-c05d98b26784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:27.766097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3240/6392] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:27.774368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f124-a761-426e-8a64-714bb150ccb0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:27.774648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f124-a761-426e-8a64-714bb150ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:27.775601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f124-a761-426e-8a64-714bb150ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:27.798405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-02f9f124-a761-426e-8a64-714bb150ccb0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:27.800530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-02f9f124-a761-426e-8a64-714bb150ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:27.810517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3153/6393] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:27.815925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888dde0-a508-4e27-a3dc-c05d98b26784 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:27.832742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888dde0-a508-4e27-a3dc-c05d98b26784 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:27.838120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:27.839253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:27.839682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:27.840134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:27.841277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:27.841765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:27.843652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:27.863773 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3241/6394] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:27.866242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f124-a761-426e-8a64-714bb150ccb0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:27.877199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f124-a761-426e-8a64-714bb150ccb0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:27.882552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:27.883480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:27.883897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:27.884420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:27.885720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:27.888882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:27.918739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:27.921470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:27.942557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffad10-38cd-41d2-8147-785aa2fb6f1d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:27.943246 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3154/6395] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:27 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:27.965638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.108952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b0d1d-4526-4c70-8f3b-0b342e72488e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.118291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.119407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.120551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.121217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.122681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.126094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.127204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.140487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.141113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.141113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] PATH_INFO: `/v3/projects/92f38b2c41e34e73bd6baa83478dddfa` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.147665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f38b2c41e34e73bd6baa83478dddfa)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.151458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.206340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3155/6396] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:27 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:28.210125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.233261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76476-495e-46d4-8f44-47c46e46ba3c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.246616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.248560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.250129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.251524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.253954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.260764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.292756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3156/6397] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:28.296615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.297962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f38b2c41e34e73bd6baa83478dddfa', 'request_id': 'req-29a7c038-4d30-4615-b7db-b61535826949'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:28.310304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae81d-0348-40fa-9864-c87526415d6d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.313536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f38b2c41e34e73bd6baa83478dddfa', 'request_id': 'req-29a7c038-4d30-4615-b7db-b61535826949'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:28.339760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f38b2c41e34e73bd6baa83478dddfa', 'request_id': 'req-29a7c038-4d30-4615-b7db-b61535826949'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:28.362118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] The token cache is being invalidate because project 92f38b2c41e34e73bd6baa83478dddfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:28.362876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:28.363756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-29a7c038-4d30-4615-b7db-b61535826949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:28.370336 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3242/6398] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:27 2022] DELETE /identity/v3/projects/92f38b2c41e34e73bd6baa83478dddfa => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:28.378144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04c4b-7c7d-4567-a094-150fffc64300 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.378808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04c4b-7c7d-4567-a094-150fffc64300 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.379033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04c4b-7c7d-4567-a094-150fffc64300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.413137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-74d04c4b-7c7d-4567-a094-150fffc64300 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:28.414474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-74d04c4b-7c7d-4567-a094-150fffc64300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:28.419038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.420532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.421144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.421521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.422404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.424591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3243/6399] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:28.426633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.432711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41acb0-2c47-44e0-abac-463ee4999f5f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.433457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41acb0-2c47-44e0-abac-463ee4999f5f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.433712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41acb0-2c47-44e0-abac-463ee4999f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.450799 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3157/6400] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:28.458668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.463934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:28.476305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9b41acb0-2c47-44e0-abac-463ee4999f5f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:28.477915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9b41acb0-2c47-44e0-abac-463ee4999f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:28.482138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252ade-1a7a-4743-8fc2-66cbc58e9f30 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.488410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8436-9d9b-4613-9e5f-f73e3b47eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.489794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8436-9d9b-4613-9e5f-f73e3b47eeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.490206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8436-9d9b-4613-9e5f-f73e3b47eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.491452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8436-9d9b-4613-9e5f-f73e3b47eeb7 admin admin] PATH_INFO: `/v3/projects/a57e29e56e1b4eb193575f404d3da032/users/68ae029784a84b9abe3c13a7a229f74e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.493768 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3244/6401] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:28.499051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41acb0-2c47-44e0-abac-463ee4999f5f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.512506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41acb0-2c47-44e0-abac-463ee4999f5f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.517099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b8436-9d9b-4613-9e5f-f73e3b47eeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57e29e56e1b4eb193575f404d3da032, user_id=68ae029784a84b9abe3c13a7a229f74e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.520370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b8436-9d9b-4613-9e5f-f73e3b47eeb7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.521495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.522321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.522646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.522914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.523653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:28.523955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.530425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.543474 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3158/6402] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:28 2022] PUT /identity/v3/projects/a57e29e56e1b4eb193575f404d3da032/users/68ae029784a84b9abe3c13a7a229f74e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:28.556060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b808bd-972c-4bde-bfa3-f8fc74587139 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.559856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b808bd-972c-4bde-bfa3-f8fc74587139 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.560029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3245/6403] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:28.560972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b808bd-972c-4bde-bfa3-f8fc74587139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.561626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.576055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131185-1d16-4334-a3b2-8f865028512d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.591730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b5b808bd-972c-4bde-bfa3-f8fc74587139 None None] MFA Rules not processed for user `68ae029784a84b9abe3c13a7a229f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:28.593160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b5b808bd-972c-4bde-bfa3-f8fc74587139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:28.652087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.654411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.655682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.656225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.657546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.660101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.682049 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3159/6404] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:28.687456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b808bd-972c-4bde-bfa3-f8fc74587139 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.713153 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3246/6405] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:28 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:28.720007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.725661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b808bd-972c-4bde-bfa3-f8fc74587139 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.867719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5f93-d721-4bba-8bad-3119ef1812b7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:28.890691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.891704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.892218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.892670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.893558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.894998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:28.895860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:28.896139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:28.896411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:28.897191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:28.899136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.900295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:28.953312 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3160/6406] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:28 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:28.955331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.965433 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3247/6407] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:28 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:28.967561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:28.984994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904262-1d27-4740-bd2d-b211f17fabf7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.078834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a000-dd9a-499b-8abb-baf86ad845de admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.084226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.085238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.086203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.086635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.087487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.090419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.123755 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3161/6408] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:28 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:29.125381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.128835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:29.139000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.140528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.141194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.142202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.143320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.143771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64728f-df21-44f6-9602-e806b6fa9ca1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.146022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.149965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.151435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.151715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.151987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] PATH_INFO: `/v3/projects/8e98e94619914b85b016c86eb40f5420` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.153447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e98e94619914b85b016c86eb40f5420)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.155646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.166983 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3248/6409] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:29.168641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.181880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b520b3-4152-457e-a3e0-5b65ef54dc26 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.188620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.189752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.190244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.190719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.192227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.194887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.216544 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3249/6410] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:29.218176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.238090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061616c-c704-4473-b89a-1238402a6291 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.251757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e98e94619914b85b016c86eb40f5420', 'request_id': 'req-8f938c59-31cd-499a-9aa4-47547df98388'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:29.272275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e98e94619914b85b016c86eb40f5420', 'request_id': 'req-8f938c59-31cd-499a-9aa4-47547df98388'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:29.294315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e98e94619914b85b016c86eb40f5420', 'request_id': 'req-8f938c59-31cd-499a-9aa4-47547df98388'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:29.331910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] The token cache is being invalidate because project 8e98e94619914b85b016c86eb40f5420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:29.332188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:29.338215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:29.346230 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3162/6411] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:29 2022] DELETE /identity/v3/projects/8e98e94619914b85b016c86eb40f5420 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:29.346230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.358443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:29.415223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9b528-6d5e-41ff-874b-309fe7aa1141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.416208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9b528-6d5e-41ff-874b-309fe7aa1141 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.416492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9b528-6d5e-41ff-874b-309fe7aa1141 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.416822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9b528-6d5e-41ff-874b-309fe7aa1141 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.418591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9b528-6d5e-41ff-874b-309fe7aa1141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.424647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9b528-6d5e-41ff-874b-309fe7aa1141 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.450727 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3250/6412] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:29.454611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.454936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.455357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.489657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:29.491288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:29.505639 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3251/6413] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:29.506842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.517054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:29.535190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f938c59-31cd-499a-9aa4-47547df98388 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.549942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c526-7426-462e-a889-72486a0a46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.551921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c526-7426-462e-a889-72486a0a46f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.552243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c526-7426-462e-a889-72486a0a46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.552641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c526-7426-462e-a889-72486a0a46f1 admin admin] PATH_INFO: `/v3/projects/e5d77ab6ee7c475eb4eae4021c347560/users/6ac55bfedb984dbd987ceeea1c981a27/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.596083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c526-7426-462e-a889-72486a0a46f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d77ab6ee7c475eb4eae4021c347560, user_id=6ac55bfedb984dbd987ceeea1c981a27, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.596689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb133f0-be6f-4010-b6a1-a0658d35e072 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.601351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c526-7426-462e-a889-72486a0a46f1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.616253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.617877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.618363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.620602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] PATH_INFO: `/v3/projects/b1a0dd9831d74a52be0dc22e11c509c0/users/7c2ee8df5e5e495fba1e6fe4e91d3108/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.624876 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3163/6414] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:29 2022] PUT /identity/v3/projects/e5d77ab6ee7c475eb4eae4021c347560/users/6ac55bfedb984dbd987ceeea1c981a27/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:29.627208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31cf7-58fe-446f-acc8-afa0a95e1505 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.627736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31cf7-58fe-446f-acc8-afa0a95e1505 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.628488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31cf7-58fe-446f-acc8-afa0a95e1505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.669552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a0dd9831d74a52be0dc22e11c509c0, user_id=7c2ee8df5e5e495fba1e6fe4e91d3108, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.673145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-32d31cf7-58fe-446f-acc8-afa0a95e1505 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:29.673832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.674679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-32d31cf7-58fe-446f-acc8-afa0a95e1505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:29.704851 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3252/6415] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:29 2022] PUT /identity/v3/projects/b1a0dd9831d74a52be0dc22e11c509c0/users/7c2ee8df5e5e495fba1e6fe4e91d3108/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:29.705850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.793504 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3164/6416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:29.797453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb686f-fc88-4bfa-8149-891b6efa8fca None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.797453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb686f-fc88-4bfa-8149-891b6efa8fca None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.797453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb686f-fc88-4bfa-8149-891b6efa8fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.852613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-22eb686f-fc88-4bfa-8149-891b6efa8fca None None] MFA Rules not processed for user `7c2ee8df5e5e495fba1e6fe4e91d3108`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:29.854096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-22eb686f-fc88-4bfa-8149-891b6efa8fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:29.858276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475c71-8262-4509-a9a8-d1b5807bd278 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.867313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.868979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.869302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.869579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.872442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.874303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.897370 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3253/6417] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:29.899600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.915020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed49509-a451-4c49-8f8f-2671c2a6e3b2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.924402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.925297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.926019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.926399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.927430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:29.927870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.930503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.953238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3254/6418] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:29.953238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.966410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ae7f6-5817-4ab0-9cbb-760062907153 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:29.972416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:29.974129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:29.974861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:29.975330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] PATH_INFO: `/v3/projects/e5d77ab6ee7c475eb4eae4021c347560/users/6ac55bfedb984dbd987ceeea1c981a27/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:29.976273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3165/6419] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:29.980269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb686f-fc88-4bfa-8149-891b6efa8fca None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:29.980425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d77ab6ee7c475eb4eae4021c347560, user_id=6ac55bfedb984dbd987ceeea1c981a27, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:29.982526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:29.992176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb686f-fc88-4bfa-8149-891b6efa8fca None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.001298 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3255/6420] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:29 2022] PUT /identity/v3/projects/e5d77ab6ee7c475eb4eae4021c347560/users/6ac55bfedb984dbd987ceeea1c981a27/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:30.001298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.062737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0712404-3d26-453f-a47c-cc4f274e65c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.063551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0712404-3d26-453f-a47c-cc4f274e65c5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.064277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0712404-3d26-453f-a47c-cc4f274e65c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.064675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0712404-3d26-453f-a47c-cc4f274e65c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.065513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0712404-3d26-453f-a47c-cc4f274e65c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.069465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0712404-3d26-453f-a47c-cc4f274e65c5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.091276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd7cef-3d10-4c8e-a285-3f9a36d5727e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.099725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.100856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.100856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.101070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.101655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.103596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.108033 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3166/6421] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:29 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:30.110035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8298fd-bae9-4715-a8e0-608e1a414b3f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.110488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8298fd-bae9-4715-a8e0-608e1a414b3f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.110887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8298fd-bae9-4715-a8e0-608e1a414b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.143341 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3256/6422] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:29 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:30.143341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.148701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ba8298fd-bae9-4715-a8e0-608e1a414b3f None None] MFA Rules not processed for user `6ac55bfedb984dbd987ceeea1c981a27`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:30.150183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba8298fd-bae9-4715-a8e0-608e1a414b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:30.221638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5fe06-4c3b-40b9-bf7c-ff0eb2fd0f86 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.228917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.229618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.229970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.230250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.231199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.233235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.249341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3167/6423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:30.250510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8298fd-bae9-4715-a8e0-608e1a414b3f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.267589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3257/6424] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:30 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:30.272152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.275860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8298fd-bae9-4715-a8e0-608e1a414b3f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.276038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:30.283842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.284632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.285012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.286138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.287685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.291457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.324386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3168/6425] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:30 2022] POST /identity/v3/users => generated 298 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:30.325657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.339814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ffbae-10fb-4ca7-8ff3-86c626785710 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.354115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b2883-3d51-4ab3-b9b6-8b6b616236d9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.355040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.356401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.357577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.358075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.359035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.359655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.359798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.360459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.360785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.362452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.376047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.377320 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3169/6426] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:30.377957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.382132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.390596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644ef4a-aa4d-4039-96e5-3ffdeec626e9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.395015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3258/6427] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:30.395949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.397591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.398512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.398942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.399418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.400291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.402934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.415934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd90b9-33f7-43b7-8528-1560200c6568 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.419630 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3170/6428] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:30.423692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.425122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.425272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.425601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.425919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.426667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.428667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.463286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fe9cf-98fd-4beb-9f6f-d87a04a8f5f3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.472316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.473596 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3259/6429] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:30.473754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.474017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.474669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] PATH_INFO: `/v3/projects/193aceeee87847aea4d50b736aa9a414/users/cda2b26be0034543b7e5e3470ecc31ed/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.476017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.488858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534d34-e5fa-4e93-9de8-58ac1f2320e2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.496625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aec39b-e43e-4d08-b991-064d7277e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.497927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec39b-e43e-4d08-b991-064d7277e308 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.498388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec39b-e43e-4d08-b991-064d7277e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.498838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec39b-e43e-4d08-b991-064d7277e308 admin admin] PATH_INFO: `/v3/projects/9a1f1000df0b4a299ab837512be51843/users/48ff1f8139f84d7880e22265a16379f5/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.501454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=193aceeee87847aea4d50b736aa9a414, user_id=cda2b26be0034543b7e5e3470ecc31ed, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.507797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.524923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aec39b-e43e-4d08-b991-064d7277e308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1f1000df0b4a299ab837512be51843, user_id=48ff1f8139f84d7880e22265a16379f5, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.529638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aec39b-e43e-4d08-b991-064d7277e308 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.534006 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3171/6430] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:30 2022] PUT /identity/v3/projects/193aceeee87847aea4d50b736aa9a414/users/cda2b26be0034543b7e5e3470ecc31ed/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:30.539828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.555867 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3260/6431] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:30 2022] PUT /identity/v3/projects/9a1f1000df0b4a299ab837512be51843/users/48ff1f8139f84d7880e22265a16379f5/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:30.582900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.583218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.583601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.640213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] MFA Rules not processed for user `48ff1f8139f84d7880e22265a16379f5`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:30.643058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:30.787355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88d99a-c748-44e9-8d4c-30dbf7c62e8b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.808368 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3261/6432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:30.824243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.827511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:30.909238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.909935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.910219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.910978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.912077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.916042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.932761 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3172/6433] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:30.933715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:30.947834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77972b3-4a7a-4e40-84ce-4c034760073f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.952680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82421278-38c6-4c39-9a72-a444f42b7d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.953448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82421278-38c6-4c39-9a72-a444f42b7d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.953734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82421278-38c6-4c39-9a72-a444f42b7d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.954129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82421278-38c6-4c39-9a72-a444f42b7d96 admin admin] PATH_INFO: `/v3/projects/193aceeee87847aea4d50b736aa9a414/users/cda2b26be0034543b7e5e3470ecc31ed/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.956985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a10c0-4256-4725-9750-f4f263eb8523 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:30.957270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82421278-38c6-4c39-9a72-a444f42b7d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193aceeee87847aea4d50b736aa9a414, user_id=cda2b26be0034543b7e5e3470ecc31ed, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.960817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82421278-38c6-4c39-9a72-a444f42b7d96 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.964463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:30.965433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.965950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.966417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:30.976001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3173/6434] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:30 2022] PUT /identity/v3/projects/193aceeee87847aea4d50b736aa9a414/users/cda2b26be0034543b7e5e3470ecc31ed/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:30.982158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:30.983876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:30.992621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73662-709c-4999-9888-436d1ad229e6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:30.992997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73662-709c-4999-9888-436d1ad229e6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:30.993683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73662-709c-4999-9888-436d1ad229e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:31.008297 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3262/6435] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:31.078264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fdf73662-709c-4999-9888-436d1ad229e6 None None] MFA Rules not processed for user `cda2b26be0034543b7e5e3470ecc31ed`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:31.079838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fdf73662-709c-4999-9888-436d1ad229e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:31.205828 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3174/6436] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:31.212166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:31.311873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330a2a-efee-4581-8e77-dafb9c50cad7 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:31.325906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:31.327426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:31.329303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:31.329303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:31.330599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:31.332707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:31.364454 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invalid input for field 'name': '' is too short Apr 09 21:17:31.364454 ncdv-master-1 devstack@keystone.service[102532]: Failed validating 'minLength' in schema['properties']['name']: Apr 09 21:17:31.364454 ncdv-master-1 devstack@keystone.service[102532]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 09 21:17:31.364454 ncdv-master-1 devstack@keystone.service[102532]: On instance['name']: Apr 09 21:17:31.364454 ncdv-master-1 devstack@keystone.service[102532]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 09 21:17:31.374061 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3263/6437] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:17:31 2022] POST /identity/v3/domains => generated 283 bytes in 163 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:17:31.374266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73662-709c-4999-9888-436d1ad229e6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:31.387669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73662-709c-4999-9888-436d1ad229e6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:31.399302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:31.403653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:31.405353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:31.406035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:31.409882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:31.413658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:31.455770 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 09 21:17:31.455770 ncdv-master-1 devstack@keystone.service[102531]: Failed validating 'maxLength' in schema['properties']['name']: Apr 09 21:17:31.455770 ncdv-master-1 devstack@keystone.service[102531]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 09 21:17:31.455770 ncdv-master-1 devstack@keystone.service[102531]: On instance['name']: Apr 09 21:17:31.455770 ncdv-master-1 devstack@keystone.service[102531]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 09 21:17:31.467577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:31.467824 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3175/6438] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:17:31 2022] POST /identity/v3/domains => generated 412 bytes in 91 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:17:31.512294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066793-ce33-4043-af3d-5565b1e74908 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:31.524678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:31.528076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:31.528459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:31.528763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:31.529665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:31.532298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:31.571749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3264/6439] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:17:31 2022] POST /identity/v3/domains => generated 276 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:31.575971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:31.601805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02a2ec-2ae3-4783-a10f-504362e54330 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:31.783511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:31.785674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:31.787531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:31.787835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains/786dd1d962d94878ba7ac8c63b5685be` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:31.813104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=786dd1d962d94878ba7ac8c63b5685be)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:31.815204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:31.863705 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Apr 09 21:17:31.865730 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3176/6440] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:31 2022] DELETE /identity/v3/domains/786dd1d962d94878ba7ac8c63b5685be => generated 120 bytes in 290 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:17:31.869665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:31.889747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbebb9-2c09-4213-bf87-9ddf76288f52 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:31.900403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:31.901489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:31.901793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:31.904232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains/786dd1d962d94878ba7ac8c63b5685be` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:31.908277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=786dd1d962d94878ba7ac8c63b5685be)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:31.912170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:31.963826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:31.965053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.019830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.020525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.029211 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3265/6441] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:17:31 2022] PATCH /identity/v3/domains/786dd1d962d94878ba7ac8c63b5685be => generated 277 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:32.031204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:32.033741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:32.058102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e0513-d1e2-447e-a55d-c3637772c6fb tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:32.136633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:32.137637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:32.137933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:32.139382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains/786dd1d962d94878ba7ac8c63b5685be` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:32.155326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=786dd1d962d94878ba7ac8c63b5685be)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:32.158030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:32.228836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.239074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.340040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be', 'request_id': 'req-ac41d6bf-09a7-4243-9862-f8346cf81aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.352040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be', 'request_id': 'req-ac41d6bf-09a7-4243-9862-f8346cf81aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.377642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be', 'request_id': 'req-ac41d6bf-09a7-4243-9862-f8346cf81aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.423349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] The token cache is being invalidate because project 786dd1d962d94878ba7ac8c63b5685be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:32.423349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.424162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.461067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be', 'request_id': 'req-ac41d6bf-09a7-4243-9862-f8346cf81aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.461953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be', 'request_id': 'req-ac41d6bf-09a7-4243-9862-f8346cf81aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.466323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '786dd1d962d94878ba7ac8c63b5685be', 'request_id': 'req-ac41d6bf-09a7-4243-9862-f8346cf81aa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:32.475733 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3177/6442] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:32 2022] DELETE /identity/v3/domains/786dd1d962d94878ba7ac8c63b5685be => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:32.480936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:32.504185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6824-f24e-47ec-89c7-6cb8d3912019 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:32.602459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:32.604216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:32.604216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:32.604216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains/2bccfca8762045b782c11e4d658659f9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:32.614449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:17:32.625980 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Could not find domain: 2bccfca8762045b782c11e4d658659f9.: keystone.exception.DomainNotFound: Could not find domain: 2bccfca8762045b782c11e4d658659f9. Apr 09 21:17:32.627800 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3266/6443] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:32 2022] DELETE /identity/v3/domains/2bccfca8762045b782c11e4d658659f9 => generated 112 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:17:32.633343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:32.634842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:32.656023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d6bf-09a7-4243-9862-f8346cf81aa4 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:32.665379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:32.666319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:32.666837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:32.667319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:32.669019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:32.673902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:32.715688 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3178/6444] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:17:32 2022] POST /identity/v3/domains => generated 253 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:32.720221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:32.735952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0110e33-3ee1-44ca-8718-d33062b4b8ef tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:32.864541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:32.866004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:32.866443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:32.866919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:32.868047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:32.870007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:32.881999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.sql.core [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1329881801' for key 'project.ixu_project_name_domain_id'") Apr 09 21:17:32.881999 ncdv-master-1 devstack@keystone.service[102532]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 09 21:17:32.881999 ncdv-master-1 devstack@keystone.service[102532]: [parameters: {'id': '995a98b571334eeca67376512f868941', 'name': 'tempest-domain-dup-1329881801', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Apr 09 21:17:32.881999 ncdv-master-1 devstack@keystone.service[102532]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102532) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 09 21:17:32.951252 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1329881801.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1329881801. Apr 09 21:17:32.952922 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3267/6445] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:17:32 2022] POST /identity/v3/domains => generated 212 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 09 21:17:32.957954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:32.972218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bc4e2-a603-4d0c-ae13-1b2ed85b317f tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:32.978808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:32.980556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:32.981103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:32.981568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains/62c6fa22eb8e41de9b728e481cf8b780` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:33.003619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=62c6fa22eb8e41de9b728e481cf8b780)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:33.006525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:33.037710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.039854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.079739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.080811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.087243 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3179/6446] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:17:32 2022] PATCH /identity/v3/domains/62c6fa22eb8e41de9b728e481cf8b780 => generated 254 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:33.088468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:33.090667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:33.113724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e839e7-c239-4498-946e-24fd7843e5c1 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:33.199323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:33.200517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:33.200918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:33.201581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains/62c6fa22eb8e41de9b728e481cf8b780` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:33.227650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=62c6fa22eb8e41de9b728e481cf8b780)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:33.230003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:33.282579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.291236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.379160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780', 'request_id': 'req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.387232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780', 'request_id': 'req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.402326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780', 'request_id': 'req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.422273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] The token cache is being invalidate because project 62c6fa22eb8e41de9b728e481cf8b780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:33.422805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.424615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.442013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780', 'request_id': 'req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.456214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780', 'request_id': 'req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.457309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '62c6fa22eb8e41de9b728e481cf8b780', 'request_id': 'req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.466614 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3268/6447] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:33 2022] DELETE /identity/v3/domains/62c6fa22eb8e41de9b728e481cf8b780 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:33.471652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:33.488377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53b6b-2a17-426d-a40d-0eeecf2a5ad8 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:33.595663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dc2c1-2663-4ef8-a2eb-99eda95dbb9e tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda2b26be0034543b7e5e3470ecc31ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193aceeee87847aea4d50b736aa9a414', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:33.596785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dc2c1-2663-4ef8-a2eb-99eda95dbb9e tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:33.597503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dc2c1-2663-4ef8-a2eb-99eda95dbb9e tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:33.598382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dc2c1-2663-4ef8-a2eb-99eda95dbb9e tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] PATH_INFO: `/v3/domains/786dd1d962d94878ba7ac8c63b5685be` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:33.615833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48dc2c1-2663-4ef8-a2eb-99eda95dbb9e tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:17:33.626866 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-c48dc2c1-2663-4ef8-a2eb-99eda95dbb9e tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Could not find domain: 786dd1d962d94878ba7ac8c63b5685be.: keystone.exception.DomainNotFound: Could not find domain: 786dd1d962d94878ba7ac8c63b5685be. Apr 09 21:17:33.633099 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3180/6448] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:17:33 2022] PATCH /identity/v3/domains/786dd1d962d94878ba7ac8c63b5685be => generated 112 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:17:33.634165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:33.635752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:33.727330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3a07-c75b-4e9b-8920-a3b25c5ebf81 tempest-DomainsNegativeTestJSON-1637100752 tempest-DomainsNegativeTestJSON-1637100752-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:33.733993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:33.734853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:33.735180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:33.735416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] PATH_INFO: `/v3/users/7c2ee8df5e5e495fba1e6fe4e91d3108` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:33.736806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2ee8df5e5e495fba1e6fe4e91d3108)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:33.739132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:33.802936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2ee8df5e5e495fba1e6fe4e91d3108'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.803779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2ee8df5e5e495fba1e6fe4e91d3108'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.820050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2ee8df5e5e495fba1e6fe4e91d3108'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.831022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2ee8df5e5e495fba1e6fe4e91d3108'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.831737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2ee8df5e5e495fba1e6fe4e91d3108'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:33.857429 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3269/6449] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:33 2022] DELETE /identity/v3/users/7c2ee8df5e5e495fba1e6fe4e91d3108 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:33.862313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:33.862817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:33.862965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:33.893434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:33.894882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:33.979018 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3181/6450] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:34.011564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:34.018144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:34.103742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbfbf5-3d6d-47ff-a4fe-23e9e4b25066 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:34.109304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:34.111290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:34.112065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:34.112065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:34.127715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:34.129428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:34.143047 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3270/6451] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:35.024145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:35.026406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:35.045806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce94e7-0453-4097-91b5-94c330552a74 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:35.057091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:35.058468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:35.059031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:35.059511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] PATH_INFO: `/v3/users/f2809b3bcbea4d2eb9ab6b360669fc67` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:35.061483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2809b3bcbea4d2eb9ab6b360669fc67)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:35.066161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:35.109521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:35.111014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:35.126744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e874588-7824-42c3-a07e-fc882778b789 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:35.132098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:35.133518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:35.134287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:35.134944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] PATH_INFO: `/v3/projects/b1a0dd9831d74a52be0dc22e11c509c0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:35.136544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a0dd9831d74a52be0dc22e11c509c0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:35.138757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:35.206629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2809b3bcbea4d2eb9ab6b360669fc67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.207931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2809b3bcbea4d2eb9ab6b360669fc67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.221774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a0dd9831d74a52be0dc22e11c509c0', 'request_id': 'req-ea6fe492-82ca-4142-ab50-99e62db61dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.227982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2809b3bcbea4d2eb9ab6b360669fc67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.228953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2809b3bcbea4d2eb9ab6b360669fc67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.242793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a0dd9831d74a52be0dc22e11c509c0', 'request_id': 'req-ea6fe492-82ca-4142-ab50-99e62db61dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.247704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2809b3bcbea4d2eb9ab6b360669fc67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.262362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a0dd9831d74a52be0dc22e11c509c0', 'request_id': 'req-ea6fe492-82ca-4142-ab50-99e62db61dd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.289068 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3182/6452] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:35 2022] DELETE /identity/v3/users/f2809b3bcbea4d2eb9ab6b360669fc67 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:35.306246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] The token cache is being invalidate because project b1a0dd9831d74a52be0dc22e11c509c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:35.307154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.313188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.319785 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3271/6453] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:35 2022] DELETE /identity/v3/projects/b1a0dd9831d74a52be0dc22e11c509c0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:35.324470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:35.326255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:35.505265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de4ff5-7cc4-4133-be72-d01f4557b765 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:35.511877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:35.513684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:35.513970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:35.514251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] PATH_INFO: `/v3/users/cda2b26be0034543b7e5e3470ecc31ed` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:35.516495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda2b26be0034543b7e5e3470ecc31ed)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:35.518520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:35.601388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda2b26be0034543b7e5e3470ecc31ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.602135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda2b26be0034543b7e5e3470ecc31ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.611826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda2b26be0034543b7e5e3470ecc31ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.612585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda2b26be0034543b7e5e3470ecc31ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.627321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda2b26be0034543b7e5e3470ecc31ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:35.660788 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3183/6454] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:35 2022] DELETE /identity/v3/users/cda2b26be0034543b7e5e3470ecc31ed => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:36.637404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:36.639698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:36.752197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fe492-82ca-4142-ab50-99e62db61dd3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:36.772415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:36.774650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:36.984994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:36.987032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:36.988517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:36.988969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] PATH_INFO: `/v3/projects/193aceeee87847aea4d50b736aa9a414` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:36.994804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=193aceeee87847aea4d50b736aa9a414)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:36.999170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.004224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f634ba-b392-40df-86e8-a4b495150788 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.018044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.020297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.020883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.021870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] PATH_INFO: `/v3/projects/b0a1102e4f4e441b947116441b3e330d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.024051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a1102e4f4e441b947116441b3e330d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.027188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.123166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193aceeee87847aea4d50b736aa9a414', 'request_id': 'req-f962be0e-a80e-4dcf-b913-3a3524f8b045'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.138961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193aceeee87847aea4d50b736aa9a414', 'request_id': 'req-f962be0e-a80e-4dcf-b913-3a3524f8b045'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.144595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a1102e4f4e441b947116441b3e330d', 'request_id': 'req-2fec986d-1e2b-46d5-a4f1-a36d55524303'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.156970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193aceeee87847aea4d50b736aa9a414', 'request_id': 'req-f962be0e-a80e-4dcf-b913-3a3524f8b045'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.161315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a1102e4f4e441b947116441b3e330d', 'request_id': 'req-2fec986d-1e2b-46d5-a4f1-a36d55524303'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.182631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] The token cache is being invalidate because project 193aceeee87847aea4d50b736aa9a414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:37.182928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.183753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f962be0e-a80e-4dcf-b913-3a3524f8b045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.187833 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3272/6455] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:36 2022] DELETE /identity/v3/projects/193aceeee87847aea4d50b736aa9a414 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:37.192960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e3b69-1a7a-46e0-b47a-bc6bf9c942f0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.193686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e3b69-1a7a-46e0-b47a-bc6bf9c942f0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.193806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e3b69-1a7a-46e0-b47a-bc6bf9c942f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.200493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a1102e4f4e441b947116441b3e330d', 'request_id': 'req-2fec986d-1e2b-46d5-a4f1-a36d55524303'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.218631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] The token cache is being invalidate because project b0a1102e4f4e441b947116441b3e330d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:37.219312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.220319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2fec986d-1e2b-46d5-a4f1-a36d55524303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:37.222193 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3184/6456] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:36 2022] DELETE /identity/v3/projects/b0a1102e4f4e441b947116441b3e330d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:37.224587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-960e3b69-1a7a-46e0-b47a-bc6bf9c942f0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:37.227567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-960e3b69-1a7a-46e0-b47a-bc6bf9c942f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:37.229439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab78f9-a7dc-4b1b-85f1-3c1a4bbc31c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.229893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab78f9-a7dc-4b1b-85f1-3c1a4bbc31c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.230363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab78f9-a7dc-4b1b-85f1-3c1a4bbc31c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.254433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-97ab78f9-a7dc-4b1b-85f1-3c1a4bbc31c0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:37.255676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97ab78f9-a7dc-4b1b-85f1-3c1a4bbc31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:37.351682 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3273/6457] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:37.359666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e29c0-ef6d-48d4-9492-05aef202abda None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.360041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e29c0-ef6d-48d4-9492-05aef202abda None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.360235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e29c0-ef6d-48d4-9492-05aef202abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.369367 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3185/6458] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:37.377205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd76bd-6ca4-4a7f-a455-02edf62df102 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.377499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd76bd-6ca4-4a7f-a455-02edf62df102 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.377783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd76bd-6ca4-4a7f-a455-02edf62df102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.389680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b54e29c0-ef6d-48d4-9492-05aef202abda None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:37.391054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b54e29c0-ef6d-48d4-9492-05aef202abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:37.412780 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3274/6459] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:37.414935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e29c0-ef6d-48d4-9492-05aef202abda None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.423016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-afdd76bd-6ca4-4a7f-a455-02edf62df102 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:37.424332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-afdd76bd-6ca4-4a7f-a455-02edf62df102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:37.433747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e29c0-ef6d-48d4-9492-05aef202abda None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.451217 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3186/6460] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:37.456394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd76bd-6ca4-4a7f-a455-02edf62df102 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.468755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.469979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.470645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.471593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.472537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:37.473322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.474838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd76bd-6ca4-4a7f-a455-02edf62df102 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.477549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.484174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.485354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.486387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.486824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.490092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:37.490678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.493552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.505152 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3275/6461] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:37.510951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.521555 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3187/6462] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:17:37.528254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.530638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7caf2-ce7a-411a-aeb2-0ac2783f6085 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.551358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d25f66-811e-4053-958d-3fa0b7033db7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.556811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.558052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.558574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.558947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.559467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.559676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.559925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.560201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.560911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.561623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.562907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.564871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.607500 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3276/6463] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:37.609353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.613547 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3188/6464] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:37.619878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.748642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7fe94-af71-4ecf-8c29-c067b91f6ae4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.753487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec38a-53da-4708-8141-4d36e8565974 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.759446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.760104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.760387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.760664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.761396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.763729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.767610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.768313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.768590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.768868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.775380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.778001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.834029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3277/6465] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:37.835039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.842467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3189/6466] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:37 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:37.846608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.867716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e186ea-7ec1-41f1-b38d-7ed3c0d7d8a1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.880965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73537581-c3ed-451e-8676-361e92407ec1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.886963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.887677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.887978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.888898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.894761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.895008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.895952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.896493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.896972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.898338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.898964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.900445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.919104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3190/6467] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:37.924048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.925254 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3278/6468] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:37.929383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:37.950640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba62c4b-94f2-41bd-b592-7cad8f7d927a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.955899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a739e-cd4e-499d-9702-b3b1fe9247d0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:37.965724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.967371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:37.968234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.968610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.968751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:37.969202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:37.969382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.970527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.971011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:37.972025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:37.973652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.975703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:37.991208 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3279/6469] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:37.992617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.001936 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3191/6470] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:38.009934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.034498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db6d74-e97c-4141-b3f2-95df84be4013 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.048489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca049d-9e7c-482e-99f6-2bd729cf1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.049460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca049d-9e7c-482e-99f6-2bd729cf1b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.049735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca049d-9e7c-482e-99f6-2bd729cf1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.050100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca049d-9e7c-482e-99f6-2bd729cf1b61 admin admin] PATH_INFO: `/v3/projects/18f50ae31fe6485597032aafabf20c25/users/2bc01a712e904a3289861e0d2b7e80f5/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.057374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524df-8f28-4c5a-8b9a-ad3934785dad admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.069190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca4eef-f2a1-464c-868f-e2beef784d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.070427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca4eef-f2a1-464c-868f-e2beef784d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.071276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca4eef-f2a1-464c-868f-e2beef784d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.071684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca4eef-f2a1-464c-868f-e2beef784d6c admin admin] PATH_INFO: `/v3/projects/c2c48063951e4dd0aad013011a14d1b3/users/51afff10afaf4ad9b0ea39aca884eab2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.078061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca049d-9e7c-482e-99f6-2bd729cf1b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f50ae31fe6485597032aafabf20c25, user_id=2bc01a712e904a3289861e0d2b7e80f5, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.081074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca049d-9e7c-482e-99f6-2bd729cf1b61 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.110148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca4eef-f2a1-464c-868f-e2beef784d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c48063951e4dd0aad013011a14d1b3, user_id=51afff10afaf4ad9b0ea39aca884eab2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.115347 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3192/6471] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:38 2022] PUT /identity/v3/projects/18f50ae31fe6485597032aafabf20c25/users/2bc01a712e904a3289861e0d2b7e80f5/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:38.125775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b4e40-8671-481e-97a8-125c538dfdc1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.126342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b4e40-8671-481e-97a8-125c538dfdc1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.126828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b4e40-8671-481e-97a8-125c538dfdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.127101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca4eef-f2a1-464c-868f-e2beef784d6c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.154793 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3280/6472] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:37 2022] PUT /identity/v3/projects/c2c48063951e4dd0aad013011a14d1b3/users/51afff10afaf4ad9b0ea39aca884eab2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:38.171317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c153e7-24a2-4476-ba5d-c20bce80f8e7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.171825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c153e7-24a2-4476-ba5d-c20bce80f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.174831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c153e7-24a2-4476-ba5d-c20bce80f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.186857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8f0b4e40-8671-481e-97a8-125c538dfdc1 None None] MFA Rules not processed for user `2bc01a712e904a3289861e0d2b7e80f5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:38.189256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f0b4e40-8671-481e-97a8-125c538dfdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:38.235161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-64c153e7-24a2-4476-ba5d-c20bce80f8e7 None None] MFA Rules not processed for user `51afff10afaf4ad9b0ea39aca884eab2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:38.236401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-64c153e7-24a2-4476-ba5d-c20bce80f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:38.360275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3193/6473] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:38.362542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b4e40-8671-481e-97a8-125c538dfdc1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.373097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3281/6474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:38.376651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c153e7-24a2-4476-ba5d-c20bce80f8e7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.488216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b4e40-8671-481e-97a8-125c538dfdc1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.497097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.498685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.499527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.502026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.502764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.504749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.520289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c153e7-24a2-4476-ba5d-c20bce80f8e7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.528148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.529265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.529755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.530906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.532062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.536929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.566327 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3194/6475] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:38 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:38.570744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.599070 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3282/6476] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:38 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:38.605003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.707118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02f2bb-c6b8-4933-872f-3957f72495ba admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.759263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2c828-20e0-4e62-899a-b1e66d464ece admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.771805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.772518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.772800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.773104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.773824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.775819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.811521 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3283/6477] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:38 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:38.816168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.837950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff71a8-e068-4ac4-929d-d72d77c09785 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.851133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.852766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.853754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.854054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.854809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.856476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.862616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.863312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.863786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.864074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.864758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.866807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.892592 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3284/6478] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:38.897308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.916675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caad08a-c894-496d-86ae-721cb68066a0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.920390 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3195/6479] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:38 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:38.929614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:38.942657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.943826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.944105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.944378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] PATH_INFO: `/v3/projects/dd5b314191fb4540a87af9cf69d88fb5/users/0bcb6125e45040288c9f3d9640a173b9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.950612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330755-4940-47fb-abd4-18f35c215873 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:38.964355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:38.965141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:38.965369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:38.965648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:38.966383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.968717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.983093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5b314191fb4540a87af9cf69d88fb5, user_id=0bcb6125e45040288c9f3d9640a173b9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:38.987751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:38.998828 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3196/6480] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:39.010065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.022221 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3285/6481] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:38 2022] PUT /identity/v3/projects/dd5b314191fb4540a87af9cf69d88fb5/users/0bcb6125e45040288c9f3d9640a173b9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:39.024736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.065258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34abf7-7f5f-4ddd-ab1f-8de45bc6781e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:39.121259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709af32-5966-454a-bd25-0693a936ea0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:39.127173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:39.128404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.128895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.129460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.130436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:39.132789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:39.152263 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3286/6482] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:39.156146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.176743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53867d85-7841-4016-a2c5-d001821ffc81 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:39.183734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198bfe-733b-48d9-a953-b1923129d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:39.184873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198bfe-733b-48d9-a953-b1923129d88c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.185282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198bfe-733b-48d9-a953-b1923129d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.186459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198bfe-733b-48d9-a953-b1923129d88c admin admin] PATH_INFO: `/v3/projects/dd5b314191fb4540a87af9cf69d88fb5/users/0bcb6125e45040288c9f3d9640a173b9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.190240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a198bfe-733b-48d9-a953-b1923129d88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5b314191fb4540a87af9cf69d88fb5, user_id=0bcb6125e45040288c9f3d9640a173b9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:39.193208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a198bfe-733b-48d9-a953-b1923129d88c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:39.215477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:39.216404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.219721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.220012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] PATH_INFO: `/v3/projects/c89970c0d94e4311a33757cfce6bfd22/users/6a511ce5f494430495f417c69c7cab7a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.237508 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3287/6483] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:39 2022] PUT /identity/v3/projects/dd5b314191fb4540a87af9cf69d88fb5/users/0bcb6125e45040288c9f3d9640a173b9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:39.244170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b9d5-c840-434d-a973-f54e65bdf426 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.244459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b9d5-c840-434d-a973-f54e65bdf426 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.244740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b9d5-c840-434d-a973-f54e65bdf426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.260670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89970c0d94e4311a33757cfce6bfd22, user_id=6a511ce5f494430495f417c69c7cab7a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:39.265790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:39.305698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dde4b9d5-c840-434d-a973-f54e65bdf426 None None] MFA Rules not processed for user `0bcb6125e45040288c9f3d9640a173b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:39.309264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dde4b9d5-c840-434d-a973-f54e65bdf426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:39.313235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3197/6484] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:38 2022] PUT /identity/v3/projects/c89970c0d94e4311a33757cfce6bfd22/users/6a511ce5f494430495f417c69c7cab7a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:39.315941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.469970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3288/6485] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:39.474855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4b9d5-c840-434d-a973-f54e65bdf426 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.481093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6031529-c13e-4621-8035-78628e80d5dd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:39.485968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4b9d5-c840-434d-a973-f54e65bdf426 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:39.500859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:39.501411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.501702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.501978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/services` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.502835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:39.503239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:39.504112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.504504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:39.504709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.505156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.506182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:39.508179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:39.529968 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3198/6486] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:39.534540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.542077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3289/6487] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:39 2022] POST /identity/v3/services => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:39.549278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.581373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c170809-961c-4fab-891b-66688f3bcd7e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:39.629706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f33c5-3e09-4177-bc9c-34b49102ce69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:39.654670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:39.656799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.657275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.659777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:39.660361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.660697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.661514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:39.664895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.665281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] PATH_INFO: `/v3/projects/c89970c0d94e4311a33757cfce6bfd22/users/6a511ce5f494430495f417c69c7cab7a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.674326 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:39.674326 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:17:39.674326 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:39.674754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89970c0d94e4311a33757cfce6bfd22, user_id=6a511ce5f494430495f417c69c7cab7a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:39.679351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:39.680608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:39.725563 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3199/6488] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:39 2022] PUT /identity/v3/projects/c89970c0d94e4311a33757cfce6bfd22/users/6a511ce5f494430495f417c69c7cab7a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:39.740988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:39.751519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:39.766965 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-e654d3b2-4b1c-4bf1-ac18-2ebb2f6d8275 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-893444939. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:17:39.766965 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:17:39.766965 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:39.812754 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3290/6489] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:17:39 2022] POST /identity/v3/endpoints => generated 359 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:39.812754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee25272-1cb6-43d5-885e-c6f3d59f58c0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:39.813348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee25272-1cb6-43d5-885e-c6f3d59f58c0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:39.813761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee25272-1cb6-43d5-885e-c6f3d59f58c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:39.883209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dee25272-1cb6-43d5-885e-c6f3d59f58c0 None None] MFA Rules not processed for user `6a511ce5f494430495f417c69c7cab7a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:39.885261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dee25272-1cb6-43d5-885e-c6f3d59f58c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:40.062560 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3291/6490] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3621 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:40.063623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee25272-1cb6-43d5-885e-c6f3d59f58c0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.161579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b784c6-6b08-42e9-a9a6-272aa7884f22 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.194851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee25272-1cb6-43d5-885e-c6f3d59f58c0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.202188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.203373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.203850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.204398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-893444939` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.205293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-893444939)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.205906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.206642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.207031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.207931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.208274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.210794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3292/6491] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 21:17:40 2022] GET /identity/v3/regions/tempest-region-893444939 => generated 178 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:40.211781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.217317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:40.239521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af744674-aad2-49f8-91a6-ad50fa6c0adc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.249344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.251711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.252659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.253209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.253830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.255155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.256156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.258275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.287198 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3200/6492] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:39 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:40.301680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.339814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba552163-1892-4159-af03-b479bdc495f4 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.354213 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3293/6493] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:40 2022] POST /identity/v3/projects => generated 350 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:40.363424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.497220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.498955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.499339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.501375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.501886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.504105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.536301 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3201/6494] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:40 2022] POST /identity/v3/services => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:40.540989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.582569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aed2f-ee5f-4546-b39e-779dd2d23413 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.617111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.617820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.618103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.618376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.619080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.621325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.622364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a5a7-00ad-4e0e-b811-7c36c029f0e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.639091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.640053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.640278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.640753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.641709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.642804 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:40.642804 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:40.642804 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:40.643715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.689174 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3294/6495] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:17:40 2022] POST /identity/v3/projects => generated 348 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:40.690853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.695507 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2041716079. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:17:40.695507 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:17:40.695507 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:40.741158 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3202/6496] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:17:40 2022] POST /identity/v3/endpoints => generated 362 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:40.745744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.781201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218ea73-7627-4e4c-bf99-a8079128c900 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.804001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.804864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.805177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.805447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/users/2bc01a712e904a3289861e0d2b7e80f5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.806707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:get_user(user_id=2bc01a712e904a3289861e0d2b7e80f5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.808990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.814991 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3295/6497] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:17:40 2022] GET /identity/v3/users/2bc01a712e904a3289861e0d2b7e80f5 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:17:40.816035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.818215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e202518-ad82-4d90-b380-cffd3562d6c1 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.829223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40defef-166b-47c8-bb4d-68364890877e tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.836429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.837627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.837884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.838227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.839005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.841805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.902442 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3296/6498] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Apr 9 21:17:40 2022] POST /identity/v3/credentials => generated 431 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:40.904922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:40.940555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ee5dc-7b57-46ea-950a-7abe44619284 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:40.965862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.969629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.970216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.973744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials/2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.977016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.982080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.989084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.991470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:40.992362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:40.992641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:40.992919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-2041716079` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:40.993652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:40.993995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2041716079)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:40.997637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.004374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3203/6499] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 21:17:40 2022] GET /identity/v3/regions/tempest-region-2041716079 => generated 180 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:17:41.009346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.035223 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3297/6500] 10.222.0.30 () {60 vars in 1357 bytes} [Sat Apr 9 21:17:40 2022] PATCH /identity/v3/credentials/2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436 => generated 436 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:41.035459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8283853-336d-443a-82f5-64d60c09686b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.036539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.049924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.050627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.050889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.051169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.051927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.057978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.061357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452ee2-a0d5-4fd1-a8f3-db2899e72d73 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.073676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.076139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.076524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.076840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials/2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.083328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.089384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.098925 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3298/6501] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/credentials/2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436 => generated 436 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:41.101180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.107238 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-239990891. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:17:41.107238 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:17:41.107238 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:41.117599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bda4f4-70b9-43a4-addf-c31c39cc9d70 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.148566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.150320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.150654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.151596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials/2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.153733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.155923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.157794 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3204/6502] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:17:41 2022] POST /identity/v3/endpoints => generated 359 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:41.161904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.201746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3299/6503] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Apr 9 21:17:41 2022] DELETE /identity/v3/credentials/2f30463939b922497fe0bbcbe3cfe77638858fcdd8af33b0a9d0e40f939b3436 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:41.208006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.227153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543925a-dea3-4bde-a9e8-79e43a323bc7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.229782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9175c-25cd-40b3-b26a-7a6e34241078 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.239544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.242857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.243231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.243514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-239990891` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.244207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-239990891)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.250283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.254172 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3205/6504] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/regions/tempest-region-239990891 => generated 178 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:41.258681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.277001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.277927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.278256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.278587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.279506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.281447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097909-5805-4253-99b6-b2e806b01558 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.286535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.306010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.306831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.307166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.307448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.308320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.311545 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:41.311545 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:41.311545 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:41.313991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.320434 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3300/6505] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Apr 9 21:17:41 2022] POST /identity/v3/credentials => generated 431 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:41.324246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.332862 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3206/6506] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/endpoints => generated 4384 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:41.334533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.348433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474633f-fb81-4b43-8a90-f31faf6be5ca tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.349585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8f1a-2d8c-4e9e-b5f1-66bfc7d8fc96 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.362202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.363085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.363403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.363718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.364467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.366085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.372855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.373254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.373254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.373254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints/03e0506f5f354c47ac006c7e1bfc9145` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.375753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=03e0506f5f354c47ac006c7e1bfc9145)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.378553 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:41.378553 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:41.378553 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:41.380031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.383070 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3207/6507] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/endpoints/03e0506f5f354c47ac006c7e1bfc9145 => generated 359 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:41.389864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.406156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340438f7-cc1f-4128-8bdc-1d873761c66b tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.415443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.416738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.416957 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3301/6508] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Apr 9 21:17:41 2022] POST /identity/v3/credentials => generated 430 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:41.417853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.418386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints/03e0506f5f354c47ac006c7e1bfc9145` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.420702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=03e0506f5f354c47ac006c7e1bfc9145)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.422584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.423087 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:41.423087 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:41.423087 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:41.425209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.445918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '03e0506f5f354c47ac006c7e1bfc9145', 'request_id': 'req-3b26dd64-c97e-4566-9476-5ddd06c0d44a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:41.458092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddda10-9f17-4a81-9c36-b8707bbb2772 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.460168 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3208/6509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:41 2022] DELETE /identity/v3/endpoints/03e0506f5f354c47ac006c7e1bfc9145 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:41.466625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.506123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.507203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.507500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.507785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.508473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.510268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.518554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26dd64-c97e-4566-9476-5ddd06c0d44a tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.528634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.533220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.543774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.545869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.551120 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3302/6510] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/credentials => generated 946 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:41.552821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.557333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.560175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.560675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.561992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.564063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.568489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.575692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5912-6bdb-43e2-ae27-a1034ceb384b tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.592491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.593679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.593972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.594254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials/0c18ff3f49c77c4fb1b7c8d00813329f0f5a439bb4e8daeee1ffa024c910686c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.597438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=0c18ff3f49c77c4fb1b7c8d00813329f0f5a439bb4e8daeee1ffa024c910686c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.603378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.608793 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3209/6511] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/endpoints => generated 4038 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:41.612105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.639641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a3a1-0d42-4c44-97a5-7e92f6768c01 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.644016 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3303/6512] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Apr 9 21:17:41 2022] DELETE /identity/v3/credentials/0c18ff3f49c77c4fb1b7c8d00813329f0f5a439bb4e8daeee1ffa024c910686c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:41.648189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.652032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.653813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.654416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.654879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints/03e0506f5f354c47ac006c7e1bfc9145` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.663745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed6e2-bea7-4cca-bee5-ae9195b44a7d tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.666608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:17:41.683291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.684550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.685066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.685298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/credentials/5f9c0242dc34a01834c69c0e849c797a69edf1c526fd5788122e17fb81c42eb3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.694254 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Could not find endpoint: 03e0506f5f354c47ac006c7e1bfc9145.: keystone.exception.EndpointNotFound: Could not find endpoint: 03e0506f5f354c47ac006c7e1bfc9145. Apr 09 21:17:41.696569 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3210/6513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:41 2022] DELETE /identity/v3/endpoints/03e0506f5f354c47ac006c7e1bfc9145 => generated 114 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:17:41.704099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.706502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=5f9c0242dc34a01834c69c0e849c797a69edf1c526fd5788122e17fb81c42eb3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.708610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.730990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16c97-ae31-4d03-9329-ec3c5dd53a67 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.744026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.746852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.747234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.748761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-239990891` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.751083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-239990891)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.758574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.785189 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3304/6514] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Apr 9 21:17:41 2022] DELETE /identity/v3/credentials/5f9c0242dc34a01834c69c0e849c797a69edf1c526fd5788122e17fb81c42eb3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:41.796297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.820701 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3211/6515] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 21:17:41 2022] DELETE /identity/v3/regions/tempest-region-239990891 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:41.821978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.841799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a76fe-4f3d-4ca6-ba5e-0a03d59db0cd tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.875438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc40e1-8de9-473f-bac1-9de3798577f4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.876949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.878869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.879567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.880218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/projects/d719d48b8d5e4d1a9a565ba246b2a275` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.885246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d719d48b8d5e4d1a9a565ba246b2a275)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.887850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.890434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.891138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.891647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.891888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.892527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.894425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.913595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3212/6516] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/endpoints => generated 4038 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:41.917893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:41.938883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324084b-e96a-4333-be36-0d8b984639e0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:41.950196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:41.950883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:41.951161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:41.951432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:41.952272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Adding query filter params (service_id=2fb5cce1db1348089180281c02dbb68c) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:41.952462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:41.954620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:41.976376 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3213/6517] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/endpoints?service_id=2fb5cce1db1348089180281c02dbb68c => generated 501 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:17:41.985618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.014417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c295-8b62-4896-a2be-20d0d72a2dde tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.027541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd719d48b8d5e4d1a9a565ba246b2a275', 'request_id': 'req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.044806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd719d48b8d5e4d1a9a565ba246b2a275', 'request_id': 'req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.071922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd719d48b8d5e4d1a9a565ba246b2a275', 'request_id': 'req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.124768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] The token cache is being invalidate because project d719d48b8d5e4d1a9a565ba246b2a275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:42.125296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.128341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.134116 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3305/6518] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:41 2022] DELETE /identity/v3/projects/d719d48b8d5e4d1a9a565ba246b2a275 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:42.140480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.143016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:42.201159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.202018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.203085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.203339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.204017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Adding query filter params (service_id=d94b3f5cb8e540709d167afa696eeefd) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:42.204319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.206035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.224216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3214/6519] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:17:41 2022] GET /identity/v3/endpoints?service_id=d94b3f5cb8e540709d167afa696eeefd => generated 504 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:42.228406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.230732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:42.274910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17640ad-01ba-4911-861e-329348acec86 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.296853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.297568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.297851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.298122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.298868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:42.299175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.304506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.326232 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3215/6520] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Apr 9 21:17:42 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:42.345356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.368826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea90e-5fe0-4f2f-8ed5-f30a17b80ba5 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.375638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5d89-7fa9-4be4-8cec-93dd59c802d9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.379990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a511ce5f494430495f417c69c7cab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89970c0d94e4311a33757cfce6bfd22', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.381954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.383410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.383410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] PATH_INFO: `/v3/projects/5e927aeedf6340fe81aab0c958b13163` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.384526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e927aeedf6340fe81aab0c958b13163)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.386530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.387219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.387550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.387830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.388061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.388618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:42.388928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.391222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.404208 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3216/6521] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Apr 9 21:17:42 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:42.411900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.424445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4b673-1c9d-4993-87f6-81bccc8783e9 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.433327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.434026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.449813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.458938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.460388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.463051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.488485 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3217/6522] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:42 2022] POST /identity/v3/services => generated 285 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:42.493051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.510353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e927aeedf6340fe81aab0c958b13163', 'request_id': 'req-f88a5ea3-79db-40c3-86a3-409b4b99d806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.527241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e927aeedf6340fe81aab0c958b13163', 'request_id': 'req-f88a5ea3-79db-40c3-86a3-409b4b99d806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.535230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020c5b-5eac-4a54-b193-52abbb39e243 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.543080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e927aeedf6340fe81aab0c958b13163', 'request_id': 'req-f88a5ea3-79db-40c3-86a3-409b4b99d806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.564553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] The token cache is being invalidate because project 5e927aeedf6340fe81aab0c958b13163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:42.565347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.566623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.570165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3306/6523] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:42 2022] DELETE /identity/v3/projects/5e927aeedf6340fe81aab0c958b13163 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:42.576267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.579651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:42.640955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.642035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.642255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.642675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.644586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.646492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.677320 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1506514946. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:17:42.677320 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:17:42.677320 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:42.707276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a5ea3-79db-40c3-86a3-409b4b99d806 tempest-CredentialsTestJSON-421009274 tempest-CredentialsTestJSON-421009274-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.729228 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3218/6524] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:17:42 2022] POST /identity/v3/endpoints => generated 360 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:42.734093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.742558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:42.772669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.774520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.774810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.775093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] PATH_INFO: `/v3/users/2bc01a712e904a3289861e0d2b7e80f5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.777683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc01a712e904a3289861e0d2b7e80f5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.779861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.781210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beb768-efd8-47fb-9d5a-57a7dc9c798d tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.786268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.787162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.787496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.787961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-1506514946` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.788883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1506514946)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.790037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.792226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3219/6525] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 21:17:42 2022] GET /identity/v3/regions/tempest-region-1506514946 => generated 180 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:42.803208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.824695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b25d-614e-4518-a463-3ef607e7fb5f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:42.831841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:42.833080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.834875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.834875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints/6c13bb52acf24d8fb78ff36309ad1d6e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.857421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc01a712e904a3289861e0d2b7e80f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.858946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc01a712e904a3289861e0d2b7e80f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.862222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=6c13bb52acf24d8fb78ff36309ad1d6e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:42.865345 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:42.865345 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:42.865345 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:42.868583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc01a712e904a3289861e0d2b7e80f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.869237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:42.880556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc01a712e904a3289861e0d2b7e80f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.881416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8985e565-3174-4a75-9de8-d462ba556fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc01a712e904a3289861e0d2b7e80f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:42.906232 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3307/6526] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:42 2022] DELETE /identity/v3/users/2bc01a712e904a3289861e0d2b7e80f5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:42.910223 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-851588840. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:17:42.910223 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:17:42.910223 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:42.911766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:42.912133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:42.912530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:42.936284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:42.938412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:42.971399 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3220/6527] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:17:42 2022] PATCH /identity/v3/endpoints/6c13bb52acf24d8fb78ff36309ad1d6e => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:42.975729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:42.977931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:43.018605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7aea20-24de-47ed-aeac-b55da0a735d3 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.031468 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3308/6528] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3990 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:43.044951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.051503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:43.201529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.202536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.202886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.203686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-851588840` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.204494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-851588840)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.205908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.208530 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3221/6529] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 21:17:42 2022] GET /identity/v3/regions/tempest-region-851588840 => generated 178 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:43.214956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.242087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7782-4635-4ba0-bf51-2692d76183cc tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.259241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.260639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb0294-f173-41d9-be1c-d375486f80ec None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.261131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.261504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.262331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints/6c13bb52acf24d8fb78ff36309ad1d6e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.268740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.269908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6c13bb52acf24d8fb78ff36309ad1d6e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.272115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.272271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.272818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.273524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.300965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.306197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6c13bb52acf24d8fb78ff36309ad1d6e', 'request_id': 'req-5fbf880e-df31-4966-9169-8c5fe8ff60e6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:43.313377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.327320 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3222/6530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:43 2022] DELETE /identity/v3/endpoints/6c13bb52acf24d8fb78ff36309ad1d6e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:43.328324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.339633 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3309/6531] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:43 2022] GET /identity/v3/auth/tokens => generated 3990 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:43.359210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.360756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:43.428602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf880e-df31-4966-9169-8c5fe8ff60e6 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.448565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.450049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.457138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.460976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-851588840` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.462097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-851588840)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.466258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.504746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3223/6532] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 21:17:43 2022] DELETE /identity/v3/regions/tempest-region-851588840 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:43.509248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.545081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fefd-821d-4652-a69f-9cfe19a4ab1f tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.547756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9ae39-f657-4192-93a1-e7baf9484321 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.551224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.552098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.552742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.552868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-1506514946` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.553930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1506514946)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.556375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.584445 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3224/6533] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 21:17:43 2022] DELETE /identity/v3/regions/tempest-region-1506514946 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:43.588531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.603230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac55bfedb984dbd987ceeea1c981a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d77ab6ee7c475eb4eae4021c347560', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.603953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.605022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.605022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.605343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:43.605609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.608810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.637622 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3310/6534] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:43.639061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.661273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b64725-e660-4d7a-ac16-667cd7a5d274 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.661862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e3b3-5205-4954-9b4f-52738149e539 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.669495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.671154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.671675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.672407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/services/b5efdff4a513476b82c3f4b3c9426741` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.673814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b5efdff4a513476b82c3f4b3c9426741)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.678710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.714662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac55bfedb984dbd987ceeea1c981a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d77ab6ee7c475eb4eae4021c347560', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:43.716423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:43.716719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:43.718272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:43.719422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:43.724563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:43.765757 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3225/6535] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:43 2022] DELETE /identity/v3/services/b5efdff4a513476b82c3f4b3c9426741 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:43.771043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.791204 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3311/6536] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:43 2022] POST /identity/v3/projects => generated 348 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:43.796495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:43.817530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7505b9-1ff0-40cf-b3fd-ac597fe7c637 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:43.963386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e338a17-33ca-450e-9125-7ddf6f7ac733 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.000695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.000695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.004512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.005486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac55bfedb984dbd987ceeea1c981a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d77ab6ee7c475eb4eae4021c347560', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.005817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints/d5c387b88c0c4283aad40773095111bd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.006574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.006964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.007336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.008178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:44.008601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.011699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.020086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d5c387b88c0c4283aad40773095111bd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.022608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.043297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd5c387b88c0c4283aad40773095111bd', 'request_id': 'req-116d8a84-848a-4951-9dd0-b713b13654f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:44.047512 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3312/6537] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:44.072032 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3226/6538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:43 2022] DELETE /identity/v3/endpoints/d5c387b88c0c4283aad40773095111bd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:44.078701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:44.102934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618d80-5ab3-4adb-a0eb-c790b1a2c32c tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.139278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.141561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.142083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.142914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-2041716079` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.143833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2041716079)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.146156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.200189 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2041716079. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:17:44.200189 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:17:44.200189 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:44.216852 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3313/6539] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 21:17:44 2022] DELETE /identity/v3/regions/tempest-region-2041716079 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:44.217945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:44.234213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d8a84-848a-4951-9dd0-b713b13654f0 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.265288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.266372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.266638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.266902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/services/d94b3f5cb8e540709d167afa696eeefd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.267679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d94b3f5cb8e540709d167afa696eeefd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.271999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.333136 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3227/6540] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:44 2022] DELETE /identity/v3/services/d94b3f5cb8e540709d167afa696eeefd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:44.337264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:44.354336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e582a0-843d-467b-8a0b-c441912630ab tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.429012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.431146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.432237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.441268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/endpoints/adc20f145a0148e9ac4574030089f26a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.456010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=adc20f145a0148e9ac4574030089f26a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.457459 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:44.457459 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:17:44.457459 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:44.458438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.484576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'adc20f145a0148e9ac4574030089f26a', 'request_id': 'req-324639f4-4108-4517-a650-3b1747bb84f7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:44.509492 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3314/6541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:44 2022] DELETE /identity/v3/endpoints/adc20f145a0148e9ac4574030089f26a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:44.514333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:44.539143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59167b-eadd-4288-b9ad-50a632ac6e69 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.613370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.618679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.627789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.628395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/regions/tempest-region-893444939` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.629554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-893444939)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.632718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.667328 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-893444939. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:17:44.667328 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:17:44.667328 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:44.685202 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3228/6542] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 21:17:44 2022] DELETE /identity/v3/regions/tempest-region-893444939 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:44.686965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:44.705657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:44.710617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:44.711291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324639f4-4108-4517-a650-3b1747bb84f7 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.751767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bcb6125e45040288c9f3d9640a173b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5b314191fb4540a87af9cf69d88fb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.752616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.752963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.753527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] PATH_INFO: `/v3/services/2fb5cce1db1348089180281c02dbb68c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.754486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2fb5cce1db1348089180281c02dbb68c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.756949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.795646 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3315/6543] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:44 2022] DELETE /identity/v3/services/2fb5cce1db1348089180281c02dbb68c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:44.800580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:44.813985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:44.897896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531225d-9a94-4aa7-86f7-730f9c4064b4 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.918663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.919393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.919681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.919956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] PATH_INFO: `/v3/projects/18f50ae31fe6485597032aafabf20c25` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.921337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f50ae31fe6485597032aafabf20c25)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.924596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.959142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d263c9-8b40-4737-a9f9-89f44cf942b8 tempest-EndPointsTestJSON-936468641 tempest-EndPointsTestJSON-936468641-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:44.965068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:44.966162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:44.966520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:44.966863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] PATH_INFO: `/v3/users/51afff10afaf4ad9b0ea39aca884eab2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:44.968785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51afff10afaf4ad9b0ea39aca884eab2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:44.971037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:44.985414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f50ae31fe6485597032aafabf20c25', 'request_id': 'req-1244ca09-782d-4e97-a70b-a5ac2441a9e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:44.991862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f50ae31fe6485597032aafabf20c25', 'request_id': 'req-1244ca09-782d-4e97-a70b-a5ac2441a9e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.020740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f50ae31fe6485597032aafabf20c25', 'request_id': 'req-1244ca09-782d-4e97-a70b-a5ac2441a9e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.041886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] The token cache is being invalidate because project 18f50ae31fe6485597032aafabf20c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:45.042360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.043756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.050860 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3229/6544] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:44 2022] DELETE /identity/v3/projects/18f50ae31fe6485597032aafabf20c25 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:45.052536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:45.054971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:45.082729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51afff10afaf4ad9b0ea39aca884eab2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.083930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51afff10afaf4ad9b0ea39aca884eab2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.094546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51afff10afaf4ad9b0ea39aca884eab2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.111068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51afff10afaf4ad9b0ea39aca884eab2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.111765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51afff10afaf4ad9b0ea39aca884eab2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.176238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3316/6545] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:44 2022] DELETE /identity/v3/users/51afff10afaf4ad9b0ea39aca884eab2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:45.180157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:45.181636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:45.240587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ca09-782d-4e97-a70b-a5ac2441a9e8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:45.358625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a7d9-5523-4470-970b-7cedd462e337 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:45.366495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:45.367755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:45.368177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:45.368622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] PATH_INFO: `/v3/users/6a511ce5f494430495f417c69c7cab7a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:45.370776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a511ce5f494430495f417c69c7cab7a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:45.373842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:45.397086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac55bfedb984dbd987ceeea1c981a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d77ab6ee7c475eb4eae4021c347560', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:45.398130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:45.398436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:45.398747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] PATH_INFO: `/v3/projects/d7b2ba7f777049ac8bad7b8ca2525fe1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:45.400160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d7b2ba7f777049ac8bad7b8ca2525fe1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:45.408579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:45.484161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a511ce5f494430495f417c69c7cab7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.484911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a511ce5f494430495f417c69c7cab7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.493393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a511ce5f494430495f417c69c7cab7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.505413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b2ba7f777049ac8bad7b8ca2525fe1', 'request_id': 'req-027791b8-1799-4724-91b0-3d010fc316f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.505748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a511ce5f494430495f417c69c7cab7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.506541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0b5751b4-8e4e-4f25-bc4f-6b149ef96ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a511ce5f494430495f417c69c7cab7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.519865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b2ba7f777049ac8bad7b8ca2525fe1', 'request_id': 'req-027791b8-1799-4724-91b0-3d010fc316f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.534108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b2ba7f777049ac8bad7b8ca2525fe1', 'request_id': 'req-027791b8-1799-4724-91b0-3d010fc316f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.541680 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3317/6546] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:45 2022] DELETE /identity/v3/users/6a511ce5f494430495f417c69c7cab7a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:45.547872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:45.548195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:45.550263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:45.556984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] The token cache is being invalidate because project d7b2ba7f777049ac8bad7b8ca2525fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:45.558162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.559105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:45.562100 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3230/6547] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:45 2022] DELETE /identity/v3/projects/d7b2ba7f777049ac8bad7b8ca2525fe1 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:45.583753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:45.586149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:45.599617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:45.602525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:45.720495 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3318/6548] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:45.744985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027791b8-1799-4724-91b0-3d010fc316f0 tempest-RoutersIpV6AdminTest-971059108 tempest-RoutersIpV6AdminTest-971059108-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:45.754813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:45.756882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:45.881664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecc7f9-f6a5-41ba-b453-6a74e33b6af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:45.882256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc7f9-f6a5-41ba-b453-6a74e33b6af8 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:45.882600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc7f9-f6a5-41ba-b453-6a74e33b6af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:45.882880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc7f9-f6a5-41ba-b453-6a74e33b6af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:45.893664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-10ecc7f9-f6a5-41ba-b453-6a74e33b6af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:45.901865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4e7b0-43f3-41b6-b167-9f74a5a16a13 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:45.917003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:45.917710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:45.917990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:45.918260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:45.943333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:45.944851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:45.974026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3319/6549] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:46.019087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecc7f9-f6a5-41ba-b453-6a74e33b6af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:46.021424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecc7f9-f6a5-41ba-b453-6a74e33b6af8 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:46.058307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3231/6550] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:46.547592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:46.549667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:46.574989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b61a0f-f732-420e-bd40-a9d966be7315 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:46.581390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:46.582660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:46.583040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:46.583411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] PATH_INFO: `/v3/users/48ff1f8139f84d7880e22265a16379f5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:46.588973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ff1f8139f84d7880e22265a16379f5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:46.591448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:46.683670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ff1f8139f84d7880e22265a16379f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:46.684466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ff1f8139f84d7880e22265a16379f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:46.697879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ff1f8139f84d7880e22265a16379f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:46.714130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ff1f8139f84d7880e22265a16379f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:46.715119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ff1f8139f84d7880e22265a16379f5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:46.738332 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3320/6551] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:46 2022] DELETE /identity/v3/users/48ff1f8139f84d7880e22265a16379f5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:46.743160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:46.743635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:46.743732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:46.763766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:46.764998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:46.841610 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3232/6552] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:46.870881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:46.871427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:46.957842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308de1a4-3b8b-4450-94be-2eacd89187b1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:46.971126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c60a2d-6539-4fb1-b899-476143e91b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:46.971782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60a2d-6539-4fb1-b899-476143e91b28 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:46.972125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60a2d-6539-4fb1-b899-476143e91b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:46.972460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60a2d-6539-4fb1-b899-476143e91b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.001077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c60a2d-6539-4fb1-b899-476143e91b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:47.003137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c60a2d-6539-4fb1-b899-476143e91b28 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:47.029375 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3321/6553] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:47.124071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:47.126270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:47.141604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70088e0-d802-4b81-89c7-1899b681b835 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:47.149527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:47.150853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:47.151135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:47.151408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] PATH_INFO: `/v3/projects/c89970c0d94e4311a33757cfce6bfd22` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.152864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89970c0d94e4311a33757cfce6bfd22)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:47.159072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:47.228035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89970c0d94e4311a33757cfce6bfd22', 'request_id': 'req-42d40422-9c16-439e-b15c-e3d8acbcbea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:47.234421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89970c0d94e4311a33757cfce6bfd22', 'request_id': 'req-42d40422-9c16-439e-b15c-e3d8acbcbea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:47.249016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89970c0d94e4311a33757cfce6bfd22', 'request_id': 'req-42d40422-9c16-439e-b15c-e3d8acbcbea5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:47.270089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] The token cache is being invalidate because project c89970c0d94e4311a33757cfce6bfd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:47.270674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:47.272119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42d40422-9c16-439e-b15c-e3d8acbcbea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:47.276121 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3233/6554] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:47 2022] DELETE /identity/v3/projects/c89970c0d94e4311a33757cfce6bfd22 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:47.282139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2a41-1f0e-4824-a3b8-24dea8c31175 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:47.282429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2a41-1f0e-4824-a3b8-24dea8c31175 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:47.282705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2a41-1f0e-4824-a3b8-24dea8c31175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.313896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-78cd2a41-1f0e-4824-a3b8-24dea8c31175 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:47.317275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-78cd2a41-1f0e-4824-a3b8-24dea8c31175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:47.471605 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3322/6555] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:47.556059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc8d0-fccd-4349-af3b-6649f3700402 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:47.556453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc8d0-fccd-4349-af3b-6649f3700402 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:47.556743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc8d0-fccd-4349-af3b-6649f3700402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.588750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ddfcc8d0-fccd-4349-af3b-6649f3700402 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:47.589928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ddfcc8d0-fccd-4349-af3b-6649f3700402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:47.612497 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3234/6556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:47.619274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd2a41-1f0e-4824-a3b8-24dea8c31175 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:47.631148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd2a41-1f0e-4824-a3b8-24dea8c31175 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:47.636693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:47.637583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:47.638166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:47.638714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.639767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:47.639883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:47.642591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:47.658074 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3323/6557] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:47.663621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcc8d0-fccd-4349-af3b-6649f3700402 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:47.677292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcc8d0-fccd-4349-af3b-6649f3700402 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:47.685081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:47.686594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:47.687080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:47.687550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.688488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:47.690965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:47.729736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:47.738535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:47.767172 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3235/6558] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:47 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:47.772362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:47.773267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f321298-f02b-488e-a245-8835d1be6aeb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:47.874354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:47.882333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:47.882672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:47.882955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] PATH_INFO: `/v3/projects/c2c48063951e4dd0aad013011a14d1b3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.886445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c48063951e4dd0aad013011a14d1b3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:47.915984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5431f-1f40-45fb-b154-66430967e28c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:47.919008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:47.938608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:47.939648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:47.940128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:47.940561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:47.941441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:47.943979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:47.983349 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3236/6559] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:47 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:47.987745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:48.006592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dfa37-d7a0-4da5-ac5f-02cbf2743819 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:48.013443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:48.014409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:48.014782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:48.015228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:48.017053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:48.021378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:48.039137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3237/6560] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:48.044409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:48.053720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c48063951e4dd0aad013011a14d1b3', 'request_id': 'req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.071249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c48063951e4dd0aad013011a14d1b3', 'request_id': 'req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.077584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc0cd-dc12-4751-a069-8f8da81f3b0c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:48.082922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c48063951e4dd0aad013011a14d1b3', 'request_id': 'req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.103433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] The token cache is being invalidate because project c2c48063951e4dd0aad013011a14d1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:48.103641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.104287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.109714 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3324/6561] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:47 2022] DELETE /identity/v3/projects/c2c48063951e4dd0aad013011a14d1b3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:48.111049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:48.120093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:48.230540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:48.231422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:48.232163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:48.232610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:48.233589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:48.238578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:48.280906 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3238/6562] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:48.282175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:48.283164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3a4c-3e78-4919-bbfe-2ca51cfed2df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:48.287216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:48.289915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:48.290956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:48.291259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:48.291568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] PATH_INFO: `/v3/users/0bcb6125e45040288c9f3d9640a173b9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:48.293015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bcb6125e45040288c9f3d9640a173b9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:48.295162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:48.316222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e208-b589-4361-b710-e22bf4db2137 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:48.322487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb9220-3bd0-42c3-9f06-d61ce46c2805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:48.323443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9220-3bd0-42c3-9f06-d61ce46c2805 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:48.323988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9220-3bd0-42c3-9f06-d61ce46c2805 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:48.323988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9220-3bd0-42c3-9f06-d61ce46c2805 admin admin] PATH_INFO: `/v3/projects/b737942cf73f41c2b540507b73ea1833/users/aadeb21e716a4581836bd7a9b851320b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:48.344843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb9220-3bd0-42c3-9f06-d61ce46c2805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b737942cf73f41c2b540507b73ea1833, user_id=aadeb21e716a4581836bd7a9b851320b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:48.348381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb9220-3bd0-42c3-9f06-d61ce46c2805 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:48.378467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3239/6563] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:48 2022] PUT /identity/v3/projects/b737942cf73f41c2b540507b73ea1833/users/aadeb21e716a4581836bd7a9b851320b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:48.380260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fda1e2-fed2-4fbe-83e4-f5f487976a1f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:48.380625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fda1e2-fed2-4fbe-83e4-f5f487976a1f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:48.380907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fda1e2-fed2-4fbe-83e4-f5f487976a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:48.390160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bcb6125e45040288c9f3d9640a173b9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.391267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bcb6125e45040288c9f3d9640a173b9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.413865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bcb6125e45040288c9f3d9640a173b9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.428114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bcb6125e45040288c9f3d9640a173b9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.428339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-46fda1e2-fed2-4fbe-83e4-f5f487976a1f None None] MFA Rules not processed for user `aadeb21e716a4581836bd7a9b851320b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:48.430242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-46fda1e2-fed2-4fbe-83e4-f5f487976a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:48.431016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bcb6125e45040288c9f3d9640a173b9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:48.489431 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3325/6564] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:48 2022] DELETE /identity/v3/users/0bcb6125e45040288c9f3d9640a173b9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:48.539417 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3240/6565] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:48.544833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:48.552520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:48.682071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba31605-d360-4529-9217-062e0f5a300e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:48.697561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:48.698691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:48.699021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:48.699244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:48.700239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:48.702245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:48.753750 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3326/6566] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:48 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:48.758129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fda1e2-fed2-4fbe-83e4-f5f487976a1f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:48.929409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fda1e2-fed2-4fbe-83e4-f5f487976a1f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.106758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.107463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.107745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.108019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.108734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.114086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.161623 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3241/6567] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:48 2022] POST /identity/v3/users => generated 300 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:49.162926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.178261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a513d6-3549-4093-befe-e65a1f378438 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.183089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.183769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.184154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.184436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.185204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.187339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.203704 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3327/6568] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:49.205181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.217729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6a4d-1077-45dc-a177-0a10dc1150f9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.223429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.224462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.225186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.225186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] PATH_INFO: `/v3/projects/626295f12bb94037af38e27d8582b0fa/users/7fb4f510f3d84a89a7321e33f03751d8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.258802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=626295f12bb94037af38e27d8582b0fa, user_id=7fb4f510f3d84a89a7321e33f03751d8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.262243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.285541 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3242/6569] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:49 2022] PUT /identity/v3/projects/626295f12bb94037af38e27d8582b0fa/users/7fb4f510f3d84a89a7321e33f03751d8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:49.287119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.301204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27303b0-b49b-48c5-9c59-5d027fe4a2f0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.401332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dc8d0-c7f3-420a-9adc-f29eac27d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.402510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dc8d0-c7f3-420a-9adc-f29eac27d231 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.402996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dc8d0-c7f3-420a-9adc-f29eac27d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.403489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dc8d0-c7f3-420a-9adc-f29eac27d231 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.405604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dc8d0-c7f3-420a-9adc-f29eac27d231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.407896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dc8d0-c7f3-420a-9adc-f29eac27d231 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.427178 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3328/6570] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:49.429216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.442312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fa1f0-28ee-4da2-af30-0bcd7e1c2efc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.454776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.456181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.456466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.456744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] PATH_INFO: `/v3/projects/626295f12bb94037af38e27d8582b0fa/users/7fb4f510f3d84a89a7321e33f03751d8/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.459348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626295f12bb94037af38e27d8582b0fa, user_id=7fb4f510f3d84a89a7321e33f03751d8, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.462316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.481182 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3243/6571] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:49 2022] PUT /identity/v3/projects/626295f12bb94037af38e27d8582b0fa/users/7fb4f510f3d84a89a7321e33f03751d8/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:49.487386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8133b0-70eb-4091-aeb3-78516815c091 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.487688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8133b0-70eb-4091-aeb3-78516815c091 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.487953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8133b0-70eb-4091-aeb3-78516815c091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.532549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7d8133b0-70eb-4091-aeb3-78516815c091 None None] MFA Rules not processed for user `7fb4f510f3d84a89a7321e33f03751d8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:49.535137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7d8133b0-70eb-4091-aeb3-78516815c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:49.653904 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3329/6572] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:49.659551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.680317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75499e2-1852-481b-ae09-76f7dd985d20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.690948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.692147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.692436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.692771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects/b737942cf73f41c2b540507b73ea1833` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.694210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:get_project(project_id=b737942cf73f41c2b540507b73ea1833)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.696303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.698301 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3244/6573] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:49 2022] GET /identity/v3/projects/b737942cf73f41c2b540507b73ea1833 => generated 387 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:49.704259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8133b0-70eb-4091-aeb3-78516815c091 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.721073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8133b0-70eb-4091-aeb3-78516815c091 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.727250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.728318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.728597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.728876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.729619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.731646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.773987 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3330/6574] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:17:49 2022] POST /identity/v3/projects => generated 338 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:49.782286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.804771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31544f-b6b6-4153-8581-d736579d9d25 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.849467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.852483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:49.884943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.897075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.897075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.897327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.899755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.904274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.963717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277593-84d3-4398-a286-fed6b703a0e2 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:49.964866 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3245/6575] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:17:49 2022] GET /identity/v3/projects => generated 7291 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:49.966797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:49.976920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:49.978551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:49.978869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:49.979144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] PATH_INFO: `/v3/projects/9a1f1000df0b4a299ab837512be51843` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:49.981289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1f1000df0b4a299ab837512be51843)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:49.983357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:49.993396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24378b-a31e-4eb3-8712-15635ff7dd71 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.003577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.004478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.004759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.005060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects/b737942cf73f41c2b540507b73ea1833` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.009961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:get_project(project_id=b737942cf73f41c2b540507b73ea1833)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.013999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.016340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3246/6576] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:49 2022] GET /identity/v3/projects/b737942cf73f41c2b540507b73ea1833 => generated 387 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:50.020373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.057497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1070af2-3d88-444d-b186-6f8c0d4b2d83 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.068552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.069925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.070568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.071076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects/28376cece2884033b77d47dd1cc69c55` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.073531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:get_project(project_id=28376cece2884033b77d47dd1cc69c55)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.077925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.084877 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3247/6577] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/projects/28376cece2884033b77d47dd1cc69c55 => generated 338 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:17:50.086130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.089253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1f1000df0b4a299ab837512be51843', 'request_id': 'req-9175a86a-d59f-40c2-9183-4767b75c814f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.100081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51299830-62a9-4b8c-9b7b-a330298f2113 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.109418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1f1000df0b4a299ab837512be51843', 'request_id': 'req-9175a86a-d59f-40c2-9183-4767b75c814f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.130475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1f1000df0b4a299ab837512be51843', 'request_id': 'req-9175a86a-d59f-40c2-9183-4767b75c814f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.164374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] The token cache is being invalidate because project 9a1f1000df0b4a299ab837512be51843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:50.165062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.166944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9175a86a-d59f-40c2-9183-4767b75c814f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.172375 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3331/6578] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:49 2022] DELETE /identity/v3/projects/9a1f1000df0b4a299ab837512be51843 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:50.183012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1a41-b30d-452e-b5e6-08ff0a826b44 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.183455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1a41-b30d-452e-b5e6-08ff0a826b44 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.183826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1a41-b30d-452e-b5e6-08ff0a826b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.187187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.187969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.188330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.188678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.190009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.192243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.215218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-28cb1a41-b30d-452e-b5e6-08ff0a826b44 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:50.216563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-28cb1a41-b30d-452e-b5e6-08ff0a826b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:50.217676 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3248/6579] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/projects => generated 6930 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:50.222713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.226386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:50.242527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574a99e-4de0-41ac-aec7-2914ff8b95b7 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.248225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.249220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.249729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.250413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.261739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:50.264430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.266514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.297414 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3249/6580] 10.222.0.30 () {58 vars in 1165 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/projects?domain_id=default => generated 6599 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:50.302469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.331139 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3332/6581] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:50.331341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376801e8-35aa-442e-ae85-0d542609e0cf tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.333460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c654a-7f0d-4ef7-b65a-a255a57d00fd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.333820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c654a-7f0d-4ef7-b65a-a255a57d00fd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.334099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c654a-7f0d-4ef7-b65a-a255a57d00fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.342859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.343554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.343843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.344139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.344876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.347353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.360647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-760c654a-7f0d-4ef7-b65a-a255a57d00fd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:50.362321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-760c654a-7f0d-4ef7-b65a-a255a57d00fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:50.376106 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3250/6582] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/projects => generated 6930 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:50.377085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3333/6583] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:50.379452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.392625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c654a-7f0d-4ef7-b65a-a255a57d00fd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.396590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d78192-252f-4d3b-9671-64981465e42b tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.403264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.404436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.404715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.405076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.407086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:50.407412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.410891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.423029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c654a-7f0d-4ef7-b65a-a255a57d00fd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.438885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.441635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.441995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.442417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.445649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:50.452020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.455077 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3251/6584] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:50.455194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.455349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.477927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8535c-83ed-4393-8a79-6ebf3adb6f2e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.494753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.497334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.497621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.497902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.498662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.504468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.524589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3334/6585] 10.222.0.30 () {58 vars in 1165 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/projects?domain_id=default => generated 6599 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:50.531163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.565766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ebe8b-5383-47a3-a686-cfa2b209802e tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.574544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3252/6586] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:50 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:50.574763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.574902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.575004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.575004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.575004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.575004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.577110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.577226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:50.650393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3335/6587] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/projects => generated 7293 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:50.651086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.677164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f2c7c-a8b9-4a28-b8bd-c7c0cdff8bfb tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.692807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56875-2474-4069-8e86-d5f6d58fa388 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.697267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.698460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.698919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.699393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] PATH_INFO: `/v3/projects/dd5b314191fb4540a87af9cf69d88fb5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.701521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5b314191fb4540a87af9cf69d88fb5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.703831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.760488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.761534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.762105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.762391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.763093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.765865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.772775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5b314191fb4540a87af9cf69d88fb5', 'request_id': 'req-50c4369a-1f2e-42f4-9e20-caffee34aebc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.787873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5b314191fb4540a87af9cf69d88fb5', 'request_id': 'req-50c4369a-1f2e-42f4-9e20-caffee34aebc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.802595 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3336/6588] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:50 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:50.803636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.805598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:50.810511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5b314191fb4540a87af9cf69d88fb5', 'request_id': 'req-50c4369a-1f2e-42f4-9e20-caffee34aebc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.826194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] The token cache is being invalidate because project dd5b314191fb4540a87af9cf69d88fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:50.827085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.827783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:50.832634 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3253/6589] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:50 2022] DELETE /identity/v3/projects/dd5b314191fb4540a87af9cf69d88fb5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:50.832634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.832914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:50.931183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4369a-1f2e-42f4-9e20-caffee34aebc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.936397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:50.937289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:50.938047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:50.938047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:50.938873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-681938193) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:50.939188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:50.940857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2515a-8271-4596-a1a4-8b5e46ce3b0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:50.942521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:50.981825 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3254/6590] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-681938193 => generated 534 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:50.982857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:50.987359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:51.022355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994142-738a-4ba7-b073-879011428993 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:51.023032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994142-738a-4ba7-b073-879011428993 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.023308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994142-738a-4ba7-b073-879011428993 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.023639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994142-738a-4ba7-b073-879011428993 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.025577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3d994142-738a-4ba7-b073-879011428993 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:51.075327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994142-738a-4ba7-b073-879011428993 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:51.076731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994142-738a-4ba7-b073-879011428993 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:51.126530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35dda3-8f6b-4e8c-a974-bc64679d51c5 tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:51.132888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:51.133473 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3337/6591] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:51.134545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.134896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.135234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.136197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:51.140103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6218-68ee-41e4-ad4b-00d9f1a3fd61 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.140413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6218-68ee-41e4-ad4b-00d9f1a3fd61 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.140609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:51.140725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6218-68ee-41e4-ad4b-00d9f1a3fd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.172599 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3255/6592] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:51.173775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:51.180463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-561f6218-68ee-41e4-ad4b-00d9f1a3fd61 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:51.183162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-561f6218-68ee-41e4-ad4b-00d9f1a3fd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:51.186985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a79c-122a-423f-b560-29ad0cbf39fd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:51.193449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb4f510f3d84a89a7321e33f03751d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '626295f12bb94037af38e27d8582b0fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:51.194670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.195042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.195453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] PATH_INFO: `/v3/projects/28376cece2884033b77d47dd1cc69c55` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.197235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorizing `identity:delete_project(project_id=28376cece2884033b77d47dd1cc69c55)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:51.199721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:51.212392 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3338/6593] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:51.213568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f6218-68ee-41e4-ad4b-00d9f1a3fd61 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:51.244457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f6218-68ee-41e4-ad4b-00d9f1a3fd61 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:51.261568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fb514-f2ff-4d4d-9c7b-277797fb6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:51.261957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fb514-f2ff-4d4d-9c7b-277797fb6314 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.262186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fb514-f2ff-4d4d-9c7b-277797fb6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.262454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fb514-f2ff-4d4d-9c7b-277797fb6314 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.263598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fb514-f2ff-4d4d-9c7b-277797fb6314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:51.264956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fb514-f2ff-4d4d-9c7b-277797fb6314 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:51.294314 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3339/6594] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:51.303593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.305863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.306166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.386848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:51.390609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:51.397605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28376cece2884033b77d47dd1cc69c55', 'request_id': 'req-6760e37b-be08-4885-b021-c8635719af4a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.413189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28376cece2884033b77d47dd1cc69c55', 'request_id': 'req-6760e37b-be08-4885-b021-c8635719af4a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.439988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28376cece2884033b77d47dd1cc69c55', 'request_id': 'req-6760e37b-be08-4885-b021-c8635719af4a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.457961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] The token cache is being invalidate because project 28376cece2884033b77d47dd1cc69c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:51.458354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.459164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.463393 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3256/6595] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:51 2022] DELETE /identity/v3/projects/28376cece2884033b77d47dd1cc69c55 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:51.466034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:51.469579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:51.509187 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3340/6596] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:51.509187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:51.511077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:51.545664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545be0-40de-4c29-94e7-ed686684c52c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:51.553655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:51.555156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.555442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.555719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] PATH_INFO: `/v3/users/aadeb21e716a4581836bd7a9b851320b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.558226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadeb21e716a4581836bd7a9b851320b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:51.561460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:51.576246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e37b-be08-4885-b021-c8635719af4a tempest-ListProjectsStaticTestJSON-485265629 tempest-ListProjectsStaticTestJSON-485265629-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:51.583200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:51.584298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.584582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.584932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] PATH_INFO: `/v3/projects/55bfa8219d074eb1b2e1f2469053cd8f/users/10418f53ef434172ba24367322166d33/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.609367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bfa8219d074eb1b2e1f2469053cd8f, user_id=10418f53ef434172ba24367322166d33, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:51.613266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:51.641313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadeb21e716a4581836bd7a9b851320b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.642128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadeb21e716a4581836bd7a9b851320b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.664698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadeb21e716a4581836bd7a9b851320b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.668156 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3257/6597] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:51 2022] PUT /identity/v3/projects/55bfa8219d074eb1b2e1f2469053cd8f/users/10418f53ef434172ba24367322166d33/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:51.672094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:51.686754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadeb21e716a4581836bd7a9b851320b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.688197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68b44dfc-2e8a-4a11-90ac-e085b06cc616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadeb21e716a4581836bd7a9b851320b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:51.735365 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3341/6598] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:51 2022] DELETE /identity/v3/users/aadeb21e716a4581836bd7a9b851320b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:51.737235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.739672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.740304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.839237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] MFA Rules not processed for user `10418f53ef434172ba24367322166d33`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:51.841563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:51.848489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079770a-fc23-48ef-8050-0d95ae39ce28 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:51.950359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f24de-d5aa-43a7-bb8b-f41e14a9122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:51.951571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f24de-d5aa-43a7-bb8b-f41e14a9122d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.952061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f24de-d5aa-43a7-bb8b-f41e14a9122d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.953468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f24de-d5aa-43a7-bb8b-f41e14a9122d admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:51.954622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f24de-d5aa-43a7-bb8b-f41e14a9122d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:51.955189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f24de-d5aa-43a7-bb8b-f41e14a9122d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:51.957976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f24de-d5aa-43a7-bb8b-f41e14a9122d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:51.984298 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3258/6599] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:51.987649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:51.988991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:51.989633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.014125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:52.016053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:52.036353 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3259/6600] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:52.039063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:52.044429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:52.067293 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3342/6601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:52.072650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:52.074432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:52.075763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864a0b3-1d8f-4c0c-80d1-2d0705c59b89 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:52.089761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:52.090628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.091004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.091504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.095106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:52.114141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:52.174024 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3260/6602] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:52 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:52.176810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:52.178909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:52.193376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb54a-af9e-4b13-b776-645a19108987 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:52.286798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:52.289307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.290045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.290618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.292850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603e477-6e83-4959-873f-c7f083b36d30 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:52.302710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:52.303425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.303714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.303993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.407137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:52.408618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:52.425135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:52.427406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:52.430437 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3343/6603] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:52.431275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:52.451904 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3261/6604] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:52.467766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a8e9-4644-48fe-aaed-fb9f7adaeb13 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:52.488058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:52.488938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.489326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.489508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.490291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:52.493999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:52.565909 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3344/6605] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:52 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:52.570929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:52.596044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a565350-5180-4b57-9566-585c534e18dd service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:52.607279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:52.608747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.609569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.609862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.612106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:52.617455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:52.647040 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3262/6606] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:52.648599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:52.668281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f449-e46d-4d32-aa92-f02ee15edb3f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:52.693013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcfa4c-fbad-4497-9b27-0ff8edbc486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:52.693784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcfa4c-fbad-4497-9b27-0ff8edbc486d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.694054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcfa4c-fbad-4497-9b27-0ff8edbc486d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.694321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcfa4c-fbad-4497-9b27-0ff8edbc486d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.695051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcfa4c-fbad-4497-9b27-0ff8edbc486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:52.696685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcfa4c-fbad-4497-9b27-0ff8edbc486d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:52.753941 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3345/6607] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:52.755693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:52.789086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeabe07-af58-4070-ac5c-70c3d0ae2717 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:52.808251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:52.810043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.811490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.812459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] PATH_INFO: `/v3/projects/a88ceb31f8e34d6395ecb76fb479bbd7/users/221af1cb0a324f1baae529153ff7831a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:52.868525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88ceb31f8e34d6395ecb76fb479bbd7, user_id=221af1cb0a324f1baae529153ff7831a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:52.875527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:52.919597 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3263/6608] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:52 2022] PUT /identity/v3/projects/a88ceb31f8e34d6395ecb76fb479bbd7/users/221af1cb0a324f1baae529153ff7831a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:52.933160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b099a8-9c51-4dcc-912f-c836086464ca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:52.933478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b099a8-9c51-4dcc-912f-c836086464ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:52.933714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b099a8-9c51-4dcc-912f-c836086464ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:53.006018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-59b099a8-9c51-4dcc-912f-c836086464ca None None] MFA Rules not processed for user `221af1cb0a324f1baae529153ff7831a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:53.007243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-59b099a8-9c51-4dcc-912f-c836086464ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:53.213293 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3346/6609] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:53.217531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:53.358443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039a7de-9340-4062-81d0-0176cfd3c3b5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:53.363137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:53.363924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:53.365821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:53.366172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:53.367005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:53.369193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:53.405113 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3264/6610] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:53 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:53.408913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b099a8-9c51-4dcc-912f-c836086464ca None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:53.428129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b099a8-9c51-4dcc-912f-c836086464ca None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:53.538533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:53.540175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:53.540619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:53.541072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:53.541951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:53.544087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:53.580215 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3347/6611] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:53 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:53.584607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:53.605844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ac1df-2271-4aba-b032-9066a9ea118d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:53.622526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:53.638798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:53.639676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:53.639996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:53.641581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:53.646801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:53.690721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3265/6612] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:53.695493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:53.708142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d76ace-918b-49d1-a752-43cb5a930943 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:53.713467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:53.714383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:53.714663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:53.714936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] PATH_INFO: `/v3/projects/5e172c89d19741ddb34375444cd41685/users/568ec309989e4ba484bbb341c1ab35f9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:53.733839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e172c89d19741ddb34375444cd41685, user_id=568ec309989e4ba484bbb341c1ab35f9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:53.747263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:53.796327 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3348/6613] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:53 2022] PUT /identity/v3/projects/5e172c89d19741ddb34375444cd41685/users/568ec309989e4ba484bbb341c1ab35f9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:53.799940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:53.811655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b27bc7-4f54-4098-bb86-12bb4df4e942 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:53.905126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857b8ba-4a2f-4758-933d-92c51d733d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:53.906052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b8ba-4a2f-4758-933d-92c51d733d72 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:53.906429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b8ba-4a2f-4758-933d-92c51d733d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:53.907057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b8ba-4a2f-4758-933d-92c51d733d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:53.908137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857b8ba-4a2f-4758-933d-92c51d733d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:53.911445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857b8ba-4a2f-4758-933d-92c51d733d72 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:53.926717 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3266/6614] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:53.928671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:53.939988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f3f93-7ebd-420e-a134-137748fddc36 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:53.945449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:53.946361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:53.946640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:53.946908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] PATH_INFO: `/v3/projects/5e172c89d19741ddb34375444cd41685/users/568ec309989e4ba484bbb341c1ab35f9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:53.949388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e172c89d19741ddb34375444cd41685, user_id=568ec309989e4ba484bbb341c1ab35f9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:53.952233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:53.981231 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3349/6615] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:53 2022] PUT /identity/v3/projects/5e172c89d19741ddb34375444cd41685/users/568ec309989e4ba484bbb341c1ab35f9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:53.982957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e0b0d-4b61-461b-99cc-62b8938ca582 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:53.983240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e0b0d-4b61-461b-99cc-62b8938ca582 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:53.983510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e0b0d-4b61-461b-99cc-62b8938ca582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.028692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b49e0b0d-4b61-461b-99cc-62b8938ca582 None None] MFA Rules not processed for user `568ec309989e4ba484bbb341c1ab35f9`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:54.030262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b49e0b0d-4b61-461b-99cc-62b8938ca582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:54.213474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.215729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:54.247667 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3267/6616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:54.249586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e0b0d-4b61-461b-99cc-62b8938ca582 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.291259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e0b0d-4b61-461b-99cc-62b8938ca582 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:54.313681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:54.314387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.314672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.314947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.315959 ncdv-master-1 devstack@keystone.service[102531]: WARNING oslo_log.versionutils [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 09 21:17:54.316487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:54.317811 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:54.317811 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:54.317811 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:54.318744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:54.373755 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3268/6617] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:17:54 2022] POST /identity/v3/policies => generated 229 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:54.375305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.404045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125520-0b10-48eb-95ab-2361b88c2f3a tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:54.430434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:54.431548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.431979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.433675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies/632b85a6efe64930ad0a24afaf08886f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.435325 ncdv-master-1 devstack@keystone.service[102531]: WARNING oslo_log.versionutils [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 09 21:17:54.436996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=632b85a6efe64930ad0a24afaf08886f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:54.438980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f27a8-0616-4356-af2a-b42620788743 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:54.454518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:54.454957 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:54.454957 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:54.454957 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:54.455719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.456064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.456401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] PATH_INFO: `/v3/projects/b737942cf73f41c2b540507b73ea1833` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.458287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b737942cf73f41c2b540507b73ea1833)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:54.459716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f993e-39e8-4f40-a7e9-c203abc7c09c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:54.464920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:54.508146 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3269/6618] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Apr 9 21:17:54 2022] PATCH /identity/v3/policies/632b85a6efe64930ad0a24afaf08886f => generated 236 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:54.512700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.513149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.513525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.543862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] MFA Rules not processed for user `10418f53ef434172ba24367322166d33`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:54.546015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:54.559794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b737942cf73f41c2b540507b73ea1833', 'request_id': 'req-668ea5c6-479f-4c86-acdb-ae3163ab2900'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.569141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b737942cf73f41c2b540507b73ea1833', 'request_id': 'req-668ea5c6-479f-4c86-acdb-ae3163ab2900'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.582169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b737942cf73f41c2b540507b73ea1833', 'request_id': 'req-668ea5c6-479f-4c86-acdb-ae3163ab2900'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.605307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] The token cache is being invalidate because project b737942cf73f41c2b540507b73ea1833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:54.606618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.607459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.609942 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3350/6619] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:54 2022] DELETE /identity/v3/projects/b737942cf73f41c2b540507b73ea1833 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:54.611697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.613893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:54.627799 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3270/6620] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:54.629107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.630769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:54.731661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea5c6-479f-4c86-acdb-ae3163ab2900 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:54.740211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:54.741672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.742175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.742662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies/632b85a6efe64930ad0a24afaf08886f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.743736 ncdv-master-1 devstack@keystone.service[102532]: WARNING oslo_log.versionutils [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 09 21:17:54.744717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=632b85a6efe64930ad0a24afaf08886f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:54.751490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c71da0-06e7-48b6-85d7-11e52299e9cb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:54.752338 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:54.752338 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:17:54.752338 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:54.754563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:54.766955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:54.767990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.768332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.768675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] PATH_INFO: `/v3/users/7fb4f510f3d84a89a7321e33f03751d8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.770413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb4f510f3d84a89a7321e33f03751d8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:54.775278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:54.776986 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3351/6621] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:17:54 2022] GET /identity/v3/policies/632b85a6efe64930ad0a24afaf08886f => generated 236 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:54.779323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.792903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524cddb-a045-4c24-aee7-c43a433f51cc tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:54.799392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:54.801093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.801597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.802065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies/632b85a6efe64930ad0a24afaf08886f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.803538 ncdv-master-1 devstack@keystone.service[102532]: WARNING oslo_log.versionutils [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 09 21:17:54.805374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=632b85a6efe64930ad0a24afaf08886f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:54.806694 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:54.806694 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:17:54.806694 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:54.807614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:54.841842 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3352/6622] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:54 2022] DELETE /identity/v3/policies/632b85a6efe64930ad0a24afaf08886f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:54.850127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.868424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb4f510f3d84a89a7321e33f03751d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.869975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb4f510f3d84a89a7321e33f03751d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.873483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec911d-91c1-4217-8a39-d919bd731d9c tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:54.880176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:54.881327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:54.881842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:54.882403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:54.883577 ncdv-master-1 devstack@keystone.service[102532]: WARNING oslo_log.versionutils [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 09 21:17:54.884325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:54.886049 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:54.886049 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:17:54.886049 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:54.886389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb4f510f3d84a89a7321e33f03751d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.887707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:54.888364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb4f510f3d84a89a7321e33f03751d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.905179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb4f510f3d84a89a7321e33f03751d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:54.916953 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3353/6623] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:17:54 2022] POST /identity/v3/policies => generated 229 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:54.922443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:54.926014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:54.937834 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3271/6624] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:54 2022] DELETE /identity/v3/users/7fb4f510f3d84a89a7321e33f03751d8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:54.950665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75a22-e3a0-493c-b80b-683dfefd06f7 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.025673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.026434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.026715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.027054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.028881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.030248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.054181 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3354/6625] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:17:54 2022] POST /identity/v3/policies => generated 230 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:55.055781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:55.070406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a20f10-666d-4dbc-85bc-f2eca9ab541b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.083742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.084650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.085000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.085488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.086849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.088819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.112707 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3272/6626] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:17:55 2022] POST /identity/v3/policies => generated 229 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:55.118968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:55.130034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0b406-5f3f-45e1-a832-43c75d18c7b9 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.136290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.137277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.138362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.138831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.139883 ncdv-master-1 devstack@keystone.service[102532]: WARNING oslo_log.versionutils [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 09 21:17:55.140568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.142267 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:55.142267 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:17:55.142267 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:17:55.143342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.159660 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3355/6627] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:17:55 2022] GET /identity/v3/policies => generated 764 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:55.160904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:55.173165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c6a8b-020c-4f31-8f67-fdd3ed55b092 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.177949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.178924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.179250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.179616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies/93007617626949f681254ab27ffc26ad` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.180466 ncdv-master-1 devstack@keystone.service[102531]: WARNING oslo_log.versionutils [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 09 21:17:55.181189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=93007617626949f681254ab27ffc26ad)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.182502 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:17:55.182502 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:17:55.182502 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:17:55.183559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.199932 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3273/6628] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:55 2022] DELETE /identity/v3/policies/93007617626949f681254ab27ffc26ad => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:55.205103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:55.217174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256b0f-4e7a-4aa2-83ef-5e7190525b0b tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.223112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.224135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.224478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.224817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies/636a7f6220e44b96b1a566e20d0ff5bd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.226053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=636a7f6220e44b96b1a566e20d0ff5bd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.227965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.242992 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3356/6629] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:55 2022] DELETE /identity/v3/policies/636a7f6220e44b96b1a566e20d0ff5bd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:55.249024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:55.263554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3f3a-3a9e-4a67-87c3-4ee8dcec947e tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.269206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a271f-da27-4cbd-9842-76860bed1385 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568ec309989e4ba484bbb341c1ab35f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e172c89d19741ddb34375444cd41685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.270090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a271f-da27-4cbd-9842-76860bed1385 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.270364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a271f-da27-4cbd-9842-76860bed1385 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.270631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a271f-da27-4cbd-9842-76860bed1385 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] PATH_INFO: `/v3/policies/9f1a9075ab5a410b9e11ce4d7a584ec0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.271796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a271f-da27-4cbd-9842-76860bed1385 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=9f1a9075ab5a410b9e11ce4d7a584ec0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.273658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a271f-da27-4cbd-9842-76860bed1385 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.290476 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3274/6630] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:55 2022] DELETE /identity/v3/policies/9f1a9075ab5a410b9e11ce4d7a584ec0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:55.296294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:55.298673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:55.416076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f97a1-851e-4707-a10d-6fff527bb3f0 tempest-PoliciesTestJSON-1744035354 tempest-PoliciesTestJSON-1744035354-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.421278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.422556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.423556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.423556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] PATH_INFO: `/v3/users/221af1cb0a324f1baae529153ff7831a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.425021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=221af1cb0a324f1baae529153ff7831a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.427881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.495319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221af1cb0a324f1baae529153ff7831a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:55.496305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221af1cb0a324f1baae529153ff7831a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:55.504810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221af1cb0a324f1baae529153ff7831a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:55.514905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221af1cb0a324f1baae529153ff7831a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:55.515752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221af1cb0a324f1baae529153ff7831a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:55.540182 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3357/6631] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:55 2022] DELETE /identity/v3/users/221af1cb0a324f1baae529153ff7831a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:55.542256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.542546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.542878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.561374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:55.562940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:55.647036 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3275/6632] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:55.662477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:55.664405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:55.728546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e1449-cbfe-4d42-80ee-e7b642224a9a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:55.732183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:55.732861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:55.733176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:55.733610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:55.743442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:55.745140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:55.756549 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3358/6633] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:17:56.427580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:56.429231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:56.449466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783bf00-b2b7-4618-8682-d1ee6a2f5523 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:56.457276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:56.460956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:56.469936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:56.470832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:56.471106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:56.471378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] PATH_INFO: `/v3/projects/626295f12bb94037af38e27d8582b0fa` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:56.473504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626295f12bb94037af38e27d8582b0fa)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:56.479865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7802dd-9d11-4563-abca-4626f4374205 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:56.483619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:56.489982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:56.491007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:56.491454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:56.491787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] PATH_INFO: `/v3/projects/a88ceb31f8e34d6395ecb76fb479bbd7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:56.493142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88ceb31f8e34d6395ecb76fb479bbd7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:56.495365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:56.574828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626295f12bb94037af38e27d8582b0fa', 'request_id': 'req-84093e86-30a3-4cd7-8ec9-fb1672806365'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.601086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626295f12bb94037af38e27d8582b0fa', 'request_id': 'req-84093e86-30a3-4cd7-8ec9-fb1672806365'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.621651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626295f12bb94037af38e27d8582b0fa', 'request_id': 'req-84093e86-30a3-4cd7-8ec9-fb1672806365'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.629088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88ceb31f8e34d6395ecb76fb479bbd7', 'request_id': 'req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.641595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88ceb31f8e34d6395ecb76fb479bbd7', 'request_id': 'req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.645891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] The token cache is being invalidate because project 626295f12bb94037af38e27d8582b0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:56.646976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.648032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84093e86-30a3-4cd7-8ec9-fb1672806365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.654874 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3276/6634] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:56 2022] DELETE /identity/v3/projects/626295f12bb94037af38e27d8582b0fa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:56.656584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55c8d-bd9a-4395-8e60-a9ea275bd00a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:56.657116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55c8d-bd9a-4395-8e60-a9ea275bd00a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:56.657404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55c8d-bd9a-4395-8e60-a9ea275bd00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:56.662846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88ceb31f8e34d6395ecb76fb479bbd7', 'request_id': 'req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.704274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] The token cache is being invalidate because project a88ceb31f8e34d6395ecb76fb479bbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:56.704622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.705706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7cc55c8d-bd9a-4395-8e60-a9ea275bd00a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:56.707209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7cc55c8d-bd9a-4395-8e60-a9ea275bd00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:56.707525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.728239 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3359/6635] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:56 2022] DELETE /identity/v3/projects/a88ceb31f8e34d6395ecb76fb479bbd7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:56.729594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:56.734290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:56.784649 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3277/6636] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:56.795655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163e40-5f2d-4cb5-a8c7-439d35994e0b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:56.795982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163e40-5f2d-4cb5-a8c7-439d35994e0b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:56.796179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163e40-5f2d-4cb5-a8c7-439d35994e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:56.817913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ea163e40-5f2d-4cb5-a8c7-439d35994e0b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:56.819344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ea163e40-5f2d-4cb5-a8c7-439d35994e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:56.833054 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3278/6637] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:56.834701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163e40-5f2d-4cb5-a8c7-439d35994e0b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:56.839894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d17e5-2f1f-44d9-919b-1732a58a4e33 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:56.845001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163e40-5f2d-4cb5-a8c7-439d35994e0b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:56.846135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:56.847067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:56.847389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:56.848011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] PATH_INFO: `/v3/users/568ec309989e4ba484bbb341c1ab35f9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:56.850385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:56.850533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] RBAC: Authorizing `identity:delete_user(user_id=568ec309989e4ba484bbb341c1ab35f9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:56.851149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:56.851499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:56.851845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:56.852660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:56.853123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:56.853650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:56.855584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:56.917391 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3279/6638] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:56.923238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:56.948214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aba29-55ee-4a78-bcbe-de557efcc88f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:56.954660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:56.955405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:56.955684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:56.956011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:56.957053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:56.960133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:56.970285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568ec309989e4ba484bbb341c1ab35f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.971256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568ec309989e4ba484bbb341c1ab35f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:56.987439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568ec309989e4ba484bbb341c1ab35f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:57.008150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568ec309989e4ba484bbb341c1ab35f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:57.009299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568ec309989e4ba484bbb341c1ab35f9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:57.020096 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3280/6639] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:56 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:57.030336 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3360/6640] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:56 2022] DELETE /identity/v3/users/568ec309989e4ba484bbb341c1ab35f9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:57.032790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:57.038701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:57.122771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d1cc8-5ba4-4a85-8952-df0b15e8ba3a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:57.198706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:57.199385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.199692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.199941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.200803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:57.203017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:57.239046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:57.239856 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3281/6641] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:57 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:57.260922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9572f-d9a8-4d7c-9a36-7bc53a66062f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:57.275958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:57.276758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.277076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.277335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.278089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:57.281685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:57.340230 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3361/6642] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:57.346349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:57.374739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63c4b-6a4b-4c01-a932-050db198ed39 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:57.392755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebfcd7-e2c6-4d08-8e29-d326a0553916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:57.395455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebfcd7-e2c6-4d08-8e29-d326a0553916 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.395889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebfcd7-e2c6-4d08-8e29-d326a0553916 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.396401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebfcd7-e2c6-4d08-8e29-d326a0553916 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.397302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebfcd7-e2c6-4d08-8e29-d326a0553916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:57.400546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebfcd7-e2c6-4d08-8e29-d326a0553916 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:57.438695 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3282/6643] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:57.444462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:57.482945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ac30-a857-491d-83a5-5e6eeacba6c5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:57.504227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:57.505555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.508133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.510289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] PATH_INFO: `/v3/projects/489d25b5b25a49e0bc8e805a0e4c4193/users/28daf9f7b92c42db96a0f496d2e8a1ae/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.535354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=489d25b5b25a49e0bc8e805a0e4c4193, user_id=28daf9f7b92c42db96a0f496d2e8a1ae, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:57.538538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:57.566301 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3362/6644] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:57 2022] PUT /identity/v3/projects/489d25b5b25a49e0bc8e805a0e4c4193/users/28daf9f7b92c42db96a0f496d2e8a1ae/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:57.576771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145895-c90c-408d-b5ef-a9c76ec02ef4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.577148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145895-c90c-408d-b5ef-a9c76ec02ef4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.577378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145895-c90c-408d-b5ef-a9c76ec02ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.608768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-94145895-c90c-408d-b5ef-a9c76ec02ef4 None None] MFA Rules not processed for user `28daf9f7b92c42db96a0f496d2e8a1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:57.610065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-94145895-c90c-408d-b5ef-a9c76ec02ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:57.685727 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3283/6645] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:57.690408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:57.756345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be75a-08b7-49e2-9c92-2e9bd79757bf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:57.761385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:57.762092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.762388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.762654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.763378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:57.765510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:57.809969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145895-c90c-408d-b5ef-a9c76ec02ef4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:57.812075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3363/6646] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:57 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:17:57.822613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145895-c90c-408d-b5ef-a9c76ec02ef4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:57.891258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:57.892150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.892437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.892711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.893445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:57.896019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:57.924418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3284/6647] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:57 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:57.929141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:57.950831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3214-ce38-4e1b-a02e-9a42a1c96458 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:57.957198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:57.958122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:57.958563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:57.958845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:57.959814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:57.961810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:57.994980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.005772 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3364/6648] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:17:58.007823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d3f7-3037-4a0a-a657-3dc6b90c8c2e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:58.014496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.016457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:58.017696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:58.019272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:58.019557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:58.020395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] PATH_INFO: `/v3/projects/4195cba158564eedb50d0802dcd5bd89/users/5b15ab7d551d4c3c8f8ceda6615f6a58/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:58.047824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4195cba158564eedb50d0802dcd5bd89, user_id=5b15ab7d551d4c3c8f8ceda6615f6a58, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:58.051785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:58.081109 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3285/6649] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:57 2022] PUT /identity/v3/projects/4195cba158564eedb50d0802dcd5bd89/users/5b15ab7d551d4c3c8f8ceda6615f6a58/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:58.082672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.163489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0820dca-a3a5-4028-b71b-66980ed97db4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:58.206024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0b55-43d9-4b9a-a293-f947c486976d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:58.217086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:58.217840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:58.218125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:58.218401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:58.219143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:58.220900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:58.238704 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3286/6650] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:17:58.239685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.276163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6927f49-04cf-4ea9-a41a-a144f777540f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:58.286890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1c04c-7498-4ddf-a46a-c3d658f24bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:58.288839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c04c-7498-4ddf-a46a-c3d658f24bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:58.290902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c04c-7498-4ddf-a46a-c3d658f24bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:58.290902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c04c-7498-4ddf-a46a-c3d658f24bd5 admin admin] PATH_INFO: `/v3/projects/4195cba158564eedb50d0802dcd5bd89/users/5b15ab7d551d4c3c8f8ceda6615f6a58/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:58.292150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:58.292953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:58.293333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:58.294390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:58.296236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1c04c-7498-4ddf-a46a-c3d658f24bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4195cba158564eedb50d0802dcd5bd89, user_id=5b15ab7d551d4c3c8f8ceda6615f6a58, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:58.296614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:58.306001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1c04c-7498-4ddf-a46a-c3d658f24bd5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:58.338584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3287/6651] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:17:58 2022] PUT /identity/v3/projects/4195cba158564eedb50d0802dcd5bd89/users/5b15ab7d551d4c3c8f8ceda6615f6a58/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:58.349903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900fdb0-5abe-4da6-86a9-9dab598d48a2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:58.350335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900fdb0-5abe-4da6-86a9-9dab598d48a2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:58.350713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900fdb0-5abe-4da6-86a9-9dab598d48a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:58.421769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:58.423738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:58.429888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9900fdb0-5abe-4da6-86a9-9dab598d48a2 None None] MFA Rules not processed for user `5b15ab7d551d4c3c8f8ceda6615f6a58`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:58.432158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9900fdb0-5abe-4da6-86a9-9dab598d48a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:58.453967 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3365/6652] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:17:58.531851 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3288/6653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:58.532418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.622726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0f5da-9434-4361-acae-f6b25eb46710 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:58.629109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b15ab7d551d4c3c8f8ceda6615f6a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4195cba158564eedb50d0802dcd5bd89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:58.630383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:58.630913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:58.631758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:58.632836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:58.635522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:58.689198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900fdb0-5abe-4da6-86a9-9dab598d48a2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.689341 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3366/6654] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:58 2022] POST /identity/v3/projects => generated 359 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:58.781414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900fdb0-5abe-4da6-86a9-9dab598d48a2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:58.879418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28daf9f7b92c42db96a0f496d2e8a1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d25b5b25a49e0bc8e805a0e4c4193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:58.880399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:58.880945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:58.881317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] PATH_INFO: `/v3/projects/83b6248a87914507bf7225b6124e5b8f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:58.882714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] RBAC: Authorizing `identity:delete_project(project_id=83b6248a87914507bf7225b6124e5b8f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:58.901046 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Apr 09 21:17:58.903154 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3289/6655] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:58 2022] DELETE /identity/v3/projects/83b6248a87914507bf7225b6124e5b8f => generated 136 bytes in 214 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:17:58.907460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.993590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:58.995418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:59.043487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0eb7-4752-42b4-b9f1-00bdb27e0163 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:59.055920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b15ab7d551d4c3c8f8ceda6615f6a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4195cba158564eedb50d0802dcd5bd89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:59.056849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.057156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.057433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] PATH_INFO: `/v3/projects/83b6248a87914507bf7225b6124e5b8f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.058660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] RBAC: Authorizing `identity:delete_project(project_id=83b6248a87914507bf7225b6124e5b8f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:59.060798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:59.153818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b6248a87914507bf7225b6124e5b8f', 'request_id': 'req-204f28a1-0066-4200-9ab5-88e2201634d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.171534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b6248a87914507bf7225b6124e5b8f', 'request_id': 'req-204f28a1-0066-4200-9ab5-88e2201634d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.171894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c6b8a-d2df-4f8f-a84e-3424ecee7fd2 tempest-ProjectsNegativeTestJSON-1219393120 tempest-ProjectsNegativeTestJSON-1219393120-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:59.185736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b6248a87914507bf7225b6124e5b8f', 'request_id': 'req-204f28a1-0066-4200-9ab5-88e2201634d3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.206565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] The token cache is being invalidate because project 83b6248a87914507bf7225b6124e5b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:59.206934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.207649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.214639 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3367/6656] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:58 2022] DELETE /identity/v3/projects/83b6248a87914507bf7225b6124e5b8f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:59.215621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:59.222231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:59.290646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:59.291808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.292214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.292591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] PATH_INFO: `/v3/projects/5e172c89d19741ddb34375444cd41685` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.295541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e172c89d19741ddb34375444cd41685)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:59.324752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:59.368135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f28a1-0066-4200-9ab5-88e2201634d3 tempest-ProjectsNegativeTestJSON-1354568267 tempest-ProjectsNegativeTestJSON-1354568267-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:59.393103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:59.394045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.394328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.394599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] PATH_INFO: `/v3/users/28daf9f7b92c42db96a0f496d2e8a1ae` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.397826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28daf9f7b92c42db96a0f496d2e8a1ae)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:59.400271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:59.442830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e172c89d19741ddb34375444cd41685', 'request_id': 'req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.451013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e172c89d19741ddb34375444cd41685', 'request_id': 'req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.473467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e172c89d19741ddb34375444cd41685', 'request_id': 'req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.494316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] The token cache is being invalidate because project 5e172c89d19741ddb34375444cd41685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:17:59.494617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.498175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e9b6ed2-e2a4-428e-809c-cc736cb0e28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.502407 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3290/6657] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:17:58 2022] DELETE /identity/v3/projects/5e172c89d19741ddb34375444cd41685 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:17:59.513681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28daf9f7b92c42db96a0f496d2e8a1ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.515185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28daf9f7b92c42db96a0f496d2e8a1ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.517425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53b3d-bfc1-47e5-a6fa-f072759c0203 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.517719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53b3d-bfc1-47e5-a6fa-f072759c0203 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.518000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53b3d-bfc1-47e5-a6fa-f072759c0203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.542983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28daf9f7b92c42db96a0f496d2e8a1ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.555357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28daf9f7b92c42db96a0f496d2e8a1ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.556405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-96ef5a41-4e3d-4be3-9c80-d93f72281d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28daf9f7b92c42db96a0f496d2e8a1ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:17:59.572022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-dcd53b3d-bfc1-47e5-a6fa-f072759c0203 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:59.574263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dcd53b3d-bfc1-47e5-a6fa-f072759c0203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:59.592354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3368/6658] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:17:59 2022] DELETE /identity/v3/users/28daf9f7b92c42db96a0f496d2e8a1ae => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:17:59.597423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd473f5-4852-430a-91ad-c4af79335e2d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.598350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd473f5-4852-430a-91ad-c4af79335e2d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.598809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd473f5-4852-430a-91ad-c4af79335e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.635262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3cd473f5-4852-430a-91ad-c4af79335e2d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:59.636569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3cd473f5-4852-430a-91ad-c4af79335e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:59.714391 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3291/6659] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:59.715992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.716283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.716618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.742503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:17:59.743749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:59.754075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3369/6660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:17:59.763587 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3292/6661] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:17:59.768734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd473f5-4852-430a-91ad-c4af79335e2d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:59.781923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd473f5-4852-430a-91ad-c4af79335e2d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:59.788341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:59.789306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.789752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.790117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.790931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:17:59.791308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:59.793063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:59.801704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:59.808195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:17:59.836410 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3370/6662] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:17:59.839961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:59.869257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227915f-24d7-4907-998b-a6036b578652 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:59.884004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:59.884617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.884899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.885203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.885905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:59.891448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:17:59.947145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eeed9-81b8-4382-8604-3a9852c511e9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:17:59.950084 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3371/6663] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:17:59 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:17:59.954874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:17:59.959771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:17:59.960382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:17:59.964479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:17:59.964479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:17:59.988239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:17:59.989890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.019435 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3293/6664] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:18:00.065807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a0ac-af4a-466f-9467-f3b6d64413c2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.071700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.072609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.073068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.073497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.074367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.076529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.112094 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3372/6665] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:17:59 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:00.116714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.133493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed522b03-fa78-422a-b439-4a18435318fc service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.150234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.152319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.152792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.153309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.157201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.159166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.181673 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3294/6666] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:00.186359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.204059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219060dd-1e8c-4c73-bd28-cd295abb2e53 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.230844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844053d-115f-4f01-8133-3913f7095c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.231707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844053d-115f-4f01-8133-3913f7095c93 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.232996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844053d-115f-4f01-8133-3913f7095c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.234130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844053d-115f-4f01-8133-3913f7095c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.236538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844053d-115f-4f01-8133-3913f7095c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.243078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844053d-115f-4f01-8133-3913f7095c93 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.273099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3373/6667] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:00.276036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.306128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f5e45-5ced-41d1-a78f-39ca3bc15705 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.329454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.331895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.332501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.332846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] PATH_INFO: `/v3/projects/61503e913bde4c41b5d75e779e718f0b/users/2aba2ce102ca469797461d2b4ce4db4e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.357660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=61503e913bde4c41b5d75e779e718f0b, user_id=2aba2ce102ca469797461d2b4ce4db4e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.361727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.390943 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3295/6668] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:00 2022] PUT /identity/v3/projects/61503e913bde4c41b5d75e779e718f0b/users/2aba2ce102ca469797461d2b4ce4db4e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:00.401535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ec81a-fbb1-4ba2-b0f1-a0a5f36bcdc2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.401836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ec81a-fbb1-4ba2-b0f1-a0a5f36bcdc2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.402243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ec81a-fbb1-4ba2-b0f1-a0a5f36bcdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.445116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d03ec81a-fbb1-4ba2-b0f1-a0a5f36bcdc2 None None] MFA Rules not processed for user `2aba2ce102ca469797461d2b4ce4db4e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:00.446477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d03ec81a-fbb1-4ba2-b0f1-a0a5f36bcdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:00.549412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3374/6669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:00.553849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.643588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d191c5-d7da-4954-b4ec-c2568d2319ef admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.655672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.656507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.656949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.657264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.658246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.660374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.701657 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3296/6670] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:00 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:00.702684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ec81a-fbb1-4ba2-b0f1-a0a5f36bcdc2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.719828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ec81a-fbb1-4ba2-b0f1-a0a5f36bcdc2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.799412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.801220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.801846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.802484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.803668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.806752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.847053 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3375/6671] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:00 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:00.852264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.865387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f714-c485-479e-a410-28d2eb55ff69 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.870454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.871456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.871743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.872020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.872758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.874753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.893225 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3297/6672] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:00.894015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.906944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caf942-6fbc-4adf-9b39-9b3a9dc76b8e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:00.914047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:00.915292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:00.915779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:00.916916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] PATH_INFO: `/v3/projects/ad02053a4707469cbd80126be38998b2/users/a82fab79e8984fb7b062b7a60e5435bd/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:00.946427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad02053a4707469cbd80126be38998b2, user_id=a82fab79e8984fb7b062b7a60e5435bd, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:00.950264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:00.970264 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3376/6673] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:00 2022] PUT /identity/v3/projects/ad02053a4707469cbd80126be38998b2/users/a82fab79e8984fb7b062b7a60e5435bd/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:00.976938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:00.992954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e253-3a46-466f-bde9-81ae0076d3a8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:01.070683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97536f-a4df-42b9-8c5c-85e6ec4d7784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:01.071677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97536f-a4df-42b9-8c5c-85e6ec4d7784 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.072057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97536f-a4df-42b9-8c5c-85e6ec4d7784 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.072468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97536f-a4df-42b9-8c5c-85e6ec4d7784 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.073276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97536f-a4df-42b9-8c5c-85e6ec4d7784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:01.075060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97536f-a4df-42b9-8c5c-85e6ec4d7784 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:01.090874 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3298/6674] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:01.096672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:01.108768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b758a72-9ee8-4a9d-a064-3d3c77157e68 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:01.114232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:01.115331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.115611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.115884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] PATH_INFO: `/v3/projects/ad02053a4707469cbd80126be38998b2/users/a82fab79e8984fb7b062b7a60e5435bd/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.119359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad02053a4707469cbd80126be38998b2, user_id=a82fab79e8984fb7b062b7a60e5435bd, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:01.122939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:01.138359 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3377/6675] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:01 2022] PUT /identity/v3/projects/ad02053a4707469cbd80126be38998b2/users/a82fab79e8984fb7b062b7a60e5435bd/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:01.150699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1ceb-abd7-4a71-a3d4-03915019d991 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.151321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1ceb-abd7-4a71-a3d4-03915019d991 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.151846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1ceb-abd7-4a71-a3d4-03915019d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.204956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-db7e1ceb-abd7-4a71-a3d4-03915019d991 None None] MFA Rules not processed for user `a82fab79e8984fb7b062b7a60e5435bd`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:01.206979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-db7e1ceb-abd7-4a71-a3d4-03915019d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:01.401051 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3299/6676] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:01.404776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:01.418719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5cfe8-a50e-490f-9138-1ad15396e6a5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:01.465978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:01.466753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.467041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.467318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.468150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:01.470140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:01.532125 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3378/6677] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:01 2022] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:01.536233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1ceb-abd7-4a71-a3d4-03915019d991 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:01.555828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1ceb-abd7-4a71-a3d4-03915019d991 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:01.669387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:01.670356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.670687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.671014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-620596898` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.672387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=280178d42f4c419a9d7f30c52404c8a3, value=tempest-tag-620596898)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:01.674608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:01.698233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:01.701981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:01.829059 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-620596898. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:18:01.829059 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:18:01.829059 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:01.836595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3300/6678] 10.222.0.30 () {60 vars in 1329 bytes} [Sat Apr 9 21:18:01 2022] PUT /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-620596898 => generated 0 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Apr 09 21:18:01.840902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:01.852667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e2d9-f62e-4e01-9331-d85d9c8fc23f tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:01.857755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:01.858940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.859317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.860116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-620596898` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.873070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=280178d42f4c419a9d7f30c52404c8a3, value=tempest-tag-620596898)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:01.875413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:01.887989 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3301/6679] 10.222.0.30 () {58 vars in 1310 bytes} [Sat Apr 9 21:18:01 2022] GET /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-620596898 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:01.892083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0142-afd0-414e-a66c-278fa816adfb tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:01.893450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:01.899406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:01.900323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.900606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.900881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] PATH_INFO: `/v3/projects/489d25b5b25a49e0bc8e805a0e4c4193` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.906649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=489d25b5b25a49e0bc8e805a0e4c4193)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:01.909651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:01.919204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a51c9-b930-443a-91f4-f8a30c826af8 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:01.932951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:01.933897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:01.934176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:01.934500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:01.937098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=280178d42f4c419a9d7f30c52404c8a3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:01.941636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:01.991627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489d25b5b25a49e0bc8e805a0e4c4193', 'request_id': 'req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:01.998539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489d25b5b25a49e0bc8e805a0e4c4193', 'request_id': 'req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.026838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489d25b5b25a49e0bc8e805a0e4c4193', 'request_id': 'req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.053642 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3302/6680] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Apr 9 21:18:01 2022] PUT /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags => generated 140 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:02.054682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.059361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] The token cache is being invalidate because project 489d25b5b25a49e0bc8e805a0e4c4193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:02.060258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.061661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.065491 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3379/6681] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:01 2022] DELETE /identity/v3/projects/489d25b5b25a49e0bc8e805a0e4c4193 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:02.071652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.074303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:02.075385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dabcb4-debe-4f3e-9b61-dc8590f36f9a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:02.146423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:02.147323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:02.147602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:02.147875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:02.170271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=280178d42f4c419a9d7f30c52404c8a3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:02.172368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:02.189241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d0e55-39e3-4531-a4e5-b1ee77a38f7a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:02.199992 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3303/6682] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:18:02 2022] GET /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags => generated 140 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:02.203031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:02.204317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.205441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:02.206379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:02.206760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] PATH_INFO: `/v3/users/5b15ab7d551d4c3c8f8ceda6615f6a58` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:02.208520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:02.211768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b15ab7d551d4c3c8f8ceda6615f6a58)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:02.217164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:02.230430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1b99-53c8-4b30-baef-471bee92043a tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:02.242416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:02.243663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:02.244046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:02.244553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-1539506722` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:02.246310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=280178d42f4c419a9d7f30c52404c8a3, value=tempest-tag-1539506722)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:02.248782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:02.309510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b15ab7d551d4c3c8f8ceda6615f6a58'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.310980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b15ab7d551d4c3c8f8ceda6615f6a58'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.314765 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1539506722. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:18:02.314765 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:18:02.314765 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:02.323789 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3304/6683] 10.222.0.30 () {58 vars in 1316 bytes} [Sat Apr 9 21:18:02 2022] DELETE /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-1539506722 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:02.327977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.336737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b15ab7d551d4c3c8f8ceda6615f6a58'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.348398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140313b-f827-496d-881d-92075ec7aa61 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:02.353702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b15ab7d551d4c3c8f8ceda6615f6a58'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.353974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:02.354819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:02.355102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:02.355433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-1539506722` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:02.355790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b15ab7d551d4c3c8f8ceda6615f6a58'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.372408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=280178d42f4c419a9d7f30c52404c8a3, value=tempest-tag-1539506722)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:02.374738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:02.400617 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Could not find project tag: tempest-tag-1539506722.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1539506722. Apr 09 21:18:02.406673 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3305/6684] 10.222.0.30 () {58 vars in 1313 bytes} [Sat Apr 9 21:18:02 2022] GET /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags/tempest-tag-1539506722 => generated 107 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:02.407867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.410182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:02.418025 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3380/6685] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:02 2022] DELETE /identity/v3/users/5b15ab7d551d4c3c8f8ceda6615f6a58 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:02.501003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3ad5-1f6c-48bb-8264-59e77ca22f0d tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:02.606091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:02.607183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:02.607496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:02.607870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:02.609748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=280178d42f4c419a9d7f30c52404c8a3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:02.613648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:02.689304 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3306/6686] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:18:02 2022] DELETE /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:02.693437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.709419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe9d80-6432-4b99-9681-5d4f2c8f704a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:02.718661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:02.722574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:02.723271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:02.723617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:02.739869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=280178d42f4c419a9d7f30c52404c8a3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:02.743332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:02.766664 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3381/6687] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:18:02 2022] GET /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3/tags => generated 66 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 09 21:18:02.772158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.790983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217e2e-abb0-4e1e-8681-80b4b2e8ea85 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:02.801905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82fab79e8984fb7b062b7a60e5435bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad02053a4707469cbd80126be38998b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:02.802746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:02.803106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:02.803473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] PATH_INFO: `/v3/projects/280178d42f4c419a9d7f30c52404c8a3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:02.805503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorizing `identity:delete_project(project_id=280178d42f4c419a9d7f30c52404c8a3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:02.807573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:02.894104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280178d42f4c419a9d7f30c52404c8a3', 'request_id': 'req-699d35d8-b722-4a01-8d7f-a7381a502df3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.902229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280178d42f4c419a9d7f30c52404c8a3', 'request_id': 'req-699d35d8-b722-4a01-8d7f-a7381a502df3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.921887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280178d42f4c419a9d7f30c52404c8a3', 'request_id': 'req-699d35d8-b722-4a01-8d7f-a7381a502df3'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.948950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] The token cache is being invalidate because project 280178d42f4c419a9d7f30c52404c8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:02.953679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.955864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-699d35d8-b722-4a01-8d7f-a7381a502df3 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:02.963197 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3307/6688] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:02 2022] DELETE /identity/v3/projects/280178d42f4c419a9d7f30c52404c8a3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:02.969137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:02.970902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:03.136379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a45b2-bb2a-457c-be3e-2064475a9f03 tempest-IdentityV3ProjectTagsTest-1838646178 tempest-IdentityV3ProjectTagsTest-1838646178-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:03.246064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:03.247355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:03.247894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:03.248382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] PATH_INFO: `/v3/users/2aba2ce102ca469797461d2b4ce4db4e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:03.252469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aba2ce102ca469797461d2b4ce4db4e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:03.257698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:03.350452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aba2ce102ca469797461d2b4ce4db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:03.351254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aba2ce102ca469797461d2b4ce4db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:03.366712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aba2ce102ca469797461d2b4ce4db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:03.391567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aba2ce102ca469797461d2b4ce4db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:03.392454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aba2ce102ca469797461d2b4ce4db4e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:03.422735 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3382/6689] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:02 2022] DELETE /identity/v3/users/2aba2ce102ca469797461d2b4ce4db4e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:03.424526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc46d-a913-4874-ad62-fb2c7eda4ef2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:03.424963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc46d-a913-4874-ad62-fb2c7eda4ef2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:03.425444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc46d-a913-4874-ad62-fb2c7eda4ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:03.462580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-566bc46d-a913-4874-ad62-fb2c7eda4ef2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:03.464510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-566bc46d-a913-4874-ad62-fb2c7eda4ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:03.597924 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3308/6690] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:03.619115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:03.621987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:03.734405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2dc02-25e0-4e70-9082-ca4631487823 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:03.744899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:03.747449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:03.747449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:03.747449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:03.761435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:03.763379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:03.782914 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3383/6691] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:18:03.948728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:03.949505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:03.949895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:04.107002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:04.109096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:04.152654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:04.154291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:04.175969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9406c-012e-4ffb-8bd5-65bbe3152cf2 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:04.196980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:04.198113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:04.198397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:04.198667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] PATH_INFO: `/v3/projects/4195cba158564eedb50d0802dcd5bd89` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:04.200922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4195cba158564eedb50d0802dcd5bd89)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:04.204735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:04.270365 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3309/6692] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:04.380325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4195cba158564eedb50d0802dcd5bd89', 'request_id': 'req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:04.388118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4195cba158564eedb50d0802dcd5bd89', 'request_id': 'req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:04.392544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:04.394020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:04.414423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4195cba158564eedb50d0802dcd5bd89', 'request_id': 'req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:04.453275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] The token cache is being invalidate because project 4195cba158564eedb50d0802dcd5bd89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:04.461977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:04.463480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-fb7065b0-fa16-40a3-94e3-18a12d8c13dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:04.469681 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3384/6693] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:04 2022] DELETE /identity/v3/projects/4195cba158564eedb50d0802dcd5bd89 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:04.471367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd8e6-b58d-4257-af30-1c705c1a9f5e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:04.471664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd8e6-b58d-4257-af30-1c705c1a9f5e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:04.471944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd8e6-b58d-4257-af30-1c705c1a9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:04.511653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4b3fd8e6-b58d-4257-af30-1c705c1a9f5e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:04.512911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4b3fd8e6-b58d-4257-af30-1c705c1a9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:04.643378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af78efa-3281-46c2-ac7d-f36226c701a7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:04.656889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3385/6694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:04.671064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9814-33b8-4a06-92a4-af626f3671f7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:04.671359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9814-33b8-4a06-92a4-af626f3671f7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:04.671635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9814-33b8-4a06-92a4-af626f3671f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:04.705071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4feb9814-33b8-4a06-92a4-af626f3671f7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:04.706471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4feb9814-33b8-4a06-92a4-af626f3671f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:04.732641 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3386/6695] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:04.734047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb9814-33b8-4a06-92a4-af626f3671f7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:04.747064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb9814-33b8-4a06-92a4-af626f3671f7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:04.760463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:04.761267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:04.761550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:04.764036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:04.766106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:04.766443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:04.770261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:04.805724 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3387/6696] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:04.808973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:04.830718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefa92f-45f4-4413-aa5f-73ec73700240 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:04.831097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:04.831897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:04.832176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:04.832446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:04.834790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:04.846819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:04.848518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:04.848878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:04.849175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:04.849951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:04.853388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:04.930746 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3388/6697] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:04 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:04.931728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:04.967047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:04.969134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:04.980809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3310/6698] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:18:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:18:05.059136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920e4ab-caee-4b4a-b651-06f7719b21e8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:05.066380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:05.068212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:05.068493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:05.081552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:05.083969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:05.086554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:05.126422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3389/6699] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:04 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:05.126806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:05.136704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181c124-972d-4085-b501-b3d4d5e03680 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:05.142796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:05.143080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:05.143414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:05.143793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:05.144414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:05.146222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:05.160517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3311/6700] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:05.164496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:05.180009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3b9c2-eff9-49e9-911c-78c6b70e53ef admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:05.186237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696504-b8ae-4c4c-9bcd-03e4dc376523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:05.187484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696504-b8ae-4c4c-9bcd-03e4dc376523 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:05.187859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696504-b8ae-4c4c-9bcd-03e4dc376523 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:05.188248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696504-b8ae-4c4c-9bcd-03e4dc376523 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:05.189286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696504-b8ae-4c4c-9bcd-03e4dc376523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:05.192022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696504-b8ae-4c4c-9bcd-03e4dc376523 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:05.205855 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3390/6701] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:05.210027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:05.237308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0307e9-0d03-431e-b34d-fe5ba242c5c1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:05.263239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:05.267427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:05.269368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:05.271724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] PATH_INFO: `/v3/projects/71269fb007a54a229435791f65be549b/users/9da5fd3aed114ce39058fc16d30a86ef/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:05.315381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71269fb007a54a229435791f65be549b, user_id=9da5fd3aed114ce39058fc16d30a86ef, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:05.320226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:05.393542 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3312/6702] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:05 2022] PUT /identity/v3/projects/71269fb007a54a229435791f65be549b/users/9da5fd3aed114ce39058fc16d30a86ef/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:05.404808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810a29-e8ea-4171-95d3-a126f41b51cd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:05.405312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810a29-e8ea-4171-95d3-a126f41b51cd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:05.405690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810a29-e8ea-4171-95d3-a126f41b51cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:05.490675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b0810a29-e8ea-4171-95d3-a126f41b51cd None None] MFA Rules not processed for user `9da5fd3aed114ce39058fc16d30a86ef`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:05.492037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0810a29-e8ea-4171-95d3-a126f41b51cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:05.654879 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3391/6703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:05.657260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:05.679467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370518ac-256d-4094-a4d0-6c3e003fe77e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:05.707094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:05.707997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:05.708287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:05.724604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:05.730579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:05.748743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:05.842558 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3313/6704] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Apr 9 21:18:05 2022] POST /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2 => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:05.844037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810a29-e8ea-4171-95d3-a126f41b51cd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:05.857562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810a29-e8ea-4171-95d3-a126f41b51cd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:05.908279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:05.915632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:05.915917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:05.918128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/8a2b2696d9fb4f1886f6631f23a84c32` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:05.950112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef, credential_id=8a2b2696d9fb4f1886f6631f23a84c32)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:05.955985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:05.957833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:05.966673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.057453 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3392/6705] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Apr 9 21:18:05 2022] DELETE /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/8a2b2696d9fb4f1886f6631f23a84c32 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:06.064944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.087644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb6c0f-b2bf-4923-85c6-660787198a3e tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.093877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.096262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.096618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.097152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.098265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.100008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.137718 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3393/6706] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Apr 9 21:18:06 2022] POST /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2 => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:06.138955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.152817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d71b5-cbbe-4c97-ad24-f21b3fcd550c tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.154556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdbccf-42ad-4609-8d19-183048af2865 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.159071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.159971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.160252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.160524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/8a86738d787c47e9a21a8d30a48cd7e9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.162594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef, credential_id=8a86738d787c47e9a21a8d30a48cd7e9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.164045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.167501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.172420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.173430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.173740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] PATH_INFO: `/v3/projects/61503e913bde4c41b5d75e779e718f0b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.175317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=61503e913bde4c41b5d75e779e718f0b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.177683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.188069 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3394/6707] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Apr 9 21:18:06 2022] DELETE /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/8a86738d787c47e9a21a8d30a48cd7e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:06.192996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.210191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbe8b-5da0-4a48-b1e0-7e691b97f8f6 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.221422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5968cb-f2bc-4b28-89c3-54ecbcf0b913 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.223920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5968cb-f2bc-4b28-89c3-54ecbcf0b913 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.223920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5968cb-f2bc-4b28-89c3-54ecbcf0b913 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.224152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5968cb-f2bc-4b28-89c3-54ecbcf0b913 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/8a86738d787c47e9a21a8d30a48cd7e9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.249052 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-1b5968cb-f2bc-4b28-89c3-54ecbcf0b913 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Could not find credential: 8080cfab02482bfece1bc5da0f39d497242ccd2928a8d86e03b5120df1176ff3.: keystone.exception.CredentialNotFound: Could not find credential: 8080cfab02482bfece1bc5da0f39d497242ccd2928a8d86e03b5120df1176ff3. Apr 09 21:18:06.253349 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3395/6708] 10.222.0.30 () {58 vars in 1376 bytes} [Sat Apr 9 21:18:06 2022] GET /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/8a86738d787c47e9a21a8d30a48cd7e9 => generated 148 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:18:06.254360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5968cb-f2bc-4b28-89c3-54ecbcf0b913 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.279824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5968cb-f2bc-4b28-89c3-54ecbcf0b913 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.298442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61503e913bde4c41b5d75e779e718f0b', 'request_id': 'req-2958b0f0-bab5-4519-a24a-fc5af2730d0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.309399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61503e913bde4c41b5d75e779e718f0b', 'request_id': 'req-2958b0f0-bab5-4519-a24a-fc5af2730d0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.324626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61503e913bde4c41b5d75e779e718f0b', 'request_id': 'req-2958b0f0-bab5-4519-a24a-fc5af2730d0c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.344096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] The token cache is being invalidate because project 61503e913bde4c41b5d75e779e718f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:06.344416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.346000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.348571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3314/6709] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:05 2022] DELETE /identity/v3/projects/61503e913bde4c41b5d75e779e718f0b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:06.352940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.356013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:06.368762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.369651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.369933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.370778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.371076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.374390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.398156 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3396/6710] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Apr 9 21:18:06 2022] POST /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2 => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:06.402380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.404183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:06.419812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d11db-fe7d-41f5-b731-0e26be1a22a1 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.457316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.458632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.459166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.459652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.461292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.463289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.503150 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3397/6711] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Apr 9 21:18:06 2022] POST /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2 => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:06.506390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.509154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b0f0-bab5-4519-a24a-fc5af2730d0c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.520230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.521304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.521671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.522099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] PATH_INFO: `/v3/users/a82fab79e8984fb7b062b7a60e5435bd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.523553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82fab79e8984fb7b062b7a60e5435bd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.524438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209216-3660-49c1-bc21-ea20060ba2d2 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.525907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.543390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.544294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.544575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.544848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.545534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=9da5fd3aed114ce39058fc16d30a86ef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.547976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.573152 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3398/6712] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Apr 9 21:18:06 2022] GET /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2 => generated 865 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:06.576309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.602513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82fab79e8984fb7b062b7a60e5435bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.604009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82fab79e8984fb7b062b7a60e5435bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.607289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6ee3-d912-4dcb-969a-877458b42403 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.613272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82fab79e8984fb7b062b7a60e5435bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.614494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82fab79e8984fb7b062b7a60e5435bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.617349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.618538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.621287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.622151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/19840f890dfc43afb646daeb9f641410` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.625790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef, credential_id=19840f890dfc43afb646daeb9f641410)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.627547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.629445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82fab79e8984fb7b062b7a60e5435bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:06.670290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3399/6714] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Apr 9 21:18:06 2022] DELETE /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/19840f890dfc43afb646daeb9f641410 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:06.670528 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3315/6714] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:06 2022] DELETE /identity/v3/users/a82fab79e8984fb7b062b7a60e5435bd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:06.673853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.675718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:06.696369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f3b4f-dff1-4f22-ab02-d0af3c673445 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.789715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.791675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.791966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.792241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/b81cb09be5304bb1a07d07456a0a9408` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.794426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef, credential_id=b81cb09be5304bb1a07d07456a0a9408)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.795887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.831499 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3400/6715] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Apr 9 21:18:06 2022] DELETE /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/b81cb09be5304bb1a07d07456a0a9408 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:06.836737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.850680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f540b74-9d3b-489b-b87c-77f2ecd17a47 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.866446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.867790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.868323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.868719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.869603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.871433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.902554 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3316/6716] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Apr 9 21:18:06 2022] POST /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2 => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:06.906829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.917657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275f7c-1c68-4142-88d9-117e526da18f tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.933933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.935296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.936745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.937528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/e1678f24053b4a78b9459149d4e419b1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.942526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef, credential_id=e1678f24053b4a78b9459149d4e419b1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.944255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:06.957159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:06.957750 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3401/6717] 10.222.0.30 () {58 vars in 1376 bytes} [Sat Apr 9 21:18:06 2022] GET /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/e1678f24053b4a78b9459149d4e419b1 => generated 367 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:06.975516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915db406-ef27-4da1-885d-a870182bf5a3 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:06.982146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1f6a1-f719-4049-9166-9c3ce8aac458 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da5fd3aed114ce39058fc16d30a86ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71269fb007a54a229435791f65be549b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:06.983377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1f6a1-f719-4049-9166-9c3ce8aac458 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:06.983815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1f6a1-f719-4049-9166-9c3ce8aac458 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:06.984263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1f6a1-f719-4049-9166-9c3ce8aac458 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/e1678f24053b4a78b9459149d4e419b1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:06.991330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1f6a1-f719-4049-9166-9c3ce8aac458 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9da5fd3aed114ce39058fc16d30a86ef, credential_id=e1678f24053b4a78b9459149d4e419b1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:06.993274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1f6a1-f719-4049-9166-9c3ce8aac458 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:07.033606 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3317/6718] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Apr 9 21:18:06 2022] DELETE /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef/credentials/OS-EC2/e1678f24053b4a78b9459149d4e419b1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:07.038742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:07.040651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:07.173483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa25582-2b9f-49fa-85f4-970767188212 tempest-EC2CredentialsTest-1675777677 tempest-EC2CredentialsTest-1675777677-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:07.186233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:07.187424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:07.187803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:07.188193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] PATH_INFO: `/v3/users/9da5fd3aed114ce39058fc16d30a86ef` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:07.190264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da5fd3aed114ce39058fc16d30a86ef)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:07.192491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:07.273006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da5fd3aed114ce39058fc16d30a86ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.274162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da5fd3aed114ce39058fc16d30a86ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.284036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da5fd3aed114ce39058fc16d30a86ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.296040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da5fd3aed114ce39058fc16d30a86ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.296925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da5fd3aed114ce39058fc16d30a86ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.326065 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3402/6719] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:07 2022] DELETE /identity/v3/users/9da5fd3aed114ce39058fc16d30a86ef => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:07.326625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:07.327122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:07.327226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:07.364220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:07.365522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:07.496795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3318/6720] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:07.571784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:07.574424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:07.613378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:07.615101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:07.636810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a1645-b758-4f1e-bd74-5faba38c6632 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:07.649502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:07.650321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:07.650593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:07.650856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] PATH_INFO: `/v3/projects/ad02053a4707469cbd80126be38998b2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:07.652607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad02053a4707469cbd80126be38998b2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:07.654037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:07.773866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad02053a4707469cbd80126be38998b2', 'request_id': 'req-00314cd5-c77c-4eb0-b2ac-486202e084e1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.785293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad02053a4707469cbd80126be38998b2', 'request_id': 'req-00314cd5-c77c-4eb0-b2ac-486202e084e1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.805538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad02053a4707469cbd80126be38998b2', 'request_id': 'req-00314cd5-c77c-4eb0-b2ac-486202e084e1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.816401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a09c0f-7d2e-4e12-bdb0-91482e480375 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:07.831247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] The token cache is being invalidate because project ad02053a4707469cbd80126be38998b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:07.831541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.834578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-00314cd5-c77c-4eb0-b2ac-486202e084e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:07.843795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3319/6721] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:07 2022] DELETE /identity/v3/projects/ad02053a4707469cbd80126be38998b2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:07.847211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039eed9-d050-48ab-90fe-1a625c577ffc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:07.847493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039eed9-d050-48ab-90fe-1a625c577ffc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:07.848330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039eed9-d050-48ab-90fe-1a625c577ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:07.902298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6039eed9-d050-48ab-90fe-1a625c577ffc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:07.903982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6039eed9-d050-48ab-90fe-1a625c577ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:07.935216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991f621-b831-477a-949d-167632011bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:07.935908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991f621-b831-477a-949d-167632011bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:07.936184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991f621-b831-477a-949d-167632011bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:07.936461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991f621-b831-477a-949d-167632011bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:07.938934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4991f621-b831-477a-949d-167632011bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:08.011673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991f621-b831-477a-949d-167632011bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:08.013192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991f621-b831-477a-949d-167632011bc8 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:08.024246 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3403/6722] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:08.053341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3320/6723] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:08.176407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e521-b5f0-4b0f-9532-2500ce5c4573 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.176794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e521-b5f0-4b0f-9532-2500ce5c4573 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.177050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e521-b5f0-4b0f-9532-2500ce5c4573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:08.217162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e050e521-b5f0-4b0f-9532-2500ce5c4573 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:08.218420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e050e521-b5f0-4b0f-9532-2500ce5c4573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:08.231282 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3404/6724] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:08.233016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039eed9-d050-48ab-90fe-1a625c577ffc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:08.264344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039eed9-d050-48ab-90fe-1a625c577ffc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:08.283532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:08.297718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.297985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.298266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:08.301193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:08.302473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:08.309395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:08.338539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e521-b5f0-4b0f-9532-2500ce5c4573 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:08.341472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3321/6725] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:18:08.352475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e521-b5f0-4b0f-9532-2500ce5c4573 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:08.363527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:08.365803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.366265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.367232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:08.368905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:08.371904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:08.452704 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3405/6726] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:08 2022] POST /identity/v3/projects => generated 395 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:08.456733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:08.475465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdc458-3942-40f0-b702-48fb06aa175d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:08.605852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:08.606479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.606755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.607028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:08.614446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:08.616475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:08.644988 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3322/6727] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:08 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:08.647626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:08.666802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b462e9-8c9e-4f0b-a7f8-fec0ccda332f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:08.687567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:08.688311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.688600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.688879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:08.698920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:08.700929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:08.758744 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3406/6728] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:08.763221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:08.780546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac3f52-e3b0-4287-8b97-94874d7f8681 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:08.793375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194197b9-7915-4e2e-a3ae-a50bd305d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:08.794811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194197b9-7915-4e2e-a3ae-a50bd305d672 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.795302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194197b9-7915-4e2e-a3ae-a50bd305d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.795813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194197b9-7915-4e2e-a3ae-a50bd305d672 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:08.796815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194197b9-7915-4e2e-a3ae-a50bd305d672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:08.799092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194197b9-7915-4e2e-a3ae-a50bd305d672 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:08.818674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3323/6729] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:08.819920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:08.835108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98699472-49fd-4850-a62d-2291e9dd6b6f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:08.862000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:08.865705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.868139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.868483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] PATH_INFO: `/v3/projects/8c1d69f811d14e88b72bed054ef72a2d/users/d94ca57b5f9444628b68749ff0c6201d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:08.919940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1d69f811d14e88b72bed054ef72a2d, user_id=d94ca57b5f9444628b68749ff0c6201d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:08.922674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:08.967403 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3407/6730] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:08 2022] PUT /identity/v3/projects/8c1d69f811d14e88b72bed054ef72a2d/users/d94ca57b5f9444628b68749ff0c6201d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:08.972235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e3228-db22-4c10-aa92-3e7cf1d37abd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:08.973241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e3228-db22-4c10-aa92-3e7cf1d37abd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:08.973765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e3228-db22-4c10-aa92-3e7cf1d37abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:09.044757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ec9e3228-db22-4c10-aa92-3e7cf1d37abd None None] MFA Rules not processed for user `d94ca57b5f9444628b68749ff0c6201d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:09.046570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec9e3228-db22-4c10-aa92-3e7cf1d37abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:09.220528 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3324/6731] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:09.221761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:09.367964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb337-c2e4-4c67-a0fa-48fa93e7e6d1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:09.381863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:09.382746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:09.383130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:09.383505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:09.384321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:09.386516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:09.447056 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3408/6732] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:09 2022] POST /identity/v3/projects => generated 397 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:09.449550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e3228-db22-4c10-aa92-3e7cf1d37abd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:09.517220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e3228-db22-4c10-aa92-3e7cf1d37abd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:09.673743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:09.674447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:09.674724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:09.675000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:09.675715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:09.678361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:09.717728 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3325/6733] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:09 2022] POST /identity/v3/users => generated 305 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:09.721483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:09.739297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aedfa-5205-46aa-ad14-2e981e35c8b6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:09.748365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:09.749897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:09.749897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:09.750061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:09.750673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:09.758066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:09.806017 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3409/6734] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:09.810287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:09.833024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54173-73a1-4c21-ab60-5b64d38d7e8e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:09.840853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:09.843392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:09.844848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:09.845698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] PATH_INFO: `/v3/projects/e586c3fad30f4212a2bba8c9e58d73dd/users/2e96c44a372b43958143f5db8d65b072/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:09.884194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e586c3fad30f4212a2bba8c9e58d73dd, user_id=2e96c44a372b43958143f5db8d65b072, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:09.888221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:09.930240 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3326/6735] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:09 2022] PUT /identity/v3/projects/e586c3fad30f4212a2bba8c9e58d73dd/users/2e96c44a372b43958143f5db8d65b072/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:09.933799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:09.950892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02024e6-523a-411c-bbe2-ac3698671642 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:10.086998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fb427-a112-4f40-9e74-d92af037bae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:10.087711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb427-a112-4f40-9e74-d92af037bae8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.087995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb427-a112-4f40-9e74-d92af037bae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.088268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb427-a112-4f40-9e74-d92af037bae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.089274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb427-a112-4f40-9e74-d92af037bae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:10.090686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb427-a112-4f40-9e74-d92af037bae8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:10.116621 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3410/6736] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:10.121542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:10.135219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dacfd-b8d2-4570-963e-14beeeec07ad admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:10.159544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:10.166276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.166577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.166851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] PATH_INFO: `/v3/projects/e586c3fad30f4212a2bba8c9e58d73dd/users/2e96c44a372b43958143f5db8d65b072/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.177268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e586c3fad30f4212a2bba8c9e58d73dd, user_id=2e96c44a372b43958143f5db8d65b072, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:10.180000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:10.242575 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3327/6737] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:10 2022] PUT /identity/v3/projects/e586c3fad30f4212a2bba8c9e58d73dd/users/2e96c44a372b43958143f5db8d65b072/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:10.252954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f4a61-80a1-4c60-a243-53c6d30e3dee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.253273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f4a61-80a1-4c60-a243-53c6d30e3dee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.253553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f4a61-80a1-4c60-a243-53c6d30e3dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.312217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c75f4a61-80a1-4c60-a243-53c6d30e3dee None None] MFA Rules not processed for user `2e96c44a372b43958143f5db8d65b072`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:10.313598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c75f4a61-80a1-4c60-a243-53c6d30e3dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:10.501476 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3411/6738] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:10.502427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:10.651375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905604e-04c5-49c3-8f62-28cc1ae1567f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:10.661560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94ca57b5f9444628b68749ff0c6201d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c1d69f811d14e88b72bed054ef72a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:10.662616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.664133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.664882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.665823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:10.676397 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Apr 09 21:18:10.688339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f4a61-80a1-4c60-a243-53c6d30e3dee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:10.695688 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3328/6739] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:18:10 2022] POST /identity/v3/projects => generated 136 bytes in 194 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:10.699779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f4a61-80a1-4c60-a243-53c6d30e3dee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:10.705295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e96c44a372b43958143f5db8d65b072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e586c3fad30f4212a2bba8c9e58d73dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:10.706231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.706748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.707246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.708448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:10.710606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:10.717298 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Invalid input for field 'name': '' is too short Apr 09 21:18:10.717298 ncdv-master-1 devstack@keystone.service[102532]: Failed validating 'minLength' in schema['properties']['name']: Apr 09 21:18:10.717298 ncdv-master-1 devstack@keystone.service[102532]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 09 21:18:10.717298 ncdv-master-1 devstack@keystone.service[102532]: On instance['name']: Apr 09 21:18:10.717298 ncdv-master-1 devstack@keystone.service[102532]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 09 21:18:10.726283 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3412/6740] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:18:10 2022] POST /identity/v3/projects => generated 283 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:18:10.726656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:10.778419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d08af-de3a-4673-ad8c-7df8a3fa425f tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:10.823016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e96c44a372b43958143f5db8d65b072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e586c3fad30f4212a2bba8c9e58d73dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:10.824335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.824631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.824910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.825820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:10.827931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:10.848026 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 09 21:18:10.848026 ncdv-master-1 devstack@keystone.service[102531]: Failed validating 'maxLength' in schema['properties']['name']: Apr 09 21:18:10.848026 ncdv-master-1 devstack@keystone.service[102531]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 09 21:18:10.848026 ncdv-master-1 devstack@keystone.service[102531]: On instance['name']: Apr 09 21:18:10.848026 ncdv-master-1 devstack@keystone.service[102531]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 09 21:18:10.850467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3329/6741] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:18:10 2022] POST /identity/v3/projects => generated 412 bytes in 124 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:18:10.859164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:10.871885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b446ac0-0505-49bb-b521-178d2f5d5cb6 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:10.881996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e96c44a372b43958143f5db8d65b072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e586c3fad30f4212a2bba8c9e58d73dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:10.883199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.883488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.883766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] PATH_INFO: `/v3/projects/c1c281ab26a442c99c8997b7550f6041` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.906392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1c281ab26a442c99c8997b7550f6041)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:10.908661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:10.947010 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Could not find project: c1c281ab26a442c99c8997b7550f6041.: keystone.exception.ProjectNotFound: Could not find project: c1c281ab26a442c99c8997b7550f6041. Apr 09 21:18:10.955072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:10.955448 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3413/6742] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:10 2022] DELETE /identity/v3/projects/c1c281ab26a442c99c8997b7550f6041 => generated 113 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:10.975063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aa958-2177-4220-baa0-7157c2a1f108 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:10.983940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94ca57b5f9444628b68749ff0c6201d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c1d69f811d14e88b72bed054ef72a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:10.985873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:10.986430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:10.986922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:10.987918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:11.005748 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Apr 09 21:18:11.007749 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3330/6743] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:18:10 2022] GET /identity/v3/projects => generated 135 bytes in 53 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:18:11.014656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:11.028516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c554748-9fcc-4635-a980-4d16e6e31b09 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:11.044907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e96c44a372b43958143f5db8d65b072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e586c3fad30f4212a2bba8c9e58d73dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:11.045118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:11.047059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:11.048168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:11.051423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:11.055411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:11.149601 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3414/6744] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:11 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:11.154360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:11.170489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cbdbc-9dc5-48ee-9f7b-ee2f7966cf95 tempest-ProjectsNegativeStaticTestJSON-594790697 tempest-ProjectsNegativeStaticTestJSON-594790697-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:11.227577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:11.230937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:11.304339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e96c44a372b43958143f5db8d65b072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e586c3fad30f4212a2bba8c9e58d73dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:11.305481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:11.305918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:11.306373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:11.307383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:11.309640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:11.370680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.sql.core [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-897387358' for key 'project.ixu_project_name_domain_id'") Apr 09 21:18:11.370680 ncdv-master-1 devstack@keystone.service[102531]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 09 21:18:11.370680 ncdv-master-1 devstack@keystone.service[102531]: [parameters: {'id': 'cdea6047d5144baaafa407eaeaa451ea', 'name': 'tempest-project-dup-897387358', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 09 21:18:11.370680 ncdv-master-1 devstack@keystone.service[102531]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102531) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 09 21:18:11.385328 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-897387358, project id cdea6047d5144baaafa407eaeaa451ea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-897387358, project id cdea6047d5144baaafa407eaeaa451ea. Apr 09 21:18:11.406753 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3331/6745] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:18:11 2022] POST /identity/v3/projects => generated 284 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 09 21:18:11.409871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:11.447948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d336b2-87c5-4c5e-a65f-5254baf2065c tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:11.478918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e96c44a372b43958143f5db8d65b072', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e586c3fad30f4212a2bba8c9e58d73dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:11.479815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:11.480097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:11.480568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] PATH_INFO: `/v3/projects/661a6f9dbfe442e7a96574bd4c18fa19` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:11.483789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorizing `identity:delete_project(project_id=661a6f9dbfe442e7a96574bd4c18fa19)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:11.486607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:11.488389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcf531-74cb-4653-92a1-ae88ae3019e9 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:11.503173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:11.504407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:11.504959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:11.505428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] PATH_INFO: `/v3/projects/71269fb007a54a229435791f65be549b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:11.507663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71269fb007a54a229435791f65be549b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:11.510564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:11.632600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661a6f9dbfe442e7a96574bd4c18fa19', 'request_id': 'req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.662276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661a6f9dbfe442e7a96574bd4c18fa19', 'request_id': 'req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.675658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71269fb007a54a229435791f65be549b', 'request_id': 'req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.686153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71269fb007a54a229435791f65be549b', 'request_id': 'req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.688500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661a6f9dbfe442e7a96574bd4c18fa19', 'request_id': 'req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.711362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] The token cache is being invalidate because project 661a6f9dbfe442e7a96574bd4c18fa19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:11.711594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.721615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71269fb007a54a229435791f65be549b', 'request_id': 'req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.733473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.737670 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3332/6746] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:11 2022] DELETE /identity/v3/projects/661a6f9dbfe442e7a96574bd4c18fa19 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:11.751198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:11.758013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:11.767896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] The token cache is being invalidate because project 71269fb007a54a229435791f65be549b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:11.770835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.775921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e1f39bb-b7a0-4d7e-92cf-ab20b2d33716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:11.778092 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3415/6747] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:11 2022] DELETE /identity/v3/projects/71269fb007a54a229435791f65be549b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:11.783423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69ffa-95ca-4fa7-9dc8-b1cb36df8ad9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:11.783848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69ffa-95ca-4fa7-9dc8-b1cb36df8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:11.784938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69ffa-95ca-4fa7-9dc8-b1cb36df8ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:11.844026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b2a69ffa-95ca-4fa7-9dc8-b1cb36df8ad9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:11.845358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b2a69ffa-95ca-4fa7-9dc8-b1cb36df8ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:11.977378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba2cec-de54-4de1-8549-1f5602dbd9d4 tempest-ProjectsNegativeStaticTestJSON-1622272408 tempest-ProjectsNegativeStaticTestJSON-1622272408-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.032232 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3416/6748] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:12.042382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb613755-8c3c-4c92-bcc4-e52e39b02e0b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.043024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb613755-8c3c-4c92-bcc4-e52e39b02e0b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.043513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb613755-8c3c-4c92-bcc4-e52e39b02e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.065730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bb613755-8c3c-4c92-bcc4-e52e39b02e0b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:12.067371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bb613755-8c3c-4c92-bcc4-e52e39b02e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:12.083282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.084393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3417/6749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:12.085486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.086034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.086444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb613755-8c3c-4c92-bcc4-e52e39b02e0b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:12.088192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] PATH_INFO: `/v3/users/d94ca57b5f9444628b68749ff0c6201d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.090033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94ca57b5f9444628b68749ff0c6201d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.092937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.102521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb613755-8c3c-4c92-bcc4-e52e39b02e0b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.137773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.138593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.139050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.139579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.140493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:12.140961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.144363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.165329 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3418/6750] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:12.167311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:12.179440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d54e-829d-4021-8443-b434a93def90 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.184613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.185822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.186292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.186911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.187943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.190142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.197316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94ca57b5f9444628b68749ff0c6201d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:12.198141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94ca57b5f9444628b68749ff0c6201d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:12.217140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94ca57b5f9444628b68749ff0c6201d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:12.218359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94ca57b5f9444628b68749ff0c6201d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:12.237684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3b5d803-66f7-4956-b693-877065a430ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94ca57b5f9444628b68749ff0c6201d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:12.241569 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3419/6751] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:12 2022] POST /identity/v3/projects => generated 361 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:12.242641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:12.244483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:12.326910 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3333/6752] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:11 2022] DELETE /identity/v3/users/d94ca57b5f9444628b68749ff0c6201d => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:12.331774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261925-73d2-4adb-bb15-c87a85edb1c8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.332067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261925-73d2-4adb-bb15-c87a85edb1c8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.332348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261925-73d2-4adb-bb15-c87a85edb1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.349131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97591f-dc42-4942-b601-f7b9d36a51be admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.370126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9d261925-73d2-4adb-bb15-c87a85edb1c8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:12.371444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9d261925-73d2-4adb-bb15-c87a85edb1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:12.521341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.524902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.525251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.525548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.526275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.528278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.564502 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3334/6753] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:12.589257 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3420/6754] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:12 2022] POST /identity/v3/users => generated 281 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:12.590873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261925-73d2-4adb-bb15-c87a85edb1c8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:12.611533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261925-73d2-4adb-bb15-c87a85edb1c8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.615314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:12.620307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:12.633011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.634084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.634372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.634651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.635395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.637156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.673955 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3335/6755] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:12.679674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:12.701949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e834cc-eb57-469b-914a-3e73f81fdb91 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.732832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.733335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.733618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.733894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.734634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.736286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.781138 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3336/6756] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:12.782640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:12.798509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76505f-079b-46db-ac2c-44ed28141427 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.799468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e92fa-31d7-44e7-89f0-72c21914212b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:12.805010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece690f-fefb-438d-b4e6-e8213b8f7364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.805817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece690f-fefb-438d-b4e6-e8213b8f7364 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.806061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d31f1a-cca0-475c-b403-ebbc0344e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:12.806192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece690f-fefb-438d-b4e6-e8213b8f7364 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.806417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece690f-fefb-438d-b4e6-e8213b8f7364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.809870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d31f1a-cca0-475c-b403-ebbc0344e758 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.810583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d31f1a-cca0-475c-b403-ebbc0344e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.811150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d31f1a-cca0-475c-b403-ebbc0344e758 admin admin] PATH_INFO: `/v3/projects/351e5c0803cb4daa8789a2bcceac847a/users/1b1ed521f46a4d38966c6aaf3c52b015/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:12.828221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece690f-fefb-438d-b4e6-e8213b8f7364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.830162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece690f-fefb-438d-b4e6-e8213b8f7364 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.859138 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3421/6757] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:12.889148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d31f1a-cca0-475c-b403-ebbc0344e758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351e5c0803cb4daa8789a2bcceac847a, user_id=1b1ed521f46a4d38966c6aaf3c52b015, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:12.901215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d31f1a-cca0-475c-b403-ebbc0344e758 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:12.930674 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3337/6758] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:12 2022] PUT /identity/v3/projects/351e5c0803cb4daa8789a2bcceac847a/users/1b1ed521f46a4d38966c6aaf3c52b015/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:12.941611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b463bb-e02b-4bf2-a77f-31a0f9a4dcda None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:12.941900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b463bb-e02b-4bf2-a77f-31a0f9a4dcda None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:12.942422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b463bb-e02b-4bf2-a77f-31a0f9a4dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.003385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-64b463bb-e02b-4bf2-a77f-31a0f9a4dcda None None] MFA Rules not processed for user `1b1ed521f46a4d38966c6aaf3c52b015`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:13.004952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-64b463bb-e02b-4bf2-a77f-31a0f9a4dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:13.171985 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3422/6759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:13.178592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421873-1f2e-43f8-ae90-5255c0b2997c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.179168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421873-1f2e-43f8-ae90-5255c0b2997c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.179451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421873-1f2e-43f8-ae90-5255c0b2997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.212464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0d421873-1f2e-43f8-ae90-5255c0b2997c None None] MFA Rules not processed for user `1b1ed521f46a4d38966c6aaf3c52b015`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:13.217854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0d421873-1f2e-43f8-ae90-5255c0b2997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:13.241388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c7e1-2520-4a41-937a-fce07323d0c3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.241893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c7e1-2520-4a41-937a-fce07323d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.242165 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3338/6760] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:13 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:18:13.242351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c7e1-2520-4a41-937a-fce07323d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.284643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2808c7e1-2520-4a41-937a-fce07323d0c3 None None] MFA Rules not processed for user `1b1ed521f46a4d38966c6aaf3c52b015`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:13.285776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2808c7e1-2520-4a41-937a-fce07323d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:13.301800 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3423/6761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:13 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 09 21:18:13.305966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421873-1f2e-43f8-ae90-5255c0b2997c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:13.323190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421873-1f2e-43f8-ae90-5255c0b2997c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:13.340823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b1ed521f46a4d38966c6aaf3c52b015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351e5c0803cb4daa8789a2bcceac847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:13.341849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.342607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.342607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.355875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorizing `identity:check_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:13.360748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:13.387766 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3339/6762] 10.222.0.30 () {56 vars in 1263 bytes} [Sat Apr 9 21:18:13 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Apr 09 21:18:13.388438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808c7e1-2520-4a41-937a-fce07323d0c3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:13.407372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808c7e1-2520-4a41-937a-fce07323d0c3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:13.417760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b1ed521f46a4d38966c6aaf3c52b015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351e5c0803cb4daa8789a2bcceac847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:13.419592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.419880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.420155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.436519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:13.449922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:13.479628 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3424/6763] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Apr 9 21:18:13 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:13.483968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:13.495883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b0594-0644-44fc-9b9d-5ef6496e5d0a tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:13.529854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debeccb-9a21-4fa0-aadd-f2390328351b tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b1ed521f46a4d38966c6aaf3c52b015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351e5c0803cb4daa8789a2bcceac847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:13.530480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debeccb-9a21-4fa0-aadd-f2390328351b tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.530764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debeccb-9a21-4fa0-aadd-f2390328351b tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.531312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debeccb-9a21-4fa0-aadd-f2390328351b tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.554791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debeccb-9a21-4fa0-aadd-f2390328351b tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:13.556730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debeccb-9a21-4fa0-aadd-f2390328351b tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:13.589599 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3340/6764] 10.222.0.30 () {56 vars in 1265 bytes} [Sat Apr 9 21:18:13 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:13.594257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:13.607492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b1f4c-da41-4107-8876-198a810c87d7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:13.640349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b1ed521f46a4d38966c6aaf3c52b015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351e5c0803cb4daa8789a2bcceac847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:13.642681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.645913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.648937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.656860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:13.684699 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 09 21:18:13.688578 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3425/6765] 10.222.0.30 () {56 vars in 1263 bytes} [Sat Apr 9 21:18:13 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Apr 09 21:18:13.694264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bb01e-64c6-49a4-a64e-97fe30c358f9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.694837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bb01e-64c6-49a4-a64e-97fe30c358f9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.694837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bb01e-64c6-49a4-a64e-97fe30c358f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.727747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1b8bb01e-64c6-49a4-a64e-97fe30c358f9 None None] MFA Rules not processed for user `1b1ed521f46a4d38966c6aaf3c52b015`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:13.730755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1b8bb01e-64c6-49a4-a64e-97fe30c358f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:13.739842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3341/6766] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:13 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 09 21:18:13.744334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:13.767861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307f9d-29f8-4b7c-b46a-aadfb7ca6886 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:13.786751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b1ed521f46a4d38966c6aaf3c52b015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351e5c0803cb4daa8789a2bcceac847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:13.788606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.788894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.789222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.804831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:13.806682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:13.828865 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3426/6767] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Apr 9 21:18:13 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:13.832961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bb01e-64c6-49a4-a64e-97fe30c358f9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:13.857680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bb01e-64c6-49a4-a64e-97fe30c358f9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:13.862351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b1ed521f46a4d38966c6aaf3c52b015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351e5c0803cb4daa8789a2bcceac847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:13.863252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.863720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.864212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.876671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:13.878553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:13.914070 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3342/6768] 10.222.0.30 () {56 vars in 1265 bytes} [Sat Apr 9 21:18:13 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:13.918285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:13.928039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf42ff0-88d8-41f1-a953-c3375213a9b7 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:13.941779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a941b-7f46-45ce-ac2b-6d38f5e988a9 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b1ed521f46a4d38966c6aaf3c52b015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351e5c0803cb4daa8789a2bcceac847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:13.943111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a941b-7f46-45ce-ac2b-6d38f5e988a9 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:13.943111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a941b-7f46-45ce-ac2b-6d38f5e988a9 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:13.943327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a941b-7f46-45ce-ac2b-6d38f5e988a9 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:13.948749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a70a941b-7f46-45ce-ac2b-6d38f5e988a9 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:13.975962 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-a70a941b-7f46-45ce-ac2b-6d38f5e988a9 tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 09 21:18:13.982330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3427/6769] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Apr 9 21:18:13 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 21:18:13.991389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:14.141393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc4b39-25ae-4d73-8c8e-cfc13a6c4c6d tempest-TokensV3Test-1409544776 tempest-TokensV3Test-1409544776-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:14.158680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:14.160016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:14.161948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:14.163128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] PATH_INFO: `/v3/users/1b1ed521f46a4d38966c6aaf3c52b015` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:14.167534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1ed521f46a4d38966c6aaf3c52b015)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:14.171251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:14.306444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1ed521f46a4d38966c6aaf3c52b015'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:14.307429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1ed521f46a4d38966c6aaf3c52b015'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:14.329056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1ed521f46a4d38966c6aaf3c52b015'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:14.332857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1ed521f46a4d38966c6aaf3c52b015'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:14.363877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1ed521f46a4d38966c6aaf3c52b015'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:14.399901 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3343/6770] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:13 2022] DELETE /identity/v3/users/1b1ed521f46a4d38966c6aaf3c52b015 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:14.401503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:14.401975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:14.402061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:14.436319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:14.440517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:14.654487 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3428/6771] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:14.709367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:14.716066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:14.848238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1ccb2-8dbf-4216-b6bc-6373894d7b24 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:14.860315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcab0e2-24ab-4587-9216-ecb94a5a3774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:14.861208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcab0e2-24ab-4587-9216-ecb94a5a3774 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:14.861494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcab0e2-24ab-4587-9216-ecb94a5a3774 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:14.861769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcab0e2-24ab-4587-9216-ecb94a5a3774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:14.888157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcab0e2-24ab-4587-9216-ecb94a5a3774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:14.890984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcab0e2-24ab-4587-9216-ecb94a5a3774 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:14.924084 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3344/6772] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:16.619050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:16.621284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:16.642164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943b472-93db-4578-9241-6ba9a168e525 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:16.655830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:16.664170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:16.664659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:16.665351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] PATH_INFO: `/v3/projects/351e5c0803cb4daa8789a2bcceac847a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:16.667842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=351e5c0803cb4daa8789a2bcceac847a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:16.672987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:16.803015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351e5c0803cb4daa8789a2bcceac847a', 'request_id': 'req-55f9c341-813b-4703-a3d5-07857bf05bfa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:16.821649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351e5c0803cb4daa8789a2bcceac847a', 'request_id': 'req-55f9c341-813b-4703-a3d5-07857bf05bfa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:16.842072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351e5c0803cb4daa8789a2bcceac847a', 'request_id': 'req-55f9c341-813b-4703-a3d5-07857bf05bfa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:16.871013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] The token cache is being invalidate because project 351e5c0803cb4daa8789a2bcceac847a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:16.871321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:16.873166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-55f9c341-813b-4703-a3d5-07857bf05bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:16.877735 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3429/6773] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:16 2022] DELETE /identity/v3/projects/351e5c0803cb4daa8789a2bcceac847a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:16.885398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10713213-f786-4fac-806c-f9fe658f783c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:16.886013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10713213-f786-4fac-806c-f9fe658f783c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:16.886013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10713213-f786-4fac-806c-f9fe658f783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:16.940100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-10713213-f786-4fac-806c-f9fe658f783c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:16.943317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-10713213-f786-4fac-806c-f9fe658f783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:17.129397 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3345/6774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:17.132986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e340a-9c0f-470e-88f8-2068312c70da None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:17.132986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e340a-9c0f-470e-88f8-2068312c70da None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:17.133280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e340a-9c0f-470e-88f8-2068312c70da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:17.171351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cb7e340a-9c0f-470e-88f8-2068312c70da None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:17.176745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cb7e340a-9c0f-470e-88f8-2068312c70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:17.189502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10713213-f786-4fac-806c-f9fe658f783c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:17.192174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-10713213-f786-4fac-806c-f9fe658f783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:17.218653 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3430/6775] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:17.219453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10713213-f786-4fac-806c-f9fe658f783c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:17.220531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e340a-9c0f-470e-88f8-2068312c70da None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:17.232868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:17.236207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:17.238475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:17.238980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] PATH_INFO: `/v3/projects/8c1d69f811d14e88b72bed054ef72a2d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:17.242154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1d69f811d14e88b72bed054ef72a2d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:17.244011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e340a-9c0f-470e-88f8-2068312c70da None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:17.249068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:17.259506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:17.262592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:17.263219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:17.263699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:17.265899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:17.266934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:17.270362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:17.291776 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3431/6776] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:17.294758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:17.306937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779531fc-c4d2-424a-a619-6c3dd6df4a10 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:17.326843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:17.329961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:17.330533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:17.330905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:17.332779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:17.337796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:17.407660 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3432/6777] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:17 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:17.409199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:17.467691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1d69f811d14e88b72bed054ef72a2d', 'request_id': 'req-18f026ed-822b-47b8-8e03-b99cb84e2103'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.474365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1d69f811d14e88b72bed054ef72a2d', 'request_id': 'req-18f026ed-822b-47b8-8e03-b99cb84e2103'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.513782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1d69f811d14e88b72bed054ef72a2d', 'request_id': 'req-18f026ed-822b-47b8-8e03-b99cb84e2103'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.565557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] The token cache is being invalidate because project 8c1d69f811d14e88b72bed054ef72a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:17.572763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.575428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.578532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3346/6778] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:17 2022] DELETE /identity/v3/projects/8c1d69f811d14e88b72bed054ef72a2d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:17.582277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:17.584150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:17.631064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc416646-70b9-47fa-ab26-11850ccf90af admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:17.748859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f026ed-822b-47b8-8e03-b99cb84e2103 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:17.755311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:17.757281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:17.757876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:17.758672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] PATH_INFO: `/v3/users/2e96c44a372b43958143f5db8d65b072` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:17.760490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e96c44a372b43958143f5db8d65b072)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:17.763329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:17.887864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e96c44a372b43958143f5db8d65b072'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.890190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e96c44a372b43958143f5db8d65b072'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.903455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:17.904283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:17.904581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:17.904863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:17.905638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:17.912854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:17.913490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e96c44a372b43958143f5db8d65b072'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.914778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e96c44a372b43958143f5db8d65b072'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.931153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e96c44a372b43958143f5db8d65b072'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:17.973906 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3347/6779] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:17 2022] DELETE /identity/v3/users/2e96c44a372b43958143f5db8d65b072 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:17.975227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:17.977098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:18.005422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3433/6780] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:17 2022] POST /identity/v3/users => generated 293 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:18.007029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:18.009947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:18.025157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66113c11-0d4f-4419-b9f7-e1d009b57520 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:18.115104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:18.115873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:18.116161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:18.116438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:18.117204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:18.120596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:18.140165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3434/6781] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:18.141350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:18.155401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a98a96-7352-4caf-aaba-372ac3444d68 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:18.160583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:18.161456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:18.161730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:18.162009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:18.163715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:18.165536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:18.181703 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3435/6782] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:18.182671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:18.194068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b631f7-0e4a-43e9-a22d-614670c4a109 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:18.197971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85c65-d26a-4ccd-a637-8d81f264743b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:18.199540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302606a-f805-429b-90e3-2b877117fdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:18.200519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302606a-f805-429b-90e3-2b877117fdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:18.200802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302606a-f805-429b-90e3-2b877117fdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:18.201101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302606a-f805-429b-90e3-2b877117fdf5 admin admin] PATH_INFO: `/v3/projects/7721c47121574e43b29f99d5c06543ef/users/b44e6b1cfdc644568744686315beb33e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:18.211323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:18.212660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:18.213989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:18.215839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] PATH_INFO: `/v3/users/8303163dfe6c44dc8552919975c72eba` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:18.220717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302606a-f805-429b-90e3-2b877117fdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7721c47121574e43b29f99d5c06543ef, user_id=b44e6b1cfdc644568744686315beb33e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:18.220990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8303163dfe6c44dc8552919975c72eba)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:18.224378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302606a-f805-429b-90e3-2b877117fdf5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:18.226290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:18.261914 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3436/6783] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:18 2022] PUT /identity/v3/projects/7721c47121574e43b29f99d5c06543ef/users/b44e6b1cfdc644568744686315beb33e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:18.277731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bbc28-9ee7-497a-9001-cc910ac215ee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:18.278801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bbc28-9ee7-497a-9001-cc910ac215ee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:18.279260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bbc28-9ee7-497a-9001-cc910ac215ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:18.384258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8303163dfe6c44dc8552919975c72eba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:18.386056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8303163dfe6c44dc8552919975c72eba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:18.408303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8303163dfe6c44dc8552919975c72eba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:18.409253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8303163dfe6c44dc8552919975c72eba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:18.426910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8303163dfe6c44dc8552919975c72eba'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:18.516837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3348/6784] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:17 2022] DELETE /identity/v3/users/8303163dfe6c44dc8552919975c72eba => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:18.566144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d33bbc28-9ee7-497a-9001-cc910ac215ee None None] MFA Rules not processed for user `b44e6b1cfdc644568744686315beb33e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:18.568241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d33bbc28-9ee7-497a-9001-cc910ac215ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:18.738519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3437/6785] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:18.745746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:18.748380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:18.905478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0f3b-eb28-4fdb-b1dd-ad6f4f92a453 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:18.930090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:18.930889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:18.931223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:18.931579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:18.932347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:18.935272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:19.020650 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3349/6786] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:18 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:19.024515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bbc28-9ee7-497a-9001-cc910ac215ee None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:19.040842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bbc28-9ee7-497a-9001-cc910ac215ee None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:19.171241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:19.172335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:19.172881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:19.173402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:19.174431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:19.177298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:19.223507 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3438/6787] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:19 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:19.228018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:19.241873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d00292-45b9-4298-a504-009e4cc4e44c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:19.249152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:19.250832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:19.251298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:19.251849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:19.253588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:19.255124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:19.256586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:19.256864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:19.286996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3350/6788] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:18:19.291920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ad696-7af7-478c-8856-5e82f15fd511 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:19.293185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:19.333623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d95a05-fef4-40f6-a53c-25257cf94230 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:19.338003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:19.338975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:19.339173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:19.342791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] PATH_INFO: `/v3/projects/a2e537a0863d43df811118a31e20609c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:19.346179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e537a0863d43df811118a31e20609c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:19.353467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:19.359927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:19.362610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:19.377281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:19.379342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:19.383207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:19.394793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:19.432058 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3351/6789] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:19.444417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:19.477374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e537a0863d43df811118a31e20609c', 'request_id': 'req-4234d7e5-8087-44b3-bdc3-0181e0254179'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.485072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e537a0863d43df811118a31e20609c', 'request_id': 'req-4234d7e5-8087-44b3-bdc3-0181e0254179'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.495101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7bac0-5afe-4d60-b48b-0b15c3151089 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:19.497857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e537a0863d43df811118a31e20609c', 'request_id': 'req-4234d7e5-8087-44b3-bdc3-0181e0254179'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.514508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] The token cache is being invalidate because project a2e537a0863d43df811118a31e20609c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:19.515093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.516197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.518547 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3439/6790] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:19 2022] DELETE /identity/v3/projects/a2e537a0863d43df811118a31e20609c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:19.523910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:19.528574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:19.637410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234d7e5-8087-44b3-bdc3-0181e0254179 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:19.644836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:19.645980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:19.646262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:19.660010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] PATH_INFO: `/v3/users/41e80feebae146f2bb61569f716aaf45` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:19.665112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e80feebae146f2bb61569f716aaf45)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:19.673162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:19.751876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29196c-3479-4ddb-8883-1d5eb56d8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:19.753716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29196c-3479-4ddb-8883-1d5eb56d8448 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:19.755599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29196c-3479-4ddb-8883-1d5eb56d8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:19.759105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29196c-3479-4ddb-8883-1d5eb56d8448 admin admin] PATH_INFO: `/v3/projects/693248449bf7400fa7f3a543edc5cd06/users/84f0f292dbc14e6eaaedb14d8b0ca64d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:19.809321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e80feebae146f2bb61569f716aaf45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.810302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e80feebae146f2bb61569f716aaf45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.818787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e80feebae146f2bb61569f716aaf45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.819225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29196c-3479-4ddb-8883-1d5eb56d8448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=693248449bf7400fa7f3a543edc5cd06, user_id=84f0f292dbc14e6eaaedb14d8b0ca64d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:19.829010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29196c-3479-4ddb-8883-1d5eb56d8448 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:19.835727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e80feebae146f2bb61569f716aaf45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.837158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e80feebae146f2bb61569f716aaf45'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:19.864115 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3352/6791] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:19 2022] PUT /identity/v3/projects/693248449bf7400fa7f3a543edc5cd06/users/84f0f292dbc14e6eaaedb14d8b0ca64d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:19.866151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:19.866562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:19.867730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:19.906536 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3440/6792] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:19 2022] DELETE /identity/v3/users/41e80feebae146f2bb61569f716aaf45 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:19.993023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] MFA Rules not processed for user `84f0f292dbc14e6eaaedb14d8b0ca64d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:19.997328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:20.066286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:20.068200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:20.207153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bc817-ad08-46b0-9bb7-547542a9ebf8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:20.216179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:20.217107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:20.217392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:20.217664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] PATH_INFO: `/v3/projects/e586c3fad30f4212a2bba8c9e58d73dd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:20.220621 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3353/6793] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:20.220950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e586c3fad30f4212a2bba8c9e58d73dd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:20.221968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:20.223338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:20.225628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:20.332091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e586c3fad30f4212a2bba8c9e58d73dd', 'request_id': 'req-19a273bc-22b6-4545-85fd-a8659d8d597c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.338174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e586c3fad30f4212a2bba8c9e58d73dd', 'request_id': 'req-19a273bc-22b6-4545-85fd-a8659d8d597c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.351521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e586c3fad30f4212a2bba8c9e58d73dd', 'request_id': 'req-19a273bc-22b6-4545-85fd-a8659d8d597c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.376319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] The token cache is being invalidate because project e586c3fad30f4212a2bba8c9e58d73dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:20.377242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.379508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-19a273bc-22b6-4545-85fd-a8659d8d597c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.395689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3441/6794] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:20 2022] DELETE /identity/v3/projects/e586c3fad30f4212a2bba8c9e58d73dd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:20.397713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3f133-7b1c-462f-905f-72ef6056d98b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:20.397997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3f133-7b1c-462f-905f-72ef6056d98b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:20.398346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3f133-7b1c-462f-905f-72ef6056d98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:20.404638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8ebd-b49d-458f-943b-56afe8299dd1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:20.428114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9cd3f133-7b1c-462f-905f-72ef6056d98b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:20.429894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9cd3f133-7b1c-462f-905f-72ef6056d98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:20.514503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3442/6795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:20.523877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:20.524163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:20.524437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:20.556359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:20.556944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:20.557237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:20.557510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:20.563430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:20.565836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:20.568852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:20.584181 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3443/6796] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:20.585957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:20.588518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:20.608686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3412d04-2f9a-4389-98a1-90059373eebd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:20.622070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:20.624125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:20.624487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:20.625533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] PATH_INFO: `/v3/projects/a704e92a3e354728af3cc4e133464f97` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:20.629403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a704e92a3e354728af3cc4e133464f97)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:20.633861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:20.690746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:20.692545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:20.704716 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3354/6797] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:20.705619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:20.718476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21485a93-867a-4003-8233-c0aeb9a42ee6 service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:20.769999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a704e92a3e354728af3cc4e133464f97', 'request_id': 'req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.795709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a704e92a3e354728af3cc4e133464f97', 'request_id': 'req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.819911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a704e92a3e354728af3cc4e133464f97', 'request_id': 'req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.841358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] The token cache is being invalidate because project a704e92a3e354728af3cc4e133464f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:20.841659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.846144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:20.862244 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3444/6798] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:20 2022] DELETE /identity/v3/projects/a704e92a3e354728af3cc4e133464f97 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:20.949994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:20.950716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:20.950990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:20.951288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:20.952035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:20.952341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:20.958482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:20.981726 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3355/6799] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:20.991581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:20.995195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:21.024766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:21.029156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:21.046655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5f670-7fdc-42fe-8a7b-4fc6599d0b37 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:21.069581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:21.070212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.070491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.070765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:21.071494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:21.073629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:21.163125 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3445/6800] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:20 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:21.164783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:21.224301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bcdf0-6393-41f8-9903-8596d3b5cbf4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:21.344040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d82ead-0eff-4b4f-a361-0c5529594cd7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:21.354726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:21.369773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.371961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:21.372467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.373562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.373995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.374431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:21.375945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:21.376724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:21.376900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:21.389386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:21.456280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:21.460022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:21.470061 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3446/6801] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:21 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:21.471799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:21.486483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8ea1-b1c0-400b-94e5-49f64e7eb8ad admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:21.490468 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3356/6802] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:21.492163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:21.492913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.493425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.493651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:21.494485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:21.496239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:21.520706 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3447/6803] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:21.522152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:21.537864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b98d-b4b2-438c-9ff8-481a6503eb33 service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:21.549808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1076bb-b605-44c6-9d51-cffbf0e85468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:21.550509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1076bb-b605-44c6-9d51-cffbf0e85468 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.551339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1076bb-b605-44c6-9d51-cffbf0e85468 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.551705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1076bb-b605-44c6-9d51-cffbf0e85468 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:21.552573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1076bb-b605-44c6-9d51-cffbf0e85468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:21.555090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1076bb-b605-44c6-9d51-cffbf0e85468 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:21.578242 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3357/6804] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:21.579816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:21.592103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602584d4-786c-4d69-9e50-96b013364dd0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:21.599606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:21.600601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.601547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.602809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] PATH_INFO: `/v3/projects/d989d0c21c364eecb624511d989f59f9/users/34dd37a6e1714162a6feb7584a7e6330/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:21.628923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d989d0c21c364eecb624511d989f59f9, user_id=34dd37a6e1714162a6feb7584a7e6330, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:21.632721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:21.661721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3448/6805] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:21 2022] PUT /identity/v3/projects/d989d0c21c364eecb624511d989f59f9/users/34dd37a6e1714162a6feb7584a7e6330/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:21.675877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.676308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.676531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:21.711135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] MFA Rules not processed for user `34dd37a6e1714162a6feb7584a7e6330`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:21.714234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:21.829279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:21.830841 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3358/6806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:21.976776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a080a-1beb-40dc-a74b-7f4ac439f9c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:21.992285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:21.996209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:21.997283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:21.998999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.000117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.007152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:22.012238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:22.014134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:22.030048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365adff-a33c-4893-9518-90bb9a88e808 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:22.037393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:22.038353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.038634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.038907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] PATH_INFO: `/v3/users/b44e6b1cfdc644568744686315beb33e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.040455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44e6b1cfdc644568744686315beb33e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.044072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:22.080102 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3449/6807] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:21 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:22.081511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:22.174529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44e6b1cfdc644568744686315beb33e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:22.175463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44e6b1cfdc644568744686315beb33e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:22.184135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44e6b1cfdc644568744686315beb33e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:22.185060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44e6b1cfdc644568744686315beb33e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:22.200762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc838195-2832-4b26-a074-24169ef827bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44e6b1cfdc644568744686315beb33e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:22.225467 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3359/6808] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:22 2022] DELETE /identity/v3/users/b44e6b1cfdc644568744686315beb33e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:22.233220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.233684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.234036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.241224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f703b-00ef-4268-ad06-b8577e223185 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:22.259055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:22.260718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:22.351764 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3360/6809] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:22.379166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:22.380235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.380513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.380782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.381525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.383519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:22.412575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:22.414363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:22.433859 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3450/6810] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:22 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:22.438038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:22.448289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:22.485603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aad2c-9c28-495a-9a07-c8af7e22a6df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:22.500560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:22.501576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.502011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.502584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.503488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.508047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:22.534970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3451/6811] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:22.536029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:22.543704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c4f85-0ee3-42ee-83b6-30d6f84ad475 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:22.549802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:22.550806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.551569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.552305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.574867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0c24-cc15-4138-b151-a37f90f3434a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:22.590293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.592342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:22.606684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:22.607534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.607777 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3361/6812] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:18:22.607886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.608095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] PATH_INFO: `/v3/projects/45d8f82b2e60407bb87e75d12e30ad15/users/b48a4b09074a4f7388a5e2df4a069b2c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.651789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d8f82b2e60407bb87e75d12e30ad15, user_id=b48a4b09074a4f7388a5e2df4a069b2c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.655092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:22.685321 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3452/6813] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:22 2022] PUT /identity/v3/projects/45d8f82b2e60407bb87e75d12e30ad15/users/b48a4b09074a4f7388a5e2df4a069b2c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:22.689271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:22.704997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95da61-d37b-49c4-a57c-11e9ee3e18a9 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:22.876820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275c9d9-c431-4bcc-86c8-1cfaed781c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:22.886322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275c9d9-c431-4bcc-86c8-1cfaed781c1d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.886589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275c9d9-c431-4bcc-86c8-1cfaed781c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.886904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275c9d9-c431-4bcc-86c8-1cfaed781c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.894865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275c9d9-c431-4bcc-86c8-1cfaed781c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.896942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275c9d9-c431-4bcc-86c8-1cfaed781c1d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:22.936550 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3362/6814] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:22.941002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:22.958112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597e25-01a5-46e4-b36e-0e912e609180 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:22.966298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:22.968112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:22.969131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:22.969625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] PATH_INFO: `/v3/projects/45d8f82b2e60407bb87e75d12e30ad15/users/b48a4b09074a4f7388a5e2df4a069b2c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:22.975203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d8f82b2e60407bb87e75d12e30ad15, user_id=b48a4b09074a4f7388a5e2df4a069b2c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:22.978546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:23.024648 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3453/6815] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:22 2022] PUT /identity/v3/projects/45d8f82b2e60407bb87e75d12e30ad15/users/b48a4b09074a4f7388a5e2df4a069b2c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:23.028596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c131d-ad59-431b-af5e-2bc009b14e72 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:23.029190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c131d-ad59-431b-af5e-2bc009b14e72 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:23.029680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c131d-ad59-431b-af5e-2bc009b14e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:23.084193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-802c131d-ad59-431b-af5e-2bc009b14e72 None None] MFA Rules not processed for user `b48a4b09074a4f7388a5e2df4a069b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:23.087745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-802c131d-ad59-431b-af5e-2bc009b14e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:23.315697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:23.325311 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3363/6816] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:23.338751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affa807-94d0-4508-a046-ffc95fb3603a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:23.352035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:23.353207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:23.353841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:23.354471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:23.355431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:23.360276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:23.395486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c131d-ad59-431b-af5e-2bc009b14e72 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:23.402068 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3454/6817] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:23 2022] POST /identity/v3/roles => generated 234 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:23.409197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c131d-ad59-431b-af5e-2bc009b14e72 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:23.432199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:23.434146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:23.436157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:23.437494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:23.438449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:23.452458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:23.482985 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3364/6818] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:23 2022] POST /identity/v3/roles => generated 234 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:23.484955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:23.510720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb14b6-47ff-4489-8077-2ff3d7a2c6e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:23.524753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:23.524753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:23.524753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:23.525235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:23.526103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:23.532068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:23.561621 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3455/6819] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:23 2022] POST /identity/v3/roles => generated 235 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:23.566135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:23.599324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e83ec-b556-4ca8-b10d-99de8429910b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:23.607022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:23.607705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:23.613609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:23.614569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:23.615357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:23.619216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:23.668340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3365/6820] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:18:23 2022] POST /identity/v3/domains => generated 274 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:23.672553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:23.711459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842501e2-0bff-4adc-b79c-fc68238c9cad tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:23.713173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:23.715365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:23.865418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e69fa-77f7-41ae-bd94-dbc6b4a5c7e7 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:23.871911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:23.873278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:23.873787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:23.874273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] PATH_INFO: `/v3/projects/7721c47121574e43b29f99d5c06543ef` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:23.875705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7721c47121574e43b29f99d5c06543ef)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:23.878050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:23.882571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:23.883377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:23.883667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:23.883940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:23.884645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:23.886654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:23.970204 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3456/6821] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:23 2022] POST /identity/v3/projects => generated 401 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:23.974006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:23.993747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7721c47121574e43b29f99d5c06543ef', 'request_id': 'req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.006662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7721c47121574e43b29f99d5c06543ef', 'request_id': 'req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.025881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7721c47121574e43b29f99d5c06543ef', 'request_id': 'req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.043310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] The token cache is being invalidate because project 7721c47121574e43b29f99d5c06543ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:24.044649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.047854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.050035 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3366/6822] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:23 2022] DELETE /identity/v3/projects/7721c47121574e43b29f99d5c06543ef => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:24.052905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:24.054943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:24.064818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56219f2e-3ce5-4194-b672-c07d72619b1b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:24.069983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:24.070637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:24.070921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:24.071195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/groups` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:24.071894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:24.074155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:24.122201 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3457/6823] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:18:23 2022] POST /identity/v3/groups => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:24.133075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:24.143745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:24.169063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce47db-d2d0-4b66-9671-5e59e2a63f30 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:24.258463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:24.259139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:24.259476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:24.259674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:24.265890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:24.275428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454950-e943-431f-9867-d515472cf6e6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:24.284092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:24.284717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:24.285938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:24.286310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:24.286679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:24.287105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] PATH_INFO: `/v3/users/84f0f292dbc14e6eaaedb14d8b0ca64d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:24.289747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f0f292dbc14e6eaaedb14d8b0ca64d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:24.293313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:24.301806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3367/6824] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:24.302650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:24.304124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:24.334477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707d71-b2a0-4686-8221-d25cc3c0c74a service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:24.350263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:24.351415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:24.352008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:24.352746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:24.354172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:24.361397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:24.395756 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3368/6825] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:24 2022] POST /identity/v3/roles => generated 233 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:24.400291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:24.401883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f0f292dbc14e6eaaedb14d8b0ca64d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.403433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f0f292dbc14e6eaaedb14d8b0ca64d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.421551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f0f292dbc14e6eaaedb14d8b0ca64d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.425641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311b58-bd76-4e8e-8526-343985d38e15 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:24.444483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:24.445453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:24.445605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:24.445845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:24.446791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:24.449545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:24.452011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f0f292dbc14e6eaaedb14d8b0ca64d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.452739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f0f292dbc14e6eaaedb14d8b0ca64d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:24.495736 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3369/6826] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:24 2022] POST /identity/v3/users => generated 442 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:24.499892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:24.500159 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3458/6827] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:24 2022] DELETE /identity/v3/users/84f0f292dbc14e6eaaedb14d8b0ca64d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:24.504234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:24.539828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f5fca-e81e-4509-bdc5-22ae6a95a05d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:24.704558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:24.705381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:24.705668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:24.706144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:24.707003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:24.708175 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:24.708175 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:24.708175 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:24.710289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:24.737843 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3370/6828] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:24 2022] POST /identity/v3/roles => generated 269 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:24.742142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:24.756158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa98cd-36b3-47d1-a933-58f80868c84a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:24.790226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992f9f-1e23-458d-996a-05b1deed6d80 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:24.791515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992f9f-1e23-458d-996a-05b1deed6d80 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:24.792419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992f9f-1e23-458d-996a-05b1deed6d80 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:24.792931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992f9f-1e23-458d-996a-05b1deed6d80 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/16818441d17c44ea893ad95255439852` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:24.849585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992f9f-1e23-458d-996a-05b1deed6d80 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_grant(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=16818441d17c44ea893ad95255439852)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:24.852630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992f9f-1e23-458d-996a-05b1deed6d80 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:24.886185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3459/6829] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:24 2022] PUT /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/16818441d17c44ea893ad95255439852 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:24.890847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:24.905332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e180-940f-4211-97b2-78a816e3f5ab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:25.060434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:25.061158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.061497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.061766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.063398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Adding query filter params (scope.project.id=366c9993bec84008b63f73c491da6d14, user.id=10c683dd0e174d0ab21aa7669cc3c0fe) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:25.063717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:25.069135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:25.083993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.084953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.085411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.111890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:25.113649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:25.202435 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3371/6830] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:18:24 2022] GET /identity/v3/role_assignments?scope.project.id=366c9993bec84008b63f73c491da6d14&user.id=10c683dd0e174d0ab21aa7669cc3c0fe&effective => generated 228 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:25.206588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:25.228636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074085f7-e6fb-4ee2-af3f-34f5a037f1f5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:25.234970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3460/6831] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:25.240945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:25.242637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.242931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.243579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/16818441d17c44ea893ad95255439852` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.245650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=16818441d17c44ea893ad95255439852)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:25.249060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:25.252396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:25.254833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:25.268510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 16818441d17c44ea893ad95255439852 was removed from user 10c683dd0e174d0ab21aa7669cc3c0fe on project 366c9993bec84008b63f73c491da6d14. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:25.268749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.269694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.302757 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3372/6832] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Apr 9 21:18:25 2022] DELETE /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/16818441d17c44ea893ad95255439852 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:25.307074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:25.310084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:25.377913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d918-255a-4a8a-8c64-9413a3f54d3f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:25.480804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073c3e-6f9d-4d41-b4e6-a0bd6ec3944b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:25.492599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:25.494355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.494968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.496270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/16818441d17c44ea893ad95255439852` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.499378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=16818441d17c44ea893ad95255439852)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:25.500658 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:25.500658 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:25.500658 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:25.502116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:25.537978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:25.538565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.538852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.539131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.541140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:25.601525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 16818441d17c44ea893ad95255439852 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:25.601836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.605461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.608656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3373/6833] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:25 2022] DELETE /identity/v3/roles/16818441d17c44ea893ad95255439852 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:25.615876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:25.624439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:25.683877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:25.685577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:25.708374 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3461/6834] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:18:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:18:25.709335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:25.715416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea50d-7ffa-4d67-8ad1-627a68ce2b6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:25.722230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:25.723853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.724151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.724528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] PATH_INFO: `/v3/projects/693248449bf7400fa7f3a543edc5cd06` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.727086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=693248449bf7400fa7f3a543edc5cd06)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:25.734913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:25.749994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ab692-5c2b-4553-b29d-be706da922be service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:25.881886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693248449bf7400fa7f3a543edc5cd06', 'request_id': 'req-a41a0a89-eef0-47b0-986c-e94b6078e328'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.894630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693248449bf7400fa7f3a543edc5cd06', 'request_id': 'req-a41a0a89-eef0-47b0-986c-e94b6078e328'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.917057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693248449bf7400fa7f3a543edc5cd06', 'request_id': 'req-a41a0a89-eef0-47b0-986c-e94b6078e328'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.917476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:25.919707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.919707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.919917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/aaedf4f639a84b5ba8c3307f18f31778` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.928732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_grant(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=aaedf4f639a84b5ba8c3307f18f31778)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:25.935162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:25.938343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] The token cache is being invalidate because project 693248449bf7400fa7f3a543edc5cd06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:25.938660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.939574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a41a0a89-eef0-47b0-986c-e94b6078e328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:25.946141 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3374/6835] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:25 2022] DELETE /identity/v3/projects/693248449bf7400fa7f3a543edc5cd06 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:25.947665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec1e4-8a4d-40fd-b69a-304921c45387 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:25.947958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec1e4-8a4d-40fd-b69a-304921c45387 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:25.948241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec1e4-8a4d-40fd-b69a-304921c45387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:25.970484 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3462/6836] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:25 2022] PUT /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/aaedf4f639a84b5ba8c3307f18f31778 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:25.975147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:25.978729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:25.990944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cc3ec1e4-8a4d-40fd-b69a-304921c45387 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:25.992203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc3ec1e4-8a4d-40fd-b69a-304921c45387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:26.108523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3375/6837] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:26.110125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6259c-f94c-439c-8331-9c85d4e15e96 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.110353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6259c-f94c-439c-8331-9c85d4e15e96 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.110608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6259c-f94c-439c-8331-9c85d4e15e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.140211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ab444-1ed0-4afe-a8ba-4853e76ffd8d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.147288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.148512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.148802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.149105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.152142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.153290 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:26.153290 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:26.153290 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:26.154181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.155441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b3b6259c-f94c-439c-8331-9c85d4e15e96 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:26.168399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b3b6259c-f94c-439c-8331-9c85d4e15e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:26.193138 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3376/6838] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:26.199593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6259c-f94c-439c-8331-9c85d4e15e96 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.199806 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3463/6839] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:25 2022] PUT /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 519 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:26.203821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.226377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6259c-f94c-439c-8331-9c85d4e15e96 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.367346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.368048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.368351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.368632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.370367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:26.370688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.372366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.382792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975faf2-a069-4b0e-8c8d-135365172feb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.399780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.406873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.407689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.408138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.409273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Adding query filter params (scope.project.id=366c9993bec84008b63f73c491da6d14, user.id=10c683dd0e174d0ab21aa7669cc3c0fe) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:26.409875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.412029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.424847 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3377/6840] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:26.430220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.460373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf88096-30f7-4e9f-8a70-eba28fcd18bd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.484870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.485808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.486458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.486458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.487045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.498721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.558113 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3378/6841] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:26 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:26.565334 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3464/6842] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:18:26 2022] GET /identity/v3/role_assignments?scope.project.id=366c9993bec84008b63f73c491da6d14&user.id=10c683dd0e174d0ab21aa7669cc3c0fe&effective => generated 1061 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:18:26.565509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.567335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.584327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3412b-0338-4a12-91ea-4f83ff6eb81c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.682170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.682170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.682170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.684649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.687440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.688664 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:26.688664 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:26.688664 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:26.689823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.704620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d1239-a805-46fe-9639-cfed0170ae52 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.711192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.712270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.712761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.713343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.713782 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3465/6843] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:26 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:26.714699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.723995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.726811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.760636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3379/6844] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:26 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:26.764517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.785310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44034b-4818-4f33-8e5c-e5bb03854536 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.839412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b536844-0470-469d-9715-7ad064f9f55d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.845602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.846919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.847302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.848090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.852309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Adding query filter params (scope.project.id=366c9993bec84008b63f73c491da6d14, user.id=10c683dd0e174d0ab21aa7669cc3c0fe) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:26.852992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.855374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.906321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb3dce-4552-4841-84da-478f91dc65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.907455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3dce-4552-4841-84da-478f91dc65ed admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.907647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3dce-4552-4841-84da-478f91dc65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.908024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3dce-4552-4841-84da-478f91dc65ed admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.909052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb3dce-4552-4841-84da-478f91dc65ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.914297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb3dce-4552-4841-84da-478f91dc65ed admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:26.936001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3380/6845] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:26 2022] GET /identity/v3/roles => generated 2320 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:26.938179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3246-4fbc-44f9-851d-e220184a1d93 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.938852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3246-4fbc-44f9-851d-e220184a1d93 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.939141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3246-4fbc-44f9-851d-e220184a1d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.953026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3466/6846] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Apr 9 21:18:26 2022] GET /identity/v3/role_assignments?scope.project.id=366c9993bec84008b63f73c491da6d14&user.id=10c683dd0e174d0ab21aa7669cc3c0fe&effective => generated 577 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:26.953026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:26.967229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3055ba-5134-49d8-b9f6-e3e3c28639a9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:26.975485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-939a3246-4fbc-44f9-851d-e220184a1d93 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:26.978384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:26.979101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:26.979221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-939a3246-4fbc-44f9-851d-e220184a1d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:26.979522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:26.979801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:26.980538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:26.990484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.013452 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3467/6847] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:26 2022] GET /identity/v3/roles => generated 2320 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:27.015390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.035692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0714255-4240-420f-b908-8b8138f1c683 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.044615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.046447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.049563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.049921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.053195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.054960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.061236 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3381/6848] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:27.062089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3246-4fbc-44f9-851d-e220184a1d93 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.106628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3246-4fbc-44f9-851d-e220184a1d93 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.111749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.114683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.114968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.115239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] PATH_INFO: `/v3/projects/29174d3feed746e3b2763f341840c808/users/c04a493bf2ca46bca03727104a87691b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.123473 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] aaedf4f639a84b5ba8c3307f18f31778 does not imply 78dedeca454e48a5bcaf5e62e29ddf5c.: keystone.exception.ImpliedRoleNotFound: aaedf4f639a84b5ba8c3307f18f31778 does not imply 78dedeca454e48a5bcaf5e62e29ddf5c. Apr 09 21:18:27.129436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3468/6849] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:27 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 137 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:27.130892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.132464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29174d3feed746e3b2763f341840c808, user_id=c04a493bf2ca46bca03727104a87691b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.135187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.136535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.171657 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3382/6850] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:27 2022] PUT /identity/v3/projects/29174d3feed746e3b2763f341840c808/users/c04a493bf2ca46bca03727104a87691b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:27.171842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.232506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227af6f-ebf9-4265-884a-3c6e0388921c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.249814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff858a-9a44-4491-b336-8365e3b490b0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.260206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.261756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.262569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.262856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/aaedf4f639a84b5ba8c3307f18f31778` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.266362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=aaedf4f639a84b5ba8c3307f18f31778)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.269539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.278793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role aaedf4f639a84b5ba8c3307f18f31778 was removed from user 10c683dd0e174d0ab21aa7669cc3c0fe on project 366c9993bec84008b63f73c491da6d14. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:27.279133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:27.279875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61adc96a-60eb-4e2e-ad58-86b558886611 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:27.308544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.310065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.310580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.311364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.313675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.329428 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3383/6851] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Apr 9 21:18:27 2022] DELETE /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/aaedf4f639a84b5ba8c3307f18f31778 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:27.330541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.330829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.334194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.387531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] MFA Rules not processed for user `c04a493bf2ca46bca03727104a87691b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:27.387531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.426991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.428142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.450751 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3469/6852] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:18:27.453558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.459220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.476397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ddf-065b-4b7b-9090-d208401c4734 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.508129 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3384/6853] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:27.513723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.516055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.590999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.591714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.591996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.592267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.593028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.596098 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:27.596098 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:27.596098 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:27.597180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.629516 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3470/6854] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:27 2022] POST /identity/v3/roles => generated 271 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:27.635633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.649530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f865870-9b74-4f2c-8d94-b2781b09fc12 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.653706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d58a2-94d0-4fca-b6e9-949edc673d16 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.660418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.660418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.661567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.661878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.663731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.664667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.665390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.665684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.666089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.667856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.669719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Adding query filter params (domain_id=440d0208a5184453be282191e6db4bd4) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:27.669719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.671749 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:27.671749 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:27.671749 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:27.672546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.698855 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3471/6855] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Apr 9 21:18:27 2022] GET /identity/v3/roles?domain_id=440d0208a5184453be282191e6db4bd4 => generated 408 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:27.699888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.712758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeb88c-cb19-42bf-b6d7-44efb2a58276 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.720654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.721770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.722059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.722833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/29509f506d734a4d9d071629a445b4dc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.724324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=29509f506d734a4d9d071629a445b4dc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.725553 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:27.725553 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:27.725553 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:27.731913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.741844 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3385/6856] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:27 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:27.743492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.790295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 29509f506d734a4d9d071629a445b4dc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:27.790932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:27.791788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9fba58a-1111-45cc-9c63-a9f1d7fe968a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:27.795425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3472/6857] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:27 2022] DELETE /identity/v3/roles/29509f506d734a4d9d071629a445b4dc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:27.797134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.797798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.798239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.824594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:27.826346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.836972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10b6c2-c8bf-4c9b-b7ce-a5a0c17740d8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.892770 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3473/6858] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:27.893699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.895210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.895700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.896543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.896834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.897285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.897978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.900086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:27.926669 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3386/6859] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:27 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:27.926669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:27.926977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:27.975469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7ffa-bc40-4716-a0cb-1fa8c337a8ea None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:27.983389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:27.984503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:27.984975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:27.985503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:27.987804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Adding query filter params (domain_id=440d0208a5184453be282191e6db4bd4) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:27.988616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:27.992045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.003616 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3474/6860] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Apr 9 21:18:27 2022] GET /identity/v3/roles?domain_id=440d0208a5184453be282191e6db4bd4 => generated 148 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:28.005080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.007234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:28.027262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a67e4-b9a3-4ceb-8a25-e48d62f86b8c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.030356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0e2ad-9b72-47d2-8cc5-942f798cf759 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.034648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.035505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.035754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.036378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.036750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.036918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.037019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.037335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.038558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.040917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.046733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.048347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.059653 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3475/6861] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:28 2022] GET /identity/v3/roles => generated 2320 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:28.059847 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3387/6862] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:18:28.059956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.060906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.072042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac854a3-f68f-4110-ba9f-8e18a228c972 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.074083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639a08-2be1-4ba5-9248-ae36eb2e0415 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.077235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.078139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.078413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.078678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] PATH_INFO: `/v3/projects/d48fac9e29ee41aa83b3953d99640240/users/7f909b179f094ddc9761096bdbeba1a4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.079271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.080317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.080674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.081188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/29509f506d734a4d9d071629a445b4dc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.100152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48fac9e29ee41aa83b3953d99640240, user_id=7f909b179f094ddc9761096bdbeba1a4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.103080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.105537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:18:28.124631 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Could not find role: 29509f506d734a4d9d071629a445b4dc.: keystone.exception.RoleNotFound: Could not find role: 29509f506d734a4d9d071629a445b4dc. Apr 09 21:18:28.130840 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3476/6863] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:28 2022] DELETE /identity/v3/roles/29509f506d734a4d9d071629a445b4dc => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:28.141139 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3388/6864] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:28 2022] PUT /identity/v3/projects/d48fac9e29ee41aa83b3953d99640240/users/7f909b179f094ddc9761096bdbeba1a4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:28.141539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.149139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.160920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b052d2-3b2d-4a4a-b9d4-264d336bbae4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.223893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4777-ede8-4501-b3f5-9c815354981f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.233144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.233144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.233144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.233144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.233682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.238868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.240033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.240142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.240488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.241276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.247330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=440d0208a5184453be282191e6db4bd4, group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.251058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.256275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3389/6865] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:28 2022] GET /identity/v3/roles => generated 2320 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:28.260139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.270088 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3477/6866] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:28 2022] PUT /identity/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:28.273809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.285524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2851d-ddc2-407e-ad3a-2366e5a6ec5f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.359387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0788-bc88-41a8-91bc-1469005e9cbf tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.364945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.366131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.366279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.366534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.369736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=440d0208a5184453be282191e6db4bd4, group_id=896cb979b5b04b95b2c2d3f3a370adb4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.370965 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:28.370965 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:28.370965 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:28.373011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.384234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe79c5f-397d-498f-8a7e-18800fe29187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.385179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe79c5f-397d-498f-8a7e-18800fe29187 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.385468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe79c5f-397d-498f-8a7e-18800fe29187 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.385722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe79c5f-397d-498f-8a7e-18800fe29187 admin admin] PATH_INFO: `/v3/projects/d48fac9e29ee41aa83b3953d99640240/users/7f909b179f094ddc9761096bdbeba1a4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.389267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe79c5f-397d-498f-8a7e-18800fe29187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48fac9e29ee41aa83b3953d99640240, user_id=7f909b179f094ddc9761096bdbeba1a4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.390234 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3478/6867] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Apr 9 21:18:28 2022] GET /identity/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles => generated 408 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:28.392324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe79c5f-397d-498f-8a7e-18800fe29187 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.396632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.404634 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3390/6868] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:28 2022] PUT /identity/v3/projects/d48fac9e29ee41aa83b3953d99640240/users/7f909b179f094ddc9761096bdbeba1a4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:28.415093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4c95-c5fe-48fc-bfb3-4b76c58dbef2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.415462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a0878-8406-4db1-b81a-0018d5e29278 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.415601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4c95-c5fe-48fc-bfb3-4b76c58dbef2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.415874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4c95-c5fe-48fc-bfb3-4b76c58dbef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.461336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-af7a4c95-c5fe-48fc-bfb3-4b76c58dbef2 None None] MFA Rules not processed for user `7f909b179f094ddc9761096bdbeba1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:28.462974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-af7a4c95-c5fe-48fc-bfb3-4b76c58dbef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:28.512389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.514128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.514656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.515094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.517883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=440d0208a5184453be282191e6db4bd4, group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.522060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.531271 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3479/6869] 10.222.0.30 () {58 vars in 1464 bytes} [Sat Apr 9 21:18:28 2022] HEAD /identity/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:28.532290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.542800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ccf38-9677-4c46-b10d-741c64e661f2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.547632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.548751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.549154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.549643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.552132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=440d0208a5184453be282191e6db4bd4, group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.554949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.559600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3391/6870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:28.560689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 92878d24e1be46a3bfeef6c086e89051 was removed from group 896cb979b5b04b95b2c2d3f3a370adb4 on domain 440d0208a5184453be282191e6db4bd4. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:28.561115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:28.561886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:28.564895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.565215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.566484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.583864 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3480/6871] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Apr 9 21:18:28 2022] DELETE /identity/v3/domains/440d0208a5184453be282191e6db4bd4/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:28.583864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.583864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:28.590077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:28.591316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:28.648713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b12b5-3fe5-43e4-9e7e-39a4da8f4de2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.652295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.652961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.653275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.653594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.655357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:28.656276 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3392/6872] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:28.666658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.671049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:28.736807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.738590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.749560 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3481/6873] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:28.750315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.751825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:28.757776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce758-ef86-4c49-a0ec-26a3ae4a4a4e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.765383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.766398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.766783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.767148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.769935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_grant(project_id=366c9993bec84008b63f73c491da6d14, group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.773075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.794896 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3393/6874] 10.222.0.30 () {60 vars in 1485 bytes} [Sat Apr 9 21:18:28 2022] PUT /identity/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:28.796161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.836500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58e17-f721-4f36-8013-524236aa348c service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.872572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd2a7f-3f56-44c6-8f42-3fdc931bc4cb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.878333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.879351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.879708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.880053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.882160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_grants(project_id=366c9993bec84008b63f73c491da6d14, group_id=896cb979b5b04b95b2c2d3f3a370adb4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.884817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.903352 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3394/6875] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Apr 9 21:18:28 2022] GET /identity/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles => generated 409 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:28.904307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:28.908076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.908755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.909209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.909484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.916423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d919e00-ed95-4124-8a78-d0ea62fc6be5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:28.924664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeca38-cd14-440d-aeda-63a13b64a3d4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:28.925787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeca38-cd14-440d-aeda-63a13b64a3d4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.926175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeca38-cd14-440d-aeda-63a13b64a3d4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.926571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeca38-cd14-440d-aeda-63a13b64a3d4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/groups/896cb979b5b04b95b2c2d3f3a370adb4/users/10c683dd0e174d0ab21aa7669cc3c0fe` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:28.929071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeca38-cd14-440d-aeda-63a13b64a3d4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=896cb979b5b04b95b2c2d3f3a370adb4, user_id=10c683dd0e174d0ab21aa7669cc3c0fe)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:28.931284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeca38-cd14-440d-aeda-63a13b64a3d4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:28.965744 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3395/6876] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Apr 9 21:18:28 2022] PUT /identity/v3/groups/896cb979b5b04b95b2c2d3f3a370adb4/users/10c683dd0e174d0ab21aa7669cc3c0fe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:28.967374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130e4d0-1854-476c-adb2-2a5a7f89123f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:28.967889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130e4d0-1854-476c-adb2-2a5a7f89123f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:28.968378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130e4d0-1854-476c-adb2-2a5a7f89123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.002847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.004949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.017569 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3482/6877] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:18:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:18:29.020402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8130e4d0-1854-476c-adb2-2a5a7f89123f None None] MFA Rules not processed for user `10c683dd0e174d0ab21aa7669cc3c0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:29.021873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8130e4d0-1854-476c-adb2-2a5a7f89123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:29.146613 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3396/6878] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:29.151174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.165796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d67b3-b813-4a2d-9804-a0336247643d service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.244614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.245639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.246123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.246464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.249182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:check_grant(project_id=366c9993bec84008b63f73c491da6d14, group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.252323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.261284 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3483/6879] 10.222.0.30 () {58 vars in 1467 bytes} [Sat Apr 9 21:18:29 2022] HEAD /identity/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:29.266923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130e4d0-1854-476c-adb2-2a5a7f89123f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.284581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130e4d0-1854-476c-adb2-2a5a7f89123f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.290320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.291311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.291818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.292094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.296844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=366c9993bec84008b63f73c491da6d14, group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.300580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.307976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 92878d24e1be46a3bfeef6c086e89051 was removed from group 896cb979b5b04b95b2c2d3f3a370adb4 on project 366c9993bec84008b63f73c491da6d14. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:29.309586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:29.310386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:29.333258 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3397/6880] 10.222.0.30 () {58 vars in 1469 bytes} [Sat Apr 9 21:18:29 2022] DELETE /identity/v3/projects/366c9993bec84008b63f73c491da6d14/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:29.338609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.340785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:29.354601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb65d-40bc-4c69-9955-9f0481c3bb29 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.481886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.484430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.484721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.485000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/groups/896cb979b5b04b95b2c2d3f3a370adb4/users/10c683dd0e174d0ab21aa7669cc3c0fe` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.490523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=896cb979b5b04b95b2c2d3f3a370adb4, user_id=10c683dd0e174d0ab21aa7669cc3c0fe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.494321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.513805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '10c683dd0e174d0ab21aa7669cc3c0fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:29.550759 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3484/6881] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:18:29 2022] DELETE /identity/v3/groups/896cb979b5b04b95b2c2d3f3a370adb4/users/10c683dd0e174d0ab21aa7669cc3c0fe => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:29.555846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.567273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d2191-262f-4695-b759-5ef9e67378be tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.636896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.638565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.638864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.639127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.641095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.642343 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:29.642343 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:29.642343 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:29.643229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.659353 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3398/6882] 10.222.0.30 () {60 vars in 1380 bytes} [Sat Apr 9 21:18:29 2022] PUT /identity/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:29.660890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.681126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f0b0-b5c4-4502-b73a-2143b79d5e9b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.687634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.688616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.688995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.689501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.692012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=896cb979b5b04b95b2c2d3f3a370adb4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.694291 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:29.694291 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:29.694291 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:29.695683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.719549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.726953 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3485/6883] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:18:29 2022] GET /identity/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles => generated 374 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:29.735112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca101f1c-bcc5-4916-950a-a2d2c5aef179 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.742543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.743566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.744016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.744379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.748707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.749655 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:29.749655 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:29.749655 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:29.752609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.769460 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3399/6884] 10.222.0.30 () {58 vars in 1362 bytes} [Sat Apr 9 21:18:29 2022] HEAD /identity/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:29.774662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.788973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685896-5298-48c0-8324-0cd47b108255 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.800780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.802803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.803090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.804539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.806421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=896cb979b5b04b95b2c2d3f3a370adb4, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.813254 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:29.813254 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:29.813254 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:29.813254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.833458 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3486/6885] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Apr 9 21:18:29 2022] DELETE /identity/v3/system/groups/896cb979b5b04b95b2c2d3f3a370adb4/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:29.834763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.846676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e833da-b490-420c-b5ed-108f86b43cce tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:29.853063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:29.854236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:29.854699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:29.855183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:29.857772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=440d0208a5184453be282191e6db4bd4, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:29.861510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:29.905578 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3400/6886] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Apr 9 21:18:29 2022] PUT /identity/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:29.910063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:29.928215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14f7da-0504-4adb-8bb6-fdbb42033378 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.034413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.035486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.035849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.036397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.039272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=440d0208a5184453be282191e6db4bd4, user_id=10c683dd0e174d0ab21aa7669cc3c0fe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.043703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.065889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3487/6887] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Apr 9 21:18:29 2022] GET /identity/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles => generated 407 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:30.069735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.083369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeed39-8c14-4e18-b6cb-f9fd399e2fe1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.088495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.089485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.089808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.090168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.094216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=440d0208a5184453be282191e6db4bd4, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.097852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.120577 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3401/6888] 10.222.0.30 () {58 vars in 1461 bytes} [Sat Apr 9 21:18:30 2022] HEAD /identity/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:30.125682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.145697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa223e-44b7-414e-9027-2baaa3e99799 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.148320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.162131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.165567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.165771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.171164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=440d0208a5184453be282191e6db4bd4, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.174226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.191242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 92878d24e1be46a3bfeef6c086e89051 was removed from user 10c683dd0e174d0ab21aa7669cc3c0fe on domain 440d0208a5184453be282191e6db4bd4. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:30.191607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:30.193690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:30.234191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3488/6889] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Apr 9 21:18:30 2022] DELETE /identity/v3/domains/440d0208a5184453be282191e6db4bd4/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:30.239684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.241548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:30.262366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70956bdf-d074-4400-85d8-859c320178aa tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.352317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.353593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.354140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.354516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.357323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_grant(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.360263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.380387 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3402/6890] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:30 2022] PUT /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:30.385255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.397463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963632-2630-4355-a1c4-39303c4421c8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.502293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.503536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.503984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.504502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.507055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_grants(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.510304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.525029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3489/6891] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Apr 9 21:18:30 2022] GET /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles => generated 408 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:18:30.533095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.546530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78efd32-5663-4b5b-ab2a-0287c5bb6a78 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.553483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.554573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.554948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.555315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.557804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:check_grant(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.561465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.568706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3403/6892] 10.222.0.30 () {58 vars in 1464 bytes} [Sat Apr 9 21:18:30 2022] HEAD /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:30.573187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.587618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857a19-8e2f-4db6-addf-a790e5cfa68d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.594318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.595465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.595923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.596505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.600058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=366c9993bec84008b63f73c491da6d14, user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.603147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.609881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 92878d24e1be46a3bfeef6c086e89051 was removed from user 10c683dd0e174d0ab21aa7669cc3c0fe on project 366c9993bec84008b63f73c491da6d14. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:30.610465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:30.611315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:30.631291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3490/6893] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Apr 9 21:18:30 2022] DELETE /identity/v3/projects/366c9993bec84008b63f73c491da6d14/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:30.636708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.638844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:30.654254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac906cd-6c9d-480b-a7c3-5d8dfe7244e1 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.732335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.733658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.734534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.734534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.738088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.739364 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:30.739364 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:30.739364 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:30.740840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.751981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3404/6894] 10.222.0.30 () {60 vars in 1377 bytes} [Sat Apr 9 21:18:30 2022] PUT /identity/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:30.756007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.767059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74601f1a-c43d-4e43-9fd3-d97035e78d6d tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.776022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.777763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.782983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.783391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.785194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=10c683dd0e174d0ab21aa7669cc3c0fe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.787387 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:30.787387 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:30.787387 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:30.788361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.802888 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3491/6895] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:18:30 2022] GET /identity/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles => generated 373 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:18:30.806917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.821129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f89f6-3722-4481-b407-1979d73372bb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.827031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.828608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.829507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.830119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.834012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.834786 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:30.834786 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:30.834786 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:30.835670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.842524 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3405/6896] 10.222.0.30 () {58 vars in 1359 bytes} [Sat Apr 9 21:18:30 2022] HEAD /identity/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:30.846918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.862309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdbf8-dbc1-48da-a2f3-e640fa660d6b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.871161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.872536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.872858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.873171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.875453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=10c683dd0e174d0ab21aa7669cc3c0fe, role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.876868 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:30.876868 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:30.876868 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:30.877806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.892695 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3492/6897] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Apr 9 21:18:30 2022] DELETE /identity/v3/system/users/10c683dd0e174d0ab21aa7669cc3c0fe/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:30.898464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.911023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8ca62-88cf-4547-889d-812ce0f57f89 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.917941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.919476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.919878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.920405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.921277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.922997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.943267 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3406/6898] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:30 2022] POST /identity/v3/roles => generated 269 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:30.947553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:30.962547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf27c6-556c-4a32-b3bc-57188349e166 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:30.968159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:30.968898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:30.969273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:30.969553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:30.970358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:30.972061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:30.994013 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3493/6899] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:30 2022] POST /identity/v3/roles => generated 270 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:30.998234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.018754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6a95b-5c41-4c35-8433-7b2073e00672 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.027537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.028874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.029811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.030397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/a80b1c32a19a4ddbb97515ad87893da9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.032871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d98816567db40c1acf7c1489cc272f2, implied_role_id=a80b1c32a19a4ddbb97515ad87893da9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.034509 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:31.034509 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:31.034509 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:31.036154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.084790 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3407/6900] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:30 2022] PUT /identity/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/a80b1c32a19a4ddbb97515ad87893da9 => generated 530 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:31.088700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.104089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c25ec-7e17-4624-ba63-b90f46db1fc5 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.200532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.201252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.201678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.201987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.202708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.204398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.223859 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3494/6901] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:18:31 2022] POST /identity/v3/domains => generated 276 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:31.227579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.242868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc06a4-077c-49c3-a7e0-61760ead195a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.311364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.312080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.312372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.312812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.313665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.315385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.340935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.352121 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3408/6902] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:31 2022] POST /identity/v3/roles => generated 270 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:31.358556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848058c5-0cab-47b8-a32f-c006843037e2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.369450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.370638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.370928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.371204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/dc8d5d9dfa27471a98dc35857d9f0957` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.373754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d98816567db40c1acf7c1489cc272f2, implied_role_id=dc8d5d9dfa27471a98dc35857d9f0957)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.375501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.422258 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3495/6903] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:31 2022] PUT /identity/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/dc8d5d9dfa27471a98dc35857d9f0957 => generated 530 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:31.423705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.443026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13e47-2f51-4c1d-a0da-f0018d7be330 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.528342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.530336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.530738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.531120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.533432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d98816567db40c1acf7c1489cc272f2, implied_role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.535536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.568074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.570167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:31.591536 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3409/6904] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:31 2022] PUT /identity/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/92878d24e1be46a3bfeef6c086e89051 => generated 523 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:31.603789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.690078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6760-99e6-4826-9e92-6154f9970275 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.697747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.698987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.699244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.699792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/92878d24e1be46a3bfeef6c086e89051/implies/5d98816567db40c1acf7c1489cc272f2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.701746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=92878d24e1be46a3bfeef6c086e89051, implied_role_id=5d98816567db40c1acf7c1489cc272f2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.704154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.705644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499be1-9eb7-4539-9333-8d0f8ad13a08 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.746629 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] 5d98816567db40c1acf7c1489cc272f2 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 5d98816567db40c1acf7c1489cc272f2 cannot be an implied roles. Apr 09 21:18:31.753294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3410/6905] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:31 2022] PUT /identity/v3/roles/92878d24e1be46a3bfeef6c086e89051/implies/5d98816567db40c1acf7c1489cc272f2 => generated 116 bytes in 159 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:31.755164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.777404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcfa61-eba5-46bb-babe-6622c6589abd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.791067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.792113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.792770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.794763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/92878d24e1be46a3bfeef6c086e89051` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.798172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d98816567db40c1acf7c1489cc272f2, implied_role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.800773 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:31.800773 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:31.800773 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:31.803963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.822343 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3411/6906] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:31 2022] DELETE /identity/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:31.826331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.834908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.835601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.835882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.836159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] PATH_INFO: `/v3/users/10418f53ef434172ba24367322166d33` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.839703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10418f53ef434172ba24367322166d33)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.841529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.909809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfbab0-ac14-40e2-aa6b-301ae5923737 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:31.915972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:31.916844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.917212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.917554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/dc8d5d9dfa27471a98dc35857d9f0957` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.919821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d98816567db40c1acf7c1489cc272f2, implied_role_id=dc8d5d9dfa27471a98dc35857d9f0957)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:31.921222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10418f53ef434172ba24367322166d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:31.921715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:31.922233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10418f53ef434172ba24367322166d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:31.932995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10418f53ef434172ba24367322166d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:31.935838 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3412/6907] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:31 2022] DELETE /identity/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/dc8d5d9dfa27471a98dc35857d9f0957 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:31.940003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:31.944005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10418f53ef434172ba24367322166d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:31.944947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-eeb9114d-f612-4093-ac1c-625798f434c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10418f53ef434172ba24367322166d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:31.970492 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3496/6908] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:31 2022] DELETE /identity/v3/users/10418f53ef434172ba24367322166d33 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:31.974019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:31.974019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:31.974256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:31.998866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:32.000067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.027629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579646-23a2-4013-9ec9-efb54d700abe tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.080238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3497/6909] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:32.080238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:32.080238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.091911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439e62b-2514-4445-899a-9b9655f1cb67 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.098334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.099196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.099478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.099754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] PATH_INFO: `/v3/users/c04a493bf2ca46bca03727104a87691b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.100974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04a493bf2ca46bca03727104a87691b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.103656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:32.106278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.107560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.107918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.108709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/dc8d5d9dfa27471a98dc35857d9f0957` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.110187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=dc8d5d9dfa27471a98dc35857d9f0957)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.112785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:32.157596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role dc8d5d9dfa27471a98dc35857d9f0957 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:32.157946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.160035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.162478 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3413/6910] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:31 2022] DELETE /identity/v3/roles/dc8d5d9dfa27471a98dc35857d9f0957 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:32.163342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:32.164644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.169148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04a493bf2ca46bca03727104a87691b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.174405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04a493bf2ca46bca03727104a87691b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.188489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04a493bf2ca46bca03727104a87691b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.200688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04a493bf2ca46bca03727104a87691b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.202028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04a493bf2ca46bca03727104a87691b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.223477 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3498/6911] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:32 2022] DELETE /identity/v3/users/c04a493bf2ca46bca03727104a87691b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:32.224282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:32.225947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.241724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b1bd-fcff-4fbe-b01e-f9b1acc2f2f0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.296670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ceccf-8fb4-4b5f-9854-2a2c18f21702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.297388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ceccf-8fb4-4b5f-9854-2a2c18f21702 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.297909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ceccf-8fb4-4b5f-9854-2a2c18f21702 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.298195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ceccf-8fb4-4b5f-9854-2a2c18f21702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.300207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d1ceccf-8fb4-4b5f-9854-2a2c18f21702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.321332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c62b-f19f-4dea-b02e-48b8904d6511 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.329404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.330850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.331323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.331674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/a2c4e806c82743faa6313f7f50123ccd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.349305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a2c4e806c82743faa6313f7f50123ccd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.352189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:32.372731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ceccf-8fb4-4b5f-9854-2a2c18f21702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.375693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ceccf-8fb4-4b5f-9854-2a2c18f21702 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:32.377618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.378475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.388961 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3414/6912] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:32.391346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.391899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.392366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.417643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.418344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.424896 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3499/6913] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:18:32 2022] PATCH /identity/v3/domains/a2c4e806c82743faa6313f7f50123ccd => generated 277 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:32.425524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:32.425524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.426426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:32.428304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.549757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34425e67-16e9-4621-b979-c27f02444792 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.556388 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3415/6914] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:32.560752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.561917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.562352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.563559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/a2c4e806c82743faa6313f7f50123ccd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.569089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:32.571466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.579974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a2c4e806c82743faa6313f7f50123ccd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.582589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:32.615018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.618867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.682279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd', 'request_id': 'req-97f0a3d3-6ce3-432b-8175-6f45d2286053'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.690144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd', 'request_id': 'req-97f0a3d3-6ce3-432b-8175-6f45d2286053'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.698875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1ae5-2ec9-48fb-b4de-f953c4fce5cd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.701426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd', 'request_id': 'req-97f0a3d3-6ce3-432b-8175-6f45d2286053'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.723190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] The token cache is being invalidate because project a2c4e806c82743faa6313f7f50123ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:32.723632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.724418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.739313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd', 'request_id': 'req-97f0a3d3-6ce3-432b-8175-6f45d2286053'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.748587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd', 'request_id': 'req-97f0a3d3-6ce3-432b-8175-6f45d2286053'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.749455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a2c4e806c82743faa6313f7f50123ccd', 'request_id': 'req-97f0a3d3-6ce3-432b-8175-6f45d2286053'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:32.759064 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3500/6915] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:18:32 2022] DELETE /identity/v3/domains/a2c4e806c82743faa6313f7f50123ccd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:32.763543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:32.767306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.774012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.774657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.774937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.775212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.777246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:32.856393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0a3d3-6ce3-432b-8175-6f45d2286053 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.861260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.862383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.862669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.862941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/a80b1c32a19a4ddbb97515ad87893da9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.864989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d98816567db40c1acf7c1489cc272f2, implied_role_id=a80b1c32a19a4ddbb97515ad87893da9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.866714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:32.867503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.870227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:32.878597 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3501/6916] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:32 2022] DELETE /identity/v3/roles/5d98816567db40c1acf7c1489cc272f2/implies/a80b1c32a19a4ddbb97515ad87893da9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:32.884482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:32.892130 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3416/6917] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:18:32.951811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78306d0f-75b2-42f6-83ab-23a89de57c56 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:32.958637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:32.959632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:32.960100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:32.960424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/a80b1c32a19a4ddbb97515ad87893da9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:32.961614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a80b1c32a19a4ddbb97515ad87893da9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:32.963283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.004047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role a80b1c32a19a4ddbb97515ad87893da9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:33.005026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.006070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.008549 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3502/6918] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:32 2022] DELETE /identity/v3/roles/a80b1c32a19a4ddbb97515ad87893da9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:33.013959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.031122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a2c5d-9d9e-4f25-ab21-a72560cddac4 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.111368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.112828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.114498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.116274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.116750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.118134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/5d98816567db40c1acf7c1489cc272f2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.120205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5d98816567db40c1acf7c1489cc272f2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.122452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.164715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 5d98816567db40c1acf7c1489cc272f2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:33.165095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.165697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.169079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3417/6919] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:33 2022] DELETE /identity/v3/roles/5d98816567db40c1acf7c1489cc272f2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:33.174621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.176418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.201798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c2f57-f995-478c-82ae-21127378d411 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.256796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1198-a9bd-4525-8dd6-c9e71b5af768 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.263835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.264975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.265279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.266087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.267867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.267994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.269186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.269654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.269952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.270060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] PATH_INFO: `/v3/projects/55bfa8219d074eb1b2e1f2469053cd8f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.271605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bfa8219d074eb1b2e1f2469053cd8f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.273816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.298031 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3418/6920] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:33 2022] PUT /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 519 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:33.302263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.358615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bfa8219d074eb1b2e1f2469053cd8f', 'request_id': 'req-11943ee8-4255-4a39-8f68-1af88dc14a01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.369521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bfa8219d074eb1b2e1f2469053cd8f', 'request_id': 'req-11943ee8-4255-4a39-8f68-1af88dc14a01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.386013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bfa8219d074eb1b2e1f2469053cd8f', 'request_id': 'req-11943ee8-4255-4a39-8f68-1af88dc14a01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.397443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbda50-e27e-40da-b80f-90c1a149529e tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.404161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] The token cache is being invalidate because project 55bfa8219d074eb1b2e1f2469053cd8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:33.404458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.405367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-11943ee8-4255-4a39-8f68-1af88dc14a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.407489 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3503/6921] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:33 2022] DELETE /identity/v3/projects/55bfa8219d074eb1b2e1f2469053cd8f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:33.414235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.414549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.414897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.442685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:33.445260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.493996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.495151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.495443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.496227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.498000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.498983 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:33.498983 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:33.498983 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:33.500174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.501381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.502753 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:33.502753 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:33.502753 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:33.503346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.513165 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3419/6922] 10.222.0.30 () {58 vars in 1344 bytes} [Sat Apr 9 21:18:33 2022] HEAD /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:33.513165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.514056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.545427 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3504/6923] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:33.547530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.553133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.568275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53943f-21b3-4909-a06d-d210138d26bc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.574296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591305fb-fd7e-418b-a0bc-23cf521d9c69 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.575423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591305fb-fd7e-418b-a0bc-23cf521d9c69 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.576349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591305fb-fd7e-418b-a0bc-23cf521d9c69 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.577396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591305fb-fd7e-418b-a0bc-23cf521d9c69 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.579404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591305fb-fd7e-418b-a0bc-23cf521d9c69 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.580798 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-591305fb-fd7e-418b-a0bc-23cf521d9c69 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:33.580798 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:33.580798 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:33.582073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591305fb-fd7e-418b-a0bc-23cf521d9c69 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.596412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3505/6924] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:18:33 2022] GET /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 519 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:33.596412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b581-d95c-4fe6-b8cb-2a5588f99cea None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.596412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b581-d95c-4fe6-b8cb-2a5588f99cea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.596412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b581-d95c-4fe6-b8cb-2a5588f99cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.632524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b322-7723-4e3b-914b-f5c835f0cfc8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.633007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0267b581-d95c-4fe6-b8cb-2a5588f99cea None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:33.634291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0267b581-d95c-4fe6-b8cb-2a5588f99cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.640107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.642161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.642438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.642707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] PATH_INFO: `/v3/projects/29174d3feed746e3b2763f341840c808` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.646385 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3506/6925] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:33.646385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b581-d95c-4fe6-b8cb-2a5588f99cea None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.646611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29174d3feed746e3b2763f341840c808)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.646611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.658340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b581-d95c-4fe6-b8cb-2a5588f99cea None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.665647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.666926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.667205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.667478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.669280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.671495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.697943 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3507/6926] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:33 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:33.699118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.719755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29174d3feed746e3b2763f341840c808', 'request_id': 'req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.726946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29174d3feed746e3b2763f341840c808', 'request_id': 'req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.741023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29174d3feed746e3b2763f341840c808', 'request_id': 'req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.768999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] The token cache is being invalidate because project 29174d3feed746e3b2763f341840c808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:33.769387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.771268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.780793 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3420/6927] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:33 2022] DELETE /identity/v3/projects/29174d3feed746e3b2763f341840c808 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:33.782439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.785711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.822539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c39b86-2414-48f9-a439-c7bb41eccfab tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.828194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.828953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.829275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.829541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.830280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:33.830609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.832305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.846097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3508/6928] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:33.846995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:33.850309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:33.864365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720f7b-6c6c-4c83-b989-9825c3e6eabb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.870924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.871843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.872115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.872389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] PATH_INFO: `/v3/users/7f909b179f094ddc9761096bdbeba1a4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.873686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f909b179f094ddc9761096bdbeba1a4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:33.875694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:33.887578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcfebd-f5f7-4638-8d08-af1bb9ac3242 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:33.970097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f909b179f094ddc9761096bdbeba1a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.971557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f909b179f094ddc9761096bdbeba1a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.982750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f909b179f094ddc9761096bdbeba1a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:33.985552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:33.988024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:33.989306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:33.989971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:33.994354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.000245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.013548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f909b179f094ddc9761096bdbeba1a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:34.014803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f909b179f094ddc9761096bdbeba1a4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:34.046859 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] aaedf4f639a84b5ba8c3307f18f31778 does not imply 78dedeca454e48a5bcaf5e62e29ddf5c.: keystone.exception.ImpliedRoleNotFound: aaedf4f639a84b5ba8c3307f18f31778 does not imply 78dedeca454e48a5bcaf5e62e29ddf5c. Apr 09 21:18:34.054700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3421/6929] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Apr 9 21:18:33 2022] GET /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 137 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:34.054700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.058035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:34.060925 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3509/6930] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:33 2022] DELETE /identity/v3/users/7f909b179f094ddc9761096bdbeba1a4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:34.061866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.068874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:34.096768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48e8a1-96d5-442f-813a-ffe6226b751c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.166140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07eb78-093e-4b7c-92c2-ee4d4ce1e4f9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.182047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb9722-3193-4dae-8705-a46d99c43cf3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.183337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9722-3193-4dae-8705-a46d99c43cf3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.183630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9722-3193-4dae-8705-a46d99c43cf3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.184052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9722-3193-4dae-8705-a46d99c43cf3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.191699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9722-3193-4dae-8705-a46d99c43cf3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.193728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9722-3193-4dae-8705-a46d99c43cf3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.200744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.201616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.201996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.202382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.203174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.205221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.235496 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-c8eb9722-3193-4dae-8705-a46d99c43cf3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] aaedf4f639a84b5ba8c3307f18f31778 does not imply 78dedeca454e48a5bcaf5e62e29ddf5c.: keystone.exception.ImpliedRoleNotFound: aaedf4f639a84b5ba8c3307f18f31778 does not imply 78dedeca454e48a5bcaf5e62e29ddf5c. Apr 09 21:18:34.250107 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3510/6931] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:34 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 137 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:34.251962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa15f6-3f40-4c17-b276-8358279e0858 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.255046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa15f6-3f40-4c17-b276-8358279e0858 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.255500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa15f6-3f40-4c17-b276-8358279e0858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.255921 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3422/6932] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:34 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:34.256969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.283931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f8aa15f6-3f40-4c17-b276-8358279e0858 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:34.285618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f8aa15f6-3f40-4c17-b276-8358279e0858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:34.344610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4651a-ede6-404c-8db5-380020be7f37 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.362278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.364880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.365192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.365473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.368106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.370152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.380420 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3511/6933] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:34.381448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa15f6-3f40-4c17-b276-8358279e0858 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.416312 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3423/6934] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:34 2022] PUT /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 519 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:34.416312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.420383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:34.527246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa15f6-3f40-4c17-b276-8358279e0858 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.566290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc9701-ad5f-43bc-9403-636e2967aa44 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.573614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.574292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.574718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.575253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.631392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.632437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.632764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.633056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.633768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.635905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.659246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.663331 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3512/6935] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:34 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:34.664231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.666110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.675636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3424/6936] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:18:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:18:34.683436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.700550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79835a-7126-4ed7-b966-6d2e002d1b0e service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.717833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.718934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.719393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.719826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.721391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.725242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.768494 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3425/6937] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:34 2022] GET /identity/v3/roles => generated 2320 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:34.773775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.797420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f129ab-8f90-4767-a36c-373c159dc79f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.812049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459341-6d5c-495e-8e7f-e43e7f5dca1a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.819453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.820601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.821119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.821641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.822625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.822917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.823895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.824182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.824459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.825860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.842474 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3426/6938] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:34 2022] GET /identity/v3/roles => generated 2320 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:34.845773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.846905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.847896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:34.882886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf68f1-8286-49b1-98d4-5ced9bece683 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.883829 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3513/6939] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:34 2022] PUT /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b => generated 520 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:34.889880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:34.967398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08793d-f042-415a-afc8-f62ed534faca tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:34.976771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:34.978309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:34.978309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:34.978530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:34.980922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b, implied_role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:34.983198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.022329 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3514/6940] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:34 2022] PUT /identity/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051 => generated 519 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:35.026457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:35.065701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b691f8a-40ce-4cba-a959-8415ff59fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.069643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b691f8a-40ce-4cba-a959-8415ff59fd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.070234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b691f8a-40ce-4cba-a959-8415ff59fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.073840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b691f8a-40ce-4cba-a959-8415ff59fd31 admin admin] PATH_INFO: `/v3/projects/169228e607bf4e5aab28729d44e6d177/users/585aa397329b4f8786c18e708a5bc413/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.108525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3806b24-a06d-4150-a23f-6c0ab056f424 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:35.112001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b691f8a-40ce-4cba-a959-8415ff59fd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169228e607bf4e5aab28729d44e6d177, user_id=585aa397329b4f8786c18e708a5bc413, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.113663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.114364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.114651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.115126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.116004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.117261 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:35.117261 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:35.117261 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:35.118552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.121215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b691f8a-40ce-4cba-a959-8415ff59fd31 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.139703 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3515/6941] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:18:35 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:35.144851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:35.158951 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3427/6942] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:34 2022] PUT /identity/v3/projects/169228e607bf4e5aab28729d44e6d177/users/585aa397329b4f8786c18e708a5bc413/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:35.167214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a283784-f68a-47f1-9459-4472abb63048 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.167592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087aa61-b308-475f-b48c-efba806ead9f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:35.169431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a283784-f68a-47f1-9459-4472abb63048 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.169954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a283784-f68a-47f1-9459-4472abb63048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.214409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3a283784-f68a-47f1-9459-4472abb63048 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:35.217897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3a283784-f68a-47f1-9459-4472abb63048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:35.303852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.304848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.305161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.305442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.308043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b, implied_role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.313389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.334838 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3428/6943] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:35.340104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3516/6944] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:35 2022] DELETE /identity/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:35.344698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a283784-f68a-47f1-9459-4472abb63048 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:35.366550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:35.368982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:35.377280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a283784-f68a-47f1-9459-4472abb63048 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:35.504216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac8eb7-4c04-4a0c-b1a5-e2805d141f1f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:35.519000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.519741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.520021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.520292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.571663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.575812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.576107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.576392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.589025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.596847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.630426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3429/6945] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:35 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:35.632653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:35.669469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.675666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.704721 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3517/6946] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:18:35.741129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614d6af-0d3d-4d6e-a0e3-fe76e878c9eb tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:35.759626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.760859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.761681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.762500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.766999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.769176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.790575 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3430/6947] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:35 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:35.793883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:35.831252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4011f0-a4fb-4450-8791-ce9fd9dcd247 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:35.918139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.919087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.919479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.919937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.921151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.923505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:35.943328 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3518/6948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:35 2022] GET /identity/v3/roles => generated 2320 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:35.945100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:35.962620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c824b-d6ff-4084-a6cf-cf77e246f7d2 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:35.975617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:35.976716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:35.977259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:35.977786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:35.978934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:35.980860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:36.005910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:36.007800 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3431/6949] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Apr 9 21:18:35 2022] POST /identity/v3/roles => generated 234 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:36.019955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2ff1-e3b9-43d1-8ca1-d27491b5c00a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:36.035805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:36.037311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.037865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.038411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/401b4eed5a16462dacf0331f542c45ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.040373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:update_role(role_id=401b4eed5a16462dacf0331f542c45ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:36.042048 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:36.042048 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:36.042048 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:36.046349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:36.101393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3519/6950] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Apr 9 21:18:36 2022] PATCH /identity/v3/roles/401b4eed5a16462dacf0331f542c45ab => generated 238 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:18:36.103517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:36.122278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c46c-f9f6-45a6-8084-cc17f29576b9 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:36.129989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:36.132637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.133343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.134558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/401b4eed5a16462dacf0331f542c45ab` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.154423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:get_role(role_id=401b4eed5a16462dacf0331f542c45ab)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:36.156165 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:36.156165 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:18:36.156165 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:18:36.157940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:36.168196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:36.177375 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3432/6951] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:18:36 2022] GET /identity/v3/roles/401b4eed5a16462dacf0331f542c45ab => generated 238 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:36.179857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:36.185967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9f0a8-b3a4-4048-8724-34c156d0dcba tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:36.189170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:36.200763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:36.202417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.204240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.205338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.206336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:36.210075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:36.270588 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3520/6952] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:36 2022] GET /identity/v3/roles => generated 2549 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:36.273239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:36.302907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fc751-f83d-4bd7-b450-cf4e818b5c4a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:36.321697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:36.322678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.323039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.323281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/401b4eed5a16462dacf0331f542c45ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.328418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_role(role_id=401b4eed5a16462dacf0331f542c45ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:36.332287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:36.397403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17c9a-92ee-4d16-a497-0849bf70d58f tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:36.407649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:36.408713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.409100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.409724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] PATH_INFO: `/v3/projects/d48fac9e29ee41aa83b3953d99640240` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.411026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48fac9e29ee41aa83b3953d99640240)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:36.427706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 401b4eed5a16462dacf0331f542c45ab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:36.429115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:36.449941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:36.450281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:36.458709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3521/6953] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:36 2022] DELETE /identity/v3/roles/401b4eed5a16462dacf0331f542c45ab => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:36.464600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:36.468759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:36.574957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48fac9e29ee41aa83b3953d99640240', 'request_id': 'req-25c0c467-1f01-4e36-a21b-c2f28c8e154b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:36.595472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48fac9e29ee41aa83b3953d99640240', 'request_id': 'req-25c0c467-1f01-4e36-a21b-c2f28c8e154b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:36.602347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ead6-60d2-4b50-880b-e054afbee92a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:36.618043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48fac9e29ee41aa83b3953d99640240', 'request_id': 'req-25c0c467-1f01-4e36-a21b-c2f28c8e154b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:36.637379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] The token cache is being invalidate because project d48fac9e29ee41aa83b3953d99640240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:36.637612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:36.640225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-25c0c467-1f01-4e36-a21b-c2f28c8e154b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:36.641198 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3433/6954] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:36 2022] DELETE /identity/v3/projects/d48fac9e29ee41aa83b3953d99640240 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:36.646191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111f37-5dec-4585-b1e8-3c7eadbdae86 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.646479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111f37-5dec-4585-b1e8-3c7eadbdae86 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.646757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111f37-5dec-4585-b1e8-3c7eadbdae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.682414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-86111f37-5dec-4585-b1e8-3c7eadbdae86 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:36.684344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-86111f37-5dec-4585-b1e8-3c7eadbdae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:36.727821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:36.729594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.729866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.730139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.733888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:36.736230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:36.808282 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3522/6955] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:36 2022] PUT /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 519 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:36.816271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:36.832671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:36.847555 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3434/6956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:36.856898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ccb76-619e-4be1-81b6-575624236232 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:36.857993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ccb76-619e-4be1-81b6-575624236232 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:36.858281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ccb76-619e-4be1-81b6-575624236232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:36.895000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6e0ccb76-619e-4be1-81b6-575624236232 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:36.897162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e0ccb76-619e-4be1-81b6-575624236232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:37.008917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd8db-8c88-4961-ad6a-8a79bb5d2d48 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.025992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.032513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.033551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.034619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.038346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.042136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.066273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3435/6957] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:37.069985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ccb76-619e-4be1-81b6-575624236232 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.082426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ccb76-619e-4be1-81b6-575624236232 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.092285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.095971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.098547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.100183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.101023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:37.101379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.105136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.116038 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3523/6958] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:36 2022] PUT /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b => generated 520 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:37.120787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.142684 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3436/6959] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:37.148784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.175001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a50ed6-7acc-4e6f-b77a-df32fcff1481 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.279393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c954a-7651-42f0-85d2-450f8ae8c257 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.292754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.293986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.294376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.294778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.299339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b, implied_role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.301515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.305985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.310946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.311627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.312070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.312949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.316038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.363142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3524/6960] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Apr 9 21:18:37 2022] PUT /identity/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051 => generated 519 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:37.378578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.385134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3437/6961] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:37 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:37.386287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.526306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32ac7-69d5-43dd-a425-174c2a7f8b40 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.531223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.531925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.532199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.532477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.533324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.535318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.567774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3438/6962] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:37 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:37.569815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.596039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ce279-92c9-4b3b-b503-c70d45023934 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.615841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3d503-f841-470d-a30b-25f3c400604b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.628315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.630998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.631566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.632243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.634500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.637979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.670917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.671888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.672263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.672629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.673883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3439/6963] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:37 2022] GET /identity/v3/roles => generated 2320 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:37.674284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.675064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.675896 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:18:37.675896 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:18:37.675896 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:18:37.676898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.684347 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3525/6964] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:18:37 2022] GET /identity/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies => generated 488 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:37.688043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.703483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371af1e7-ed4b-4361-b704-f9f06e273fe2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.706629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64628899-f47b-4e03-817c-7148c7abfa6c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.717945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.719512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.719804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.720084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.724187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.727546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.728563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.730027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.732154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.732543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.738127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.744713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.753417 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3526/6965] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:18:37 2022] GET /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies => generated 659 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:37.756633 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3440/6966] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:37 2022] GET /identity/v3/roles => generated 2320 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:37.757477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.763092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.778196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b710-fc84-4a33-a191-fedae15b0ea0 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.788056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.788778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bc597-9146-46a8-81fe-67f9ade8df0d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:37.789852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.790271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.790645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.795763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b, implied_role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.797715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.802890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86eebd-c1bc-47da-9287-80fa259c329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:37.803951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86eebd-c1bc-47da-9287-80fa259c329b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.806664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86eebd-c1bc-47da-9287-80fa259c329b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.807773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86eebd-c1bc-47da-9287-80fa259c329b admin admin] PATH_INFO: `/v3/projects/440128cc2c7b4e28934c5d6bb38cacb0/users/bd216ee101c14da9b9113476aa00bc70/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.832413 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3527/6967] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:37 2022] DELETE /identity/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b/implies/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:37.836493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:37.848305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86eebd-c1bc-47da-9287-80fa259c329b admin admin] RBAC: Authorizing `identity:create_grant(project_id=440128cc2c7b4e28934c5d6bb38cacb0, user_id=bd216ee101c14da9b9113476aa00bc70, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:37.855693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86eebd-c1bc-47da-9287-80fa259c329b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:37.898355 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3441/6968] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:37 2022] PUT /identity/v3/projects/440128cc2c7b4e28934c5d6bb38cacb0/users/bd216ee101c14da9b9113476aa00bc70/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:37.901145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c73252-7b63-4f32-8a61-3a6a138ffb99 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:37.901495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c73252-7b63-4f32-8a61-3a6a138ffb99 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:37.901780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c73252-7b63-4f32-8a61-3a6a138ffb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:37.980907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d9c73252-7b63-4f32-8a61-3a6a138ffb99 None None] MFA Rules not processed for user `bd216ee101c14da9b9113476aa00bc70`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:37.984433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d9c73252-7b63-4f32-8a61-3a6a138ffb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:38.008532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52b70-cea6-4365-b687-f83e6eeb6f00 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.171207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:38.172327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:38.172596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:38.172963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:38.176312 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3442/6969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:38.178449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:38.180999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:38.186988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c73252-7b63-4f32-8a61-3a6a138ffb99 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:38.207559 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3528/6970] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:37 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/e42b44b9ae1f4c6381c1aaf286cb7b5b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:38.212057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:38.372800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c73252-7b63-4f32-8a61-3a6a138ffb99 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.376476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825c2fb-1ae8-4812-98b7-46120928009b tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.395117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:38.396095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:38.396378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:38.396653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:38.402401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aaedf4f639a84b5ba8c3307f18f31778, implied_role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:38.404075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:38.432415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3529/6971] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Apr 9 21:18:38 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778/implies/78dedeca454e48a5bcaf5e62e29ddf5c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:38.433764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:38.563052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:38.564183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:38.564615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:38.565683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:38.566662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:38.568773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:38.577301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770bd0b-db0f-491b-9833-ab6783c53e9c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.595634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:38.599245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:38.600721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:38.601147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/a2c4e806c82743faa6313f7f50123ccd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:38.613151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:18:38.629018 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3443/6972] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:38 2022] POST /identity/v3/projects => generated 373 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:38.632886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:38.640499 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Could not find domain: a2c4e806c82743faa6313f7f50123ccd.: keystone.exception.DomainNotFound: Could not find domain: a2c4e806c82743faa6313f7f50123ccd. Apr 09 21:18:38.645343 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3530/6973] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:18:38 2022] PATCH /identity/v3/domains/a2c4e806c82743faa6313f7f50123ccd => generated 112 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:18:38.650847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:38.684271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d98c2-c8ab-412c-9f79-1d713bd4760c tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.779842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5374367-1e65-46e1-b18d-0fd92db2cea3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.790725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:38.791467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:38.791925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:38.793476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:38.794618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:38.801309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:38.813015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:38.817014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:38.817405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:38.817723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/users/10c683dd0e174d0ab21aa7669cc3c0fe` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:38.819759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_user(user_id=10c683dd0e174d0ab21aa7669cc3c0fe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:38.823112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:38.848009 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3444/6974] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:38 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:38.855172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:38.883204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ebafc-7e84-4023-82b7-e9ea788255c8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.899003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:38.899840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:38.906356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:38.907017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:38.909450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:38.914189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:38.953753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c683dd0e174d0ab21aa7669cc3c0fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:38.956056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c683dd0e174d0ab21aa7669cc3c0fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:38.960640 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3445/6975] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:38 2022] GET /identity/v3/roles => generated 2320 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:38.964270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:38.969606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c683dd0e174d0ab21aa7669cc3c0fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:38.992082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76a7a-48b2-42d7-a029-c10748f48245 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:38.994899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c683dd0e174d0ab21aa7669cc3c0fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:38.995961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c683dd0e174d0ab21aa7669cc3c0fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:39.020836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:39.025236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:39.025596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:39.025898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] PATH_INFO: `/v3/projects/fdfaa853c8004c5eacd3b12120ed3931/users/100cce440ab24d988ad70abdc13786d9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:39.059537 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3531/6976] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:38 2022] DELETE /identity/v3/users/10c683dd0e174d0ab21aa7669cc3c0fe => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:39.063361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:39.065103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:39.089520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfaa853c8004c5eacd3b12120ed3931, user_id=100cce440ab24d988ad70abdc13786d9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:39.103695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:39.156216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3446/6977] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:38 2022] PUT /identity/v3/projects/fdfaa853c8004c5eacd3b12120ed3931/users/100cce440ab24d988ad70abdc13786d9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:39.161912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:39.169881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:39.262333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc862bf7-245a-45cd-b4b8-ce5d060310b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:39.425735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6404d-0d5a-4d9c-b648-53be96575513 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:39.453878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:39.453878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:39.453878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:39.454392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:39.466960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:39.470565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:39.488351 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3447/6978] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:39 2022] GET /identity/v3/roles => generated 2320 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:39.489316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:39.503147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76675-0e80-4e6e-b527-3a04d164be3c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:39.514681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffe3c9-8b7a-4314-a198-3591bb419a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:39.515763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffe3c9-8b7a-4314-a198-3591bb419a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:39.516580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:39.517628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:39.518019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffe3c9-8b7a-4314-a198-3591bb419a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:39.518711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffe3c9-8b7a-4314-a198-3591bb419a96 admin admin] PATH_INFO: `/v3/projects/fdfaa853c8004c5eacd3b12120ed3931/users/100cce440ab24d988ad70abdc13786d9/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:39.519927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:39.520306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/92878d24e1be46a3bfeef6c086e89051` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:39.522483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_role(role_id=92878d24e1be46a3bfeef6c086e89051)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:39.523465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffe3c9-8b7a-4314-a198-3591bb419a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfaa853c8004c5eacd3b12120ed3931, user_id=100cce440ab24d988ad70abdc13786d9, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:39.527071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:39.531924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffe3c9-8b7a-4314-a198-3591bb419a96 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:39.576532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3448/6979] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:39 2022] PUT /identity/v3/projects/fdfaa853c8004c5eacd3b12120ed3931/users/100cce440ab24d988ad70abdc13786d9/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:39.593996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2b8b9-b946-4e8f-84d9-a9edc0b2d2a4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:39.595500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2b8b9-b946-4e8f-84d9-a9edc0b2d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:39.600422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2b8b9-b946-4e8f-84d9-a9edc0b2d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:39.640379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 92878d24e1be46a3bfeef6c086e89051 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:39.640989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:39.643584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:39.646513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3532/6980] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:39 2022] DELETE /identity/v3/roles/92878d24e1be46a3bfeef6c086e89051 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:39.668283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:39.674865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:39.693829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5af2b8b9-b946-4e8f-84d9-a9edc0b2d2a4 None None] MFA Rules not processed for user `100cce440ab24d988ad70abdc13786d9`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:39.701521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5af2b8b9-b946-4e8f-84d9-a9edc0b2d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:39.825690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ba6c-299b-4b64-9607-032892170bcd tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:39.842001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:39.844663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:39.844834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:39.845129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/groups/896cb979b5b04b95b2c2d3f3a370adb4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:39.849067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_group(group_id=896cb979b5b04b95b2c2d3f3a370adb4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:39.852779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:39.869127 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3449/6981] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:39.874282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2b8b9-b946-4e8f-84d9-a9edc0b2d2a4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:39.886969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2b8b9-b946-4e8f-84d9-a9edc0b2d2a4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:39.893310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100cce440ab24d988ad70abdc13786d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdfaa853c8004c5eacd3b12120ed3931', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:39.894712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:39.895418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:39.896007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:39.898088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:39.898635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:39.900545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:39.923104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3450/6982] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:39.930303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:39.950653 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3533/6983] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Apr 9 21:18:39 2022] DELETE /identity/v3/groups/896cb979b5b04b95b2c2d3f3a370adb4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:39.955275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:39.966082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85a94-bea4-4c8c-84f7-faebac203f6f tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:40.100423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e1e5f-ad7b-4152-9231-7003158bd8b8 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:40.116234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:40.117358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:40.117649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:40.117923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/projects/366c9993bec84008b63f73c491da6d14` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:40.120456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_project(project_id=366c9993bec84008b63f73c491da6d14)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:40.122195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100cce440ab24d988ad70abdc13786d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdfaa853c8004c5eacd3b12120ed3931', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:40.122892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:40.123174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:40.123447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:40.124143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:40.124965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:40.126084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:40.256071 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3451/6984] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:39 2022] POST /identity/v3/projects => generated 350 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:40.259681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:40.280733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366c9993bec84008b63f73c491da6d14', 'request_id': 'req-793e699a-dd31-43ae-9c8d-c3b419da630a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.296011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366c9993bec84008b63f73c491da6d14', 'request_id': 'req-793e699a-dd31-43ae-9c8d-c3b419da630a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.307905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366c9993bec84008b63f73c491da6d14', 'request_id': 'req-793e699a-dd31-43ae-9c8d-c3b419da630a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.327522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] The token cache is being invalidate because project 366c9993bec84008b63f73c491da6d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:40.327522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.332716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.337889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3534/6985] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:39 2022] DELETE /identity/v3/projects/366c9993bec84008b63f73c491da6d14 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:40.341558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:40.343850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:40.413226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ae79-7dc3-4bcf-a9e3-db034786b809 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:40.427424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100cce440ab24d988ad70abdc13786d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdfaa853c8004c5eacd3b12120ed3931', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:40.428302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:40.428701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:40.429138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:40.430065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:40.430501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:40.432281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:40.465908 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3452/6986] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:18:40.490465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:40.491915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e699a-dd31-43ae-9c8d-c3b419da630a tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:40.492210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:40.622316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:40.624228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:40.624228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:40.624228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:40.626157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=440d0208a5184453be282191e6db4bd4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:40.627835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:40.673392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '440d0208a5184453be282191e6db4bd4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.675700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '440d0208a5184453be282191e6db4bd4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.685115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a552-3338-47fd-82e7-292779c63404 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:40.728447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '440d0208a5184453be282191e6db4bd4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.729172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '440d0208a5184453be282191e6db4bd4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.732137 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3535/6987] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:18:40 2022] PATCH /identity/v3/domains/440d0208a5184453be282191e6db4bd4 => generated 275 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:40.735699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:40.737166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:40.840850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:40.841702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:40.841987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:40.845080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:40.856931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:40.866801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c02ae-3cff-493e-85f8-4d1fc66472b6 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:40.883485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:40.884393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:40.884824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:40.885147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/domains/440d0208a5184453be282191e6db4bd4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:40.910746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=440d0208a5184453be282191e6db4bd4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:40.912456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:40.966269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '440d0208a5184453be282191e6db4bd4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:40.970493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '440d0208a5184453be282191e6db4bd4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.069095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:41.073001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:41.098751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440d0208a5184453be282191e6db4bd4', 'request_id': 'req-6b0998a1-661b-4db6-9639-474950efb4c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.101635 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3453/6988] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:41.108166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440d0208a5184453be282191e6db4bd4', 'request_id': 'req-6b0998a1-661b-4db6-9639-474950efb4c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.139966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440d0208a5184453be282191e6db4bd4', 'request_id': 'req-6b0998a1-661b-4db6-9639-474950efb4c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.162844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] The token cache is being invalidate because project 440d0208a5184453be282191e6db4bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:41.163233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.163844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.174548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '440d0208a5184453be282191e6db4bd4', 'request_id': 'req-6b0998a1-661b-4db6-9639-474950efb4c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.184214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '440d0208a5184453be282191e6db4bd4', 'request_id': 'req-6b0998a1-661b-4db6-9639-474950efb4c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.184941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '440d0208a5184453be282191e6db4bd4', 'request_id': 'req-6b0998a1-661b-4db6-9639-474950efb4c3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.211212 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3536/6989] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:18:40 2022] DELETE /identity/v3/domains/440d0208a5184453be282191e6db4bd4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:41.216076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:41.235361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537666bb-66bd-4085-b7a4-76cceffd2d7d service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:41.387821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:41.389363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:41.390128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:41.390477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:41.398554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e42b44b9ae1f4c6381c1aaf286cb7b5b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:41.400391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:41.532527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role e42b44b9ae1f4c6381c1aaf286cb7b5b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:41.532796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.554474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.581485 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3454/6990] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:41 2022] DELETE /identity/v3/roles/e42b44b9ae1f4c6381c1aaf286cb7b5b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:41.585485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:41.587419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:41.610829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0998a1-661b-4db6-9639-474950efb4c3 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:41.754283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:41.756695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:41.756982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:41.757283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/78dedeca454e48a5bcaf5e62e29ddf5c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:41.761983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_role(role_id=78dedeca454e48a5bcaf5e62e29ddf5c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:41.768455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:41.853152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role 78dedeca454e48a5bcaf5e62e29ddf5c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:41.853626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.854412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:41.860482 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3537/6991] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:41 2022] DELETE /identity/v3/roles/78dedeca454e48a5bcaf5e62e29ddf5c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:41.865839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:41.869532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:41.921932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535299c-dcd3-4e9f-9a56-6c93c4b1a3a4 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:42.096671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48a4b09074a4f7388a5e2df4a069b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d8f82b2e60407bb87e75d12e30ad15', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:42.098591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:42.099102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:42.099619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] PATH_INFO: `/v3/roles/aaedf4f639a84b5ba8c3307f18f31778` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:42.105776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aaedf4f639a84b5ba8c3307f18f31778)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:42.108368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:42.192365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invalidating the token cache because role aaedf4f639a84b5ba8c3307f18f31778 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:42.198930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:42.200271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5e517fe1-db6c-437d-82b9-b493125f3703 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:42.216090 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3455/6992] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:41 2022] DELETE /identity/v3/roles/aaedf4f639a84b5ba8c3307f18f31778 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:42.220358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:42.223043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:42.409553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c92a0c-9c16-43a9-ae58-508ea68d2869 tempest-RolesV3TestJSON-1369570745 tempest-RolesV3TestJSON-1369570745-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:42.538383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:42.540400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:42.540913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:42.541762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] PATH_INFO: `/v3/users/34dd37a6e1714162a6feb7584a7e6330` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:42.544636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=34dd37a6e1714162a6feb7584a7e6330)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:42.547252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:42.669580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34dd37a6e1714162a6feb7584a7e6330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:42.671561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34dd37a6e1714162a6feb7584a7e6330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:42.691581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34dd37a6e1714162a6feb7584a7e6330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:42.708595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34dd37a6e1714162a6feb7584a7e6330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:42.709344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34dd37a6e1714162a6feb7584a7e6330'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:42.787443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:42.787731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:42.788013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:42.797618 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3538/6993] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:42 2022] DELETE /identity/v3/users/34dd37a6e1714162a6feb7584a7e6330 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:42.827301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:42.836061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:42.957113 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3456/6994] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:43.177427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:43.180355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:43.280157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb131f-5813-4a0e-80bc-99e500d1f8fc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:43.284170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:43.284912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:43.286017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:43.286424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:43.298244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:43.300191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:43.318280 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3539/6995] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:18:44.908208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:44.910488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:44.932036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e23b9-5e6d-470b-ba64-af861f5fe646 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:44.946337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:44.947245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:44.947530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:44.947807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] PATH_INFO: `/v3/projects/d989d0c21c364eecb624511d989f59f9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:44.951415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d989d0c21c364eecb624511d989f59f9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:44.953424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:45.053889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd989d0c21c364eecb624511d989f59f9', 'request_id': 'req-4874caa1-2296-4e6e-ab11-665347452df8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.061292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd989d0c21c364eecb624511d989f59f9', 'request_id': 'req-4874caa1-2296-4e6e-ab11-665347452df8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.074387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd989d0c21c364eecb624511d989f59f9', 'request_id': 'req-4874caa1-2296-4e6e-ab11-665347452df8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.104039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] The token cache is being invalidate because project d989d0c21c364eecb624511d989f59f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:45.105896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.107194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.111964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3457/6996] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:44 2022] DELETE /identity/v3/projects/d989d0c21c364eecb624511d989f59f9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:45.116493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:45.128776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9804ac-59b7-4aea-9ed9-8d80c73e9061 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:45.272102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:45.273225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:45.273354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:45.273625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] PATH_INFO: `/v3/users/b48a4b09074a4f7388a5e2df4a069b2c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:45.274881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48a4b09074a4f7388a5e2df4a069b2c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:45.277226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:45.377741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48a4b09074a4f7388a5e2df4a069b2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.378359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48a4b09074a4f7388a5e2df4a069b2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.386731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48a4b09074a4f7388a5e2df4a069b2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.410980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48a4b09074a4f7388a5e2df4a069b2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.413541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-14007fb6-d453-411f-8b7d-9a55f3f631f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48a4b09074a4f7388a5e2df4a069b2c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:45.488304 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3540/6997] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:45 2022] DELETE /identity/v3/users/b48a4b09074a4f7388a5e2df4a069b2c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:46.193847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:46.195334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:46.209559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874caa1-2296-4e6e-ab11-665347452df8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:46.435770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:46.439252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:46.441515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:46.442361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] PATH_INFO: `/v3/projects/45d8f82b2e60407bb87e75d12e30ad15` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:46.446821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d8f82b2e60407bb87e75d12e30ad15)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:46.453725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:46.561970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d8f82b2e60407bb87e75d12e30ad15', 'request_id': 'req-4927cc4d-5692-4071-a53f-3b0b9b8553f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:46.568209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d8f82b2e60407bb87e75d12e30ad15', 'request_id': 'req-4927cc4d-5692-4071-a53f-3b0b9b8553f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:46.582425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d8f82b2e60407bb87e75d12e30ad15', 'request_id': 'req-4927cc4d-5692-4071-a53f-3b0b9b8553f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:46.624720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] The token cache is being invalidate because project 45d8f82b2e60407bb87e75d12e30ad15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:46.627505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:46.629279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4927cc4d-5692-4071-a53f-3b0b9b8553f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:46.637528 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3458/6998] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:46 2022] DELETE /identity/v3/projects/45d8f82b2e60407bb87e75d12e30ad15 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:46.642641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:46.642641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:46.643122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:46.694067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:46.698259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:46.877911 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3541/6999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:46.885979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20593b5-ca6c-484f-ae73-72252f0b5b15 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:46.886692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20593b5-ca6c-484f-ae73-72252f0b5b15 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:46.887412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20593b5-ca6c-484f-ae73-72252f0b5b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:46.891570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:46.901673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:46.932943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a20593b5-ca6c-484f-ae73-72252f0b5b15 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:46.935782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a20593b5-ca6c-484f-ae73-72252f0b5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:46.957157 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3459/7000] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:46.960397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20593b5-ca6c-484f-ae73-72252f0b5b15 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:46.982095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20593b5-ca6c-484f-ae73-72252f0b5b15 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:46.993999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:46.996443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:46.996812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:46.997413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:46.998784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:47.000390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.003020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.033772 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3460/7001] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:47.037532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:47.062716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fea2d-b9ca-4d83-9b89-9fc860f0c946 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:47.068792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10af267-8c67-4ee1-a31e-7ffbf1088461 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:47.069722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100cce440ab24d988ad70abdc13786d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdfaa853c8004c5eacd3b12120ed3931', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:47.070925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.071877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.072317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] PATH_INFO: `/v3/projects/1b8b760e5c7e4c85b4aa0dc0d5d3adf9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.073918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b8b760e5c7e4c85b4aa0dc0d5d3adf9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.076165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.100381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:47.103807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.104221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.107407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.109980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.119271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.181389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8b760e5c7e4c85b4aa0dc0d5d3adf9', 'request_id': 'req-556f5f3d-6832-4a86-8b22-90a4dd32f375'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.194013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8b760e5c7e4c85b4aa0dc0d5d3adf9', 'request_id': 'req-556f5f3d-6832-4a86-8b22-90a4dd32f375'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.194817 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3461/7002] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:47 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:47.198673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:47.209548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8b760e5c7e4c85b4aa0dc0d5d3adf9', 'request_id': 'req-556f5f3d-6832-4a86-8b22-90a4dd32f375'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.231889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] The token cache is being invalidate because project 1b8b760e5c7e4c85b4aa0dc0d5d3adf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:47.232821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.234215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.237767 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3542/7003] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:46 2022] DELETE /identity/v3/projects/1b8b760e5c7e4c85b4aa0dc0d5d3adf9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:47.246071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:47.248578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:47.316466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dfd27-cd34-4c33-a34e-5c7a0223e9ef admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:47.328543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:47.329664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.330963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.331310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.332492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.337115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.398050 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3462/7004] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:47 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:47.402389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:47.406273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:47.413871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f5f3d-6832-4a86-8b22-90a4dd32f375 tempest-QuotasNegativeTest-1189759383 tempest-QuotasNegativeTest-1189759383-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:47.427667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:47.430439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.430727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.433937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] PATH_INFO: `/v3/users/bd216ee101c14da9b9113476aa00bc70` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.440806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd216ee101c14da9b9113476aa00bc70)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.457804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.460202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f280a-701b-489a-8583-10d7b0cc5e01 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:47.466154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:47.467159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.467536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.467902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.469279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.471020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.553067 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3463/7005] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:47.562414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:47.572188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd216ee101c14da9b9113476aa00bc70'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.573643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd216ee101c14da9b9113476aa00bc70'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.598875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd216ee101c14da9b9113476aa00bc70'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.601261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55d26-7c2d-4113-b384-918e2085b08f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:47.613006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:47.613511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd216ee101c14da9b9113476aa00bc70'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.614251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ebbbfcf0-70a3-4c7d-b0f5-3397ac02fdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd216ee101c14da9b9113476aa00bc70'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:47.614896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.615919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.616956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.619185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.625262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.638557 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3543/7006] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:47 2022] DELETE /identity/v3/users/bd216ee101c14da9b9113476aa00bc70 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:47.639960 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3464/7007] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:47.645236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c48386-b91e-4122-8abf-5b9b7022773d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.645702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c48386-b91e-4122-8abf-5b9b7022773d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.645971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c48386-b91e-4122-8abf-5b9b7022773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.657336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:47.660431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:47.676946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-75c48386-b91e-4122-8abf-5b9b7022773d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:47.678864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75c48386-b91e-4122-8abf-5b9b7022773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:47.680585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf92af-611e-4185-9f86-fe6f21ad57f5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:47.828835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:47.830213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.830489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.831467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] PATH_INFO: `/v3/projects/585bb96e15864a6a8d8b1190f1dba30a/users/91d19a8f9cc34ac68115873336b8657b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.837658 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3544/7008] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:47.869843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585bb96e15864a6a8d8b1190f1dba30a, user_id=91d19a8f9cc34ac68115873336b8657b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:47.873372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:47.916369 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3465/7009] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:47 2022] PUT /identity/v3/projects/585bb96e15864a6a8d8b1190f1dba30a/users/91d19a8f9cc34ac68115873336b8657b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:47.927879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ee58-dd65-4ae9-8026-3d27a321e125 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:47.928475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ee58-dd65-4ae9-8026-3d27a321e125 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:47.929077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ee58-dd65-4ae9-8026-3d27a321e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:47.998347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b907ee58-dd65-4ae9-8026-3d27a321e125 None None] MFA Rules not processed for user `91d19a8f9cc34ac68115873336b8657b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:48.006476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b907ee58-dd65-4ae9-8026-3d27a321e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:48.093143 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3545/7010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:48.101209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.117016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae833-3c64-463b-9a74-bb531a2d9552 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:48.127956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892fda-ae0a-4b2b-8d2e-a81f78a43928 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d19a8f9cc34ac68115873336b8657b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585bb96e15864a6a8d8b1190f1dba30a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:48.129292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892fda-ae0a-4b2b-8d2e-a81f78a43928 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.130248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892fda-ae0a-4b2b-8d2e-a81f78a43928 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.130248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892fda-ae0a-4b2b-8d2e-a81f78a43928 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] PATH_INFO: `/v3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.139858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ee58-dd65-4ae9-8026-3d27a321e125 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.150997 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3466/7011] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/v3 => generated 255 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:48.151248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ee58-dd65-4ae9-8026-3d27a321e125 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:48.156207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bac3f-c636-464d-9b66-a660f6a064ce tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d19a8f9cc34ac68115873336b8657b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585bb96e15864a6a8d8b1190f1dba30a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:48.157177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bac3f-c636-464d-9b66-a660f6a064ce tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.157576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bac3f-c636-464d-9b66-a660f6a064ce tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.157958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bac3f-c636-464d-9b66-a660f6a064ce tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] PATH_INFO: `/v3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.166611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3546/7012] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/v3 => generated 255 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:48.167758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892fda-ae0a-4b2b-8d2e-a81f78a43928 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.178078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892fda-ae0a-4b2b-8d2e-a81f78a43928 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:48.182794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1772e8b-214b-45dc-a929-9dfd635bd936 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d19a8f9cc34ac68115873336b8657b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585bb96e15864a6a8d8b1190f1dba30a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:48.183718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1772e8b-214b-45dc-a929-9dfd635bd936 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.184241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1772e8b-214b-45dc-a929-9dfd635bd936 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.184778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1772e8b-214b-45dc-a929-9dfd635bd936 tempest-TestApiDiscovery-1315145270 tempest-TestApiDiscovery-1315145270-project] PATH_INFO: `/v3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.197374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3467/7013] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/v3 => generated 255 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:48.198907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82378a-05e4-4eae-bbb6-fcff26387fc4 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.199193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82378a-05e4-4eae-bbb6-fcff26387fc4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.199470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82378a-05e4-4eae-bbb6-fcff26387fc4 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.200986 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3547/7014] 10.222.0.30 () {56 vars in 894 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 21:18:48.208970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988a518-4b52-4f72-9b63-47e76b08b79e None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.213520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988a518-4b52-4f72-9b63-47e76b08b79e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.213822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988a518-4b52-4f72-9b63-47e76b08b79e None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.215664 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3468/7015] 10.222.0.30 () {56 vars in 894 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/ => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:18:48.221959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82378a-05e4-4eae-bbb6-fcff26387fc4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.303430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988a518-4b52-4f72-9b63-47e76b08b79e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.305935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6988a518-4b52-4f72-9b63-47e76b08b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:48.370820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82378a-05e4-4eae-bbb6-fcff26387fc4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:48.383825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:48.384732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.385006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.385297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] PATH_INFO: `/v3/users/91d19a8f9cc34ac68115873336b8657b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.386648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d19a8f9cc34ac68115873336b8657b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:48.388613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:48.425730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988a518-4b52-4f72-9b63-47e76b08b79e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:48.434144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762f741-c59f-42b8-9786-1adebd617aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:48.434945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762f741-c59f-42b8-9786-1adebd617aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.435223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762f741-c59f-42b8-9786-1adebd617aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.435504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762f741-c59f-42b8-9786-1adebd617aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.469676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762f741-c59f-42b8-9786-1adebd617aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:48.471330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762f741-c59f-42b8-9786-1adebd617aa6 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:48.480429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d19a8f9cc34ac68115873336b8657b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:48.481196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d19a8f9cc34ac68115873336b8657b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:48.489208 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3469/7016] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:48.495200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d19a8f9cc34ac68115873336b8657b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:48.497980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573df61-5957-448b-b111-729080e81d91 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.500132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573df61-5957-448b-b111-729080e81d91 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.500132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573df61-5957-448b-b111-729080e81d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.521106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d19a8f9cc34ac68115873336b8657b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:48.522551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b570b112-ebf0-4143-ba53-4d4be9f11f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d19a8f9cc34ac68115873336b8657b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:48.571755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0573df61-5957-448b-b111-729080e81d91 None None] MFA Rules not processed for user `585aa397329b4f8786c18e708a5bc413`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:48.575029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0573df61-5957-448b-b111-729080e81d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:48.596410 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3548/7017] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:48 2022] DELETE /identity/v3/users/91d19a8f9cc34ac68115873336b8657b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:48.598948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.599953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.599953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.635077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:48.635944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:48.734907 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3470/7018] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:48.736772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573df61-5957-448b-b111-729080e81d91 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.740721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0573df61-5957-448b-b111-729080e81d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:48.768221 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3549/7019] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:48.772810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573df61-5957-448b-b111-729080e81d91 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:48.785130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:48.786140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:48.787403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:48.787912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:48.788853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:48.791255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.794415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:48.804678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:48.867062 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3471/7020] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:48 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:48.869483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:48.873913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:48.966230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a6767-dfa3-46ad-8838-969110d33fe4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.089048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159c0d9-6a95-444f-95b2-2e51a089fa62 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.108097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.108985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.109848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.110865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.113060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.114304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.115064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.116680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.122577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:49.244064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.246043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.258834 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3550/7021] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:49.260258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:49.272300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.276194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.278627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162514f2-b662-4696-b786-d7ce8327c3fd service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.290592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.292143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.292143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.292143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.292934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.295038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.336103 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3472/7022] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:49.342254 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3551/7023] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:49 2022] POST /identity/v3/users => generated 296 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:49.346230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:49.360822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e3f4-b00a-4f78-93e1-27168f9ddb8f service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.374398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.375592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.375592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.375793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.376358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.379683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.405531 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3473/7024] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:49.406077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:49.420849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d33f2-e96a-457b-9f3b-af3f8c4d1813 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.443065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.446183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.446183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.446183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] PATH_INFO: `/v3/projects/e973b86d88684b8a9d1b2d51c884432c/users/f9c93d625789419593d2af3fb51c6d0e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.488203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e973b86d88684b8a9d1b2d51c884432c, user_id=f9c93d625789419593d2af3fb51c6d0e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.491216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.516230 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3552/7025] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:49 2022] PUT /identity/v3/projects/e973b86d88684b8a9d1b2d51c884432c/users/f9c93d625789419593d2af3fb51c6d0e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:49.521117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:49.554702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2161-f8b7-4b6e-87b9-1a72bdc70710 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.582181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:49.584039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:49.681371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.682068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.682341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.682614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.683401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.685311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.697747 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3474/7026] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:49.711122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:49.793635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927a13-4818-4aca-a441-cb28e26b581e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.826357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.827383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.827800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.828186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] PATH_INFO: `/v3/projects/e973b86d88684b8a9d1b2d51c884432c/users/f9c93d625789419593d2af3fb51c6d0e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.833348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949276-92af-45d1-8ec2-b55f5a0716c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:49.840506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e973b86d88684b8a9d1b2d51c884432c, user_id=f9c93d625789419593d2af3fb51c6d0e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.843616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.858149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:49.859066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:49.859346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:49.859623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] PATH_INFO: `/v3/projects/440128cc2c7b4e28934c5d6bb38cacb0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:49.864299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=440128cc2c7b4e28934c5d6bb38cacb0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:49.871012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:49.907504 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3475/7027] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:49 2022] PUT /identity/v3/projects/e973b86d88684b8a9d1b2d51c884432c/users/f9c93d625789419593d2af3fb51c6d0e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:50.041946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440128cc2c7b4e28934c5d6bb38cacb0', 'request_id': 'req-162f4577-0d57-4194-bd16-9d4a8cddc4fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.061509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440128cc2c7b4e28934c5d6bb38cacb0', 'request_id': 'req-162f4577-0d57-4194-bd16-9d4a8cddc4fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.085006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440128cc2c7b4e28934c5d6bb38cacb0', 'request_id': 'req-162f4577-0d57-4194-bd16-9d4a8cddc4fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.119497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] The token cache is being invalidate because project 440128cc2c7b4e28934c5d6bb38cacb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:50.121695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.123987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.125936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3553/7028] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:49 2022] DELETE /identity/v3/projects/440128cc2c7b4e28934c5d6bb38cacb0 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:50.130133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:50.133257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:50.358946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7c6e-494f-4ccc-8817-4f31282d2971 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:50.511498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:50.512948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:50.513435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:50.514306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] PATH_INFO: `/v3/users/100cce440ab24d988ad70abdc13786d9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:50.515940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=100cce440ab24d988ad70abdc13786d9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:50.518189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:50.633814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100cce440ab24d988ad70abdc13786d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.637663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100cce440ab24d988ad70abdc13786d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.671891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100cce440ab24d988ad70abdc13786d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.683174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100cce440ab24d988ad70abdc13786d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.699298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100cce440ab24d988ad70abdc13786d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:50.757638 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3476/7029] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:50 2022] DELETE /identity/v3/users/100cce440ab24d988ad70abdc13786d9 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:52.728848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:52.731676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:52.767503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f4577-0d57-4194-bd16-9d4a8cddc4fe admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:52.805095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:52.806632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:52.991311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:52.992786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:52.993373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:52.993928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] PATH_INFO: `/v3/projects/585bb96e15864a6a8d8b1190f1dba30a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:52.996904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] RBAC: Authorizing `identity:delete_project(project_id=585bb96e15864a6a8d8b1190f1dba30a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:53.004393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:53.009773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae8ede-4807-425d-a726-5af5bc2f0a0d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:53.027248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:53.029153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.029989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.030885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] PATH_INFO: `/v3/projects/fdfaa853c8004c5eacd3b12120ed3931` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.035210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfaa853c8004c5eacd3b12120ed3931)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:53.038968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:53.167431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585bb96e15864a6a8d8b1190f1dba30a', 'request_id': 'req-4f40a5c3-1a1c-4f6d-8800-def3db35745c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.190645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfaa853c8004c5eacd3b12120ed3931', 'request_id': 'req-9a5e8720-176c-45bc-ada4-90dd49be70cd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.196000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585bb96e15864a6a8d8b1190f1dba30a', 'request_id': 'req-4f40a5c3-1a1c-4f6d-8800-def3db35745c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.207348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfaa853c8004c5eacd3b12120ed3931', 'request_id': 'req-9a5e8720-176c-45bc-ada4-90dd49be70cd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.214580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585bb96e15864a6a8d8b1190f1dba30a', 'request_id': 'req-4f40a5c3-1a1c-4f6d-8800-def3db35745c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.231561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] The token cache is being invalidate because project 585bb96e15864a6a8d8b1190f1dba30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:53.232019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfaa853c8004c5eacd3b12120ed3931', 'request_id': 'req-9a5e8720-176c-45bc-ada4-90dd49be70cd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.232175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.234100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f40a5c3-1a1c-4f6d-8800-def3db35745c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.238582 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3554/7030] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:52 2022] DELETE /identity/v3/projects/585bb96e15864a6a8d8b1190f1dba30a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:53.249938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966c72-d393-48d3-9d4e-a2b74a6b7071 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.258383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966c72-d393-48d3-9d4e-a2b74a6b7071 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.258977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966c72-d393-48d3-9d4e-a2b74a6b7071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.270474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] The token cache is being invalidate because project fdfaa853c8004c5eacd3b12120ed3931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:53.270968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.273112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9a5e8720-176c-45bc-ada4-90dd49be70cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:53.279253 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3477/7031] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:52 2022] DELETE /identity/v3/projects/fdfaa853c8004c5eacd3b12120ed3931 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:53.288266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659c53-8f38-4a29-8c6d-0594aa777fbc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.289741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659c53-8f38-4a29-8c6d-0594aa777fbc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.290269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659c53-8f38-4a29-8c6d-0594aa777fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.319505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3f966c72-d393-48d3-9d4e-a2b74a6b7071 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:53.325397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3f966c72-d393-48d3-9d4e-a2b74a6b7071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:53.340162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d0659c53-8f38-4a29-8c6d-0594aa777fbc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:53.341954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d0659c53-8f38-4a29-8c6d-0594aa777fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:53.486001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3555/7032] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:53.496570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be979689-7b13-4e7b-ac3b-9a8ca7c5e3b1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.496909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be979689-7b13-4e7b-ac3b-9a8ca7c5e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.497190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be979689-7b13-4e7b-ac3b-9a8ca7c5e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.529723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3478/7033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:53.539482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d3fbd-d57b-4151-94d5-03e993bfa860 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.539744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d3fbd-d57b-4151-94d5-03e993bfa860 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.540017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d3fbd-d57b-4151-94d5-03e993bfa860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.595325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-be979689-7b13-4e7b-ac3b-9a8ca7c5e3b1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:53.597385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-be979689-7b13-4e7b-ac3b-9a8ca7c5e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:53.619977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a46d3fbd-d57b-4151-94d5-03e993bfa860 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:53.626706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a46d3fbd-d57b-4151-94d5-03e993bfa860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:53.637319 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3556/7034] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:18:53.640121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be979689-7b13-4e7b-ac3b-9a8ca7c5e3b1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:53.659827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be979689-7b13-4e7b-ac3b-9a8ca7c5e3b1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:53.664538 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3479/7035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:53.667109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d3fbd-d57b-4151-94d5-03e993bfa860 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:53.675197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:53.675907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.677239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.677239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.677912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:53.678218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:53.690068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:53.696331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d3fbd-d57b-4151-94d5-03e993bfa860 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:53.719637 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3557/7036] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:53.724730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:53.726809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.727327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.727443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:53.727965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.729621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:18:53.730185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:53.732060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:53.748854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a965d6-f661-4000-9018-7d9793800849 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:53.758840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:53.759534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.759852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.760132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.760877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:53.762871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:53.767066 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3480/7037] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:18:53.771500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:53.801103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6169a5-c6bd-480d-b43c-a8f0828af5b7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:53.816936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:53.819401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:53.820717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:53.821545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:53.823240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:53.826209 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3558/7038] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:53.833449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:53.838195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:53.906892 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3481/7039] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:53.910836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.043084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90cec5-e262-424c-b3ea-2b7c6fa9252d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.094690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdbe0f-468c-4c1f-bcb3-cf69503e29e4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.113305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.114785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.115404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.115902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.117195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.122013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.182481 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3482/7040] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:54.184017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.198650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.201713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.202244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.202759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.204355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.208943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.230713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbbb7a-384e-49f4-b340-7c4d53637666 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.261403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.262141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.262417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.262684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.265523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.270860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.271297 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3559/7041] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:53 2022] POST /identity/v3/users => generated 306 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:54.278577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.307412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892a2f-b11c-4bee-8045-5c3cd3a2df1a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.314599 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3483/7042] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:54.316493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.332537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.338176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.338800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.340390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.341471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.343386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.348794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76dd58-8c03-4f34-9291-629d82139964 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.359865 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3560/7043] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:54.367154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.371088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.373593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.373882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.374164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.385226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.387149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.396201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d810c-e401-4b48-a718-80dd364824a3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.408700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3484/7044] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:54.414221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.419321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.422086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.424121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.424683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] PATH_INFO: `/v3/projects/d9569d7ebc034b5a9ae3480c1d4000a3/users/80fee9d790a540ec85ca03ba47996647/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.434862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393850d-c127-4ac0-a404-d04e3a7d7db5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.448933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898883-5551-4453-93eb-8c4295a521d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.450333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898883-5551-4453-93eb-8c4295a521d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.450845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898883-5551-4453-93eb-8c4295a521d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.451326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898883-5551-4453-93eb-8c4295a521d8 admin admin] PATH_INFO: `/v3/projects/215676a27bf941aca89ab500b2bade51/users/2160e893637e48b68a6745a09056f97a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.472678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9569d7ebc034b5a9ae3480c1d4000a3, user_id=80fee9d790a540ec85ca03ba47996647, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.476896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.491114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898883-5551-4453-93eb-8c4295a521d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215676a27bf941aca89ab500b2bade51, user_id=2160e893637e48b68a6745a09056f97a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.499219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898883-5551-4453-93eb-8c4295a521d8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.513124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3561/7045] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:54 2022] PUT /identity/v3/projects/d9569d7ebc034b5a9ae3480c1d4000a3/users/80fee9d790a540ec85ca03ba47996647/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:54.517292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.538150 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3485/7046] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:54 2022] PUT /identity/v3/projects/215676a27bf941aca89ab500b2bade51/users/2160e893637e48b68a6745a09056f97a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:54.553438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.555214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.555887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.623282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] MFA Rules not processed for user `2160e893637e48b68a6745a09056f97a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:54.624938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:54.702866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc1940-f154-4ef5-b787-743dc050c904 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.855811 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3486/7047] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:54.871406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.872777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.873259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.873748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.874512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.876156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.883647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.885643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:54.903718 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3562/7048] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:18:54.904910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:54.925860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e571e3-d732-41f3-aa2f-ec127be04ea1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:54.939313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ebf2a-4ee6-44d9-a918-aa187f40ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:54.940349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ebf2a-4ee6-44d9-a918-aa187f40ffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.940623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ebf2a-4ee6-44d9-a918-aa187f40ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.941259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ebf2a-4ee6-44d9-a918-aa187f40ffe1 admin admin] PATH_INFO: `/v3/projects/d9569d7ebc034b5a9ae3480c1d4000a3/users/80fee9d790a540ec85ca03ba47996647/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:54.950008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ebf2a-4ee6-44d9-a918-aa187f40ffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9569d7ebc034b5a9ae3480c1d4000a3, user_id=80fee9d790a540ec85ca03ba47996647, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:54.953165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ebf2a-4ee6-44d9-a918-aa187f40ffe1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:54.978058 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3563/7049] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:54 2022] PUT /identity/v3/projects/d9569d7ebc034b5a9ae3480c1d4000a3/users/80fee9d790a540ec85ca03ba47996647/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:18:54.992327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae29ba-db43-4bb0-87e9-d40f279ed07c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:54.992877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae29ba-db43-4bb0-87e9-d40f279ed07c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:54.993352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae29ba-db43-4bb0-87e9-d40f279ed07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:55.041515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aad3a9-c526-4d95-a7f6-4dd000db7423 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:55.063239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d9ae29ba-db43-4bb0-87e9-d40f279ed07c None None] MFA Rules not processed for user `80fee9d790a540ec85ca03ba47996647`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:55.066109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d9ae29ba-db43-4bb0-87e9-d40f279ed07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:55.160516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:55.161358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:55.161501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:55.162099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:55.265942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:55.267851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:55.279910 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3564/7050] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:55.284436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae29ba-db43-4bb0-87e9-d40f279ed07c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:55.289671 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3487/7051] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:55.456141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae29ba-db43-4bb0-87e9-d40f279ed07c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:55.464347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:55.471486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:55.473771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:55.476417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:55.477562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:55.482764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:55.562983 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3565/7052] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:18:55 2022] POST /identity/v3/projects => generated 397 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:18:55.563351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:55.595472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb667c0-113e-4acb-a098-75a9f3f9f981 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:55.844391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:55.845123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:55.845403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:55.845669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:55.846371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:55.848728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:55.907939 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3488/7053] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:18:55 2022] POST /identity/v3/users => generated 299 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:18:55.912275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:55.946918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743a37d-2574-4ef2-9581-7a9ec2b1af1e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:55.961962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:55.962778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:55.963280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:55.963559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:55.964304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:55.966207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:56.011450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:56.011671 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3566/7054] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:18:56.026823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56f79f-97a5-4dc0-8b84-c1b7b7c6653c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:56.038416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252ef12-889c-467d-a753-81d56a507d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:56.039389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ef12-889c-467d-a753-81d56a507d66 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:56.039671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ef12-889c-467d-a753-81d56a507d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:56.039944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ef12-889c-467d-a753-81d56a507d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:56.040671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252ef12-889c-467d-a753-81d56a507d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:56.043570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252ef12-889c-467d-a753-81d56a507d66 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:56.072576 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3489/7055] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:18:56.074001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:56.092210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886b9c4-5b13-44b9-987f-a38d062a1ed0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:56.108419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:56.109646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:56.110118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:56.110677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] PATH_INFO: `/v3/projects/ae467832257f4b358fe26874686de095/users/1990b929eb274237973faf8073e298bc/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:56.129441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae467832257f4b358fe26874686de095, user_id=1990b929eb274237973faf8073e298bc, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:56.133108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:56.184942 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3567/7056] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:18:56 2022] PUT /identity/v3/projects/ae467832257f4b358fe26874686de095/users/1990b929eb274237973faf8073e298bc/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:56.187014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e04472-5962-4ab2-a9ed-cee52a887dc9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:56.187326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e04472-5962-4ab2-a9ed-cee52a887dc9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:56.187601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e04472-5962-4ab2-a9ed-cee52a887dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:56.246473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-88e04472-5962-4ab2-a9ed-cee52a887dc9 None None] MFA Rules not processed for user `1990b929eb274237973faf8073e298bc`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:56.248171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-88e04472-5962-4ab2-a9ed-cee52a887dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:56.371173 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3490/7057] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:56.385598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:56.388602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:56.526101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3344-8a20-42f5-ad3e-d22c8f562110 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:56.529986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893ece6-e6c6-4d29-a8ff-98004c46287e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:56.530669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ece6-e6c6-4d29-a8ff-98004c46287e service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:56.530946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ece6-e6c6-4d29-a8ff-98004c46287e service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:56.531220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ece6-e6c6-4d29-a8ff-98004c46287e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:56.637863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893ece6-e6c6-4d29-a8ff-98004c46287e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:56.646634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893ece6-e6c6-4d29-a8ff-98004c46287e service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:56.674268 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3568/7058] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:18:57.314090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e04472-5962-4ab2-a9ed-cee52a887dc9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:57.515835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e04472-5962-4ab2-a9ed-cee52a887dc9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:57.521921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:57.522806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:57.523618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:57.523914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] PATH_INFO: `/v3/users/80fee9d790a540ec85ca03ba47996647` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:57.525450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fee9d790a540ec85ca03ba47996647)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:57.528292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:57.660026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fee9d790a540ec85ca03ba47996647'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:57.661064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fee9d790a540ec85ca03ba47996647'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:57.676304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fee9d790a540ec85ca03ba47996647'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:57.677061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fee9d790a540ec85ca03ba47996647'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:57.692691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fee9d790a540ec85ca03ba47996647'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:57.724897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:57.725835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:57.726358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:57.728636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3491/7059] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:57 2022] DELETE /identity/v3/users/80fee9d790a540ec85ca03ba47996647 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:57.747746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:18:57.749983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:57.844506 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3569/7060] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:18:57.859994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:57.861664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:57.933901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39d59-f39a-4d3d-bf37-19c7de8da37c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:57.939896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:57.940729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:57.941204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:57.941628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:57.956404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:57.958407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:57.992733 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3492/7061] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:18:58.822645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:58.824166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:18:58.851196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105af52-2cbc-4692-8662-8cbb666b616c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:58.865638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:58.871113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:58.871443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:58.871728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] PATH_INFO: `/v3/projects/d9569d7ebc034b5a9ae3480c1d4000a3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:58.882682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9569d7ebc034b5a9ae3480c1d4000a3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:58.893292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:59.051841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9569d7ebc034b5a9ae3480c1d4000a3', 'request_id': 'req-b5a19f54-8138-403d-8353-565048ff4b8b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.063002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9569d7ebc034b5a9ae3480c1d4000a3', 'request_id': 'req-b5a19f54-8138-403d-8353-565048ff4b8b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.081315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9569d7ebc034b5a9ae3480c1d4000a3', 'request_id': 'req-b5a19f54-8138-403d-8353-565048ff4b8b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.106945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] The token cache is being invalidate because project d9569d7ebc034b5a9ae3480c1d4000a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:18:59.108094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.110865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.114809 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3570/7062] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:18:58 2022] DELETE /identity/v3/projects/d9569d7ebc034b5a9ae3480c1d4000a3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:18:59.119347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:18:59.139064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445aa99-e68c-41f9-b0d5-0c847e100886 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:18:59.254470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:18:59.255378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:18:59.255668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:18:59.256133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] PATH_INFO: `/v3/users/1990b929eb274237973faf8073e298bc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:18:59.257475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1990b929eb274237973faf8073e298bc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:18:59.259512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:18:59.346497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1990b929eb274237973faf8073e298bc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.347643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1990b929eb274237973faf8073e298bc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.363232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1990b929eb274237973faf8073e298bc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.364033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1990b929eb274237973faf8073e298bc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.380533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eb38f833-2a84-4fe0-aa00-f8219641739d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1990b929eb274237973faf8073e298bc'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:18:59.430235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3493/7063] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:18:59 2022] DELETE /identity/v3/users/1990b929eb274237973faf8073e298bc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:19:01.312385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:01.314420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:01.336947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19f54-8138-403d-8353-565048ff4b8b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:01.494372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:01.495526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:01.496006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:01.496462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] PATH_INFO: `/v3/projects/ae467832257f4b358fe26874686de095` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:01.497977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae467832257f4b358fe26874686de095)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:01.500149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:01.572895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae467832257f4b358fe26874686de095', 'request_id': 'req-79808409-d404-4fed-b571-0ba5c7edcd84'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:01.587693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae467832257f4b358fe26874686de095', 'request_id': 'req-79808409-d404-4fed-b571-0ba5c7edcd84'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:01.603811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae467832257f4b358fe26874686de095', 'request_id': 'req-79808409-d404-4fed-b571-0ba5c7edcd84'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:01.636492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] The token cache is being invalidate because project ae467832257f4b358fe26874686de095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:01.637026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:01.638471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-79808409-d404-4fed-b571-0ba5c7edcd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:01.640718 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3571/7064] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:01 2022] DELETE /identity/v3/projects/ae467832257f4b358fe26874686de095 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:01.646016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553817-26f4-4459-a685-f05e42a76937 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:01.646657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553817-26f4-4459-a685-f05e42a76937 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:01.646657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553817-26f4-4459-a685-f05e42a76937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:01.749236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-81553817-26f4-4459-a685-f05e42a76937 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:01.754601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-81553817-26f4-4459-a685-f05e42a76937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:01.926595 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3494/7065] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:01.934706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a495-c2fa-47b6-b6dd-8ac83f0f2824 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:01.935029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a495-c2fa-47b6-b6dd-8ac83f0f2824 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:01.937695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a495-c2fa-47b6-b6dd-8ac83f0f2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:01.987194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cd56a495-c2fa-47b6-b6dd-8ac83f0f2824 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:01.989257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cd56a495-c2fa-47b6-b6dd-8ac83f0f2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:02.000959 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3572/7066] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:02.004440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553817-26f4-4459-a685-f05e42a76937 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:02.017689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553817-26f4-4459-a685-f05e42a76937 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:02.023734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:02.024696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.025361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.025834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.026728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:02.027187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:02.029016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:02.050824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a495-c2fa-47b6-b6dd-8ac83f0f2824 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:02.063132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a495-c2fa-47b6-b6dd-8ac83f0f2824 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:02.063746 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3495/7067] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:02.071353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:02.072341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.072951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.073408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.074268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:02.076406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:02.140015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3573/7068] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:02 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:19:02.142170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:02.155132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90412f4-6ca1-4847-98cd-a8faff136faa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:02.254974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:02.256850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.257172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.257454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.260937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:02.266097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:02.311110 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3496/7069] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:02 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:02.315498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:02.338321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d4a6-ef13-4c3a-8a3d-0d980eddedf4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:02.351197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:02.352958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.354665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.355110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.365201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:02.369654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:02.402233 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3574/7070] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:02.405351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:02.417077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb27ae-f2c9-47f3-a139-a4f1286f1744 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:02.432772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:02.441634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.441979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.442374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] PATH_INFO: `/v3/projects/d808424239754dd5948da32a3eb9a97c/users/915da150fcb44a589550500c70a87943/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.468870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d808424239754dd5948da32a3eb9a97c, user_id=915da150fcb44a589550500c70a87943, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:02.472356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:02.501319 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3497/7071] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:02 2022] PUT /identity/v3/projects/d808424239754dd5948da32a3eb9a97c/users/915da150fcb44a589550500c70a87943/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:02.503748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:02.516876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5017b00-0f54-4bd5-ba2e-3ad7381f7423 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:02.586906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31f303-8e80-4d16-a5c5-58d1ef986f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:02.588038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31f303-8e80-4d16-a5c5-58d1ef986f61 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.588506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31f303-8e80-4d16-a5c5-58d1ef986f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.589242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31f303-8e80-4d16-a5c5-58d1ef986f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.590340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31f303-8e80-4d16-a5c5-58d1ef986f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:02.593291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31f303-8e80-4d16-a5c5-58d1ef986f61 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:02.608863 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3575/7072] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:02.613109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:02.646829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c551e3-3caf-4077-af13-c01eb45a1765 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:02.663234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:02.664282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.668983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.669633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] PATH_INFO: `/v3/projects/d808424239754dd5948da32a3eb9a97c/users/915da150fcb44a589550500c70a87943/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.676313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d808424239754dd5948da32a3eb9a97c, user_id=915da150fcb44a589550500c70a87943, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:02.685446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:02.707597 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3498/7073] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:02 2022] PUT /identity/v3/projects/d808424239754dd5948da32a3eb9a97c/users/915da150fcb44a589550500c70a87943/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:19:02.719719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c470-2e92-4929-b2b6-75f14e3db32c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:02.719719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c470-2e92-4929-b2b6-75f14e3db32c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:02.719719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c470-2e92-4929-b2b6-75f14e3db32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:02.786969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1df1c470-2e92-4929-b2b6-75f14e3db32c None None] MFA Rules not processed for user `915da150fcb44a589550500c70a87943`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:02.789105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1df1c470-2e92-4929-b2b6-75f14e3db32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:02.916787 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3576/7074] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:02.920775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:03.018719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55319-0c63-4ab8-bf9a-0dfd223c1411 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:03.024703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:03.025616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:03.026004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:03.026537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:03.027428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:03.033015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:03.078651 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3499/7075] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:02 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:03.080662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c470-2e92-4929-b2b6-75f14e3db32c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:03.096858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c470-2e92-4929-b2b6-75f14e3db32c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:03.202303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:03.203490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:03.203868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:03.204512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:03.205438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:03.207710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:03.242729 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3577/7076] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:03 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:19:03.248256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:03.261651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3127b0-2bce-465e-9794-e4bc6e030233 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:03.269380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:03.272731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:03.273197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:03.276049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:03.277243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:03.279898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:03.307240 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3500/7077] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:19:03.313100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:03.327436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f6dc-5406-42f7-b449-f8da0a565547 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:03.343879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521973b7-aad2-4ea9-8dbf-84fdc0045d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:03.345071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521973b7-aad2-4ea9-8dbf-84fdc0045d3f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:03.345352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521973b7-aad2-4ea9-8dbf-84fdc0045d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:03.345627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521973b7-aad2-4ea9-8dbf-84fdc0045d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:03.347542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521973b7-aad2-4ea9-8dbf-84fdc0045d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:03.351407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521973b7-aad2-4ea9-8dbf-84fdc0045d3f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:03.414703 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3578/7078] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:03.419663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:03.433177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51e79-0cd5-4131-a7ee-0f5f3bb96376 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:03.447664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:03.449006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:03.450065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:03.451224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] PATH_INFO: `/v3/projects/de1775274d8242a4810620a857693685/users/902cc376c1a048aeabca5862fe183852/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:03.514950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1775274d8242a4810620a857693685, user_id=902cc376c1a048aeabca5862fe183852, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:03.523597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:03.556908 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3501/7079] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:03 2022] PUT /identity/v3/projects/de1775274d8242a4810620a857693685/users/902cc376c1a048aeabca5862fe183852/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:03.568818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834df2-788c-411d-9c6f-a6fab5f3e184 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:03.568818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834df2-788c-411d-9c6f-a6fab5f3e184 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:03.569151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834df2-788c-411d-9c6f-a6fab5f3e184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:03.598785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2c834df2-788c-411d-9c6f-a6fab5f3e184 None None] MFA Rules not processed for user `902cc376c1a048aeabca5862fe183852`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:03.600070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2c834df2-788c-411d-9c6f-a6fab5f3e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:03.732330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3579/7080] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:03.748548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:03.751116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:03.850764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62cc69-fb6d-4293-9127-2d6d3b6d3f76 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:03.855311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255b6e8-3485-45b2-a5e4-592c79722dff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:03.856388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b6e8-3485-45b2-a5e4-592c79722dff service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:03.857011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b6e8-3485-45b2-a5e4-592c79722dff service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:03.857567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b6e8-3485-45b2-a5e4-592c79722dff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:03.937300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255b6e8-3485-45b2-a5e4-592c79722dff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:03.939701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255b6e8-3485-45b2-a5e4-592c79722dff service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:03.994667 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3502/7081] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:05.047352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834df2-788c-411d-9c6f-a6fab5f3e184 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:05.234966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834df2-788c-411d-9c6f-a6fab5f3e184 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:05.245983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:05.247862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:05.248389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:05.249011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] PATH_INFO: `/v3/users/915da150fcb44a589550500c70a87943` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:05.250531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=915da150fcb44a589550500c70a87943)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:05.265127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:05.364734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915da150fcb44a589550500c70a87943'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:05.372513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915da150fcb44a589550500c70a87943'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:05.383606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915da150fcb44a589550500c70a87943'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:05.402428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915da150fcb44a589550500c70a87943'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:05.404483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915da150fcb44a589550500c70a87943'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:05.477776 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3580/7082] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:05 2022] DELETE /identity/v3/users/915da150fcb44a589550500c70a87943 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:05.482587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee1cfb-55cb-4940-b6e6-fdbd1670eb85 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:05.483053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee1cfb-55cb-4940-b6e6-fdbd1670eb85 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:05.483053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee1cfb-55cb-4940-b6e6-fdbd1670eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:05.510709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-59ee1cfb-55cb-4940-b6e6-fdbd1670eb85 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:05.511952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-59ee1cfb-55cb-4940-b6e6-fdbd1670eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:05.633656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3503/7083] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:05.640737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:05.642599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:05.790840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12230041-be6d-4fc8-a5e8-89b34be1d78f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:05.803525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:05.804215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:05.804498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:05.804770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:05.822011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:05.823528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:05.851482 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3581/7084] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:06.123436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:06.123734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:06.124010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:06.162743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:06.164428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:06.338023 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3504/7085] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:06.364033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:06.367405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:06.546101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bc1ea-4794-4c98-9c06-9c98b4b42d91 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:06.558689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:06.559442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:06.559731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:06.560819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:06.571076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:06.573062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:06.590369 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3582/7086] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:08.021261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:08.023414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:08.056342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f38e7-d660-4b86-8695-ddad303c8f8f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:08.071068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:08.072266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:08.072742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:08.073230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] PATH_INFO: `/v3/projects/d808424239754dd5948da32a3eb9a97c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:08.074691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d808424239754dd5948da32a3eb9a97c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:08.077787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:08.194965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd808424239754dd5948da32a3eb9a97c', 'request_id': 'req-10473596-1e56-486d-941a-27f9f06dd430'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.217722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd808424239754dd5948da32a3eb9a97c', 'request_id': 'req-10473596-1e56-486d-941a-27f9f06dd430'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.238846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd808424239754dd5948da32a3eb9a97c', 'request_id': 'req-10473596-1e56-486d-941a-27f9f06dd430'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.262829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] The token cache is being invalidate because project d808424239754dd5948da32a3eb9a97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:08.263494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.264428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-10473596-1e56-486d-941a-27f9f06dd430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.266848 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3505/7087] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:08 2022] DELETE /identity/v3/projects/d808424239754dd5948da32a3eb9a97c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:08.271427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:08.286826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a41f0c-944c-41b8-986c-d8562c3958a2 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:08.414072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:08.415211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:08.415435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:08.415717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] PATH_INFO: `/v3/users/902cc376c1a048aeabca5862fe183852` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:08.423675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=902cc376c1a048aeabca5862fe183852)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:08.425972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:08.527640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902cc376c1a048aeabca5862fe183852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.528336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902cc376c1a048aeabca5862fe183852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.544190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902cc376c1a048aeabca5862fe183852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.565498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902cc376c1a048aeabca5862fe183852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.566512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902cc376c1a048aeabca5862fe183852'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:08.613790 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3583/7088] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:08 2022] DELETE /identity/v3/users/902cc376c1a048aeabca5862fe183852 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:11.372734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:11.374058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:11.375038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:11.498776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] MFA Rules not processed for user `f9c93d625789419593d2af3fb51c6d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:11.500276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:11.561247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:11.562718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:11.817013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d035a-cdee-44b0-a2c5-8606b0afd3ec admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:11.834723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:11.835649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:11.835932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:11.836208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] PATH_INFO: `/v3/projects/de1775274d8242a4810620a857693685` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:11.851176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1775274d8242a4810620a857693685)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:11.853210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:11.854021 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3506/7089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:11.868514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:11.870523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:11.966090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1775274d8242a4810620a857693685', 'request_id': 'req-5e8d9523-f01d-4b89-84dc-2669c1ab6619'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:11.985832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1775274d8242a4810620a857693685', 'request_id': 'req-5e8d9523-f01d-4b89-84dc-2669c1ab6619'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:12.016579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1775274d8242a4810620a857693685', 'request_id': 'req-5e8d9523-f01d-4b89-84dc-2669c1ab6619'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:12.037223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] The token cache is being invalidate because project de1775274d8242a4810620a857693685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:12.037518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:12.039282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5e8d9523-f01d-4b89-84dc-2669c1ab6619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:12.043552 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3584/7090] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:11 2022] DELETE /identity/v3/projects/de1775274d8242a4810620a857693685 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:19:12.047990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28beee0-8f57-47ef-9004-caec4f360ece None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.048281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28beee0-8f57-47ef-9004-caec4f360ece None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.048557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28beee0-8f57-47ef-9004-caec4f360ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.106567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d28beee0-8f57-47ef-9004-caec4f360ece None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:12.107817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d28beee0-8f57-47ef-9004-caec4f360ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:12.121805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caafcd-a9a5-46b6-b0f7-405b7a717852 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:12.286674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3585/7091] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:12.294344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11582-50e1-4765-92e8-6dca0abd3991 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.294541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11582-50e1-4765-92e8-6dca0abd3991 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.294774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11582-50e1-4765-92e8-6dca0abd3991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.342556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:12.343237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.343513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.343782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.356356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6ea11582-50e1-4765-92e8-6dca0abd3991 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:12.357704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6ea11582-50e1-4765-92e8-6dca0abd3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:12.357872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:12.385692 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3586/7092] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:12.390133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11582-50e1-4765-92e8-6dca0abd3991 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:12.460543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11582-50e1-4765-92e8-6dca0abd3991 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:12.510184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:12.510475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.510767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.511034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.511769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:12.512073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:12.514082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:12.524076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:12.533350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:12.554614 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3507/7093] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:19:12.581763 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3587/7094] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:12.586162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:12.599444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91609c82-e5e6-4f0f-8cb2-d8a7536adf28 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:12.626533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:12.627596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.628127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.628557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.629453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:12.631572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:12.698577 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3508/7095] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:12 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:12.701715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:12.718278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a78cc-6450-4b03-836f-7a833f12fcf3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:12.805908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:12.807545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.808051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.808684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.810448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:12.821687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:12.895442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:12.896250 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3588/7096] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:12 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:12.897255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:12.897772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:12.919058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a839-1c76-4dac-a383-8062cbe3f5b6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:12.933884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:12.934796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.935077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.935354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] PATH_INFO: `/v3/users/68ae029784a84b9abe3c13a7a229f74e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.937472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ae029784a84b9abe3c13a7a229f74e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:12.938636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c38b7c-74a7-4ece-b0ff-fcc98d986101 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:12.945259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:12.963830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:12.973362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:12.973632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:12.976064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:12.980050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:12.987029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:13.058675 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3589/7097] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:13.059916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:13.060909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ae029784a84b9abe3c13a7a229f74e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:13.061411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ae029784a84b9abe3c13a7a229f74e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:13.069772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:13.093957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ae029784a84b9abe3c13a7a229f74e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:13.094904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ae029784a84b9abe3c13a7a229f74e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:13.111907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ae029784a84b9abe3c13a7a229f74e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:13.167371 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3509/7098] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:12 2022] DELETE /identity/v3/users/68ae029784a84b9abe3c13a7a229f74e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:13.173163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:13.179569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:13.340969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3db5-c0ad-4a65-9b00-524839edcde3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:13.403111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ddeeb-d508-4f70-a44d-ed5048a513c7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:13.416004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70429eb7-08e6-4ef1-8c00-3b821fd0719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:13.416712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429eb7-08e6-4ef1-8c00-3b821fd0719a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:13.416994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429eb7-08e6-4ef1-8c00-3b821fd0719a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:13.417290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429eb7-08e6-4ef1-8c00-3b821fd0719a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:13.418024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70429eb7-08e6-4ef1-8c00-3b821fd0719a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:13.419657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70429eb7-08e6-4ef1-8c00-3b821fd0719a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:13.448776 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3510/7099] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:13.457528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959814a-d634-4709-8c9f-f67be0fade24 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:13.458958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959814a-d634-4709-8c9f-f67be0fade24 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:13.459410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959814a-d634-4709-8c9f-f67be0fade24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:13.520766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0959814a-d634-4709-8c9f-f67be0fade24 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:13.522368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0959814a-d634-4709-8c9f-f67be0fade24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:13.553600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd204f22-cf21-4352-971f-8124d2585334 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:13.554935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd204f22-cf21-4352-971f-8124d2585334 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:13.558878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd204f22-cf21-4352-971f-8124d2585334 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:13.558878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd204f22-cf21-4352-971f-8124d2585334 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:13.559723 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3511/7100] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:13.561555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cd204f22-cf21-4352-971f-8124d2585334 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:13.567240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959814a-d634-4709-8c9f-f67be0fade24 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:13.585190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959814a-d634-4709-8c9f-f67be0fade24 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:13.597559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd204f22-cf21-4352-971f-8124d2585334 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:13.599649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:13.600828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:13.603170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd204f22-cf21-4352-971f-8124d2585334 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:13.603501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:13.604100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] PATH_INFO: `/v3/projects/01a83ead13074ad88b5cfca0a888b1b9/users/9cb91512ef124036b9c593cec600eb21/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:13.647975 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3590/7101] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:13.648346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a83ead13074ad88b5cfca0a888b1b9, user_id=9cb91512ef124036b9c593cec600eb21, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:13.654105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:13.701626 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3512/7102] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:13 2022] PUT /identity/v3/projects/01a83ead13074ad88b5cfca0a888b1b9/users/9cb91512ef124036b9c593cec600eb21/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:13.713333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:13.713628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:13.713998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:13.734960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:13.737247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:13.779738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] MFA Rules not processed for user `9cb91512ef124036b9c593cec600eb21`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:13.781015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:13.942858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b928-f029-45f5-9d1f-c2405c1da4af admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:13.955017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:13.957283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:13.957935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:13.959116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:13.975543 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3591/7103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:13.984693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:13.986318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:14.196861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc76f8-786b-4a49-8069-04326d55d044 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:14.215060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fb300-8ad3-4cb1-b0d6-92446bc2c744 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:14.216305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fb300-8ad3-4cb1-b0d6-92446bc2c744 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:14.216585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fb300-8ad3-4cb1-b0d6-92446bc2c744 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:14.216863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fb300-8ad3-4cb1-b0d6-92446bc2c744 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:14.222168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:14.225791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:14.238235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fb300-8ad3-4cb1-b0d6-92446bc2c744 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:14.244335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fb300-8ad3-4cb1-b0d6-92446bc2c744 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:14.250892 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3513/7104] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:19:14.252257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:14.256806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:14.284049 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3592/7105] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:14.470315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49d87c-6695-4e01-bb05-b3011d537202 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:14.493910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:14.494849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:14.497230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:14.497529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:14.503440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:14.520592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193c86-391c-4e72-bbe4-b8aa52ded68b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:14.520884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193c86-391c-4e72-bbe4-b8aa52ded68b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:14.521199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193c86-391c-4e72-bbe4-b8aa52ded68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:14.580937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:14.588152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-60193c86-391c-4e72-bbe4-b8aa52ded68b None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:14.590523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:14.593069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-60193c86-391c-4e72-bbe4-b8aa52ded68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:14.670571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3514/7106] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:14.808471 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3593/7107] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:14.832885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:14.834700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:15.073807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacc355-7e4c-4055-9de5-00cce219aceb service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:15.088895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:15.090029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:15.090452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:15.090868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:15.111423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:15.119046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:15.132550 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3515/7108] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:16.098492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fbd27-3d49-4087-8b1d-4b27a5233c3e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:16.099042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fbd27-3d49-4087-8b1d-4b27a5233c3e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:16.099042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fbd27-3d49-4087-8b1d-4b27a5233c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:16.177219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7d5fbd27-3d49-4087-8b1d-4b27a5233c3e None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:16.195735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7d5fbd27-3d49-4087-8b1d-4b27a5233c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:16.281533 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3594/7109] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:16.352552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:16.399452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeca0f-6ae2-4b73-8d38-bce5cc651a84 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:16.406906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:16.407633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:16.407969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:16.408249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:16.418997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:16.423197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:16.435215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3516/7110] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:19:17.229989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793441c-08bf-4b76-bf6b-5f24f7254550 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:17.231680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793441c-08bf-4b76-bf6b-5f24f7254550 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:17.232027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793441c-08bf-4b76-bf6b-5f24f7254550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:17.257341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2793441c-08bf-4b76-bf6b-5f24f7254550 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:17.258875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2793441c-08bf-4b76-bf6b-5f24f7254550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:17.279886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:17.280774 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3595/7111] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:17.281366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:17.315769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793441c-08bf-4b76-bf6b-5f24f7254550 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:17.334517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78db469-2633-49a4-b67c-0016807d7e10 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:17.342608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793441c-08bf-4b76-bf6b-5f24f7254550 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:17.346210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:17.348435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:17.351223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:17.352376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] PATH_INFO: `/v3/projects/a57e29e56e1b4eb193575f404d3da032` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:17.356035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57e29e56e1b4eb193575f404d3da032)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:17.358050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:17.359265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:17.359555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:17.359833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:17.360366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:17.375165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:17.376850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:17.428568 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3596/7112] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:17.531484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57e29e56e1b4eb193575f404d3da032', 'request_id': 'req-20f3e825-4771-492f-ae5b-1d2f771a5752'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:17.548998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57e29e56e1b4eb193575f404d3da032', 'request_id': 'req-20f3e825-4771-492f-ae5b-1d2f771a5752'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:17.577925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57e29e56e1b4eb193575f404d3da032', 'request_id': 'req-20f3e825-4771-492f-ae5b-1d2f771a5752'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:17.628900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] The token cache is being invalidate because project a57e29e56e1b4eb193575f404d3da032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:17.629205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:17.634357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-20f3e825-4771-492f-ae5b-1d2f771a5752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:17.638886 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3517/7113] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:17 2022] DELETE /identity/v3/projects/a57e29e56e1b4eb193575f404d3da032 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:17.643176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:17.662195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517058b1-fbb4-4829-943d-fe974774d00e service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:17.830693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:17.831814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:17.834990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:17.836322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] PATH_INFO: `/v3/users/6ac55bfedb984dbd987ceeea1c981a27` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:17.839789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac55bfedb984dbd987ceeea1c981a27)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:17.847451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:17.885875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:17.886427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:17.886893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:17.918497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:17.920449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:18.016505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac55bfedb984dbd987ceeea1c981a27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:18.017228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac55bfedb984dbd987ceeea1c981a27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:18.025463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac55bfedb984dbd987ceeea1c981a27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:18.047483 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3518/7114] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:18.049953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac55bfedb984dbd987ceeea1c981a27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:18.050723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3a8911b9-bd5d-49b0-8a96-55c3b3e34f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac55bfedb984dbd987ceeea1c981a27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:18.062412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:18.065299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:18.133288 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3597/7115] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:17 2022] DELETE /identity/v3/users/6ac55bfedb984dbd987ceeea1c981a27 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:18.317249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f23a3-e0b5-4105-9ae7-fb5645b94209 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:18.461958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:18.462586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:18.462871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:18.463139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:18.468863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:18.543738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:18.545382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:18.555072 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3519/7116] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:19:19.175999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:19.176890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:19.177373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:19.214046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:19.215518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:19.232333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3598/7117] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:19.257257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:19.258946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:19.287006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf60e2-2102-452e-aefd-9506de1b7eee service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:19.293809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afbace-5b47-40bf-b8a3-c0918a1103fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:19.296136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afbace-5b47-40bf-b8a3-c0918a1103fb service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:19.296659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afbace-5b47-40bf-b8a3-c0918a1103fb service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:19.297184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afbace-5b47-40bf-b8a3-c0918a1103fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:19.324915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afbace-5b47-40bf-b8a3-c0918a1103fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:19.326979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afbace-5b47-40bf-b8a3-c0918a1103fb service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:19.336808 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3520/7118] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:19.785665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:19.790628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:19.878211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c065ff-0686-46e8-a5ca-2fd42fe3ec58 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:19.879418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c065ff-0686-46e8-a5ca-2fd42fe3ec58 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:19.880669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c065ff-0686-46e8-a5ca-2fd42fe3ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:19.950296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f6c065ff-0686-46e8-a5ca-2fd42fe3ec58 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:19.951841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6c065ff-0686-46e8-a5ca-2fd42fe3ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:19.982602 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3521/7119] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:19.986318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66def2-0d8e-4e1a-9fd0-5e9c2d18f2d5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:19.996162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:19.997225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:19.997707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:19.998150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] PATH_INFO: `/v3/projects/e5d77ab6ee7c475eb4eae4021c347560` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:19.999837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c065ff-0686-46e8-a5ca-2fd42fe3ec58 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:20.000214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d77ab6ee7c475eb4eae4021c347560)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:20.004523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:20.023014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c065ff-0686-46e8-a5ca-2fd42fe3ec58 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:20.044549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41cb51-9c3e-4b07-b349-09a7e6ad90b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:20.045252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41cb51-9c3e-4b07-b349-09a7e6ad90b9 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:20.045531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41cb51-9c3e-4b07-b349-09a7e6ad90b9 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:20.045802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41cb51-9c3e-4b07-b349-09a7e6ad90b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:20.075882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41cb51-9c3e-4b07-b349-09a7e6ad90b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:20.081283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41cb51-9c3e-4b07-b349-09a7e6ad90b9 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:20.101424 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3522/7120] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:19:20.121563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d77ab6ee7c475eb4eae4021c347560', 'request_id': 'req-dc330867-279b-4e99-8451-a35c3f17de01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.137065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d77ab6ee7c475eb4eae4021c347560', 'request_id': 'req-dc330867-279b-4e99-8451-a35c3f17de01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.159092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d77ab6ee7c475eb4eae4021c347560', 'request_id': 'req-dc330867-279b-4e99-8451-a35c3f17de01'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.183420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] The token cache is being invalidate because project e5d77ab6ee7c475eb4eae4021c347560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:20.184081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.186558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dc330867-279b-4e99-8451-a35c3f17de01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.191676 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3599/7121] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:19 2022] DELETE /identity/v3/projects/e5d77ab6ee7c475eb4eae4021c347560 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:20.197895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:20.198878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:20.199424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:20.234125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:20.236245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:20.391023 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3523/7122] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:20.391190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c923-d2eb-432c-9168-0657f39af41e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:20.391339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c923-d2eb-432c-9168-0657f39af41e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:20.391620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c923-d2eb-432c-9168-0657f39af41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:20.392495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:20.394071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:20.409578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fc36c-c47e-413c-9af9-646b4fe3aa3d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:20.418809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:20.420884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:20.422714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:20.423238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] PATH_INFO: `/v3/users/9cb91512ef124036b9c593cec600eb21` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:20.424961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb91512ef124036b9c593cec600eb21)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:20.428062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:20.469727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a521c923-d2eb-432c-9168-0657f39af41e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:20.476933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a521c923-d2eb-432c-9168-0657f39af41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:20.514697 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3600/7123] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:20.523590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521c923-d2eb-432c-9168-0657f39af41e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:20.540933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb91512ef124036b9c593cec600eb21'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.544591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb91512ef124036b9c593cec600eb21'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.558109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521c923-d2eb-432c-9168-0657f39af41e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:20.572679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb91512ef124036b9c593cec600eb21'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.575572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb91512ef124036b9c593cec600eb21'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.582242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:20.584101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:20.587926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:20.588558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:20.590429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:20.591168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:20.596299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:20.609600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8e62e2b1-99ad-4eac-b705-d59d0da1833a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb91512ef124036b9c593cec600eb21'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:20.654947 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3601/7124] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:20.657150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:20.664558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:20.690269 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3524/7125] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:20 2022] DELETE /identity/v3/users/9cb91512ef124036b9c593cec600eb21 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:20.695938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:20.696238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:20.704892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:20.735617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265e29e-75c2-4a96-b179-d9621aad493a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:20.766228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:20.771072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:20.962831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:20.966826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:20.967547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:20.968039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:20.970815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:20.976854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:20.996389 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3525/7126] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:21.088202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:21.089990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:21.146700 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3602/7127] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:20 2022] POST /identity/v3/projects => generated 393 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:21.157474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:21.297215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3122b-498d-4b4d-b697-033bc847d9db None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:21.360602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a5a05-ccf3-4939-b6d4-232dba43fc76 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:21.380883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:21.381639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:21.381925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:21.382202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:21.382929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:21.384922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:21.425737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:21.429406 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3603/7128] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:21 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:21.429618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:21.429618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:21.429618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:21.432255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:21.454553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543d83-34bb-4f5f-8f3f-a23b0450f83f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:21.464498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:21.466176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:21.476634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:21.477696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:21.478153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:21.478597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:21.479636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:21.481539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:21.488998 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3526/7129] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:21.513292 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3604/7130] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:21.514425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:21.529298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8687b6-e869-411d-9e54-2c426af9231c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:21.546551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce8f11-de75-4741-b241-dec47ecf6eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:21.547350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce8f11-de75-4741-b241-dec47ecf6eae admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:21.547656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce8f11-de75-4741-b241-dec47ecf6eae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:21.547907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce8f11-de75-4741-b241-dec47ecf6eae admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:21.548664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce8f11-de75-4741-b241-dec47ecf6eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:21.550366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce8f11-de75-4741-b241-dec47ecf6eae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:21.580098 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3527/7131] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:21.584519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:21.600131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0d5f-6dce-4b1e-82ec-da970fa66e2d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:21.620626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:21.621681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:21.621965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:21.622246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] PATH_INFO: `/v3/projects/caf06c0596a64b98bd2cc07caddc23a8/users/dcf94518a2d04e6eab284c9613d287fd/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:21.660446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf06c0596a64b98bd2cc07caddc23a8, user_id=dcf94518a2d04e6eab284c9613d287fd, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:21.663261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:21.716579 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3605/7132] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:21 2022] PUT /identity/v3/projects/caf06c0596a64b98bd2cc07caddc23a8/users/dcf94518a2d04e6eab284c9613d287fd/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:21.718440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da406b-322b-4d11-b2a1-3011b5477834 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:21.718914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da406b-322b-4d11-b2a1-3011b5477834 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:21.719351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da406b-322b-4d11-b2a1-3011b5477834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:21.790312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-36da406b-322b-4d11-b2a1-3011b5477834 None None] MFA Rules not processed for user `dcf94518a2d04e6eab284c9613d287fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:21.791563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36da406b-322b-4d11-b2a1-3011b5477834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:21.940717 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3528/7133] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:21.945320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:22.073845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2fcde-2dea-4cf8-8832-91a1cd3141c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:22.083340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:22.097281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:22.097564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:22.097844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:22.098832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:22.103715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:22.185771 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3606/7134] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:21 2022] POST /identity/v3/projects => generated 391 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:22.190569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da406b-322b-4d11-b2a1-3011b5477834 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:22.246419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da406b-322b-4d11-b2a1-3011b5477834 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:22.498720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:22.498720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:22.499052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:22.504484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:22.505926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:22.516533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:22.570625 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3529/7135] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:22 2022] POST /identity/v3/users => generated 302 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:22.572418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:22.588095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5724-d4bd-472c-bc18-385d247e07e7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:22.594647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:22.595671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:22.596168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:22.597323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:22.598333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:22.600152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:22.619625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:22.631470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8872d32-26d9-4ef6-88a0-ca49e97aed51 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:22.632831 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3607/7136] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:22.638039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:22.639590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:22.640046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:22.656044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] PATH_INFO: `/v3/projects/ba3d8e7401d8456b890802e1664c5319/users/81774c91a60848efbcea98af1db6e06e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:22.681413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3d8e7401d8456b890802e1664c5319, user_id=81774c91a60848efbcea98af1db6e06e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:22.685344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:22.748995 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3530/7137] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:22 2022] PUT /identity/v3/projects/ba3d8e7401d8456b890802e1664c5319/users/81774c91a60848efbcea98af1db6e06e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:22.752744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:22.770218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39421171-5a57-4de2-824f-e215b065aec5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:22.872842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:22.874055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:22.874758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:22.875067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:22.876338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:22.878996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:22.892644 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3608/7138] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:22.896858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:22.917989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f829-8462-48ce-b15f-b60d3e6bf9e8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:22.928578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539db07c-c276-40a1-83c2-4417ff9569bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:22.930027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db07c-c276-40a1-83c2-4417ff9569bf admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:22.930469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db07c-c276-40a1-83c2-4417ff9569bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:22.930833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db07c-c276-40a1-83c2-4417ff9569bf admin admin] PATH_INFO: `/v3/projects/ba3d8e7401d8456b890802e1664c5319/users/81774c91a60848efbcea98af1db6e06e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:22.933001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539db07c-c276-40a1-83c2-4417ff9569bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3d8e7401d8456b890802e1664c5319, user_id=81774c91a60848efbcea98af1db6e06e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:22.937856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539db07c-c276-40a1-83c2-4417ff9569bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:22.947769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:22.950175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:22.951796 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3531/7139] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:22 2022] PUT /identity/v3/projects/ba3d8e7401d8456b890802e1664c5319/users/81774c91a60848efbcea98af1db6e06e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:22.962550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3de9-ae90-40fc-a4ff-dedde7cb05a9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:22.963081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3de9-ae90-40fc-a4ff-dedde7cb05a9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:22.963568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3de9-ae90-40fc-a4ff-dedde7cb05a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:22.974969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e97b79-4f5e-4506-93e4-e084a89950dc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:23.004308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d86d3de9-ae90-40fc-a4ff-dedde7cb05a9 None None] MFA Rules not processed for user `81774c91a60848efbcea98af1db6e06e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:23.005952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d86d3de9-ae90-40fc-a4ff-dedde7cb05a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:23.144235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3532/7140] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:23.179840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:23.180981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:23.181519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:23.181962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] PATH_INFO: `/v3/projects/01a83ead13074ad88b5cfca0a888b1b9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:23.187879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a83ead13074ad88b5cfca0a888b1b9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:23.190298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:23.196055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3de9-ae90-40fc-a4ff-dedde7cb05a9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:23.294429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a83ead13074ad88b5cfca0a888b1b9', 'request_id': 'req-b1daaa47-21b5-45f2-ae20-d5fa915f140b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:23.303043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a83ead13074ad88b5cfca0a888b1b9', 'request_id': 'req-b1daaa47-21b5-45f2-ae20-d5fa915f140b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:23.325827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a83ead13074ad88b5cfca0a888b1b9', 'request_id': 'req-b1daaa47-21b5-45f2-ae20-d5fa915f140b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:23.332164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3de9-ae90-40fc-a4ff-dedde7cb05a9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:23.342871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] The token cache is being invalidate because project 01a83ead13074ad88b5cfca0a888b1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:23.343243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:23.345536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1daaa47-21b5-45f2-ae20-d5fa915f140b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:23.350826 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3609/7141] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:22 2022] DELETE /identity/v3/projects/01a83ead13074ad88b5cfca0a888b1b9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:23.357196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97264d8-06f0-4d7a-9741-5d0f9ea4808d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:23.357539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97264d8-06f0-4d7a-9741-5d0f9ea4808d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:23.357945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97264d8-06f0-4d7a-9741-5d0f9ea4808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:23.402363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c97264d8-06f0-4d7a-9741-5d0f9ea4808d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:23.405632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c97264d8-06f0-4d7a-9741-5d0f9ea4808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:23.437359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:23.438474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:23.439046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:23.440342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:23.449294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:23.552502 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3610/7142] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:23.561570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b56b0-9c83-4bb7-871b-a7e6342b092f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:23.562133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b56b0-9c83-4bb7-871b-a7e6342b092f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:23.562520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b56b0-9c83-4bb7-871b-a7e6342b092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:23.602509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-862b56b0-9c83-4bb7-871b-a7e6342b092f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:23.604183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:23.607574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-862b56b0-9c83-4bb7-871b-a7e6342b092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:23.608631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:23.633568 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3611/7143] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:23.637242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b56b0-9c83-4bb7-871b-a7e6342b092f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:23.640630 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3533/7144] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:23.648583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b56b0-9c83-4bb7-871b-a7e6342b092f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:23.655919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:23.656215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:23.656597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:23.656981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:23.659324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:23.659752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:23.661667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:23.680773 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3612/7145] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:23.687008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:23.699422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae553f-e801-4789-9be7-6c711733d3cf service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:23.711627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:23.712414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:23.713099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:23.714344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:23.715064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:23.721934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:23.774327 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3534/7146] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:23 2022] POST /identity/v3/projects => generated 407 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:23.780292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:23.794714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dedbd-6606-4ff4-9654-406d4f50af92 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:23.947024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:23.949475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:23.949996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:23.951705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:23.953116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:23.977753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:24.026460 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3613/7147] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:23 2022] POST /identity/v3/users => generated 304 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:19:24.031470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:24.046365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1a58-2f89-49aa-8c50-751d83a3115f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:24.087405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:24.088087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:24.088371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:24.088661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:24.089432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:24.096384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:24.145661 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3535/7148] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:24.150314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:24.190866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d2c1-4ead-4880-aa1d-da91482f4bf0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:24.203261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e60f8-ed03-486e-b032-8f7ff31fe6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:24.203261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e60f8-ed03-486e-b032-8f7ff31fe6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:24.203817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e60f8-ed03-486e-b032-8f7ff31fe6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:24.204185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e60f8-ed03-486e-b032-8f7ff31fe6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:24.215019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e60f8-ed03-486e-b032-8f7ff31fe6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:24.215019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e60f8-ed03-486e-b032-8f7ff31fe6a6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:24.287924 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3614/7149] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:24.289388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:24.330330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df9b28-c7f3-4f9e-9450-5591e8e24b32 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:24.339322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:24.340254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:24.340610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:24.340892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] PATH_INFO: `/v3/projects/bc3b3e528ad44a289221a82d0259043f/users/b2ae42fe79d14431b7fa765dc6646243/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:24.407791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3b3e528ad44a289221a82d0259043f, user_id=b2ae42fe79d14431b7fa765dc6646243, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:24.410553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:24.464471 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3536/7150] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:24 2022] PUT /identity/v3/projects/bc3b3e528ad44a289221a82d0259043f/users/b2ae42fe79d14431b7fa765dc6646243/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:24.476576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9d2aa-2e01-46f8-abbe-57bfe5667a3e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:24.477807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9d2aa-2e01-46f8-abbe-57bfe5667a3e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:24.478481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9d2aa-2e01-46f8-abbe-57bfe5667a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:24.523330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-aee9d2aa-2e01-46f8-abbe-57bfe5667a3e None None] MFA Rules not processed for user `b2ae42fe79d14431b7fa765dc6646243`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:24.524274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aee9d2aa-2e01-46f8-abbe-57bfe5667a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:24.668401 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3615/7151] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:24.669332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:24.791060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0634b-6a04-4104-8b56-686bee2b32cd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:24.805462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:24.806720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:24.806841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:24.807108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:24.807934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:24.810506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:24.893368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9d2aa-2e01-46f8-abbe-57bfe5667a3e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:24.902684 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3537/7152] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:24 2022] POST /identity/v3/projects => generated 407 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:24.917240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9d2aa-2e01-46f8-abbe-57bfe5667a3e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:25.078203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:25.079273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:25.079757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:25.080534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:25.081566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:25.086543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:25.196706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:25.213660 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3616/7153] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:24 2022] POST /identity/v3/users => generated 310 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:25.217922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c189cd-61fb-4dcd-adfd-0273f0179f92 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:25.233150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:25.233760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:25.234032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:25.234343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:25.235048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:25.249875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:25.302976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:25.316232 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3538/7154] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:25.320086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fb165-7c70-4048-8a7f-e692da9ce200 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:25.333780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:25.335081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:25.335081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:25.335287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] PATH_INFO: `/v3/projects/7ae8a79887884e918588007e262addea/users/43371b9a0b73481db68bdda659cffb9c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:25.372122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae8a79887884e918588007e262addea, user_id=43371b9a0b73481db68bdda659cffb9c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:25.381565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:25.433719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:25.435555 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3617/7155] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:25 2022] PUT /identity/v3/projects/7ae8a79887884e918588007e262addea/users/43371b9a0b73481db68bdda659cffb9c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:25.454331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e24e4-dc9f-423d-9ff6-c7f72fee46df admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:25.625498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb93ee2-df5a-43d2-8119-906859ef7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:25.626288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb93ee2-df5a-43d2-8119-906859ef7b0e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:25.626575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb93ee2-df5a-43d2-8119-906859ef7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:25.626852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb93ee2-df5a-43d2-8119-906859ef7b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:25.627673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb93ee2-df5a-43d2-8119-906859ef7b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:25.630879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb93ee2-df5a-43d2-8119-906859ef7b0e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:25.655298 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3539/7156] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:25.659396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:25.677334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e232d-3a2c-42c0-813d-44c80d5fbb66 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:25.691012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:25.691979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:25.692351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:25.692685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] PATH_INFO: `/v3/projects/7ae8a79887884e918588007e262addea/users/43371b9a0b73481db68bdda659cffb9c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:25.695998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae8a79887884e918588007e262addea, user_id=43371b9a0b73481db68bdda659cffb9c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:25.702274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:25.759134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:25.759427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:25.759706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:25.761640 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3618/7157] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:25 2022] PUT /identity/v3/projects/7ae8a79887884e918588007e262addea/users/43371b9a0b73481db68bdda659cffb9c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:25.834753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] MFA Rules not processed for user `43371b9a0b73481db68bdda659cffb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:25.836256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:26.035110 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3540/7158] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:26.223195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:26.225254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:26.365209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccfdda-0099-428d-b176-421a269ebe38 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:26.379680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:26.380482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:26.380823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:26.381128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:26.508297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:26.511764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:26.541190 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3619/7159] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:28.717016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:28.718699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:28.982468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34396-0ba5-4eb6-bf96-3a20390c352f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:29.008168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0aff4-d339-47a3-8b5e-d3ead29910bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:29.008868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0aff4-d339-47a3-8b5e-d3ead29910bf service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:29.010447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0aff4-d339-47a3-8b5e-d3ead29910bf service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:29.010447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0aff4-d339-47a3-8b5e-d3ead29910bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:29.040673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0aff4-d339-47a3-8b5e-d3ead29910bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:29.042514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0aff4-d339-47a3-8b5e-d3ead29910bf service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:29.084905 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3541/7160] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:28 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:32.390697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:32.393244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:32.536907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee193a-92e6-44ee-a66e-13099aa4fa3a service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:32.550780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:32.552018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:32.552997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:32.553474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] PATH_INFO: `/v3/users/dcf94518a2d04e6eab284c9613d287fd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:32.557742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf94518a2d04e6eab284c9613d287fd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:32.560323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:32.631971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf94518a2d04e6eab284c9613d287fd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:32.632813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf94518a2d04e6eab284c9613d287fd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:32.643228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf94518a2d04e6eab284c9613d287fd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:32.663276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf94518a2d04e6eab284c9613d287fd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:32.664114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf94518a2d04e6eab284c9613d287fd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:32.732630 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3620/7161] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:32 2022] DELETE /identity/v3/users/dcf94518a2d04e6eab284c9613d287fd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:32.740141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda04a9-faba-4fd4-9469-b4d37d7c9324 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:32.740699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda04a9-faba-4fd4-9469-b4d37d7c9324 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:32.741007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda04a9-faba-4fd4-9469-b4d37d7c9324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:32.783356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8dda04a9-faba-4fd4-9469-b4d37d7c9324 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:32.785474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8dda04a9-faba-4fd4-9469-b4d37d7c9324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:32.933338 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3542/7162] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:32.947459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:32.948958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:33.081435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb407-83c4-4813-9c5c-e3d850a61803 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:33.085669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:33.086584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:33.087031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:33.087474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:33.098995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:33.101016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:33.119273 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3621/7163] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:34.103010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:34.104161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:34.104632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:34.139413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:34.140671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:34.273699 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3543/7164] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:34.289613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:34.291974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:34.301817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:34.303587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:34.338492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78ccf-1399-4fc8-a877-e355b6a1b7ab None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:34.351996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:34.352993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:34.353361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:34.353828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] PATH_INFO: `/v3/projects/caf06c0596a64b98bd2cc07caddc23a8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:34.355712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf06c0596a64b98bd2cc07caddc23a8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:34.357789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:34.453853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4f5b1-a6c3-4d18-9b83-b810134a71c7 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:34.472566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf06c0596a64b98bd2cc07caddc23a8', 'request_id': 'req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.483629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf06c0596a64b98bd2cc07caddc23a8', 'request_id': 'req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.505971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf06c0596a64b98bd2cc07caddc23a8', 'request_id': 'req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.524108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] The token cache is being invalidate because project caf06c0596a64b98bd2cc07caddc23a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:34.524704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.526378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.534096 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3544/7165] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:34 2022] DELETE /identity/v3/projects/caf06c0596a64b98bd2cc07caddc23a8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:34.535057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:34.541019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:34.545809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:34.546849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:34.547134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:34.548779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:34.555053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:34.682588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:34.684314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:34.693840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3bda-e9ea-4fa2-8aae-5968387d4272 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:34.700259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:34.701221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:34.701575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:34.701920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] PATH_INFO: `/v3/users/81774c91a60848efbcea98af1db6e06e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:34.704525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81774c91a60848efbcea98af1db6e06e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:34.706534 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3622/7166] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:34.713283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:34.796550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81774c91a60848efbcea98af1db6e06e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.797374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81774c91a60848efbcea98af1db6e06e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.812426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81774c91a60848efbcea98af1db6e06e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.813502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81774c91a60848efbcea98af1db6e06e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.836861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f02ba24-98e5-4b4c-b503-61b3a32a8a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81774c91a60848efbcea98af1db6e06e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:34.924452 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3545/7167] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:34 2022] DELETE /identity/v3/users/81774c91a60848efbcea98af1db6e06e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:36.035782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:36.050795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48abd1-98c9-4b88-8062-38e54eb8ab82 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:36.170258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:36.171674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.172222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.172659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] PATH_INFO: `/v3/projects/ba3d8e7401d8456b890802e1664c5319` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.174634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3d8e7401d8456b890802e1664c5319)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:36.179260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:36.315443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3d8e7401d8456b890802e1664c5319', 'request_id': 'req-495faff9-8adb-47c7-85c5-e009c9b60d41'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:36.324013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3d8e7401d8456b890802e1664c5319', 'request_id': 'req-495faff9-8adb-47c7-85c5-e009c9b60d41'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:36.338117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3d8e7401d8456b890802e1664c5319', 'request_id': 'req-495faff9-8adb-47c7-85c5-e009c9b60d41'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:36.353814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] The token cache is being invalidate because project ba3d8e7401d8456b890802e1664c5319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:36.354468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:36.355347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-495faff9-8adb-47c7-85c5-e009c9b60d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:36.361100 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3623/7168] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:36 2022] DELETE /identity/v3/projects/ba3d8e7401d8456b890802e1664c5319 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:36.363036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e924-b396-4e12-895a-f08434ce6b25 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.363492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e924-b396-4e12-895a-f08434ce6b25 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.363576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e924-b396-4e12-895a-f08434ce6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.383660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-87e6e924-b396-4e12-895a-f08434ce6b25 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:36.385486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-87e6e924-b396-4e12-895a-f08434ce6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:36.467499 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3546/7169] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:36.477772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475461-896e-4d57-ae53-964b5e11b3cf None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.478671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475461-896e-4d57-ae53-964b5e11b3cf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.479065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475461-896e-4d57-ae53-964b5e11b3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.501636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c9475461-896e-4d57-ae53-964b5e11b3cf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:36.503112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c9475461-896e-4d57-ae53-964b5e11b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:36.516860 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3624/7170] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:36.517913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e924-b396-4e12-895a-f08434ce6b25 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:36.529745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e924-b396-4e12-895a-f08434ce6b25 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:36.542232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:36.543514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.544044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.546383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.548488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:36.549367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:36.552191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:36.586370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9475461-896e-4d57-ae53-964b5e11b3cf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:36.599047 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3547/7171] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:36.601827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9475461-896e-4d57-ae53-964b5e11b3cf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:36.608761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:36.611226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.612195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.612812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.613829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:36.618341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:36.671704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:36.675866 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3625/7172] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:36 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:36.684433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607819d-5f2d-4892-b060-58747599732b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:36.751257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:36.752466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.753102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.753554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.754417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:36.757562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:36.790556 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3548/7173] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:36 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:36.794674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:36.808443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca325a4-51e1-4e0b-b05e-50ce48c873eb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:36.815647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:36.816975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.817934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.818513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.819894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:36.822741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:36.839801 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3626/7174] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:36.843983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:36.857732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77032e3-1019-4fb3-bafd-6c793151e829 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:36.877204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9491a-a95f-4464-9849-9ecc6ff1071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:36.878606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9491a-a95f-4464-9849-9ecc6ff1071e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.880911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9491a-a95f-4464-9849-9ecc6ff1071e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.881663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9491a-a95f-4464-9849-9ecc6ff1071e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.882674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9491a-a95f-4464-9849-9ecc6ff1071e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:36.890444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9491a-a95f-4464-9849-9ecc6ff1071e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:36.909189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:36.910884 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3549/7175] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:36.922317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794521ac-1242-443d-ba2f-663d271ad1e4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:36.935264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:36.936848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:36.938235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:36.938754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] PATH_INFO: `/v3/projects/d93bfd084df34fcaa89a83144ecd646d/users/48a4295177ca40ee8838300835ade9a4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:36.980292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93bfd084df34fcaa89a83144ecd646d, user_id=48a4295177ca40ee8838300835ade9a4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:36.984481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:37.015692 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3627/7176] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:36 2022] PUT /identity/v3/projects/d93bfd084df34fcaa89a83144ecd646d/users/48a4295177ca40ee8838300835ade9a4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:19:37.029164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929426a7-1dd5-40e0-a410-44a55a99d711 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:37.029997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929426a7-1dd5-40e0-a410-44a55a99d711 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:37.030466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929426a7-1dd5-40e0-a410-44a55a99d711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:37.090916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-929426a7-1dd5-40e0-a410-44a55a99d711 None None] MFA Rules not processed for user `48a4295177ca40ee8838300835ade9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:37.092621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-929426a7-1dd5-40e0-a410-44a55a99d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:37.248659 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3550/7177] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:37.257310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:37.259200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:37.367595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deba02-92ef-4038-b5c6-cd058538e270 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:37.368242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deba02-92ef-4038-b5c6-cd058538e270 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:37.368528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deba02-92ef-4038-b5c6-cd058538e270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:37.378447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b2fb7-7fae-4eca-9950-6dc947820cf8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:37.390357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:37.391151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:37.391504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:37.391843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:37.403239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c1deba02-92ef-4038-b5c6-cd058538e270 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:37.404486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c1deba02-92ef-4038-b5c6-cd058538e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:37.408930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:37.410549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:37.431470 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3628/7178] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:37.546001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3551/7179] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:37.559600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:37.561827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:37.694473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbafcb-57e5-4c8e-b358-1d536243f777 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:37.712714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:37.713874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:37.714354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:37.714927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:37.738425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:37.744179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:37.767699 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3629/7180] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:38.601741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad1542-308d-4e8a-8711-1bb518643b9a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:38.605804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad1542-308d-4e8a-8711-1bb518643b9a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:38.605804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad1542-308d-4e8a-8711-1bb518643b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:38.623877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-79ad1542-308d-4e8a-8711-1bb518643b9a None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:38.625849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-79ad1542-308d-4e8a-8711-1bb518643b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:38.635463 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3552/7181] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:38.653312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:38.670677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca523-fb75-4c06-a5eb-db9e09d5abd2 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:38.680961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3096e-ecca-4e4b-a2f9-da72c6b30f9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:38.683493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3096e-ecca-4e4b-a2f9-da72c6b30f9b service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:38.683906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3096e-ecca-4e4b-a2f9-da72c6b30f9b service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:38.684411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3096e-ecca-4e4b-a2f9-da72c6b30f9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:38.709020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3096e-ecca-4e4b-a2f9-da72c6b30f9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:38.712476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3096e-ecca-4e4b-a2f9-da72c6b30f9b service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:38.734916 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3630/7182] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:40.171260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad1542-308d-4e8a-8711-1bb518643b9a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:40.253070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad1542-308d-4e8a-8711-1bb518643b9a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:40.259334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:40.260496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:40.261126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:40.261570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] PATH_INFO: `/v3/users/48a4295177ca40ee8838300835ade9a4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:40.263574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a4295177ca40ee8838300835ade9a4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:40.266391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:40.326546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a4295177ca40ee8838300835ade9a4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:40.327701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a4295177ca40ee8838300835ade9a4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:40.337390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a4295177ca40ee8838300835ade9a4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:40.338625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a4295177ca40ee8838300835ade9a4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:40.354021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a4295177ca40ee8838300835ade9a4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:40.379949 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3553/7183] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:40 2022] DELETE /identity/v3/users/48a4295177ca40ee8838300835ade9a4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:40.384468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:40.385108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:40.385108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:40.404655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:40.406278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:40.507339 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3631/7184] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:40.714385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:40.716455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:40.837501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9de2-bd94-4de1-828a-5b1eed094b6d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:40.843130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ce33-9178-4948-a1b8-41a7f74e7651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:40.843737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ce33-9178-4948-a1b8-41a7f74e7651 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:40.844065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ce33-9178-4948-a1b8-41a7f74e7651 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:40.844400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ce33-9178-4948-a1b8-41a7f74e7651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:40.869341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114ce33-9178-4948-a1b8-41a7f74e7651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:40.871126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114ce33-9178-4948-a1b8-41a7f74e7651 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:40.889679 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3554/7185] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:42.477296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:42.480810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:42.515473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a1c7-fc1d-46ad-ac8a-eac77c4b703d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:42.531077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:42.533371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:42.533961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:42.534441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] PATH_INFO: `/v3/projects/d93bfd084df34fcaa89a83144ecd646d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:42.536063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93bfd084df34fcaa89a83144ecd646d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:42.538635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:42.607514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93bfd084df34fcaa89a83144ecd646d', 'request_id': 'req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:42.616743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93bfd084df34fcaa89a83144ecd646d', 'request_id': 'req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:42.635704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93bfd084df34fcaa89a83144ecd646d', 'request_id': 'req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:42.707431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] The token cache is being invalidate because project d93bfd084df34fcaa89a83144ecd646d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:42.707925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:42.713565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-323cc6f5-01ec-47f7-b03e-0ec7d3072c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:42.715931 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3632/7186] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:42 2022] DELETE /identity/v3/projects/d93bfd084df34fcaa89a83144ecd646d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:42.720930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfdc3b-6cbe-4ea1-89da-e65526113008 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:42.721784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfdc3b-6cbe-4ea1-89da-e65526113008 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:42.721901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfdc3b-6cbe-4ea1-89da-e65526113008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:42.762805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-30dfdc3b-6cbe-4ea1-89da-e65526113008 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:42.764034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-30dfdc3b-6cbe-4ea1-89da-e65526113008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:42.925413 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3555/7187] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:42.933025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914259a-1129-490d-b7ad-be7de0252ae3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:42.933417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914259a-1129-490d-b7ad-be7de0252ae3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:42.933702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914259a-1129-490d-b7ad-be7de0252ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:42.976092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6914259a-1129-490d-b7ad-be7de0252ae3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:42.977837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6914259a-1129-490d-b7ad-be7de0252ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:42.995894 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3633/7188] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:19:42.997181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfdc3b-6cbe-4ea1-89da-e65526113008 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:43.017552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfdc3b-6cbe-4ea1-89da-e65526113008 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:43.043625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:43.044672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.045229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.045751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.046707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:43.047308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:43.049796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:43.089830 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3556/7189] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:43.090626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914259a-1129-490d-b7ad-be7de0252ae3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:43.103935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914259a-1129-490d-b7ad-be7de0252ae3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:43.113278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:43.113528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.113763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.116120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.116120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:43.117884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:43.151674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3634/7190] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:43 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:43.152869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:43.165526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681eaa0-f7b6-4802-b389-2e5941a81cee admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:43.234459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:43.235290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.236115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.236442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.237734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:43.239803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:43.276355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:43.284303 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3557/7191] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:43 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:19:43.288894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adabf0-961c-4c2f-9743-9501c4c6541e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:43.293901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:43.294608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.294886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.295156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.295898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:43.297765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:43.312843 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3635/7192] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:43.314318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:43.325672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694690bb-ef6e-438a-97f0-b126a009ceb0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:43.331097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f08d-857a-4265-97e6-72becf9b0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:43.333665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f08d-857a-4265-97e6-72becf9b0eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.333665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f08d-857a-4265-97e6-72becf9b0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.333665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f08d-857a-4265-97e6-72becf9b0eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.333665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f08d-857a-4265-97e6-72becf9b0eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:43.334716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f08d-857a-4265-97e6-72becf9b0eb1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:43.347393 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3558/7193] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:43.352083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:43.362940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2205df-0b6f-47c1-8d00-ac1b46cff188 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:43.368255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:43.369411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.369690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.369959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] PATH_INFO: `/v3/projects/881d5d4ef01841cf8824050b995a128d/users/47bbcd2319644e7088499f87b6157c4c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.386038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881d5d4ef01841cf8824050b995a128d, user_id=47bbcd2319644e7088499f87b6157c4c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:43.388940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:43.410131 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3636/7194] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:43 2022] PUT /identity/v3/projects/881d5d4ef01841cf8824050b995a128d/users/47bbcd2319644e7088499f87b6157c4c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:43.422948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cf53f-87cd-4549-a11b-731c349259c2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.423425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cf53f-87cd-4549-a11b-731c349259c2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.423810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cf53f-87cd-4549-a11b-731c349259c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.461772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-154cf53f-87cd-4549-a11b-731c349259c2 None None] MFA Rules not processed for user `47bbcd2319644e7088499f87b6157c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:43.463040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-154cf53f-87cd-4549-a11b-731c349259c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:43.547240 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3559/7195] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:43.561612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:43.563371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:43.584704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5698a4-cdad-4f99-bfaa-13dc8ccca863 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.584991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5698a4-cdad-4f99-bfaa-13dc8ccca863 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.585307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5698a4-cdad-4f99-bfaa-13dc8ccca863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.614295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1b5698a4-cdad-4f99-bfaa-13dc8ccca863 None None] MFA Rules not processed for user `b5534646a6384067bda99af7c864d494`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:43.615521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1b5698a4-cdad-4f99-bfaa-13dc8ccca863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:43.647380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a780b-864d-46d2-acd6-7a3c2530ff85 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:43.652285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:43.653497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:43.654036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:43.654458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:43.665839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:43.667671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:43.680396 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3637/7196] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:43.712020 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3560/7197] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:45.425823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:45.427345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:45.527836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ef336-d260-4805-8cb4-97a385ddab52 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:45.533610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:45.534675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:45.535060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:45.535457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] PATH_INFO: `/v3/users/585aa397329b4f8786c18e708a5bc413` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:45.537014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] RBAC: Authorizing `identity:delete_user(user_id=585aa397329b4f8786c18e708a5bc413)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:45.539671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:45.597579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585aa397329b4f8786c18e708a5bc413'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:45.598590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585aa397329b4f8786c18e708a5bc413'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:45.606135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585aa397329b4f8786c18e708a5bc413'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:45.616411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585aa397329b4f8786c18e708a5bc413'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:45.617428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585aa397329b4f8786c18e708a5bc413'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:45.640400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3638/7198] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:45 2022] DELETE /identity/v3/users/585aa397329b4f8786c18e708a5bc413 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:46.007983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5698a4-cdad-4f99-bfaa-13dc8ccca863 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:46.024938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5698a4-cdad-4f99-bfaa-13dc8ccca863 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:46.196977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:46.197901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:46.198181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:46.198458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] PATH_INFO: `/v3/projects/169228e607bf4e5aab28729d44e6d177` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:46.200109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169228e607bf4e5aab28729d44e6d177)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:46.205419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:46.326348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169228e607bf4e5aab28729d44e6d177', 'request_id': 'req-da5346e8-fd93-46fb-9f45-ea79d021cdf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.352447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169228e607bf4e5aab28729d44e6d177', 'request_id': 'req-da5346e8-fd93-46fb-9f45-ea79d021cdf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.377555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169228e607bf4e5aab28729d44e6d177', 'request_id': 'req-da5346e8-fd93-46fb-9f45-ea79d021cdf1'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.403894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] The token cache is being invalidate because project 169228e607bf4e5aab28729d44e6d177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:46.404206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.404975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.407600 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3561/7199] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:46 2022] DELETE /identity/v3/projects/169228e607bf4e5aab28729d44e6d177 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:46.411985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:46.413919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:46.458157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61125d-51dc-4d23-a848-4eade407724f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:46.581920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:46.582845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:46.583126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:46.583404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] PATH_INFO: `/v3/users/f9c93d625789419593d2af3fb51c6d0e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:46.589803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c93d625789419593d2af3fb51c6d0e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:46.591825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:46.695539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c93d625789419593d2af3fb51c6d0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.698217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c93d625789419593d2af3fb51c6d0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.728811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c93d625789419593d2af3fb51c6d0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.744325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c93d625789419593d2af3fb51c6d0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.747533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-076577d1-e0e5-406b-b29e-4c0cd377ec3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c93d625789419593d2af3fb51c6d0e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:46.795039 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3639/7200] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:46 2022] DELETE /identity/v3/users/f9c93d625789419593d2af3fb51c6d0e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:47.495887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:47.502332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:47.529506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5346e8-fd93-46fb-9f45-ea79d021cdf1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:47.657806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:47.659368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:47.659794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:47.660079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] PATH_INFO: `/v3/projects/e973b86d88684b8a9d1b2d51c884432c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:47.661481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e973b86d88684b8a9d1b2d51c884432c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:47.663529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:47.781982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e973b86d88684b8a9d1b2d51c884432c', 'request_id': 'req-32951e76-5765-4de0-a973-b3c2d4bf9759'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:47.793660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e973b86d88684b8a9d1b2d51c884432c', 'request_id': 'req-32951e76-5765-4de0-a973-b3c2d4bf9759'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:47.825659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e973b86d88684b8a9d1b2d51c884432c', 'request_id': 'req-32951e76-5765-4de0-a973-b3c2d4bf9759'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:47.857093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] The token cache is being invalidate because project e973b86d88684b8a9d1b2d51c884432c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:47.857677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:47.859283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-32951e76-5765-4de0-a973-b3c2d4bf9759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:47.861665 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3562/7201] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:47 2022] DELETE /identity/v3/projects/e973b86d88684b8a9d1b2d51c884432c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:47.869822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0e2c4-5da1-4ab4-81a3-ff5875aba2de None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:47.873599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0e2c4-5da1-4ab4-81a3-ff5875aba2de None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:47.874073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0e2c4-5da1-4ab4-81a3-ff5875aba2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:47.914696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-64c0e2c4-5da1-4ab4-81a3-ff5875aba2de None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:47.923304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-64c0e2c4-5da1-4ab4-81a3-ff5875aba2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:48.117480 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3640/7202] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:48.125076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7863a-ca16-424f-b4ac-84b5be2f2fc5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.126405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7863a-ca16-424f-b4ac-84b5be2f2fc5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.126878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7863a-ca16-424f-b4ac-84b5be2f2fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.165861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f5e7863a-ca16-424f-b4ac-84b5be2f2fc5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:48.167198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f5e7863a-ca16-424f-b4ac-84b5be2f2fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:48.184569 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3563/7203] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:48.188956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0e2c4-5da1-4ab4-81a3-ff5875aba2de None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:48.207424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0e2c4-5da1-4ab4-81a3-ff5875aba2de None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:48.238831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:48.239546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.239831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.240177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.240950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:48.241600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:48.254423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:48.271545 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3641/7204] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:48.276263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7863a-ca16-424f-b4ac-84b5be2f2fc5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:48.289600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7863a-ca16-424f-b4ac-84b5be2f2fc5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:48.296502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:48.297528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.297969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.298462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.299398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:48.301747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:48.345347 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3564/7205] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:48 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:48.349664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:48.363830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4e53d-8f82-476d-986a-8f07aa07a441 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:48.488857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:48.511934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.512483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.512941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.515448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:48.517797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:48.577497 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3642/7206] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:48 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:19:48.581487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:48.595699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3eba-c0f7-4004-a285-2024fb3cc51c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:48.608836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:48.609947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.610446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.610939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.613315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:48.617484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:48.636248 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3565/7207] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:48.640240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:48.655742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccbe25-f141-48cc-86dc-a01d70a89ce9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:48.670786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cccc45-fef4-4b40-8a98-e8f59b36ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:48.673333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccc45-fef4-4b40-8a98-e8f59b36ab58 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.675732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccc45-fef4-4b40-8a98-e8f59b36ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.676876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccc45-fef4-4b40-8a98-e8f59b36ab58 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.679158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cccc45-fef4-4b40-8a98-e8f59b36ab58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:48.684029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cccc45-fef4-4b40-8a98-e8f59b36ab58 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:48.722200 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3643/7208] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:48.726175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:48.741254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c37e52-79ee-4b0c-b686-3c7f9517dc5b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:48.778372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:48.779953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.780390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.780825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] PATH_INFO: `/v3/projects/caee3eff3ade4330aeccdf10be6c26fb/users/517e5fa08dba4e0cad351ab8201eaaa2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.827022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caee3eff3ade4330aeccdf10be6c26fb, user_id=517e5fa08dba4e0cad351ab8201eaaa2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:48.833882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:48.863248 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3566/7209] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:48 2022] PUT /identity/v3/projects/caee3eff3ade4330aeccdf10be6c26fb/users/517e5fa08dba4e0cad351ab8201eaaa2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:48.868659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d53d2-4473-42a1-b8b7-79e8f408b0ca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:48.869328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d53d2-4473-42a1-b8b7-79e8f408b0ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:48.869696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d53d2-4473-42a1-b8b7-79e8f408b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:48.906444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-863d53d2-4473-42a1-b8b7-79e8f408b0ca None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:48.908466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-863d53d2-4473-42a1-b8b7-79e8f408b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:49.027485 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3644/7210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:49.141635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:49.143408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:49.309727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796496-ea4e-4300-bc78-588abe792640 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:49.318504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:49.319679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:49.320439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:49.321347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:49.335793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:49.356713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:49.395224 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3567/7211] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:50.577247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f11b4-3560-44f7-bbd0-16e7d574b905 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:50.577819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f11b4-3560-44f7-bbd0-16e7d574b905 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:50.577819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f11b4-3560-44f7-bbd0-16e7d574b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:50.634911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f62f11b4-3560-44f7-bbd0-16e7d574b905 None None] MFA Rules not processed for user `1d343c69635a4412bf9ffcd9dec5c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:50.637473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f62f11b4-3560-44f7-bbd0-16e7d574b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:50.790629 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3645/7212] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:53.519352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:53.528209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:53.552733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4f94-b189-4466-931a-f7659e2077d1 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:53.561727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:53.562985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:53.563456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:53.563964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] PATH_INFO: `/v3/users/b2ae42fe79d14431b7fa765dc6646243` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:53.566541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ae42fe79d14431b7fa765dc6646243)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:53.568867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:53.696443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ae42fe79d14431b7fa765dc6646243'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:53.715621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ae42fe79d14431b7fa765dc6646243'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:53.748333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ae42fe79d14431b7fa765dc6646243'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:53.750797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ae42fe79d14431b7fa765dc6646243'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:53.772586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ae42fe79d14431b7fa765dc6646243'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:53.845634 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3568/7213] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:53 2022] DELETE /identity/v3/users/b2ae42fe79d14431b7fa765dc6646243 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:53.850655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:53.851196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:53.851196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:53.890252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:53.894977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:54.053497 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3646/7214] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:54.097684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:54.100297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:54.234166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01c162-73b8-43ac-9932-97ab7a905c66 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:54.243024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:54.245399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:54.245688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:54.246228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:54.271123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:54.272627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:54.295228 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3569/7215] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:19:55.519835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:55.521778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:55.542799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbac0a-7b86-4ae0-bd15-f1daed407be2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:55.555838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:55.557770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:55.561153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:55.561546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] PATH_INFO: `/v3/projects/bc3b3e528ad44a289221a82d0259043f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:55.563799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3b3e528ad44a289221a82d0259043f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:55.568929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:55.746249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3b3e528ad44a289221a82d0259043f', 'request_id': 'req-aeddfc9e-b084-401d-963d-bc85fb5e16a0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:55.755759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3b3e528ad44a289221a82d0259043f', 'request_id': 'req-aeddfc9e-b084-401d-963d-bc85fb5e16a0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:55.771280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3b3e528ad44a289221a82d0259043f', 'request_id': 'req-aeddfc9e-b084-401d-963d-bc85fb5e16a0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:55.793437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] The token cache is being invalidate because project bc3b3e528ad44a289221a82d0259043f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:55.794746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:55.799479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:55.802796 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3647/7216] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:55 2022] DELETE /identity/v3/projects/bc3b3e528ad44a289221a82d0259043f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:55.806704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:55.819909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c65798-13b1-4c3d-abc6-7d9be5d2ec8c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:55.990702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:55.992374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:55.992835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:55.993318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] PATH_INFO: `/v3/users/43371b9a0b73481db68bdda659cffb9c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:55.995516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43371b9a0b73481db68bdda659cffb9c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:55.998114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:56.121866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43371b9a0b73481db68bdda659cffb9c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:56.123257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43371b9a0b73481db68bdda659cffb9c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:56.133788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43371b9a0b73481db68bdda659cffb9c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:56.134766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43371b9a0b73481db68bdda659cffb9c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:56.148819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a7e41d16-d7be-4388-ae96-b0a1dc76f966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43371b9a0b73481db68bdda659cffb9c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:56.193561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3570/7217] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:19:55 2022] DELETE /identity/v3/users/43371b9a0b73481db68bdda659cffb9c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:58.314958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:58.316489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:58.332427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddfc9e-b084-401d-963d-bc85fb5e16a0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:58.411178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:58.412443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:58.412883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:58.413359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] PATH_INFO: `/v3/projects/7ae8a79887884e918588007e262addea` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:58.415327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae8a79887884e918588007e262addea)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:58.418348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:58.489668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae8a79887884e918588007e262addea', 'request_id': 'req-61e54b04-dca1-4472-b057-b9183e7c7204'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:58.520047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae8a79887884e918588007e262addea', 'request_id': 'req-61e54b04-dca1-4472-b057-b9183e7c7204'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:58.533474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae8a79887884e918588007e262addea', 'request_id': 'req-61e54b04-dca1-4472-b057-b9183e7c7204'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:58.574335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] The token cache is being invalidate because project 7ae8a79887884e918588007e262addea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:19:58.575029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:58.575985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61e54b04-dca1-4472-b057-b9183e7c7204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:19:58.579161 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3648/7218] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:19:58 2022] DELETE /identity/v3/projects/7ae8a79887884e918588007e262addea => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:58.583965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a106c9-9e4a-4d40-a652-cf86f04532ba None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:58.584495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a106c9-9e4a-4d40-a652-cf86f04532ba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:58.584495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a106c9-9e4a-4d40-a652-cf86f04532ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:58.604178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-02a106c9-9e4a-4d40-a652-cf86f04532ba None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:58.606432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-02a106c9-9e4a-4d40-a652-cf86f04532ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:58.695381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1fbd8-117a-42ab-92d0-e994a75b5c24 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:58.696847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1fbd8-117a-42ab-92d0-e994a75b5c24 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:58.697155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1fbd8-117a-42ab-92d0-e994a75b5c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:58.699718 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3571/7219] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:58.727152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3ec1fbd8-117a-42ab-92d0-e994a75b5c24 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:58.728413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3ec1fbd8-117a-42ab-92d0-e994a75b5c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:58.759160 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3649/7220] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:58.762067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a106c9-9e4a-4d40-a652-cf86f04532ba None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:58.786668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a106c9-9e4a-4d40-a652-cf86f04532ba None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:58.791779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:58.792464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:58.792740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:58.793014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:58.794696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:19:58.795007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:58.796824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:58.824644 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3572/7221] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:19:58.830262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1fbd8-117a-42ab-92d0-e994a75b5c24 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:58.849605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1fbd8-117a-42ab-92d0-e994a75b5c24 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:58.865826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:58.866747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:58.867430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:58.868021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:58.869559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:58.871790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:58.937438 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3650/7222] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:19:58 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:58.942483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:58.953168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fd2f5-ad3e-413e-b869-545775a0da11 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:59.123512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:59.124209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:59.124486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:59.124755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:59.125544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:59.127731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:59.173392 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3573/7223] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:19:58 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:19:59.174437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:59.191832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2bf8e-459f-4004-8281-96b1f2d53d5e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:59.227409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:59.228983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:59.228983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:59.228983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:59.229403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:59.231082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:59.256097 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3651/7224] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:19:59.260312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:59.271737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983443e-8c33-49ea-8536-ee1a3455049b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:59.288464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f9305-57fa-44c8-a9b1-514525fcd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:59.289816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f9305-57fa-44c8-a9b1-514525fcd2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:59.290318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f9305-57fa-44c8-a9b1-514525fcd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:59.291003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f9305-57fa-44c8-a9b1-514525fcd2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:59.291976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f9305-57fa-44c8-a9b1-514525fcd2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:59.295323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f9305-57fa-44c8-a9b1-514525fcd2b1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:59.322921 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3574/7225] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:19:59.325451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:59.338342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008205e-7516-4022-8aa8-85199e6b2b89 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:59.363417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:59.364267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:59.364548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:59.364829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] PATH_INFO: `/v3/projects/23503849c1d94d278881b1e37ebfd34c/users/1049acd7b7e24cc68cb3e0d27e9ebdf2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:59.396014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23503849c1d94d278881b1e37ebfd34c, user_id=1049acd7b7e24cc68cb3e0d27e9ebdf2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:59.398921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:59.428103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3652/7226] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:19:59 2022] PUT /identity/v3/projects/23503849c1d94d278881b1e37ebfd34c/users/1049acd7b7e24cc68cb3e0d27e9ebdf2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:19:59.437821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d3aba-5135-4c05-9fde-00b1e430ed71 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:59.438538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d3aba-5135-4c05-9fde-00b1e430ed71 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:59.439063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d3aba-5135-4c05-9fde-00b1e430ed71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:59.516997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fc7d3aba-5135-4c05-9fde-00b1e430ed71 None None] MFA Rules not processed for user `1049acd7b7e24cc68cb3e0d27e9ebdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:19:59.518600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fc7d3aba-5135-4c05-9fde-00b1e430ed71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:59.676424 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3575/7227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:19:59.777006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:19:59.779409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:19:59.923638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f24b42-f725-46ac-a2d1-c780f7ee4b4b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:19:59.927825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d2dfd-da0e-4684-a6b3-41ff07641a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:19:59.928664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d2dfd-da0e-4684-a6b3-41ff07641a60 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:19:59.929178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d2dfd-da0e-4684-a6b3-41ff07641a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:19:59.929627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d2dfd-da0e-4684-a6b3-41ff07641a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:19:59.939439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d2dfd-da0e-4684-a6b3-41ff07641a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:19:59.942110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d2dfd-da0e-4684-a6b3-41ff07641a60 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:19:59.954573 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3653/7228] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:19:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:00.398866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d3aba-5135-4c05-9fde-00b1e430ed71 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:00.604700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d3aba-5135-4c05-9fde-00b1e430ed71 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:00.654255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:00.656070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:00.658605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:00.659190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] PATH_INFO: `/v3/users/1049acd7b7e24cc68cb3e0d27e9ebdf2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:00.663789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1049acd7b7e24cc68cb3e0d27e9ebdf2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:00.666321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:00.769640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1049acd7b7e24cc68cb3e0d27e9ebdf2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:00.771407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1049acd7b7e24cc68cb3e0d27e9ebdf2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:00.790787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1049acd7b7e24cc68cb3e0d27e9ebdf2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:00.792677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1049acd7b7e24cc68cb3e0d27e9ebdf2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:00.809617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1049acd7b7e24cc68cb3e0d27e9ebdf2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:00.851090 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3576/7229] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:00 2022] DELETE /identity/v3/users/1049acd7b7e24cc68cb3e0d27e9ebdf2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:00.852953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fe25c-d7a4-4d97-8f37-156a2de019aa None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:00.853465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fe25c-d7a4-4d97-8f37-156a2de019aa None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:00.853561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fe25c-d7a4-4d97-8f37-156a2de019aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:00.887049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ca5fe25c-d7a4-4d97-8f37-156a2de019aa None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:00.888314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ca5fe25c-d7a4-4d97-8f37-156a2de019aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:00.901992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:00.903505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:01.006466 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3654/7230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:01.028242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fe25c-d7a4-4d97-8f37-156a2de019aa None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:01.043869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fe25c-d7a4-4d97-8f37-156a2de019aa None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:01.047926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0aad4-f9cf-4cbe-a225-cdf874d5b492 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:01.053589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:01.054282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:01.054565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:01.054842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:01.057579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf31d23-3be3-41b0-bf5e-8aa48b5d23f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:01.059390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf31d23-3be3-41b0-bf5e-8aa48b5d23f9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:01.060452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf31d23-3be3-41b0-bf5e-8aa48b5d23f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:01.060891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf31d23-3be3-41b0-bf5e-8aa48b5d23f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:01.066581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4cf31d23-3be3-41b0-bf5e-8aa48b5d23f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:01.083337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:01.086491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:01.119709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3655/7231] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:20:01.217881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf31d23-3be3-41b0-bf5e-8aa48b5d23f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:01.219851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf31d23-3be3-41b0-bf5e-8aa48b5d23f9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:01.239953 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3577/7232] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:20:03.261711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:03.263207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:03.289246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451df3d-db9b-42e5-919c-645b54bedab0 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:03.296929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:03.298044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:03.298563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:03.299059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] PATH_INFO: `/v3/projects/23503849c1d94d278881b1e37ebfd34c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:03.308874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23503849c1d94d278881b1e37ebfd34c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:03.308874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:03.399990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23503849c1d94d278881b1e37ebfd34c', 'request_id': 'req-d0843f0b-4afb-440f-b149-75a5b54a2f2e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:03.416160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23503849c1d94d278881b1e37ebfd34c', 'request_id': 'req-d0843f0b-4afb-440f-b149-75a5b54a2f2e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:03.440973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23503849c1d94d278881b1e37ebfd34c', 'request_id': 'req-d0843f0b-4afb-440f-b149-75a5b54a2f2e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:03.465309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] The token cache is being invalidate because project 23503849c1d94d278881b1e37ebfd34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:03.465662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:03.466706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0843f0b-4afb-440f-b149-75a5b54a2f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:03.472940 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3656/7233] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:03 2022] DELETE /identity/v3/projects/23503849c1d94d278881b1e37ebfd34c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:03.474835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05174-df20-472e-8bc7-b4d1d9313fad None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:03.475314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05174-df20-472e-8bc7-b4d1d9313fad None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:03.475452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05174-df20-472e-8bc7-b4d1d9313fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:03.510126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f2a05174-df20-472e-8bc7-b4d1d9313fad None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:03.511817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2a05174-df20-472e-8bc7-b4d1d9313fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:03.647776 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3578/7234] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:03.656389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f90ee-0382-461b-bc1f-be6b1e56df76 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:03.656612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f90ee-0382-461b-bc1f-be6b1e56df76 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:03.656828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f90ee-0382-461b-bc1f-be6b1e56df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:03.680158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-369f90ee-0382-461b-bc1f-be6b1e56df76 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:03.681569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-369f90ee-0382-461b-bc1f-be6b1e56df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:03.692105 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3657/7235] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:03.696769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05174-df20-472e-8bc7-b4d1d9313fad None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:03.706877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05174-df20-472e-8bc7-b4d1d9313fad None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:03.714577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:03.715275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:03.715554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:03.715825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:03.716755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:03.717095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:03.718700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:03.734973 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3579/7236] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:03.739929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f90ee-0382-461b-bc1f-be6b1e56df76 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:03.752259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f90ee-0382-461b-bc1f-be6b1e56df76 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:03.758432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:03.759471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:03.760111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:03.760622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:03.761600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:03.764612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:03.821025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:03.829668 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3658/7237] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:03 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:03.837663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb14dfd-5d8f-4bca-8fbb-1373ffe62f63 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:03.923373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:03.924432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:03.924968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:03.925546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:03.926714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:03.929221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:03.961881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:03.969816 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3580/7238] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:03 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:03.974986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587e5e-4346-47b0-955c-1641ccc18f56 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:03.981017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:03.981803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:03.982081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:03.982353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:03.983177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:03.984996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:04.003444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:04.015288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca3a9-6093-48f7-a247-7203cbed9675 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:04.015920 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3659/7239] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:04.021353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cde81-f1f0-4bc3-8f80-d4a51382c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:04.022952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cde81-f1f0-4bc3-8f80-d4a51382c09c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:04.023418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cde81-f1f0-4bc3-8f80-d4a51382c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:04.023845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cde81-f1f0-4bc3-8f80-d4a51382c09c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:04.024965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cde81-f1f0-4bc3-8f80-d4a51382c09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:04.026872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cde81-f1f0-4bc3-8f80-d4a51382c09c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:04.043496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:04.045371 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3581/7240] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:04.057289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f115a-af46-48b9-8ee4-e2804477a476 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:04.062229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:04.064147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:04.064430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:04.064705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] PATH_INFO: `/v3/projects/12a82117ca894ee3b2d8ca91ced1b886/users/24c289c983b244d5b48ff6782c9b1c42/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:04.097331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a82117ca894ee3b2d8ca91ced1b886, user_id=24c289c983b244d5b48ff6782c9b1c42, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:04.101297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:04.133900 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3660/7241] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:04 2022] PUT /identity/v3/projects/12a82117ca894ee3b2d8ca91ced1b886/users/24c289c983b244d5b48ff6782c9b1c42/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:20:04.137469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:04.138027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:04.138521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:04.181588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] MFA Rules not processed for user `24c289c983b244d5b48ff6782c9b1c42`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:04.182951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:04.266531 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3582/7242] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:20:04.286074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:04.289981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:04.416168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33e672-33e0-4939-9bca-3d9d6d412576 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:04.420663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fd2da-9e34-4275-be77-549bf6ca6711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:04.421423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fd2da-9e34-4275-be77-549bf6ca6711 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:04.421710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fd2da-9e34-4275-be77-549bf6ca6711 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:04.422117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fd2da-9e34-4275-be77-549bf6ca6711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:04.432588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fd2da-9e34-4275-be77-549bf6ca6711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:04.437759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fd2da-9e34-4275-be77-549bf6ca6711 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:04.459191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3661/7243] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:05.053349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:05.055488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:05.087132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40debd7-8d42-4e4b-8a24-cc79995302a1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:05.098037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:05.099124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:05.099632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:05.100138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:05.102619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:05.326405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:05.330711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:05.365355 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3583/7244] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:06.355935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d4d2-b48d-4593-9f2a-d4d2d0773376 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:06.356794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d4d2-b48d-4593-9f2a-d4d2d0773376 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:06.357100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d4d2-b48d-4593-9f2a-d4d2d0773376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:06.391012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4409d4d2-b48d-4593-9f2a-d4d2d0773376 None None] MFA Rules not processed for user `517e5fa08dba4e0cad351ab8201eaaa2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:06.392753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4409d4d2-b48d-4593-9f2a-d4d2d0773376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:06.502290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3662/7245] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:06.508543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:06.515953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:06.644512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939a15-0e84-4be7-bed0-8852c7443b84 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:06.650684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:06.652184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:06.652732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:06.653232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:06.654264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:06.659256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:06.697555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d4d2-b48d-4593-9f2a-d4d2d0773376 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:06.699495 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3584/7246] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:06 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:06.719135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d4d2-b48d-4593-9f2a-d4d2d0773376 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:06.737404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd29d5b-a8dd-487e-b520-cf13e8dfd70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:06.738601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29d5b-a8dd-487e-b520-cf13e8dfd70e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:06.739132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29d5b-a8dd-487e-b520-cf13e8dfd70e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:06.739593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29d5b-a8dd-487e-b520-cf13e8dfd70e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:06.740663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd29d5b-a8dd-487e-b520-cf13e8dfd70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:06.742540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd29d5b-a8dd-487e-b520-cf13e8dfd70e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:06.769660 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3663/7247] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:20:06.776978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:06.798531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96ad41-3354-49cb-a58f-af21003e8d41 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:06.814086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:06.814987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:06.816397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:06.817062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] PATH_INFO: `/v3/system/users/5fb26f2e2faa49b88c008d8396f4885b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:06.904678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5fb26f2e2faa49b88c008d8396f4885b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:06.913120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:06.950137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3585/7248] 10.222.0.30 () {60 vars in 1377 bytes} [Sat Apr 9 21:20:06 2022] PUT /identity/v3/system/users/5fb26f2e2faa49b88c008d8396f4885b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:06.960604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff49aed-6ef5-4418-8d31-16d075b1bba5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:06.961559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff49aed-6ef5-4418-8d31-16d075b1bba5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:06.962165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff49aed-6ef5-4418-8d31-16d075b1bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:07.059709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2ff49aed-6ef5-4418-8d31-16d075b1bba5 None None] MFA Rules not processed for user `5fb26f2e2faa49b88c008d8396f4885b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:07.063682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2ff49aed-6ef5-4418-8d31-16d075b1bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:07.224094 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3664/7249] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:06 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 09 21:20:07.224917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:07.468194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea82d3-7840-4db5-849c-9285c0d8eb43 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:07.527381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb26f2e2faa49b88c008d8396f4885b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:07.528838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:07.529178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:07.543100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:07.544111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:07.545579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:07.560412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff49aed-6ef5-4418-8d31-16d075b1bba5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:07.563509 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3586/7250] 10.222.0.30 () {58 vars in 1109 bytes} [Sat Apr 9 21:20:07 2022] GET /identity/v3/services => generated 2191 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:07.796700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff49aed-6ef5-4418-8d31-16d075b1bba5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:07.842565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb26f2e2faa49b88c008d8396f4885b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:07.843263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:07.843540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:07.843807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] PATH_INFO: `/v3/limits` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:07.845002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:07.846960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:07.879933 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Apr 09 21:20:07.885169 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3665/7251] 10.222.0.30 () {60 vars in 1125 bytes} [Sat Apr 9 21:20:07 2022] POST /identity/v3/limits => generated 124 bytes in 322 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:20:07.886446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:08.108634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4d060-af95-41f2-8147-7ad0ad8d0411 None tempest-ImageQuotaTest-621172622-system-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:08.397614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb26f2e2faa49b88c008d8396f4885b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:08.398751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:08.398751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:08.398965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:08.400248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:08.401396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:08.410042 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3587/7252] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:20:07 2022] GET /identity/v3/registered_limits => generated 129 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:08.416841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:08.614902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05a9c-6540-4c8d-940e-caf151efff6d None tempest-ImageQuotaTest-621172622-system-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:08.663510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb26f2e2faa49b88c008d8396f4885b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:08.664262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:08.664647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:08.665015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:08.665887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:08.667090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:08.673897 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3666/7253] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:20:08 2022] GET /identity/v3/registered_limits => generated 129 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:21.361367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:21.381644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e59c2-0bf0-46f8-9d38-0584519ab967 None tempest-ImageQuotaTest-621172622-system-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:21.388757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:21.390780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:21.391222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:21.392039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] PATH_INFO: `/v3/users/517e5fa08dba4e0cad351ab8201eaaa2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:21.394852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517e5fa08dba4e0cad351ab8201eaaa2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:21.415563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:21.533819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517e5fa08dba4e0cad351ab8201eaaa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:21.535208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517e5fa08dba4e0cad351ab8201eaaa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:21.553471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517e5fa08dba4e0cad351ab8201eaaa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:21.554495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517e5fa08dba4e0cad351ab8201eaaa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:21.574389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517e5fa08dba4e0cad351ab8201eaaa2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:21.651494 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3588/7254] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:21 2022] DELETE /identity/v3/users/517e5fa08dba4e0cad351ab8201eaaa2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:22.570691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:22.573913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:22.727707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca049b-316b-4547-b3f1-0bbb947e2e53 None tempest-ImageQuotaTest-621172622-system-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:22.743054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:22.747558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:22.747930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:22.748217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] PATH_INFO: `/v3/projects/caee3eff3ade4330aeccdf10be6c26fb` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:22.749753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caee3eff3ade4330aeccdf10be6c26fb)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:22.757109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:22.854007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caee3eff3ade4330aeccdf10be6c26fb', 'request_id': 'req-ab037d8f-7a20-4801-ba33-237f7d41ea51'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:22.861576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caee3eff3ade4330aeccdf10be6c26fb', 'request_id': 'req-ab037d8f-7a20-4801-ba33-237f7d41ea51'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:22.878072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caee3eff3ade4330aeccdf10be6c26fb', 'request_id': 'req-ab037d8f-7a20-4801-ba33-237f7d41ea51'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:22.903090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] The token cache is being invalidate because project caee3eff3ade4330aeccdf10be6c26fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:22.903564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:22.904565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:22.906877 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3667/7255] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:22 2022] DELETE /identity/v3/projects/caee3eff3ade4330aeccdf10be6c26fb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:22.913952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:22.928241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc0e2c-dcc0-4b82-88f0-766a33702712 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:23.024881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:23.025813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:23.026088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:23.026353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] PATH_INFO: `/v3/users/5fb26f2e2faa49b88c008d8396f4885b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:23.029916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb26f2e2faa49b88c008d8396f4885b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:23.031950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:23.155058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb26f2e2faa49b88c008d8396f4885b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:23.155787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb26f2e2faa49b88c008d8396f4885b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:23.169264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb26f2e2faa49b88c008d8396f4885b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:23.170176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb26f2e2faa49b88c008d8396f4885b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:23.181718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb26f2e2faa49b88c008d8396f4885b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:23.208302 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3589/7256] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:22 2022] DELETE /identity/v3/users/5fb26f2e2faa49b88c008d8396f4885b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:24.529112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:24.532220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:24.564747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037d8f-7a20-4801-ba33-237f7d41ea51 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:24.708255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:24.709930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:24.710486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:24.710982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] PATH_INFO: `/v3/users/50a301cd542543ab9bbb34b8b3a6f806` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:24.712659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a301cd542543ab9bbb34b8b3a6f806)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:24.715011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:24.760322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:24.761805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:24.784529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dd78-fb7c-4d34-89c4-1152af59dc0b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:24.795017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:24.795875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:24.796152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:24.796423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:24.808270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a301cd542543ab9bbb34b8b3a6f806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:24.809073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a301cd542543ab9bbb34b8b3a6f806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:24.822433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:24.824382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:24.828949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a301cd542543ab9bbb34b8b3a6f806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:24.844040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a301cd542543ab9bbb34b8b3a6f806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:24.845432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1cf8b9dd-8f56-41cb-9066-96db151208cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a301cd542543ab9bbb34b8b3a6f806'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:24.846722 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Apr 09 21:20:24.873490 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3668/7257] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:24 2022] DELETE /identity/v3/users/50a301cd542543ab9bbb34b8b3a6f806 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:24.875682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:24.876092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:24.876544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:24.885469 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3590/7258] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:20:24 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 09 21:20:24.900446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:24.901997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:25.024467 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3669/7259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:25.059939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:25.062185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:25.198072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6422e9-0e06-4c3d-a53a-8b66883a4fe2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:25.327258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450305ba-d664-49d9-8c33-e0770702765b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:25.327949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450305ba-d664-49d9-8c33-e0770702765b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:25.328263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450305ba-d664-49d9-8c33-e0770702765b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:25.328533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450305ba-d664-49d9-8c33-e0770702765b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:25.343894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450305ba-d664-49d9-8c33-e0770702765b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:25.350378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450305ba-d664-49d9-8c33-e0770702765b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:25.369462 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3591/7260] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:25.864191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:25.866596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:25.892868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a3e38-fcdc-49e9-99b0-ef9e213c888a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:25.909589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:25.912459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:25.915972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:25.916728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] PATH_INFO: `/v3/projects/181502de10414412a8e5f105bdbcb6b0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:25.924690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=181502de10414412a8e5f105bdbcb6b0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:25.930073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.002626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181502de10414412a8e5f105bdbcb6b0', 'request_id': 'req-93b61da6-afe9-40ee-a790-5b8606f92aad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:26.009526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181502de10414412a8e5f105bdbcb6b0', 'request_id': 'req-93b61da6-afe9-40ee-a790-5b8606f92aad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:26.019456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181502de10414412a8e5f105bdbcb6b0', 'request_id': 'req-93b61da6-afe9-40ee-a790-5b8606f92aad'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:26.032985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] The token cache is being invalidate because project 181502de10414412a8e5f105bdbcb6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:26.033299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:26.034172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-93b61da6-afe9-40ee-a790-5b8606f92aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:26.035853 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3670/7261] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:25 2022] DELETE /identity/v3/projects/181502de10414412a8e5f105bdbcb6b0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:26.040712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e31f34-7dc2-43a3-a0d0-8d1eef52c2e5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.041583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e31f34-7dc2-43a3-a0d0-8d1eef52c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.042028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e31f34-7dc2-43a3-a0d0-8d1eef52c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.079422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-31e31f34-7dc2-43a3-a0d0-8d1eef52c2e5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:26.080691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-31e31f34-7dc2-43a3-a0d0-8d1eef52c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:26.165930 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3592/7262] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:26.168185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f3c39-ab00-4a55-9e96-2d1ed4f4f296 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.168680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f3c39-ab00-4a55-9e96-2d1ed4f4f296 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.169080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f3c39-ab00-4a55-9e96-2d1ed4f4f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.191299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-268f3c39-ab00-4a55-9e96-2d1ed4f4f296 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:26.192531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-268f3c39-ab00-4a55-9e96-2d1ed4f4f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:26.209503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3671/7263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:26.214217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e31f34-7dc2-43a3-a0d0-8d1eef52c2e5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:26.238942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e31f34-7dc2-43a3-a0d0-8d1eef52c2e5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:26.244573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:26.245330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.245613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.245977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.246743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:26.247243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:26.249446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.264622 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3593/7264] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:26.269126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f3c39-ab00-4a55-9e96-2d1ed4f4f296 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:26.280139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f3c39-ab00-4a55-9e96-2d1ed4f4f296 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:26.287529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:26.287529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.287529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.287529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.287904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:26.289850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.327970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3672/7265] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:26 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:26.331979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:26.344318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106c35-87f4-4309-8391-b5ca0af40ebc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:26.409454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:26.410320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.410674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.411082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.412385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:26.414252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.438472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3594/7266] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:26 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:20:26.443161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:26.459442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44f60-8fc3-4554-aec9-e5ee7efee044 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:26.467762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:26.469745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.470521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.471409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.473339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:26.475584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.491241 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3673/7267] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:26.492528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:26.508215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d51db-a666-4098-b3a3-18ee886af014 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:26.514889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e113a6b-a8fc-4c98-bfe2-d2a020e7d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:26.516189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113a6b-a8fc-4c98-bfe2-d2a020e7d579 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.516771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113a6b-a8fc-4c98-bfe2-d2a020e7d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.517401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113a6b-a8fc-4c98-bfe2-d2a020e7d579 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.518525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e113a6b-a8fc-4c98-bfe2-d2a020e7d579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:26.520729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e113a6b-a8fc-4c98-bfe2-d2a020e7d579 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.537193 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3595/7268] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:20:26.537733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:26.548763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a462ff0-3e99-474c-a911-2482d9ef2acd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:26.554332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:26.555832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.556126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.556403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] PATH_INFO: `/v3/projects/52418f89a7b243cbb3978242927f12a1/users/9f0ec82face7417e958e9dd573f12564/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.579805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52418f89a7b243cbb3978242927f12a1, user_id=9f0ec82face7417e958e9dd573f12564, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:26.583088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.601905 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3674/7269] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:26 2022] PUT /identity/v3/projects/52418f89a7b243cbb3978242927f12a1/users/9f0ec82face7417e958e9dd573f12564/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:26.613465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.614089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.614571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.656796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] MFA Rules not processed for user `9f0ec82face7417e958e9dd573f12564`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:26.658790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:26.754278 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3596/7270] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:26.771987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:26.774263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:26.874907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f81dc-aec1-4d8d-89ca-415de7c1e0d2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:26.882489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5bd7f-a144-49aa-8e00-e8cec5d351e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:26.883736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5bd7f-a144-49aa-8e00-e8cec5d351e7 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:26.884184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5bd7f-a144-49aa-8e00-e8cec5d351e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:26.884658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5bd7f-a144-49aa-8e00-e8cec5d351e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:26.905673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5bd7f-a144-49aa-8e00-e8cec5d351e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:26.911975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5bd7f-a144-49aa-8e00-e8cec5d351e7 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:26.939135 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3675/7271] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:28.889335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:28.890845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:29.027815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de536069-eb42-4fa6-988a-a2f7671ec441 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:29.034404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:29.036056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:29.036334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:29.036602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] PATH_INFO: `/v3/users/47bbcd2319644e7088499f87b6157c4c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:29.037853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bbcd2319644e7088499f87b6157c4c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:29.040079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:29.137203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bbcd2319644e7088499f87b6157c4c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:29.138514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bbcd2319644e7088499f87b6157c4c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:29.152599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bbcd2319644e7088499f87b6157c4c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:29.153881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bbcd2319644e7088499f87b6157c4c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:29.169129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bbcd2319644e7088499f87b6157c4c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:29.197155 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3597/7272] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:28 2022] DELETE /identity/v3/users/47bbcd2319644e7088499f87b6157c4c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:29.201789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:29.202827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:29.203326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:29.227872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:29.229786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:29.327701 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3676/7273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:29.374233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:29.375710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:29.481474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346730c-4b50-44f9-9890-2f623fd526c1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:29.503444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99794db7-41b8-419c-981b-1842b1218e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:29.504162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99794db7-41b8-419c-981b-1842b1218e82 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:29.505510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99794db7-41b8-419c-981b-1842b1218e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:29.505907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99794db7-41b8-419c-981b-1842b1218e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:29.521992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99794db7-41b8-419c-981b-1842b1218e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:29.524060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99794db7-41b8-419c-981b-1842b1218e82 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:29.537660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3598/7274] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:30.076488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:30.078564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:30.091539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166391f6-1906-49e4-83af-c4dc9824bf08 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:30.098824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:30.100195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.100684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.101295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] PATH_INFO: `/v3/projects/881d5d4ef01841cf8824050b995a128d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.102751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=881d5d4ef01841cf8824050b995a128d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:30.106061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:30.195659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881d5d4ef01841cf8824050b995a128d', 'request_id': 'req-d25426a3-7155-4b94-b538-467eaed36e7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:30.205068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881d5d4ef01841cf8824050b995a128d', 'request_id': 'req-d25426a3-7155-4b94-b538-467eaed36e7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:30.222527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881d5d4ef01841cf8824050b995a128d', 'request_id': 'req-d25426a3-7155-4b94-b538-467eaed36e7a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:30.253235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] The token cache is being invalidate because project 881d5d4ef01841cf8824050b995a128d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:30.253817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:30.256801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d25426a3-7155-4b94-b538-467eaed36e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:30.262315 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3677/7275] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:30 2022] DELETE /identity/v3/projects/881d5d4ef01841cf8824050b995a128d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:30.268667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025a24b-048f-4b61-a66c-c2c8bf9e7a5c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.269168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025a24b-048f-4b61-a66c-c2c8bf9e7a5c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.269409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025a24b-048f-4b61-a66c-c2c8bf9e7a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.290461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f025a24b-048f-4b61-a66c-c2c8bf9e7a5c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:30.292319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f025a24b-048f-4b61-a66c-c2c8bf9e7a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:30.433807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3599/7276] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:30.435863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a70a3-8e28-4a27-a285-fab36eac122b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.436161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a70a3-8e28-4a27-a285-fab36eac122b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.436452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a70a3-8e28-4a27-a285-fab36eac122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.482546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-793a70a3-8e28-4a27-a285-fab36eac122b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:30.483809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-793a70a3-8e28-4a27-a285-fab36eac122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:30.505695 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3678/7277] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:30.509768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025a24b-048f-4b61-a66c-c2c8bf9e7a5c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:30.520825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025a24b-048f-4b61-a66c-c2c8bf9e7a5c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:30.526754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:30.527939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.528374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.528799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.530067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:30.530530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:30.540599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:30.558391 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3600/7278] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:20:30.563405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a70a3-8e28-4a27-a285-fab36eac122b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:30.579175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a70a3-8e28-4a27-a285-fab36eac122b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:30.584876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:30.585844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.586417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.586841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.587710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:30.590577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:30.635263 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3679/7279] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:30 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:30.640122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:30.652796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c797-a373-46d7-870d-61783994ff34 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:30.752409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:30.753175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.753455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.753723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.757441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:30.765530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:30.816264 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3601/7280] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:30 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:20:30.820825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:30.837355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f66b25-58a7-41ae-a2db-91922e8be4af admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:30.843185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:30.844512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.844865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.845244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.846410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:30.860101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:30.879417 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3680/7281] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:30.885326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:30.899792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd41ba-9e75-403e-82c6-bf56ab03c9c4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:30.907532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f4758-ec50-4cda-ac9d-b59ce135611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:30.908557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f4758-ec50-4cda-ac9d-b59ce135611f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.909134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f4758-ec50-4cda-ac9d-b59ce135611f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.909643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f4758-ec50-4cda-ac9d-b59ce135611f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:30.910626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f4758-ec50-4cda-ac9d-b59ce135611f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:30.912502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f4758-ec50-4cda-ac9d-b59ce135611f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:30.931407 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3602/7282] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:30.936446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:30.949906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7924c-ca8d-4be8-973e-0ad4bced6cf8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:30.965111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:30.974848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:30.974848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:30.974848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] PATH_INFO: `/v3/projects/f4cac762dfad414f906ad414f325f58a/users/e5c4b06f3fa94fcc8d77510d6930c1ce/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:31.013429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cac762dfad414f906ad414f325f58a, user_id=e5c4b06f3fa94fcc8d77510d6930c1ce, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:31.024932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:31.058432 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3681/7283] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:30 2022] PUT /identity/v3/projects/f4cac762dfad414f906ad414f325f58a/users/e5c4b06f3fa94fcc8d77510d6930c1ce/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:31.060354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fc9f-f5e6-4728-9a8b-aacca4392d4f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:31.060707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fc9f-f5e6-4728-9a8b-aacca4392d4f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:31.061243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fc9f-f5e6-4728-9a8b-aacca4392d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:31.092727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8845fc9f-f5e6-4728-9a8b-aacca4392d4f None None] MFA Rules not processed for user `e5c4b06f3fa94fcc8d77510d6930c1ce`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:31.094172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8845fc9f-f5e6-4728-9a8b-aacca4392d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:31.207787 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3603/7284] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:31.223559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:31.225595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:31.331342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15490-3f75-4fad-89d4-ec7870a450b4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:31.337847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:31.339212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:31.339516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:31.339833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:31.351535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:31.354207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:31.373044 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3682/7285] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:40.672328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:40.673346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:40.673346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:40.697956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] MFA Rules not processed for user `1d343c69635a4412bf9ffcd9dec5c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:40.699213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:40.787794 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3604/7286] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:41.729150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:41.731918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:41.752780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3793a5-3617-4201-a82f-a8d6fce85565 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:41.768703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:41.769819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:41.770318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:41.770785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:41.772981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:41.787782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:41.790254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:41.805778 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3683/7287] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:42.019346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:42.020763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:42.111608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f178c7-1a72-481a-84d7-1cb529acca75 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:42.120720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:42.121998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:42.122628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:42.123200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] PATH_INFO: `/v3/users/9f0ec82face7417e958e9dd573f12564` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:42.124719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0ec82face7417e958e9dd573f12564)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:42.126924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:42.175697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:42.194822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6048-de4e-466e-b039-4c02b01b3bad service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:42.202491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:42.204025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:42.204704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:42.205229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] PATH_INFO: `/v3/users/e5c4b06f3fa94fcc8d77510d6930c1ce` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:42.207696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c4b06f3fa94fcc8d77510d6930c1ce)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:42.209524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0ec82face7417e958e9dd573f12564'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.211518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0ec82face7417e958e9dd573f12564'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.212674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:42.224270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0ec82face7417e958e9dd573f12564'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.225928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0ec82face7417e958e9dd573f12564'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.241920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51d64cbb-ef2d-4fe3-aff4-ca0b9b7bc3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0ec82face7417e958e9dd573f12564'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.265647 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3605/7288] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:42 2022] DELETE /identity/v3/users/9f0ec82face7417e958e9dd573f12564 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:42.269939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31ecb-181a-4fd2-ae15-da37d18ffd98 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:42.270315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31ecb-181a-4fd2-ae15-da37d18ffd98 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:42.270816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31ecb-181a-4fd2-ae15-da37d18ffd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:42.295179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-88e31ecb-181a-4fd2-ae15-da37d18ffd98 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:42.297277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-88e31ecb-181a-4fd2-ae15-da37d18ffd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:42.315222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c4b06f3fa94fcc8d77510d6930c1ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.318016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c4b06f3fa94fcc8d77510d6930c1ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.333195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c4b06f3fa94fcc8d77510d6930c1ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.351439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c4b06f3fa94fcc8d77510d6930c1ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.352069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c4b06f3fa94fcc8d77510d6930c1ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:42.372494 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3606/7289] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:42.380399 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3684/7290] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:42 2022] DELETE /identity/v3/users/e5c4b06f3fa94fcc8d77510d6930c1ce => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:20:42.384804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:42.385407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:42.385890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:42.386006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:42.387337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:42.408141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:42.409704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:42.483261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3607/7291] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:42.501277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:42.503385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:42.598282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8c1d-835e-4991-8b05-4b335dc3c24d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:42.609052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:42.609949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:42.612670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:42.613322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:42.646309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64262698-4a3c-4416-851e-0da7e6667235 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:42.653706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:42.654383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:42.654660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:42.654933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:42.657115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:42.658822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:42.682205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:42.683729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:42.694560 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3685/7292] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:20:42.721118 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3608/7293] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:20:43.435510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:43.438193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:43.478624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee917-3cc1-49ab-a003-0e1d3f46802b service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:43.495456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:43.496429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:43.496693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:43.496971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] PATH_INFO: `/v3/projects/52418f89a7b243cbb3978242927f12a1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:43.503567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52418f89a7b243cbb3978242927f12a1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:43.506176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:43.530903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:43.532574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:43.557460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b87784-5ed9-437d-adad-a15b019dbcca service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:43.567356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:43.569696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:43.572664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:43.572664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] PATH_INFO: `/v3/projects/f4cac762dfad414f906ad414f325f58a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:43.582387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cac762dfad414f906ad414f325f58a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:43.587805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:43.614319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52418f89a7b243cbb3978242927f12a1', 'request_id': 'req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.644667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52418f89a7b243cbb3978242927f12a1', 'request_id': 'req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.664967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52418f89a7b243cbb3978242927f12a1', 'request_id': 'req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.685491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] The token cache is being invalidate because project 52418f89a7b243cbb3978242927f12a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:43.685881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.686727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13ed8eb4-6680-4d4d-b3ca-2711f5c5ca15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.689749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3686/7294] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:43 2022] DELETE /identity/v3/projects/52418f89a7b243cbb3978242927f12a1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:43.696799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389e62-e3b3-4184-9f9b-17f96cab4d65 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:43.697432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389e62-e3b3-4184-9f9b-17f96cab4d65 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:43.697814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389e62-e3b3-4184-9f9b-17f96cab4d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:43.727111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-de389e62-e3b3-4184-9f9b-17f96cab4d65 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:43.731040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cac762dfad414f906ad414f325f58a', 'request_id': 'req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.738246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de389e62-e3b3-4184-9f9b-17f96cab4d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:43.743495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cac762dfad414f906ad414f325f58a', 'request_id': 'req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.762957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cac762dfad414f906ad414f325f58a', 'request_id': 'req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.801720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] The token cache is being invalidate because project f4cac762dfad414f906ad414f325f58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:43.802723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.815326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ced35ec7-fbf5-4ad1-8d34-add6b33a4c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:43.822996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3609/7295] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:43 2022] DELETE /identity/v3/projects/f4cac762dfad414f906ad414f325f58a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:43.826585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577aa6-78d2-47d5-a248-81778c4cc6f8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:43.826867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577aa6-78d2-47d5-a248-81778c4cc6f8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:43.827191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577aa6-78d2-47d5-a248-81778c4cc6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:43.897305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0f577aa6-78d2-47d5-a248-81778c4cc6f8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:43.897305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f577aa6-78d2-47d5-a248-81778c4cc6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:43.908296 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3687/7296] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:43.908939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7716a4-5cb7-4809-ad44-4255353b8960 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:43.909253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7716a4-5cb7-4809-ad44-4255353b8960 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:43.909617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7716a4-5cb7-4809-ad44-4255353b8960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:43.911760 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3610/7297] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:43.921435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b6d8e-0969-4071-b547-458aeff6f06f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:43.921714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b6d8e-0969-4071-b547-458aeff6f06f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:43.921990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b6d8e-0969-4071-b547-458aeff6f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:43.942645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1d1b6d8e-0969-4071-b547-458aeff6f06f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:43.943867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1d1b6d8e-0969-4071-b547-458aeff6f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:43.948249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cc7716a4-5cb7-4809-ad44-4255353b8960 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:43.949505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc7716a4-5cb7-4809-ad44-4255353b8960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:43.956019 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3611/7298] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:43.957075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b6d8e-0969-4071-b547-458aeff6f06f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:43.968299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b6d8e-0969-4071-b547-458aeff6f06f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:43.971464 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3688/7299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:43.974913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:43.975675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:43.976041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7716a4-5cb7-4809-ad44-4255353b8960 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:43.976158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:43.976839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:43.977242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:43.977652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:43.979818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:43.993591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3612/7300] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:43.993806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7716a4-5cb7-4809-ad44-4255353b8960 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:43.997877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.006544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.007260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.007546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.007823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.008624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:44.008936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.011037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.013997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e0198-becd-454a-bcc2-e3587e7510e9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.033459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.033459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.033811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.034073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.034894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.040779 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3689/7301] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:44.040987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.042289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.068520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5d78e-ebae-42fc-844c-5f72918b36ef admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.083770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.084459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.084750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.084999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.085744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.087654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.098321 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3613/7302] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:43 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:44.099378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.132723 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3690/7303] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:44 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:44.136613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.210238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06223-aa0b-4c94-ab65-11769df6c2ae admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.215009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.215885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.216300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.216571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.218103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.219316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.221385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a87a-dd9a-4240-9800-13de9e17bac8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.240489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.241593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.241870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.242142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.242863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.244864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.268760 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3614/7304] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:44 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:44.270476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.284050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69771f55-2105-4772-84b7-bccf3194e9f6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.289124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3691/7305] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:44 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:20:44.294493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.302690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.303683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.304414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.305428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.307386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.309330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.319104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856b046-79af-440a-b7ec-d07ee2c64f38 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.331259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b401-7411-4448-b909-76df28652371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.332384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b401-7411-4448-b909-76df28652371 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.333568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b401-7411-4448-b909-76df28652371 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.334285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b401-7411-4448-b909-76df28652371 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.335611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b401-7411-4448-b909-76df28652371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.337947 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3615/7306] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:44.339457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b401-7411-4448-b909-76df28652371 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.348840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.371687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56b60-9de9-43a8-b546-eae0b177a52c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.376991 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3692/7307] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:44.379777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b401-7411-4448-b909-76df28652371 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.390083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.390815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.392245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.392735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.395619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.404179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.412425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b401-7411-4448-b909-76df28652371 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.438012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.438682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.438965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.439236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.439957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.442540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.442683 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3616/7308] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:44.447047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.457845 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3693/7309] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:44.463248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.470944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aea6-a8ad-416b-ab42-565822e93eb6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.483400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e97818-62ec-4882-b5a8-eddd82cb3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.484738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e97818-62ec-4882-b5a8-eddd82cb3cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.485301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e97818-62ec-4882-b5a8-eddd82cb3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.485797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e97818-62ec-4882-b5a8-eddd82cb3cdc admin admin] PATH_INFO: `/v3/projects/093c0a635224420ab693615c57d91fb4/users/6858b50fb55c43b49b67e7a44befafeb/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.509324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfc004-b418-4b17-a96f-2692c7322c66 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:44.524273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9260319-8718-46fd-8623-9fdd9f667589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:44.525763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260319-8718-46fd-8623-9fdd9f667589 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.526821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260319-8718-46fd-8623-9fdd9f667589 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.527267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260319-8718-46fd-8623-9fdd9f667589 admin admin] PATH_INFO: `/v3/projects/c996c1b9ebd2483795ec8b2e1f0a1f3a/users/1f261964ad654e2db25d97a5c26147a1/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.560513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e97818-62ec-4882-b5a8-eddd82cb3cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=093c0a635224420ab693615c57d91fb4, user_id=6858b50fb55c43b49b67e7a44befafeb, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.569259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9260319-8718-46fd-8623-9fdd9f667589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c996c1b9ebd2483795ec8b2e1f0a1f3a, user_id=1f261964ad654e2db25d97a5c26147a1, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:44.571978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9260319-8718-46fd-8623-9fdd9f667589 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.574611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e97818-62ec-4882-b5a8-eddd82cb3cdc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:44.601617 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3617/7310] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:44 2022] PUT /identity/v3/projects/093c0a635224420ab693615c57d91fb4/users/6858b50fb55c43b49b67e7a44befafeb/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:44.614204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.614878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.615557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.617237 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3694/7311] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:44 2022] PUT /identity/v3/projects/c996c1b9ebd2483795ec8b2e1f0a1f3a/users/1f261964ad654e2db25d97a5c26147a1/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:44.666038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] MFA Rules not processed for user `6858b50fb55c43b49b67e7a44befafeb`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:44.670443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:44.714593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb042-0eb4-4299-bef8-9da7511bd126 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:44.715434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb042-0eb4-4299-bef8-9da7511bd126 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:44.716117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb042-0eb4-4299-bef8-9da7511bd126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:44.814615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-042eb042-0eb4-4299-bef8-9da7511bd126 None None] MFA Rules not processed for user `1f261964ad654e2db25d97a5c26147a1`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:44.814615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-042eb042-0eb4-4299-bef8-9da7511bd126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:44.898700 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3618/7312] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:44.988535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:44.989950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:45.047302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3695/7313] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:20:45.048791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb042-0eb4-4299-bef8-9da7511bd126 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:45.121022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8cc8-4925-4c56-8f54-33187c4b8f22 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.127609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.128281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.128677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.128803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.138494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.140070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:45.158884 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3619/7314] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:20:45.163192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb042-0eb4-4299-bef8-9da7511bd126 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.168825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.169843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.170483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.171079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.172001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.175070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:45.212132 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3696/7315] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:45 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:45.216344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:45.232784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930558-3281-4116-810f-8f2a09b2e249 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.341400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.342473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.343543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.346229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.347210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.351877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:45.395556 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3620/7316] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:45 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:45.399996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:45.416131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a63d4-b6eb-4d3c-8970-df0ef2d12bc9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.425577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.427092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.427472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.427843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.429526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.431761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:45.446082 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3697/7317] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:45.453633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:45.466915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2711785-259d-440f-8838-24ac5a47be03 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.475665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.476719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.477295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.477455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] PATH_INFO: `/v3/projects/8c316cd693f14c498b6b7c1cd17444ee/users/92b56aa819be45889d1e4922cee3c539/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.494599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c316cd693f14c498b6b7c1cd17444ee, user_id=92b56aa819be45889d1e4922cee3c539, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.498485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:45.515958 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3621/7318] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:45 2022] PUT /identity/v3/projects/8c316cd693f14c498b6b7c1cd17444ee/users/92b56aa819be45889d1e4922cee3c539/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:45.517156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:45.527237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d007d-76f6-4edb-80bf-dd169817811b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.604137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfd554-62e3-45e6-919f-552944b84a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.605259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd554-62e3-45e6-919f-552944b84a13 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.607021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd554-62e3-45e6-919f-552944b84a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.607480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd554-62e3-45e6-919f-552944b84a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.608854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfd554-62e3-45e6-919f-552944b84a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.610706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfd554-62e3-45e6-919f-552944b84a13 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:45.634876 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3698/7319] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:45.635508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:45.650885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153afef-84f0-4ac7-b0a2-b9332a510d4a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.655718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.656628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.656901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.657194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] PATH_INFO: `/v3/projects/8c316cd693f14c498b6b7c1cd17444ee/users/92b56aa819be45889d1e4922cee3c539/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.659570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c316cd693f14c498b6b7c1cd17444ee, user_id=92b56aa819be45889d1e4922cee3c539, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.662278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:45.690287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3622/7320] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:45 2022] PUT /identity/v3/projects/8c316cd693f14c498b6b7c1cd17444ee/users/92b56aa819be45889d1e4922cee3c539/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:45.692138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b72bab-79d6-4574-badd-69a1a69e9ce9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.692423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b72bab-79d6-4574-badd-69a1a69e9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.692696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b72bab-79d6-4574-badd-69a1a69e9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.742442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c4b72bab-79d6-4574-badd-69a1a69e9ce9 None None] MFA Rules not processed for user `92b56aa819be45889d1e4922cee3c539`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:45.745671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c4b72bab-79d6-4574-badd-69a1a69e9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:45.860325 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3699/7321] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:45.861257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:45.863912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:45.978292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa4cc-9141-4a3e-89c3-3ad8a7ff7521 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:45.983952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:45.984882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:45.985510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:45.985859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:45.998020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:45.999669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:46.027908 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3623/7322] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:20:46.174132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b72bab-79d6-4574-badd-69a1a69e9ce9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:46.191996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b72bab-79d6-4574-badd-69a1a69e9ce9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:46.199894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c303860-5811-4cb5-b6d2-7fece142e92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:46.200939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c303860-5811-4cb5-b6d2-7fece142e92a service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:46.201394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c303860-5811-4cb5-b6d2-7fece142e92a service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:46.201789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c303860-5811-4cb5-b6d2-7fece142e92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:46.302318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c303860-5811-4cb5-b6d2-7fece142e92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:46.303947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c303860-5811-4cb5-b6d2-7fece142e92a service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:46.313342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3700/7323] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:46.558848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:46.645368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab32330-f306-40c0-be98-f29b1db60f6f service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:46.654864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:46.656913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:46.657880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:46.658336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] PATH_INFO: `/v3/users/6858b50fb55c43b49b67e7a44befafeb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:46.660411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6858b50fb55c43b49b67e7a44befafeb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:46.664367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:46.730072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6858b50fb55c43b49b67e7a44befafeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:46.731041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6858b50fb55c43b49b67e7a44befafeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:46.739069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6858b50fb55c43b49b67e7a44befafeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:46.740469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6858b50fb55c43b49b67e7a44befafeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:46.753131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6858b50fb55c43b49b67e7a44befafeb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:46.786772 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3624/7324] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:46 2022] DELETE /identity/v3/users/6858b50fb55c43b49b67e7a44befafeb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:46.789189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:46.790066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:46.790563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:46.817539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:46.820465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:46.912019 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3701/7325] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:46.925628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:46.927116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:47.002230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad333f-0106-4ba6-9ace-7daaeb95423e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:47.006614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016365b0-110c-455c-92e0-82cefb2f72b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:47.007281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016365b0-110c-455c-92e0-82cefb2f72b1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:47.007563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016365b0-110c-455c-92e0-82cefb2f72b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:47.007837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016365b0-110c-455c-92e0-82cefb2f72b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:47.018367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016365b0-110c-455c-92e0-82cefb2f72b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:47.020041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016365b0-110c-455c-92e0-82cefb2f72b1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:47.034251 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3625/7326] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:47.781782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:47.783792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:47.799601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d333d-8a2e-422a-8dc4-05a71f5d609f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:47.816423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:47.817911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:47.819167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:47.819973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] PATH_INFO: `/v3/projects/093c0a635224420ab693615c57d91fb4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:47.823528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093c0a635224420ab693615c57d91fb4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:47.826456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:47.927097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093c0a635224420ab693615c57d91fb4', 'request_id': 'req-2a4a2e81-b85d-4c2d-b2e6-499780296495'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:47.934731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093c0a635224420ab693615c57d91fb4', 'request_id': 'req-2a4a2e81-b85d-4c2d-b2e6-499780296495'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:47.949467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093c0a635224420ab693615c57d91fb4', 'request_id': 'req-2a4a2e81-b85d-4c2d-b2e6-499780296495'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:47.968559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] The token cache is being invalidate because project 093c0a635224420ab693615c57d91fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:47.971084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:47.974674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2a4a2e81-b85d-4c2d-b2e6-499780296495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:47.982224 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3702/7327] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:47 2022] DELETE /identity/v3/projects/093c0a635224420ab693615c57d91fb4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:47.984240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388bae-2042-4e18-948c-fda6a32f326c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:47.984714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388bae-2042-4e18-948c-fda6a32f326c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:47.984965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388bae-2042-4e18-948c-fda6a32f326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.020505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-22388bae-2042-4e18-948c-fda6a32f326c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:48.020505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-22388bae-2042-4e18-948c-fda6a32f326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:48.087185 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3626/7328] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:48.096108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.096757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.097295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.184682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:48.186147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:48.196479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3703/7329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:48.201003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388bae-2042-4e18-948c-fda6a32f326c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.213352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388bae-2042-4e18-948c-fda6a32f326c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:48.218820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:48.226208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.226450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.226792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.227807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:48.232490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:48.234580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:48.246406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.249914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:48.268891 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3627/7330] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:48.280013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.301803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f678c6-2d67-4932-8161-07fb5112dec5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:48.317149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:48.317926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.318421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.318746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.319513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:48.321883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:48.381161 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3628/7331] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:48 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:48.385395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.394739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f566521-1e11-4af0-a3cf-303ef4bebf26 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:48.504336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:48.505296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.505688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.506419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.508863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:48.532548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:48.535160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:48.536442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b345-3243-4df0-bb33-9673826ff190 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:48.545525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:48.546280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.546562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.546911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.547910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:48.553079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:48.553400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3704/7332] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:20:48.583415 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3629/7333] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:48 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:48.585136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.598321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749bea-b937-4fd2-908d-b000dd1cd6b5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:48.604908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:48.606045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.606593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.607203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.608569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:48.611803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:48.629436 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3705/7334] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:48.634601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.652031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571ca07-9c36-42ce-8493-106b249b3d9b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:48.659176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd037a-63a8-4bda-9887-9fded81ad8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:48.660273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd037a-63a8-4bda-9887-9fded81ad8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.660273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd037a-63a8-4bda-9887-9fded81ad8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.660647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd037a-63a8-4bda-9887-9fded81ad8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.661588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd037a-63a8-4bda-9887-9fded81ad8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:48.671612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd037a-63a8-4bda-9887-9fded81ad8d4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:48.694466 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3630/7335] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:48.696018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.708700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eccf8-0d15-40db-826e-b83fee1a09a7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:48.714344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:48.715272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.715552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.715827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] PATH_INFO: `/v3/projects/97ad5f7b6df9476595b9ca934cbcbdce/users/0a70173e7de74e7399c9d70aaef24f39/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.734592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ad5f7b6df9476595b9ca934cbcbdce, user_id=0a70173e7de74e7399c9d70aaef24f39, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:48.737720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:48.767253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3706/7336] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:48 2022] PUT /identity/v3/projects/97ad5f7b6df9476595b9ca934cbcbdce/users/0a70173e7de74e7399c9d70aaef24f39/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:20:48.777595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c3dc-bdd7-4088-aa1b-03b5c19e6296 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:48.777879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c3dc-bdd7-4088-aa1b-03b5c19e6296 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:48.778153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c3dc-bdd7-4088-aa1b-03b5c19e6296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:48.819593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a7b9c3dc-bdd7-4088-aa1b-03b5c19e6296 None None] MFA Rules not processed for user `0a70173e7de74e7399c9d70aaef24f39`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:48.820982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a7b9c3dc-bdd7-4088-aa1b-03b5c19e6296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:48.907372 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3631/7337] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:48.931141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:48.932978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:49.046172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102b826-add7-444c-a0ac-6f907234fec7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:49.051316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee894f25-e48d-4813-aff3-ca853ff40991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:49.051961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee894f25-e48d-4813-aff3-ca853ff40991 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:49.052379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee894f25-e48d-4813-aff3-ca853ff40991 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:49.052663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee894f25-e48d-4813-aff3-ca853ff40991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:49.063190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee894f25-e48d-4813-aff3-ca853ff40991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:49.064887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee894f25-e48d-4813-aff3-ca853ff40991 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:49.077990 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3707/7338] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:49.092662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9c3dc-bdd7-4088-aa1b-03b5c19e6296 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:49.166283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9c3dc-bdd7-4088-aa1b-03b5c19e6296 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:49.171105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:49.172081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:49.172437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:49.172774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] PATH_INFO: `/v3/users/0a70173e7de74e7399c9d70aaef24f39` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:49.174542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a70173e7de74e7399c9d70aaef24f39)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:49.176154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:49.244092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a70173e7de74e7399c9d70aaef24f39'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:49.247317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a70173e7de74e7399c9d70aaef24f39'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:49.265704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a70173e7de74e7399c9d70aaef24f39'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:49.266562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a70173e7de74e7399c9d70aaef24f39'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:49.286663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a70173e7de74e7399c9d70aaef24f39'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:49.314709 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3632/7339] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:49 2022] DELETE /identity/v3/users/0a70173e7de74e7399c9d70aaef24f39 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:49.318946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:49.319259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:49.319535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:49.340167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:49.341959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:49.424936 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3708/7340] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:49.439891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:49.441556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:49.512156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93716789-e42c-4877-9f76-bc283c8829e9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:49.515976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8a764-5c5c-4f5d-bd80-12c0185c0114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:49.516708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8a764-5c5c-4f5d-bd80-12c0185c0114 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:49.517050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8a764-5c5c-4f5d-bd80-12c0185c0114 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:49.517338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8a764-5c5c-4f5d-bd80-12c0185c0114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:49.528579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8a764-5c5c-4f5d-bd80-12c0185c0114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:49.529986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8a764-5c5c-4f5d-bd80-12c0185c0114 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:49.546399 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3633/7341] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:50.179294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:50.180815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:50.207193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c59b3-6218-403b-ac2f-924a3bc84067 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:50.212852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:50.215563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.216968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.217199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] PATH_INFO: `/v3/projects/97ad5f7b6df9476595b9ca934cbcbdce` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.218902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ad5f7b6df9476595b9ca934cbcbdce)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:50.221721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:50.274385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ad5f7b6df9476595b9ca934cbcbdce', 'request_id': 'req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:50.280233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ad5f7b6df9476595b9ca934cbcbdce', 'request_id': 'req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:50.291677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ad5f7b6df9476595b9ca934cbcbdce', 'request_id': 'req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:50.305574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] The token cache is being invalidate because project 97ad5f7b6df9476595b9ca934cbcbdce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:50.305860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:50.306716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2cf6dcaf-1af3-4e86-99fa-5f8db3b87064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:50.308575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3709/7342] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:50 2022] DELETE /identity/v3/projects/97ad5f7b6df9476595b9ca934cbcbdce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:50.313603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea75bd-0923-4956-963f-0c642c75dfb7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.314408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea75bd-0923-4956-963f-0c642c75dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.314887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea75bd-0923-4956-963f-0c642c75dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.334143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cdea75bd-0923-4956-963f-0c642c75dfb7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:50.335511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cdea75bd-0923-4956-963f-0c642c75dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:50.414974 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3634/7343] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:50.422627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd1037-fd14-479f-9dcd-5ad57603ca00 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.422914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd1037-fd14-479f-9dcd-5ad57603ca00 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.423194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd1037-fd14-479f-9dcd-5ad57603ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.452507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-02bd1037-fd14-479f-9dcd-5ad57603ca00 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:50.453858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02bd1037-fd14-479f-9dcd-5ad57603ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:50.462462 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3710/7344] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:50.467330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea75bd-0923-4956-963f-0c642c75dfb7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:50.478425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea75bd-0923-4956-963f-0c642c75dfb7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:50.487843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:50.488785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.489088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.489551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.490518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:50.490823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:50.492648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:50.504759 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3635/7345] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:50.509164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd1037-fd14-479f-9dcd-5ad57603ca00 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:50.518350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd1037-fd14-479f-9dcd-5ad57603ca00 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:50.522984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:50.523651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.523927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.524197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.524998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:50.526902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:50.556060 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3711/7346] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:50 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:50.557323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:50.568861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb134d2-21e2-4694-8f01-567c80ea1ac2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:50.643159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:50.643911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.644264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.644607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.645468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:50.647983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:50.675781 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3636/7347] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:50 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:20:50.679870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:50.693828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c13a72-23df-4293-b60d-d31073967725 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:50.699380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:50.700066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.700348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.700625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.701372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:50.703364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:50.739494 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3712/7348] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:50.744074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:50.760835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd11d-f6e4-43de-b9d0-5aab596d082d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:50.774860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8793d54-79c8-4588-a447-1341880d7b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:50.776131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8793d54-79c8-4588-a447-1341880d7b9a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.776633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8793d54-79c8-4588-a447-1341880d7b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.777089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8793d54-79c8-4588-a447-1341880d7b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.778000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8793d54-79c8-4588-a447-1341880d7b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:50.784559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8793d54-79c8-4588-a447-1341880d7b9a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:50.796318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3637/7349] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:50.801682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:50.818121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fff08d-6e95-4296-b6f8-6864a3ecb312 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:50.824107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:50.825673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.826175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.826521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] PATH_INFO: `/v3/projects/53f86e994b764548aaa50faf7349c8e4/users/230e969fa7a94da0a89e4737615fbb56/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.886074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f86e994b764548aaa50faf7349c8e4, user_id=230e969fa7a94da0a89e4737615fbb56, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:50.890871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:50.931189 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3713/7350] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:50 2022] PUT /identity/v3/projects/53f86e994b764548aaa50faf7349c8e4/users/230e969fa7a94da0a89e4737615fbb56/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:20:50.943616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe180a1-d5f7-4839-9900-973292274f2d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:50.944172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe180a1-d5f7-4839-9900-973292274f2d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:50.944773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe180a1-d5f7-4839-9900-973292274f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:50.981923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cbe180a1-d5f7-4839-9900-973292274f2d None None] MFA Rules not processed for user `230e969fa7a94da0a89e4737615fbb56`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:50.983680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cbe180a1-d5f7-4839-9900-973292274f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:51.093194 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3638/7351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:51.097748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:51.243438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b112-c965-4713-82d2-81457b6e1108 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:51.249773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:51.250891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:51.251361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:51.251811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:51.252848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:51.255370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:51.301800 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3714/7352] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:51 2022] POST /identity/v3/projects => generated 363 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:20:51.302653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe180a1-d5f7-4839-9900-973292274f2d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:51.318003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe180a1-d5f7-4839-9900-973292274f2d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:51.406337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:51.408211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:51.408497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:51.408771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:51.410453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:51.412437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:51.442515 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3639/7353] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:51 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:51.446452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:51.465011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f749-d545-4f0e-9c3c-cdd77d5c948e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:51.474253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:51.475304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:51.475790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:51.476225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:51.487094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:51.491937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:51.512175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3715/7354] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:51.512799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:51.525238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5660e0-af44-4bd0-8eed-5f26a8dd3411 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:51.530355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:51.532726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:51.533005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:51.533979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] PATH_INFO: `/v3/projects/7ed5a42e8a7c4de79c45b62edf2b1112/users/186e1726179a4f37ab2f46a582291fed/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:51.554236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed5a42e8a7c4de79c45b62edf2b1112, user_id=186e1726179a4f37ab2f46a582291fed, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:51.557065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:51.581597 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3640/7355] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:51 2022] PUT /identity/v3/projects/7ed5a42e8a7c4de79c45b62edf2b1112/users/186e1726179a4f37ab2f46a582291fed/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:20:51.585689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:51.597374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25811dc-e42f-4b55-b7c0-18a3511c43bd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:51.682381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44fb0a-34fb-423a-9d01-b664c0c60aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:51.683325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44fb0a-34fb-423a-9d01-b664c0c60aea admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:51.683831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44fb0a-34fb-423a-9d01-b664c0c60aea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:51.684270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44fb0a-34fb-423a-9d01-b664c0c60aea admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:51.685845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44fb0a-34fb-423a-9d01-b664c0c60aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:51.687748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44fb0a-34fb-423a-9d01-b664c0c60aea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:51.702637 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3716/7356] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:51.706243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:51.718659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479fbe0-bc6d-40a8-a1b3-1b49222eb567 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:51.739065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:51.739319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:51.739569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:51.739848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] PATH_INFO: `/v3/projects/7ed5a42e8a7c4de79c45b62edf2b1112/users/186e1726179a4f37ab2f46a582291fed/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:51.750941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed5a42e8a7c4de79c45b62edf2b1112, user_id=186e1726179a4f37ab2f46a582291fed, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:51.766215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:51.798516 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3641/7357] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:51 2022] PUT /identity/v3/projects/7ed5a42e8a7c4de79c45b62edf2b1112/users/186e1726179a4f37ab2f46a582291fed/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:51.809610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01809-6030-40b8-8f71-87a7ddc9d419 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:51.809902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01809-6030-40b8-8f71-87a7ddc9d419 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:51.810180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01809-6030-40b8-8f71-87a7ddc9d419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:51.850766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6da01809-6030-40b8-8f71-87a7ddc9d419 None None] MFA Rules not processed for user `186e1726179a4f37ab2f46a582291fed`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:51.852824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6da01809-6030-40b8-8f71-87a7ddc9d419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:51.975220 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3717/7358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:51.990146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:51.992049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:52.067186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098634c-88d7-4416-9f84-b2e163ede217 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:52.071921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:52.072595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:52.073488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:52.073488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:52.096297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:52.098032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:52.125510 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3642/7359] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:52.235292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01809-6030-40b8-8f71-87a7ddc9d419 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:52.253571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01809-6030-40b8-8f71-87a7ddc9d419 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:52.258260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:52.259119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:52.259462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:52.259826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:52.283160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:52.286890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:52.354858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:52.357581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:52.372994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3718/7360] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:52.448917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0126cb0-33aa-4200-ba61-77715a984c54 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:52.475068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:52.478359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:52.478827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:52.479126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:52.496851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:52.535822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:52.541379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:52.574272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3643/7361] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:54.876543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:54.878862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:55.097885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655959dc-d7df-43b9-909d-9ed31326136d service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:55.105018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735c3ab-b5c5-4bb3-a4dc-505b8ee2a2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:55.106197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735c3ab-b5c5-4bb3-a4dc-505b8ee2a2c9 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:55.106639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735c3ab-b5c5-4bb3-a4dc-505b8ee2a2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:55.107093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735c3ab-b5c5-4bb3-a4dc-505b8ee2a2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:55.110199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9735c3ab-b5c5-4bb3-a4dc-505b8ee2a2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:55.128904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735c3ab-b5c5-4bb3-a4dc-505b8ee2a2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:55.131270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735c3ab-b5c5-4bb3-a4dc-505b8ee2a2c9 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:55.151977 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3719/7362] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:55.650517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:55.745971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6f484-33da-4341-96d8-9cf335bbf981 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:55.751977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:55.753088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:55.753553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:55.753995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] PATH_INFO: `/v3/users/230e969fa7a94da0a89e4737615fbb56` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:55.755391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] RBAC: Authorizing `identity:delete_user(user_id=230e969fa7a94da0a89e4737615fbb56)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:55.758613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:55.847533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230e969fa7a94da0a89e4737615fbb56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:55.848222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230e969fa7a94da0a89e4737615fbb56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:55.861952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230e969fa7a94da0a89e4737615fbb56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:55.864155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230e969fa7a94da0a89e4737615fbb56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:55.897503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230e969fa7a94da0a89e4737615fbb56'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:55.922577 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3644/7363] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:55 2022] DELETE /identity/v3/users/230e969fa7a94da0a89e4737615fbb56 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:55.928975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:55.929545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:55.929545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:55.960881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:55.962350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:56.070558 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3720/7364] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:20:56.087781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:56.089935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:56.191057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2c76-60be-4006-8652-03508d2d757e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:56.195795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9d1bd-fb1e-4ce9-936d-b2d76f1429ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:56.199260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9d1bd-fb1e-4ce9-936d-b2d76f1429ec service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:56.199260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9d1bd-fb1e-4ce9-936d-b2d76f1429ec service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:56.199260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9d1bd-fb1e-4ce9-936d-b2d76f1429ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:56.200634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:56.202142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:56.215752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9d1bd-fb1e-4ce9-936d-b2d76f1429ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:56.217617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9d1bd-fb1e-4ce9-936d-b2d76f1429ec service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:56.219258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c01c4b-9a87-4c11-82af-d2f004fa7fb3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:56.225417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:56.226325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:56.226816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:56.227248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] PATH_INFO: `/v3/users/1f261964ad654e2db25d97a5c26147a1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:56.229244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f261964ad654e2db25d97a5c26147a1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:56.230438 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3645/7365] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:56.242307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:56.316515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f261964ad654e2db25d97a5c26147a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.319246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f261964ad654e2db25d97a5c26147a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.330353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f261964ad654e2db25d97a5c26147a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.342840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f261964ad654e2db25d97a5c26147a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.344537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f261964ad654e2db25d97a5c26147a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.388909 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3721/7366] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:56 2022] DELETE /identity/v3/users/1f261964ad654e2db25d97a5c26147a1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:56.393248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:56.394082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:56.394566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:56.425072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:56.426624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:56.529056 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3646/7367] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:20:56.538462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:56.540994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:56.612404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113134b-1311-4cda-9959-4cc762115a5e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:56.617320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:56.618489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:56.619058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:56.619498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:56.634397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:56.636126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:56.649776 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3722/7368] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:20:56.778872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:56.781495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:56.807731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a10c-4b57-4b9f-92a9-e6d218743450 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:56.813807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:56.814894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:56.815405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:56.815915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] PATH_INFO: `/v3/projects/53f86e994b764548aaa50faf7349c8e4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:56.819841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f86e994b764548aaa50faf7349c8e4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:56.822092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:56.918544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f86e994b764548aaa50faf7349c8e4', 'request_id': 'req-61be6087-8f00-4971-adf7-cdd58589ac5a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.936328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f86e994b764548aaa50faf7349c8e4', 'request_id': 'req-61be6087-8f00-4971-adf7-cdd58589ac5a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.950012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f86e994b764548aaa50faf7349c8e4', 'request_id': 'req-61be6087-8f00-4971-adf7-cdd58589ac5a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.969520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] The token cache is being invalidate because project 53f86e994b764548aaa50faf7349c8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:56.969812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.971320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:56.974034 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3647/7369] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:56 2022] DELETE /identity/v3/projects/53f86e994b764548aaa50faf7349c8e4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:56.979046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:56.994587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25153e4-7c92-462d-8145-453558641660 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:57.068303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:57.069621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:57.069971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:57.070362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] PATH_INFO: `/v3/users/186e1726179a4f37ab2f46a582291fed` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:57.071712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186e1726179a4f37ab2f46a582291fed)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:57.074942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:57.156011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186e1726179a4f37ab2f46a582291fed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.156812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186e1726179a4f37ab2f46a582291fed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.165091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186e1726179a4f37ab2f46a582291fed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.180926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186e1726179a4f37ab2f46a582291fed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.183817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186e1726179a4f37ab2f46a582291fed'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.211242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3723/7370] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:56 2022] DELETE /identity/v3/users/186e1726179a4f37ab2f46a582291fed => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:57.462905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:57.465200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:57.485833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be6087-8f00-4971-adf7-cdd58589ac5a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:57.583342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:57.584401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:57.585085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:57.585085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] PATH_INFO: `/v3/projects/c996c1b9ebd2483795ec8b2e1f0a1f3a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:57.586467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c996c1b9ebd2483795ec8b2e1f0a1f3a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:57.588943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:57.653658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c996c1b9ebd2483795ec8b2e1f0a1f3a', 'request_id': 'req-d9cb48be-7354-41af-a201-65eb43b73733'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.659540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c996c1b9ebd2483795ec8b2e1f0a1f3a', 'request_id': 'req-d9cb48be-7354-41af-a201-65eb43b73733'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.672677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c996c1b9ebd2483795ec8b2e1f0a1f3a', 'request_id': 'req-d9cb48be-7354-41af-a201-65eb43b73733'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.692085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] The token cache is being invalidate because project c996c1b9ebd2483795ec8b2e1f0a1f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:57.692340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.693173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.695806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3648/7371] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:57 2022] DELETE /identity/v3/projects/c996c1b9ebd2483795ec8b2e1f0a1f3a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:57.699752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:57.701303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:57.715912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28fed2-1a93-4f54-ae0f-6a7e90caaae5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:57.784558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:57.785653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:57.786120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:57.786391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] PATH_INFO: `/v3/users/92b56aa819be45889d1e4922cee3c539` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:57.787779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b56aa819be45889d1e4922cee3c539)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:57.789912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:57.853596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b56aa819be45889d1e4922cee3c539'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.854264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b56aa819be45889d1e4922cee3c539'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.863151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b56aa819be45889d1e4922cee3c539'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.872271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b56aa819be45889d1e4922cee3c539'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.873444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4e47cd51-69a1-4c03-bece-63ab72e15dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b56aa819be45889d1e4922cee3c539'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:57.904867 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3724/7372] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:20:57 2022] DELETE /identity/v3/users/92b56aa819be45889d1e4922cee3c539 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:57.945082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:57.947683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:57.965148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb48be-7354-41af-a201-65eb43b73733 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:58.070214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:58.073867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.074848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.074848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] PATH_INFO: `/v3/projects/7ed5a42e8a7c4de79c45b62edf2b1112` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.077463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed5a42e8a7c4de79c45b62edf2b1112)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:58.082035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:58.166524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed5a42e8a7c4de79c45b62edf2b1112', 'request_id': 'req-fdd07260-f140-4ec3-9552-8796c8a9ab58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.172907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed5a42e8a7c4de79c45b62edf2b1112', 'request_id': 'req-fdd07260-f140-4ec3-9552-8796c8a9ab58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.188062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed5a42e8a7c4de79c45b62edf2b1112', 'request_id': 'req-fdd07260-f140-4ec3-9552-8796c8a9ab58'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.208206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] The token cache is being invalidate because project 7ed5a42e8a7c4de79c45b62edf2b1112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:58.208589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.209304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fdd07260-f140-4ec3-9552-8796c8a9ab58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.213244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3649/7373] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:57 2022] DELETE /identity/v3/projects/7ed5a42e8a7c4de79c45b62edf2b1112 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:20:58.219802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caddbd-1607-4b01-87c6-b26e1cb9ab9d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.221367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caddbd-1607-4b01-87c6-b26e1cb9ab9d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.221367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caddbd-1607-4b01-87c6-b26e1cb9ab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.253407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-48caddbd-1607-4b01-87c6-b26e1cb9ab9d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:58.254697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-48caddbd-1607-4b01-87c6-b26e1cb9ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:58.345112 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3725/7374] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:58.350434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7756-bcfb-4970-94ff-23f5e5e85ec4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.350892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7756-bcfb-4970-94ff-23f5e5e85ec4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.351258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7756-bcfb-4970-94ff-23f5e5e85ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.391164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c11e7756-bcfb-4970-94ff-23f5e5e85ec4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:58.392963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c11e7756-bcfb-4970-94ff-23f5e5e85ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:58.406277 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3650/7375] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:20:58.411237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caddbd-1607-4b01-87c6-b26e1cb9ab9d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:58.422797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caddbd-1607-4b01-87c6-b26e1cb9ab9d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:58.428095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:58.428598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.428869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.429350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.430259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:58.430716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:58.432503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:58.455969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e7756-bcfb-4970-94ff-23f5e5e85ec4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:58.468738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3726/7376] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:58.470036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e7756-bcfb-4970-94ff-23f5e5e85ec4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:58.481824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:58.482655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.483203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.483805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.484811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:58.487185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:58.529533 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3651/7377] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:58 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:58.534570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:58.548856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f500d-9f85-4748-959e-a72b519a7438 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:58.590477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:58.592513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:58.712878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566458b-71d8-43ff-a1fd-bdcd8f76943f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:58.716545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:58.719233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.719849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.724826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.726625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:58.728844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:58.728994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:58.729812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.730090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.730358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] PATH_INFO: `/v3/projects/8c316cd693f14c498b6b7c1cd17444ee` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.732762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c316cd693f14c498b6b7c1cd17444ee)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:58.734855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:58.781800 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3727/7378] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:58 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:58.786698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:58.807541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4759e-7f10-48c6-8385-bf38ed12bd47 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:58.814256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:58.815128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.815513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.815859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.816816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:58.818842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:58.832142 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3728/7379] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:20:58.835767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:58.845624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c316cd693f14c498b6b7c1cd17444ee', 'request_id': 'req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.858180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c316cd693f14c498b6b7c1cd17444ee', 'request_id': 'req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.864805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5bda-f70d-42f2-a916-ae33da12d734 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:58.873250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c316cd693f14c498b6b7c1cd17444ee', 'request_id': 'req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.891960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] The token cache is being invalidate because project 8c316cd693f14c498b6b7c1cd17444ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:20:58.892100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.893953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-65e3b75a-b4e2-4d72-80e7-82fc6653d76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:20:58.899486 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3652/7380] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:20:58 2022] DELETE /identity/v3/projects/8c316cd693f14c498b6b7c1cd17444ee => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:20:58.901302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d140-3cba-498e-b87d-229b715906af None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.901581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d140-3cba-498e-b87d-229b715906af None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.901975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d140-3cba-498e-b87d-229b715906af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.939975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2147d140-3cba-498e-b87d-229b715906af None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:58.941259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2147d140-3cba-498e-b87d-229b715906af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:58.965872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:58.966831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:58.967352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:58.967826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:58.968717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:58.971419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:58.998868 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3729/7381] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:20:59.002648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.010691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:59.025301 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3653/7382] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:20:59.027503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d932-37d0-4101-a052-7a3f9a6274f8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.027947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d932-37d0-4101-a052-7a3f9a6274f8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.028577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d932-37d0-4101-a052-7a3f9a6274f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.043195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8e333-f4ff-410a-aa98-b974456bc622 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.058664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdc808-9aad-4b83-b5dd-c76b6956d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.060123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdc808-9aad-4b83-b5dd-c76b6956d805 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.060123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdc808-9aad-4b83-b5dd-c76b6956d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.060123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdc808-9aad-4b83-b5dd-c76b6956d805 admin admin] PATH_INFO: `/v3/projects/75154372cab04e1189b12cae78c2e765/users/270002bb4fc94e56ba03bedc800b32f0/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.060629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d409d932-37d0-4101-a052-7a3f9a6274f8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:59.062510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d409d932-37d0-4101-a052-7a3f9a6274f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:59.077842 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3654/7383] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:59.078881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409d932-37d0-4101-a052-7a3f9a6274f8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.086922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdc808-9aad-4b83-b5dd-c76b6956d805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75154372cab04e1189b12cae78c2e765, user_id=270002bb4fc94e56ba03bedc800b32f0, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.089632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdc808-9aad-4b83-b5dd-c76b6956d805 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.093094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409d932-37d0-4101-a052-7a3f9a6274f8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.099865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.100611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.100941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.101244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.102120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:20:59.102422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.104287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.126386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3655/7384] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:20:59.128150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.149608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3730/7385] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:59 2022] PUT /identity/v3/projects/75154372cab04e1189b12cae78c2e765/users/270002bb4fc94e56ba03bedc800b32f0/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:59.156154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890883-2628-457c-ba14-b758d99b3ea7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.156448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890883-2628-457c-ba14-b758d99b3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.156748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890883-2628-457c-ba14-b758d99b3ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.157670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263c0e5-0ef2-4f85-91f3-a0a6cc39cb23 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.201447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8b890883-2628-457c-ba14-b758d99b3ea7 None None] MFA Rules not processed for user `270002bb4fc94e56ba03bedc800b32f0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:59.206947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8b890883-2628-457c-ba14-b758d99b3ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:59.250803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.251885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.253005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.254497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.255791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.258043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.298187 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3731/7386] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:59.299080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b890883-2628-457c-ba14-b758d99b3ea7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.320138 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3656/7387] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:59.320751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b890883-2628-457c-ba14-b758d99b3ea7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.322105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.430792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.431499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.431779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.432057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.432761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.437262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.487791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0417cc-444c-40ad-aed3-fc9d77e74dc1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.530298 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3732/7388] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:20:59.530649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.530649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.530888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.530991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.530991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.530991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.530991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.572661 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3657/7389] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:59.574034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.590985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234aab-e90c-43e1-916a-f0159d7a9fb0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.649559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60b1eb-45c9-42e4-a944-5220ef9a45af admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.654937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.655738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.656096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.656444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.657425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.660354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.689736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.690776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.691223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.691652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.691907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3733/7390] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:20:59.692928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.694610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.695672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.707138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37396fa5-54bd-4b24-9552-e164dad71122 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.707546 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3658/7391] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:59.711919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.720003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.721940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.722355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.722828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.723925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.724725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cee529-9ee0-458d-a712-090b366b5bfc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.726804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.730340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.731312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.731940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.732420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.733431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.735364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.745674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3734/7392] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:20:59.746997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.753513 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3659/7393] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:20:59.755265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.765748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5a80-3c16-48a5-b5ec-aed397fb6441 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.771145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.772382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.772771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.773187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350db27-0486-4afc-be57-ce9ecab6e1b3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.773330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] PATH_INFO: `/v3/projects/dc17755174594a58beb37e30e9a0aad7/users/e67992eb598045f1bd4e342e510e3f1d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.781388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3707a-cde1-4c92-86ec-3d8aa724d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:20:59.782702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3707a-cde1-4c92-86ec-3d8aa724d0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.783145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3707a-cde1-4c92-86ec-3d8aa724d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.783630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3707a-cde1-4c92-86ec-3d8aa724d0c8 admin admin] PATH_INFO: `/v3/projects/d79c21f9883b4a4aa9924cfb578e545b/users/d947362cb7d24d4fb9bc165e375b6998/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.792771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc17755174594a58beb37e30e9a0aad7, user_id=e67992eb598045f1bd4e342e510e3f1d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.795932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.806644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3707a-cde1-4c92-86ec-3d8aa724d0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79c21f9883b4a4aa9924cfb578e545b, user_id=d947362cb7d24d4fb9bc165e375b6998, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:20:59.811391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3707a-cde1-4c92-86ec-3d8aa724d0c8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:20:59.818369 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3735/7394] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:59 2022] PUT /identity/v3/projects/dc17755174594a58beb37e30e9a0aad7/users/e67992eb598045f1bd4e342e510e3f1d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:59.822711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:20:59.853367 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3660/7395] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:20:59 2022] PUT /identity/v3/projects/d79c21f9883b4a4aa9924cfb578e545b/users/d947362cb7d24d4fb9bc165e375b6998/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:20:59.855564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f56ed-45b5-44e8-b3fc-570b862cb79a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:20:59.856117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f56ed-45b5-44e8-b3fc-570b862cb79a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:20:59.856442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f56ed-45b5-44e8-b3fc-570b862cb79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:20:59.897784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6b6f56ed-45b5-44e8-b3fc-570b862cb79a None None] MFA Rules not processed for user `d947362cb7d24d4fb9bc165e375b6998`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:20:59.899148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6b6f56ed-45b5-44e8-b3fc-570b862cb79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:20:59.943415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd73ad-17de-4ab2-92e0-ae1ee557520a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:20:59.988022 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3661/7396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:20:59.992080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f56ed-45b5-44e8-b3fc-570b862cb79a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.019603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.020782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.021251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.021707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.022597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.024415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.040334 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3736/7397] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:00.041679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.053189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fecfd6-a98f-4084-bde3-36c779a9e1ae admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.068929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322bae5-1a6c-4f9f-81dd-a346607745ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.069885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322bae5-1a6c-4f9f-81dd-a346607745ba admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.070160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322bae5-1a6c-4f9f-81dd-a346607745ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.070430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322bae5-1a6c-4f9f-81dd-a346607745ba admin admin] PATH_INFO: `/v3/projects/dc17755174594a58beb37e30e9a0aad7/users/e67992eb598045f1bd4e342e510e3f1d/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.073851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322bae5-1a6c-4f9f-81dd-a346607745ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc17755174594a58beb37e30e9a0aad7, user_id=e67992eb598045f1bd4e342e510e3f1d, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.079394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322bae5-1a6c-4f9f-81dd-a346607745ba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.100594 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3737/7398] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:00 2022] PUT /identity/v3/projects/dc17755174594a58beb37e30e9a0aad7/users/e67992eb598045f1bd4e342e510e3f1d/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:00.110442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f56ed-45b5-44e8-b3fc-570b862cb79a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.111010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.111255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.111713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.154933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] MFA Rules not processed for user `e67992eb598045f1bd4e342e510e3f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:00.157858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:00.219425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.220992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.222281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.222715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.225525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.231082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.253085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3738/7399] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:00.265334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.266973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:00.284219 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3662/7400] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:20:59 2022] POST /identity/v3/projects => generated 365 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:00.287287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.349323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376362e2-61d6-4968-96ed-e93ba61c166c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.387311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807af9-39a6-4ae2-ba61-dd49a0aa6185 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.407632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.408346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.408627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.408901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.409634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.411677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.424415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.425128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.425554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.425954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.441545 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3663/7401] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:00 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:00.449069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.466072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1cb38-358f-48f0-a847-90b5e6396707 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.477293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.477998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.478291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.478566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.479374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.481126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.501768 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3664/7402] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:00.503531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.529457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e5ea3-6233-4ecb-9208-c6b0081a6fb9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.544049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.548765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.556055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.558064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.558538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.558986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] PATH_INFO: `/v3/projects/0dbad7b29da24845a3e40bfdb543b438/users/98c01255874540419233b8902000d33e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.565886 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3739/7403] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:00.598567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbad7b29da24845a3e40bfdb543b438, user_id=98c01255874540419233b8902000d33e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.601354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.660795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3665/7404] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:00 2022] PUT /identity/v3/projects/0dbad7b29da24845a3e40bfdb543b438/users/98c01255874540419233b8902000d33e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:00.662640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.663293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.678053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594115a-6240-4edd-bd53-0a5e3148b004 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.785514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.786456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320e05-fa04-4c68-b3bb-c2404a45f217 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.786693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.786919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.787281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.788114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.790731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.800988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.802814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.803385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.803666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] PATH_INFO: `/v3/users/270002bb4fc94e56ba03bedc800b32f0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.804067 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3740/7405] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:00.804979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270002bb4fc94e56ba03bedc800b32f0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.807558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.809063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:00.829586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96ee5-6699-482b-afe5-b47d252dcd8c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:00.841597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3926e67-420d-4910-bfee-66effab1d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:00.842517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3926e67-420d-4910-bfee-66effab1d88c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.842803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3926e67-420d-4910-bfee-66effab1d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.843079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3926e67-420d-4910-bfee-66effab1d88c admin admin] PATH_INFO: `/v3/projects/0dbad7b29da24845a3e40bfdb543b438/users/98c01255874540419233b8902000d33e/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.850116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3926e67-420d-4910-bfee-66effab1d88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbad7b29da24845a3e40bfdb543b438, user_id=98c01255874540419233b8902000d33e, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:00.854776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3926e67-420d-4910-bfee-66effab1d88c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:00.870232 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3741/7406] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:00 2022] PUT /identity/v3/projects/0dbad7b29da24845a3e40bfdb543b438/users/98c01255874540419233b8902000d33e/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:00.880427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:00.880874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:00.881266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:00.921337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270002bb4fc94e56ba03bedc800b32f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:00.923487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270002bb4fc94e56ba03bedc800b32f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:00.944918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] MFA Rules not processed for user `98c01255874540419233b8902000d33e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:00.945823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270002bb4fc94e56ba03bedc800b32f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:00.955440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:00.958182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270002bb4fc94e56ba03bedc800b32f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:00.971052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-40c1e472-7a0c-48c1-88c2-00c05f337b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270002bb4fc94e56ba03bedc800b32f0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:01.017648 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3666/7407] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:00 2022] DELETE /identity/v3/users/270002bb4fc94e56ba03bedc800b32f0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:01.021292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353168-6753-4602-b758-01db7ff714bd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:01.021590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353168-6753-4602-b758-01db7ff714bd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:01.022020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353168-6753-4602-b758-01db7ff714bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:01.063041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a6353168-6753-4602-b758-01db7ff714bd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:01.064342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a6353168-6753-4602-b758-01db7ff714bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:01.133615 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3742/7408] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:01.145496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:01.149090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:01.253435 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3667/7409] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:01.269374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353168-6753-4602-b758-01db7ff714bd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:01.271522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a6353168-6753-4602-b758-01db7ff714bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:01.296532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81f507-1509-4080-a948-381ea77b4c51 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:01.355196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353168-6753-4602-b758-01db7ff714bd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:01.362135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:01.363619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:01.365268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:01.366159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:01.399490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fc42-690c-40fe-b136-f832607fff71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:01.400087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:01.400944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fc42-690c-40fe-b136-f832607fff71 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:01.401256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:01.401863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fc42-690c-40fe-b136-f832607fff71 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:01.402302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fc42-690c-40fe-b136-f832607fff71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:01.422038 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3668/7410] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:01.538949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fc42-690c-40fe-b136-f832607fff71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:01.540753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fc42-690c-40fe-b136-f832607fff71 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:01.562498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3743/7411] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:02.211257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:02.212777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:02.251102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675eca-698f-4cbc-8459-232e31590daf service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:02.270392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:02.272971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:02.273293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:02.274256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] PATH_INFO: `/v3/users/d947362cb7d24d4fb9bc165e375b6998` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:02.276084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d947362cb7d24d4fb9bc165e375b6998)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:02.287494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:02.372358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd947362cb7d24d4fb9bc165e375b6998'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.374780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd947362cb7d24d4fb9bc165e375b6998'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.386131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd947362cb7d24d4fb9bc165e375b6998'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.386881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd947362cb7d24d4fb9bc165e375b6998'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.398158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd947362cb7d24d4fb9bc165e375b6998'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.429697 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3669/7412] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:02 2022] DELETE /identity/v3/users/d947362cb7d24d4fb9bc165e375b6998 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:02.431816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:02.432302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:02.432554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:02.470489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:02.472047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:02.508405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:02.509889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:02.584972 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3744/7413] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:02.601469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:02.605179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:02.613831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e874e4-9d69-4447-94ca-098e1ba75ad1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:02.630952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:02.632398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:02.632777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:02.633182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] PATH_INFO: `/v3/projects/75154372cab04e1189b12cae78c2e765` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:02.634581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75154372cab04e1189b12cae78c2e765)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:02.636838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:02.706927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e31843-5cb7-4cfb-a614-ef31bbdd925c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:02.711891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75154372cab04e1189b12cae78c2e765', 'request_id': 'req-f10d873c-23e2-4f10-8a50-f80374693c3f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.721022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75154372cab04e1189b12cae78c2e765', 'request_id': 'req-f10d873c-23e2-4f10-8a50-f80374693c3f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.744870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75154372cab04e1189b12cae78c2e765', 'request_id': 'req-f10d873c-23e2-4f10-8a50-f80374693c3f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.773834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] The token cache is being invalidate because project 75154372cab04e1189b12cae78c2e765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:02.774117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.774953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.776559 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3670/7414] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:02 2022] DELETE /identity/v3/projects/75154372cab04e1189b12cae78c2e765 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:02.780852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:02.782394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:02.814311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:02.815305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:02.815821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:02.816236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:02.819483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:02.897070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d873c-23e2-4f10-8a50-f80374693c3f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:02.903500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:02.904905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:02.905326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:02.905699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] PATH_INFO: `/v3/users/e67992eb598045f1bd4e342e510e3f1d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:02.907212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67992eb598045f1bd4e342e510e3f1d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:02.911283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:02.912584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:02.913619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:02.927415 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3745/7415] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:02.987554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67992eb598045f1bd4e342e510e3f1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:02.988545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67992eb598045f1bd4e342e510e3f1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:03.004742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67992eb598045f1bd4e342e510e3f1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:03.005584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67992eb598045f1bd4e342e510e3f1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:03.017630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67992eb598045f1bd4e342e510e3f1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:03.041016 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3671/7416] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:02 2022] DELETE /identity/v3/users/e67992eb598045f1bd4e342e510e3f1d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:03.673903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:03.675967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:03.700974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c1eb5-6199-4b6c-aa93-6d7edad2d2b5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:03.776708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:03.781292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:03.842330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:03.844747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:03.845607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:03.853773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] PATH_INFO: `/v3/projects/d79c21f9883b4a4aa9924cfb578e545b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:03.859477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79c21f9883b4a4aa9924cfb578e545b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:03.862516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:03.917363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dff5a-e328-4276-a361-ca107e554f18 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:03.926228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:03.927509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:03.928001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:03.928300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] PATH_INFO: `/v3/projects/dc17755174594a58beb37e30e9a0aad7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:03.929713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc17755174594a58beb37e30e9a0aad7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:03.931850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:03.952314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79c21f9883b4a4aa9924cfb578e545b', 'request_id': 'req-7a3340da-42c6-4449-83c3-1a615e0c2a85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:03.961559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79c21f9883b4a4aa9924cfb578e545b', 'request_id': 'req-7a3340da-42c6-4449-83c3-1a615e0c2a85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:03.975364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79c21f9883b4a4aa9924cfb578e545b', 'request_id': 'req-7a3340da-42c6-4449-83c3-1a615e0c2a85'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:03.996493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc17755174594a58beb37e30e9a0aad7', 'request_id': 'req-16deabaf-fcbb-4057-9ab5-418a59e31a2a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.002502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc17755174594a58beb37e30e9a0aad7', 'request_id': 'req-16deabaf-fcbb-4057-9ab5-418a59e31a2a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.014241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] The token cache is being invalidate because project d79c21f9883b4a4aa9924cfb578e545b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:04.014795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.015670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.017461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc17755174594a58beb37e30e9a0aad7', 'request_id': 'req-16deabaf-fcbb-4057-9ab5-418a59e31a2a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.017674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3746/7417] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:03 2022] DELETE /identity/v3/projects/d79c21f9883b4a4aa9924cfb578e545b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:04.021485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.023045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.045547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] The token cache is being invalidate because project dc17755174594a58beb37e30e9a0aad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:04.045838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.047141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-16deabaf-fcbb-4057-9ab5-418a59e31a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.053637 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3672/7418] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:03 2022] DELETE /identity/v3/projects/dc17755174594a58beb37e30e9a0aad7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:04.055148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a65d7-66cc-4485-b0f1-e30f4f90b44d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.055436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a65d7-66cc-4485-b0f1-e30f4f90b44d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.055710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a65d7-66cc-4485-b0f1-e30f4f90b44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.089063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c12a65d7-66cc-4485-b0f1-e30f4f90b44d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:04.090699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c12a65d7-66cc-4485-b0f1-e30f4f90b44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.122695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3340da-42c6-4449-83c3-1a615e0c2a85 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.177949 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3673/7419] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:04.180573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b074fa-4ce5-4655-bfd7-f2db9bc44a51 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.181174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b074fa-4ce5-4655-bfd7-f2db9bc44a51 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.182025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b074fa-4ce5-4655-bfd7-f2db9bc44a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.192136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.193605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.193996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.194440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] PATH_INFO: `/v3/users/98c01255874540419233b8902000d33e` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.198984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c01255874540419233b8902000d33e)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.201328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.206435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-37b074fa-4ce5-4655-bfd7-f2db9bc44a51 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:04.207770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37b074fa-4ce5-4655-bfd7-f2db9bc44a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.220662 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3674/7420] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:04.224243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b074fa-4ce5-4655-bfd7-f2db9bc44a51 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.236962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b074fa-4ce5-4655-bfd7-f2db9bc44a51 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.248263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.249236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.249956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.250313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.251986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:04.252305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.255041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.268205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c01255874540419233b8902000d33e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.269419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c01255874540419233b8902000d33e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.272914 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3675/7421] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:04.274309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.281645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c01255874540419233b8902000d33e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.292403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10159f-0f75-4499-848d-17c400892b4d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.292639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c01255874540419233b8902000d33e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.293093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c01255874540419233b8902000d33e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.299672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.300379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.300648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.300939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.305991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.309277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.317499 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3747/7422] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:04 2022] DELETE /identity/v3/users/98c01255874540419233b8902000d33e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:04.318729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.320674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.346709 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3676/7423] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:04 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:04.351429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.353500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.402775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b90e7-196a-4e63-8ac7-00905bc1a838 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.425291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdf800-9bad-4aa3-b35d-6cadb7275335 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.431059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.432649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.433182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.433976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.437444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.441337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.480930 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3677/7424] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:04 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:04.486475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.503010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0370ef-d5b5-4b70-9377-467c453beb67 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.511383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.512448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.512826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.513274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.514300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.517754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.537895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.538847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.539101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.539413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] PATH_INFO: `/v3/users/2160e893637e48b68a6745a09056f97a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.540194 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3678/7425] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:04.544438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2160e893637e48b68a6745a09056f97a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.545361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.547718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.567793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaa1a8-e9cc-49db-b3fb-0bcdbca7ce3e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.579865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.580732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.581181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.581609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.582402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.585384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.614579 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3679/7426] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:04.618579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.627529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2160e893637e48b68a6745a09056f97a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.628502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2160e893637e48b68a6745a09056f97a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.629972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fe6a2-33ed-476d-b8e9-9c44af7c8c15 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.634815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79d3cf-c4bf-4e00-b586-03868e52870e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.635724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79d3cf-c4bf-4e00-b586-03868e52870e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.636008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79d3cf-c4bf-4e00-b586-03868e52870e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.636406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79d3cf-c4bf-4e00-b586-03868e52870e admin admin] PATH_INFO: `/v3/projects/5d42d61ff00b4e2e80537e9113274bb2/users/022d1258e20a4a3db0a5d817a730b4fd/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.636583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2160e893637e48b68a6745a09056f97a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.647288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2160e893637e48b68a6745a09056f97a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.648624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ab00a3de-e3bb-4318-a89c-483e8fca1bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2160e893637e48b68a6745a09056f97a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:04.655159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79d3cf-c4bf-4e00-b586-03868e52870e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d42d61ff00b4e2e80537e9113274bb2, user_id=022d1258e20a4a3db0a5d817a730b4fd, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.658930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79d3cf-c4bf-4e00-b586-03868e52870e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.667435 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3748/7427] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:04 2022] DELETE /identity/v3/users/2160e893637e48b68a6745a09056f97a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:04.672608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.672911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.673238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.676596 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3680/7428] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:04 2022] PUT /identity/v3/projects/5d42d61ff00b4e2e80537e9113274bb2/users/022d1258e20a4a3db0a5d817a730b4fd/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:04.689174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.689823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.690210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.695845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:04.698179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.718138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] MFA Rules not processed for user `022d1258e20a4a3db0a5d817a730b4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:04.719371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.762222 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3749/7429] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:04.772930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.775263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.794531 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3681/7430] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:04.811671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.813340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.847687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af60e5a-5c7d-4b70-992b-03a1a1f817c7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.851395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.852068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.852468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.852937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.866044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.867562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.877870 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3750/7431] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:04.878630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.879997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.894233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaa570-74d9-455e-85fd-88f365167fd6 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.901670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.902882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.903261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.903634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] PATH_INFO: `/v3/projects/0dbad7b29da24845a3e40bfdb543b438` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.905130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbad7b29da24845a3e40bfdb543b438)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.905685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1000f9-391d-405b-95af-2bd3e5d67542 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:04.907338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.910458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:04.911416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:04.911702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:04.911982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:04.924225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:04.925942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:04.958578 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3682/7432] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:04.962680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:04.970511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:04.991813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbad7b29da24845a3e40bfdb543b438', 'request_id': 'req-36ea8db1-d9df-4af3-82a3-30fec0f74bba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.001125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbad7b29da24845a3e40bfdb543b438', 'request_id': 'req-36ea8db1-d9df-4af3-82a3-30fec0f74bba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.006402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b59ad6-b543-4fe5-890d-76122109eec9 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.032830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbad7b29da24845a3e40bfdb543b438', 'request_id': 'req-36ea8db1-d9df-4af3-82a3-30fec0f74bba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.058868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] The token cache is being invalidate because project 0dbad7b29da24845a3e40bfdb543b438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:05.059086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.061081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-36ea8db1-d9df-4af3-82a3-30fec0f74bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.069006 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3751/7433] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:04 2022] DELETE /identity/v3/projects/0dbad7b29da24845a3e40bfdb543b438 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:05.073883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85e6a-dc91-404a-9383-e7b120651045 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.074170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85e6a-dc91-404a-9383-e7b120651045 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.074440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85e6a-dc91-404a-9383-e7b120651045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.118089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.119241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.119588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.119939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] PATH_INFO: `/v3/users/022d1258e20a4a3db0a5d817a730b4fd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.120243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-baa85e6a-dc91-404a-9383-e7b120651045 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:05.121798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-baa85e6a-dc91-404a-9383-e7b120651045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.122172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=022d1258e20a4a3db0a5d817a730b4fd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.125605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.137381 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3752/7434] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:05.145513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86e5f-8d55-4a30-bf16-21d1d075dee1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.146136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86e5f-8d55-4a30-bf16-21d1d075dee1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.146614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86e5f-8d55-4a30-bf16-21d1d075dee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.176315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6fd86e5f-8d55-4a30-bf16-21d1d075dee1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:05.177820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6fd86e5f-8d55-4a30-bf16-21d1d075dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.193898 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3753/7435] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:05.204922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd86e5f-8d55-4a30-bf16-21d1d075dee1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.216710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd86e5f-8d55-4a30-bf16-21d1d075dee1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.230073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.230893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.231221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.231869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.232538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:05.233352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.235844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.239694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022d1258e20a4a3db0a5d817a730b4fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.240529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022d1258e20a4a3db0a5d817a730b4fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.256492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022d1258e20a4a3db0a5d817a730b4fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.257906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022d1258e20a4a3db0a5d817a730b4fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.262349 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3754/7436] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:05.263430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.265487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.271411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022d1258e20a4a3db0a5d817a730b4fd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.278598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0ce43-2129-40a6-8ce6-c11536b13425 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.284563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.285938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.286220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.286494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] PATH_INFO: `/v3/projects/215676a27bf941aca89ab500b2bade51` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.288488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] RBAC: Authorizing `identity:delete_project(project_id=215676a27bf941aca89ab500b2bade51)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.290881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.298168 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3683/7437] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:04 2022] DELETE /identity/v3/users/022d1258e20a4a3db0a5d817a730b4fd => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:05.298168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.298851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.356500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215676a27bf941aca89ab500b2bade51', 'request_id': 'req-ba008434-1f6f-4d7d-9fa3-ced440f5885e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.365229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215676a27bf941aca89ab500b2bade51', 'request_id': 'req-ba008434-1f6f-4d7d-9fa3-ced440f5885e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.375728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ce72-1736-44f8-827d-2e9c8bd74856 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.379635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215676a27bf941aca89ab500b2bade51', 'request_id': 'req-ba008434-1f6f-4d7d-9fa3-ced440f5885e'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.397240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] The token cache is being invalidate because project 215676a27bf941aca89ab500b2bade51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:05.398469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.399508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ba008434-1f6f-4d7d-9fa3-ced440f5885e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:05.402689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3755/7438] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:05 2022] DELETE /identity/v3/projects/215676a27bf941aca89ab500b2bade51 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:05.406591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.409272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.409711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.429750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:05.431048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.453232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b12f2-037d-4ffe-8b6f-a49496e699b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.454259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b12f2-037d-4ffe-8b6f-a49496e699b6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.454702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b12f2-037d-4ffe-8b6f-a49496e699b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.455205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b12f2-037d-4ffe-8b6f-a49496e699b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.456188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b12f2-037d-4ffe-8b6f-a49496e699b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.458457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b12f2-037d-4ffe-8b6f-a49496e699b6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.499726 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3684/7439] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/projects => generated 357 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:05.499726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.499726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.500140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.521490 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3756/7440] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:05.521490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.521490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.528746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:05.530354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.532562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e421dd2-051b-41b3-bf45-5ac91c6e87c9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.590217 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3685/7441] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:05.591085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.592456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.597816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37a52-91ee-498f-9f22-52e8f253908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.598524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37a52-91ee-498f-9f22-52e8f253908c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.598810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37a52-91ee-498f-9f22-52e8f253908c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.599091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37a52-91ee-498f-9f22-52e8f253908c admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.599786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37a52-91ee-498f-9f22-52e8f253908c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.601898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37a52-91ee-498f-9f22-52e8f253908c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.639899 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3757/7442] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/users => generated 279 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:05.641689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7690d1-8f2b-4733-b7b9-9a12fdb5c6a0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.641983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7690d1-8f2b-4733-b7b9-9a12fdb5c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.642263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7690d1-8f2b-4733-b7b9-9a12fdb5c6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.660619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e87d-9429-48a9-a7ff-a3b621eebfbf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.661980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5a7690d1-8f2b-4733-b7b9-9a12fdb5c6a0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:05.663253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5a7690d1-8f2b-4733-b7b9-9a12fdb5c6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.665737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.666683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.667186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.667736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.672735 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3758/7443] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:05.673679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7690d1-8f2b-4733-b7b9-9a12fdb5c6a0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.682080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.683573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.683721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7690d1-8f2b-4733-b7b9-9a12fdb5c6a0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.689160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.689961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.690327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.690602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.691344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.693525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.709414 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3759/7444] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:05.710308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.720505 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3686/7445] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:05.722565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87c3a1-a032-44f2-bc23-1022189f6f8b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.724186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.728434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.729369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.729839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.730170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.731301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:05.731609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.742620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.750468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1561-6340-4e00-b300-bbcb49471271 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.758785 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3760/7446] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:05.763073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.767261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.767983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.768251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.768521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.769353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.772400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.785684 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3687/7447] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:05.788084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636357-57e8-4e9c-82fa-b082b1f51814 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.791005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.803951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.804336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e4c3-2b22-4079-b850-02a8be73df91 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:05.805118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.805740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.806850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.807686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.809580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8de9e6-17fc-4a26-9504-1ef4221c5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:05.811289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.812433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de9e6-17fc-4a26-9504-1ef4221c5a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.812716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de9e6-17fc-4a26-9504-1ef4221c5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.813093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de9e6-17fc-4a26-9504-1ef4221c5a66 admin admin] PATH_INFO: `/v3/projects/3e726719fade492e816cc49974e26ebc/users/f72c06de101549b2894b2313b4844997/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.853808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8de9e6-17fc-4a26-9504-1ef4221c5a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e726719fade492e816cc49974e26ebc, user_id=f72c06de101549b2894b2313b4844997, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:05.856555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8de9e6-17fc-4a26-9504-1ef4221c5a66 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:05.862533 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3761/7448] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/projects => generated 359 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:05.867498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:05.891903 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3688/7449] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:05 2022] PUT /identity/v3/projects/3e726719fade492e816cc49974e26ebc/users/f72c06de101549b2894b2313b4844997/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:05.902453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6ede9-b128-470d-b678-1197ade6f203 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:05.902703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6ede9-b128-470d-b678-1197ade6f203 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:05.903247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6ede9-b128-470d-b678-1197ade6f203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:05.966495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-74c6ede9-b128-470d-b678-1197ade6f203 None None] MFA Rules not processed for user `f72c06de101549b2894b2313b4844997`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:05.968356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74c6ede9-b128-470d-b678-1197ade6f203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:05.995658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7d8d-53e3-4df9-b684-1c629d912b6d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.065521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.066506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.066838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.067113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.067871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.071652 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3689/7450] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:06.071806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.072609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6ede9-b128-470d-b678-1197ade6f203 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.089872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6ede9-b128-470d-b678-1197ade6f203 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.095875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.099095 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3762/7451] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:05 2022] POST /identity/v3/users => generated 280 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:06.099232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.099232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.099232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.099232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.100155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.102140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.112880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aec72-74ec-409d-82af-b1f40c4084b6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.119017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.119860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.120252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.121689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.122456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.124602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.136684 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3690/7452] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:06 2022] POST /identity/v3/projects => generated 355 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:06.138048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.146912 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3763/7453] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:06.152419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.168377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb9ec-ec26-4ae9-829e-5a0770f9d9ca admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.312393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73547628-f360-44b3-b173-3c877130fbf4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.329781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.330976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.331466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.331945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.332885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.337929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.346615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.347404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.347756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.348132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.349144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.350900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.365994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3764/7454] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:06.367118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.369190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:06.380499 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3691/7455] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:06 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:06.381407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.394495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cb8d3-821c-4045-8191-9ead7d52ec3a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.396367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169dc23-88e1-437f-9a4b-2e7d3b509495 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.399418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.400316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.400595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.400866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] PATH_INFO: `/v3/projects/398c3ad38c5e41ceb8024cd8ba5fec34/users/cb31ef3b238e4b579589cd3e84e0aaec/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.402912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.403866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.404152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.404422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] PATH_INFO: `/v3/projects/5d42d61ff00b4e2e80537e9113274bb2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.405870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d42d61ff00b4e2e80537e9113274bb2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.407942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.418218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=398c3ad38c5e41ceb8024cd8ba5fec34, user_id=cb31ef3b238e4b579589cd3e84e0aaec, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.420848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.438413 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3692/7456] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:06 2022] PUT /identity/v3/projects/398c3ad38c5e41ceb8024cd8ba5fec34/users/cb31ef3b238e4b579589cd3e84e0aaec/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:06.439328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.467496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d42d61ff00b4e2e80537e9113274bb2', 'request_id': 'req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:06.473853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d42d61ff00b4e2e80537e9113274bb2', 'request_id': 'req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:06.486088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d42d61ff00b4e2e80537e9113274bb2', 'request_id': 'req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:06.500037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] The token cache is being invalidate because project 5d42d61ff00b4e2e80537e9113274bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:06.500335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:06.500999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-51a0d81f-51f6-4a46-96e9-1ac4ae6a45cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:06.502993 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3765/7457] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:06 2022] DELETE /identity/v3/projects/5d42d61ff00b4e2e80537e9113274bb2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:06.508874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.509203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.509605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.510668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc250d2-5a34-46dc-878b-580adf709a7b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.537331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] MFA Rules not processed for user `cb31ef3b238e4b579589cd3e84e0aaec`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:06.538661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:06.575089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030eda8-c610-4d68-9ba9-ca52026d8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.575953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eda8-c610-4d68-9ba9-ca52026d8b13 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.576232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eda8-c610-4d68-9ba9-ca52026d8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.576556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eda8-c610-4d68-9ba9-ca52026d8b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.577314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030eda8-c610-4d68-9ba9-ca52026d8b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.578961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030eda8-c610-4d68-9ba9-ca52026d8b13 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.593924 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3693/7458] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:06.595655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.595961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.596728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.614387 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3766/7459] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:06.615031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.616342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:06.616488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:06.618460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:06.627854 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3694/7460] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:06.628759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.630020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:06.639449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003755e-5169-4d1e-a1b0-fad78d23775d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.645695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267f7bd-d1a6-4daf-86a7-46aca1a33711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.646667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267f7bd-d1a6-4daf-86a7-46aca1a33711 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.646885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267f7bd-d1a6-4daf-86a7-46aca1a33711 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.647159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267f7bd-d1a6-4daf-86a7-46aca1a33711 admin admin] PATH_INFO: `/v3/projects/c588752f62c64b65802ce8b70895c79f/users/e5594eb7619a4e9bb5833a5acdb1aa0a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.663607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267f7bd-d1a6-4daf-86a7-46aca1a33711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c588752f62c64b65802ce8b70895c79f, user_id=e5594eb7619a4e9bb5833a5acdb1aa0a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.666380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267f7bd-d1a6-4daf-86a7-46aca1a33711 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.683003 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3767/7461] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:06 2022] PUT /identity/v3/projects/c588752f62c64b65802ce8b70895c79f/users/e5594eb7619a4e9bb5833a5acdb1aa0a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:06.687145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0de6-74fb-4186-9f3e-9d2b5486fad2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.687433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0de6-74fb-4186-9f3e-9d2b5486fad2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.687708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0de6-74fb-4186-9f3e-9d2b5486fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.696336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8a4a4-2c61-43d4-a1fe-32a91f7927a6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.707973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b41d0de6-74fb-4186-9f3e-9d2b5486fad2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:06.709223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b41d0de6-74fb-4186-9f3e-9d2b5486fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:06.754197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.754867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.755146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.755418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.782089 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3768/7462] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:06.786342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0de6-74fb-4186-9f3e-9d2b5486fad2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.796609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0de6-74fb-4186-9f3e-9d2b5486fad2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.801648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.802477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.802856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.803264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.804100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.806066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.821545 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3769/7463] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:06.822662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.825877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.827836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.835501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d1403-d99d-42e6-b0bb-8880c8e2474d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.838657 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3695/7464] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:06.839332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.841216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.842530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.843045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.843544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.844506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:06.845564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.848245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.852461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279e34-12ac-4bfd-ac89-cdb04ae1be1a service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.858498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb8c9-cc5c-4004-920a-3a06d0eb5eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:06.859426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb8c9-cc5c-4004-920a-3a06d0eb5eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.859708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb8c9-cc5c-4004-920a-3a06d0eb5eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.859982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb8c9-cc5c-4004-920a-3a06d0eb5eb6 admin admin] PATH_INFO: `/v3/projects/c588752f62c64b65802ce8b70895c79f/users/e5594eb7619a4e9bb5833a5acdb1aa0a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.862557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb8c9-cc5c-4004-920a-3a06d0eb5eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c588752f62c64b65802ce8b70895c79f, user_id=e5594eb7619a4e9bb5833a5acdb1aa0a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:06.866285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb8c9-cc5c-4004-920a-3a06d0eb5eb6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:06.879759 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3770/7465] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:06.880418 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3696/7466] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:06 2022] PUT /identity/v3/projects/c588752f62c64b65802ce8b70895c79f/users/e5594eb7619a4e9bb5833a5acdb1aa0a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:06.881422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:06.891417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:06.891716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:06.891998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:06.915557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19c3b3-4da4-41e7-bc29-23434110aaaf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:06.941069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] MFA Rules not processed for user `e5594eb7619a4e9bb5833a5acdb1aa0a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:06.942503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:07.060525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.061430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.063542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.063922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.065655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.067932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:07.095705 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3697/7467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:07.108595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:07.114075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:07.135742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3771/7468] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:06 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:07.140438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:07.277734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618742b-cc8c-400b-95ef-92bb0bf33b02 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:07.286832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888addc-16e4-4df1-9031-032cab9b5096 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:07.301565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.302406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.303865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.304180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.305763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.307733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:07.352248 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3772/7469] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:07 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:07.358241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:07.380273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7ee9-60bf-4fa4-83db-c6ea4d6d6c03 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:07.393371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.394245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.394839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.396121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.399512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.401379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:07.407477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08743410-c8a4-4106-b64a-ef0a3b9d843b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.408819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743410-c8a4-4106-b64a-ef0a3b9d843b service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.409160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743410-c8a4-4106-b64a-ef0a3b9d843b service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.409531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743410-c8a4-4106-b64a-ef0a3b9d843b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.419041 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3773/7470] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:07.423624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:07.442442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1ae66-9af3-4cc8-9cee-61934c88d263 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:07.459704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.461972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.462485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.462972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.463917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.468172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:07.523518 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3774/7471] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:07.527930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:07.538609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08743410-c8a4-4106-b64a-ef0a3b9d843b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.540285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08743410-c8a4-4106-b64a-ef0a3b9d843b service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:07.543480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b634-0fef-466d-893e-9668a09b0621 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:07.550432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.551566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.552612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.553118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] PATH_INFO: `/v3/projects/f51d17312a294b8780c7d9e30a923dce/users/a9d526cdb4f5487f85452e3bb9e49e2e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.557330 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3698/7472] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:07.593656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51d17312a294b8780c7d9e30a923dce, user_id=a9d526cdb4f5487f85452e3bb9e49e2e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.601193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:07.637330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3775/7473] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:07 2022] PUT /identity/v3/projects/f51d17312a294b8780c7d9e30a923dce/users/a9d526cdb4f5487f85452e3bb9e49e2e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:07.650210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60eb5f-e6b5-498a-9691-f0f56e110d94 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.650569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60eb5f-e6b5-498a-9691-f0f56e110d94 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.650843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60eb5f-e6b5-498a-9691-f0f56e110d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.689852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:07.721345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8d60eb5f-e6b5-498a-9691-f0f56e110d94 None None] MFA Rules not processed for user `a9d526cdb4f5487f85452e3bb9e49e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:07.723009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d60eb5f-e6b5-498a-9691-f0f56e110d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:07.816770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58375-74b1-4d85-9561-ff44a5447f20 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:07.838854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.841317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.842836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.844450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.848092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:07.906194 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3699/7474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:07.907361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60eb5f-e6b5-498a-9691-f0f56e110d94 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:07.962782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.964410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:07.976520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3776/7475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:07.987124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60eb5f-e6b5-498a-9691-f0f56e110d94 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:07.992451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:07.993165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:07.993442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:07.993719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:07.994406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:07.996577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.037076 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3700/7476] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:08.041866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.056833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c2cbb-fa78-4267-8c06-dd5463c55443 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.135330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.136318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.136449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.136853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.137652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.139985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.168191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3777/7477] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:08 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:08.168882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.186231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61b35e-2285-46aa-862c-803f17dfab20 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.209821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.209821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.210077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.210326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.210993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.212635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.234277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.235362 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3701/7478] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:08.246232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33ddb-41ca-47a4-b1b9-1f7ab724993f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.252077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4a067-637c-4aca-afba-170b759b731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.252861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a067-637c-4aca-afba-170b759b731e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.253084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a067-637c-4aca-afba-170b759b731e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.253412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a067-637c-4aca-afba-170b759b731e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.254149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4a067-637c-4aca-afba-170b759b731e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.256240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4a067-637c-4aca-afba-170b759b731e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.268830 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3778/7479] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:08.273912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.293014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350e6e9-a19e-4748-87b6-11e2e1f8d9f3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.298295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.299311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.299709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.300197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] PATH_INFO: `/v3/projects/e9881eccd3954c0fbc0f018741f268aa/users/43900db8251e4ff5a85d25a35cf89e64/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.318598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9881eccd3954c0fbc0f018741f268aa, user_id=43900db8251e4ff5a85d25a35cf89e64, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.321608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.338707 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3702/7480] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:08 2022] PUT /identity/v3/projects/e9881eccd3954c0fbc0f018741f268aa/users/43900db8251e4ff5a85d25a35cf89e64/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:08.350554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187c38a-5561-4b18-87d7-6150daeeedc6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.350847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187c38a-5561-4b18-87d7-6150daeeedc6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.351099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187c38a-5561-4b18-87d7-6150daeeedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.378834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c187c38a-5561-4b18-87d7-6150daeeedc6 None None] MFA Rules not processed for user `43900db8251e4ff5a85d25a35cf89e64`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:08.380053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c187c38a-5561-4b18-87d7-6150daeeedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:08.467478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3779/7481] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:08.473937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.558864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b62c12-2863-48a1-b977-2ca4203fc754 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.564226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.565124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.565379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.565657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.566448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.569168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.601056 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3703/7482] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:08.604983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187c38a-5561-4b18-87d7-6150daeeedc6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.618074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187c38a-5561-4b18-87d7-6150daeeedc6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.687130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.688003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.688403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.688723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.689633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.692375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.720818 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3780/7483] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:08 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:08.724723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.737528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e4548-1376-4f46-b769-df6a8f638a83 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.742634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.743320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.743603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.744524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.745309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.746986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.761072 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3704/7484] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:08.764483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.775815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576f14e-4fdf-4278-a5a7-cbe4b894b5c0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.781408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.782587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.783031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.783467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] PATH_INFO: `/v3/projects/c558a68f82fa4cc99e4d637cdb4a049b/users/9e1bfc8c75504117805f4aabe92afca2/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.802954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c558a68f82fa4cc99e4d637cdb4a049b, user_id=9e1bfc8c75504117805f4aabe92afca2, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.806415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.828030 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3781/7485] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:08 2022] PUT /identity/v3/projects/c558a68f82fa4cc99e4d637cdb4a049b/users/9e1bfc8c75504117805f4aabe92afca2/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:08.833179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.849602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dedd6-ceea-4d26-8cee-195c34013c83 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.929777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9edcb-5f70-4f3e-86c1-1a55bed248e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.930558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9edcb-5f70-4f3e-86c1-1a55bed248e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.932372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9edcb-5f70-4f3e-86c1-1a55bed248e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.932949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9edcb-5f70-4f3e-86c1-1a55bed248e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.933918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9edcb-5f70-4f3e-86c1-1a55bed248e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:08.935680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9edcb-5f70-4f3e-86c1-1a55bed248e9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:08.969080 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3705/7486] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:08.972810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:08.985249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38783b-a603-42b7-9f40-6a193af7069c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:08.990113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:08.991043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:08.991325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:08.992445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] PATH_INFO: `/v3/projects/c558a68f82fa4cc99e4d637cdb4a049b/users/9e1bfc8c75504117805f4aabe92afca2/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:08.995072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c558a68f82fa4cc99e4d637cdb4a049b, user_id=9e1bfc8c75504117805f4aabe92afca2, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:09.000706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:09.025867 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3782/7487] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:08 2022] PUT /identity/v3/projects/c558a68f82fa4cc99e4d637cdb4a049b/users/9e1bfc8c75504117805f4aabe92afca2/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:09.027547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:09.027843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:09.028121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:09.064930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] MFA Rules not processed for user `9e1bfc8c75504117805f4aabe92afca2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:09.067057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:09.175463 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3706/7488] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:09.188307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:09.327890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528bdd-327b-4539-b716-222276ca04ed admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:09.332316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:09.333023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:09.333626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:09.333626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:09.504280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:09.506532 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:09.538168 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3783/7489] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:11.304521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:11.306127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:11.338905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f25f5-65e4-4476-ba44-8d258303f5b7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:11.347578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:11.348264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:11.348606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:11.348885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:11.465325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:11.466829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:11.479374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3707/7490] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:12.272533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:12.301274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da24ff8-ed01-4978-9e35-cf99bbc9c7a3 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:12.308708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4675285-b164-43c8-826d-fb0ba5c06b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:12.309780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675285-b164-43c8-826d-fb0ba5c06b4b service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:12.310069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675285-b164-43c8-826d-fb0ba5c06b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:12.310349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675285-b164-43c8-826d-fb0ba5c06b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:12.342486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4675285-b164-43c8-826d-fb0ba5c06b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:12.345701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4675285-b164-43c8-826d-fb0ba5c06b4b service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:12.374914 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3784/7491] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:16.828824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:16.897366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420b26f-1f1f-4449-a521-4d2c8763b496 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:16.903606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:16.904554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:16.904838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:16.905153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] PATH_INFO: `/v3/users/a9d526cdb4f5487f85452e3bb9e49e2e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:16.906354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d526cdb4f5487f85452e3bb9e49e2e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:16.908307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:16.969317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d526cdb4f5487f85452e3bb9e49e2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:16.970326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d526cdb4f5487f85452e3bb9e49e2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:16.978657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d526cdb4f5487f85452e3bb9e49e2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:16.979365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d526cdb4f5487f85452e3bb9e49e2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:16.991231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d526cdb4f5487f85452e3bb9e49e2e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:17.010357 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3708/7492] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:16 2022] DELETE /identity/v3/users/a9d526cdb4f5487f85452e3bb9e49e2e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:17.015076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:17.015588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:17.015814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:17.033755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:17.035205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:17.101005 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3785/7493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:17.111702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:17.113197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:17.187079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf66d2f-0e93-4a4c-bc34-2a328ae10266 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:17.197967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:17.199007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:17.199373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:17.200279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:17.222963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:17.224587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:17.242824 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3709/7494] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:17.928840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:17.930456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:17.951322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f096af-04d6-49f5-a78c-e9863b23b0c8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:17.966377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:17.967425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:17.967875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:17.968405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] PATH_INFO: `/v3/projects/f51d17312a294b8780c7d9e30a923dce` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:17.972679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51d17312a294b8780c7d9e30a923dce)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:17.975197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:18.087214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51d17312a294b8780c7d9e30a923dce', 'request_id': 'req-a999daba-8725-4f3b-9e19-efbc04b2e86d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.105262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51d17312a294b8780c7d9e30a923dce', 'request_id': 'req-a999daba-8725-4f3b-9e19-efbc04b2e86d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.123623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51d17312a294b8780c7d9e30a923dce', 'request_id': 'req-a999daba-8725-4f3b-9e19-efbc04b2e86d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.150323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] The token cache is being invalidate because project f51d17312a294b8780c7d9e30a923dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:18.151186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.153373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.155920 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3786/7495] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:17 2022] DELETE /identity/v3/projects/f51d17312a294b8780c7d9e30a923dce => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:18.160090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:18.179039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f5cb0-d1c5-4ce2-8882-26891c961660 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:18.270802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:18.272845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:18.273774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:18.274244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] PATH_INFO: `/v3/users/43900db8251e4ff5a85d25a35cf89e64` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:18.276499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43900db8251e4ff5a85d25a35cf89e64)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:18.279175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:18.353420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43900db8251e4ff5a85d25a35cf89e64'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.354600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43900db8251e4ff5a85d25a35cf89e64'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.370014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43900db8251e4ff5a85d25a35cf89e64'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.371118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43900db8251e4ff5a85d25a35cf89e64'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.387522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43900db8251e4ff5a85d25a35cf89e64'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:18.413269 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3710/7496] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:18 2022] DELETE /identity/v3/users/43900db8251e4ff5a85d25a35cf89e64 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:19.131779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:19.135360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:19.163489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999daba-8725-4f3b-9e19-efbc04b2e86d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:19.309197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:19.310574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:19.311485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:19.311937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] PATH_INFO: `/v3/projects/e9881eccd3954c0fbc0f018741f268aa` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:19.317371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9881eccd3954c0fbc0f018741f268aa)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:19.329670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:19.511503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9881eccd3954c0fbc0f018741f268aa', 'request_id': 'req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.524789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9881eccd3954c0fbc0f018741f268aa', 'request_id': 'req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.542253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9881eccd3954c0fbc0f018741f268aa', 'request_id': 'req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.561726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] The token cache is being invalidate because project e9881eccd3954c0fbc0f018741f268aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:19.562233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.563106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.570206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:19.571716 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3787/7497] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:19 2022] DELETE /identity/v3/projects/e9881eccd3954c0fbc0f018741f268aa => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:19.573069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:19.598259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675629f-217d-42fb-86ba-8e4d0d60b794 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:19.740856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:19.749996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:19.754750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:19.755730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] PATH_INFO: `/v3/users/9e1bfc8c75504117805f4aabe92afca2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:19.759005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1bfc8c75504117805f4aabe92afca2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:19.761809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:19.858500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1bfc8c75504117805f4aabe92afca2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.860837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1bfc8c75504117805f4aabe92afca2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.874557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1bfc8c75504117805f4aabe92afca2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.875500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1bfc8c75504117805f4aabe92afca2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.890776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-965704d6-4d0a-4765-b071-e3d0166c84ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1bfc8c75504117805f4aabe92afca2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:19.918275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3711/7498] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:19 2022] DELETE /identity/v3/users/9e1bfc8c75504117805f4aabe92afca2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:20.555873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:20.558275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:20.580681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1a75-a21f-4be3-89bb-b46ce5cc8beb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:20.665606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:20.666582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:20.666973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:20.667319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] PATH_INFO: `/v3/projects/c558a68f82fa4cc99e4d637cdb4a049b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:20.668644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c558a68f82fa4cc99e4d637cdb4a049b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:20.671860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:20.736284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c558a68f82fa4cc99e4d637cdb4a049b', 'request_id': 'req-6146e54a-ccc7-425e-8911-0a64cbbac5b0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:20.753343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c558a68f82fa4cc99e4d637cdb4a049b', 'request_id': 'req-6146e54a-ccc7-425e-8911-0a64cbbac5b0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:20.776830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c558a68f82fa4cc99e4d637cdb4a049b', 'request_id': 'req-6146e54a-ccc7-425e-8911-0a64cbbac5b0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:20.806011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] The token cache is being invalidate because project c558a68f82fa4cc99e4d637cdb4a049b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:20.806302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:20.815790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6146e54a-ccc7-425e-8911-0a64cbbac5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:20.824327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64d7ce-13ce-4d48-8c94-553fbaade111 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:20.824925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64d7ce-13ce-4d48-8c94-553fbaade111 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:20.826009 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3788/7499] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:20 2022] DELETE /identity/v3/projects/c558a68f82fa4cc99e4d637cdb4a049b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:20.827610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64d7ce-13ce-4d48-8c94-553fbaade111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:20.853322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8b64d7ce-13ce-4d48-8c94-553fbaade111 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:20.855691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8b64d7ce-13ce-4d48-8c94-553fbaade111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:20.934652 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3712/7500] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:21.045352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c71ca-23d6-43cb-9b7a-5c8f97aa0b9d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.045652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c71ca-23d6-43cb-9b7a-5c8f97aa0b9d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.046117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c71ca-23d6-43cb-9b7a-5c8f97aa0b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.065158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ac6c71ca-23d6-43cb-9b7a-5c8f97aa0b9d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:21.066587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ac6c71ca-23d6-43cb-9b7a-5c8f97aa0b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:21.075823 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3789/7501] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:21.079907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64d7ce-13ce-4d48-8c94-553fbaade111 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:21.092692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64d7ce-13ce-4d48-8c94-553fbaade111 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:21.097986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:21.098878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.099317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.099757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.100952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:21.101450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:21.103256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:21.116296 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3713/7502] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:21.120420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c71ca-23d6-43cb-9b7a-5c8f97aa0b9d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:21.129987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c71ca-23d6-43cb-9b7a-5c8f97aa0b9d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:21.135196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:21.135902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.136183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.136461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.137204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:21.139245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:21.169124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3790/7503] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:21 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:21.171671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:21.183983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2fb4f-310a-439d-a570-1e26c914e1b6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:21.243143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:21.243770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.244048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.244317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.245044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:21.247032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:21.269606 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3714/7504] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:21 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:21.273829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:21.285297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca3b92-1695-4fea-97b5-0f231d9e37f6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:21.290137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:21.290829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.291112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.291394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.292353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:21.294032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:21.306053 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3791/7505] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:21.310089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:21.321437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbedeb-1b61-4586-ad33-34bd54d02783 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:21.326394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe10ed-3301-4148-b0d0-5f49787c9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:21.327082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe10ed-3301-4148-b0d0-5f49787c9495 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.327439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe10ed-3301-4148-b0d0-5f49787c9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.327706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe10ed-3301-4148-b0d0-5f49787c9495 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.328435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe10ed-3301-4148-b0d0-5f49787c9495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:21.330121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe10ed-3301-4148-b0d0-5f49787c9495 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:21.344301 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3715/7506] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:21.346063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:21.357619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cde27-b7c3-459b-8ef6-13c6e4d4592b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:21.364001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:21.365144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.365518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.365824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] PATH_INFO: `/v3/projects/d7173de83c5d48818793cbd7d5358eac/users/009e2cbc98054372a77e75f7d4f81085/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.383468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7173de83c5d48818793cbd7d5358eac, user_id=009e2cbc98054372a77e75f7d4f81085, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:21.386314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:21.402723 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3792/7507] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:21 2022] PUT /identity/v3/projects/d7173de83c5d48818793cbd7d5358eac/users/009e2cbc98054372a77e75f7d4f81085/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:21.413527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece271e-7e71-436f-8239-654183a96e41 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.413823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece271e-7e71-436f-8239-654183a96e41 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.414247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece271e-7e71-436f-8239-654183a96e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.445129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3ece271e-7e71-436f-8239-654183a96e41 None None] MFA Rules not processed for user `009e2cbc98054372a77e75f7d4f81085`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:21.446844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ece271e-7e71-436f-8239-654183a96e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:21.519070 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3716/7508] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:21.531014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:21.532974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:21.594092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d857-c9e3-4bd9-874a-c1cd9a49334b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:21.598567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d563a-1436-46db-b005-d4f294f6c89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:21.599273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d563a-1436-46db-b005-d4f294f6c89c service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:21.599568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d563a-1436-46db-b005-d4f294f6c89c service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:21.599827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d563a-1436-46db-b005-d4f294f6c89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:21.609284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d563a-1436-46db-b005-d4f294f6c89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:21.610770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d563a-1436-46db-b005-d4f294f6c89c service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:21.620674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3793/7509] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:23.441363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2dfc4-54ad-4986-8d29-536da58673d9 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:23.442169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2dfc4-54ad-4986-8d29-536da58673d9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:23.442619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2dfc4-54ad-4986-8d29-536da58673d9 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:23.444987 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3717/7510] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:21:23.457751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96acb-db00-413e-925d-3092d015f773 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:23.458409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96acb-db00-413e-925d-3092d015f773 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:23.458524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96acb-db00-413e-925d-3092d015f773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:23.497821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f2b96acb-db00-413e-925d-3092d015f773 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:23.500527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f2b96acb-db00-413e-925d-3092d015f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:23.701062 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3794/7511] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:23.731539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2dfc4-54ad-4986-8d29-536da58673d9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:23.734219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97b2dfc4-54ad-4986-8d29-536da58673d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:23.757418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2dfc4-54ad-4986-8d29-536da58673d9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:23.765501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:23.767644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:23.768365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:23.769011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:23.791193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:23.793247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:23.813721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3718/7512] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:24.410772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b96acb-db00-413e-925d-3092d015f773 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:24.433455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b96acb-db00-413e-925d-3092d015f773 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:24.448603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91a4b-99e3-46ae-8e55-b07a4fa089c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:24.449945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91a4b-99e3-46ae-8e55-b07a4fa089c9 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:24.451684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91a4b-99e3-46ae-8e55-b07a4fa089c9 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:24.453139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91a4b-99e3-46ae-8e55-b07a4fa089c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:24.457472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dee91a4b-99e3-46ae-8e55-b07a4fa089c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:24.488300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee91a4b-99e3-46ae-8e55-b07a4fa089c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:24.491123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee91a4b-99e3-46ae-8e55-b07a4fa089c9 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:24.510137 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3795/7513] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:24.721583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:24.979434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f075d6-3bbe-442b-9dc1-ad7cc95ed17a service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:24.995035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:24.997457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:24.997838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:24.998760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] PATH_INFO: `/v3/users/009e2cbc98054372a77e75f7d4f81085` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:25.000862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=009e2cbc98054372a77e75f7d4f81085)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:25.003345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:25.127056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009e2cbc98054372a77e75f7d4f81085'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:25.130212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009e2cbc98054372a77e75f7d4f81085'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:25.153776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009e2cbc98054372a77e75f7d4f81085'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:25.155077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009e2cbc98054372a77e75f7d4f81085'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:25.174666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009e2cbc98054372a77e75f7d4f81085'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:25.246734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:25.247025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:25.247303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:25.258426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3719/7514] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:24 2022] DELETE /identity/v3/users/009e2cbc98054372a77e75f7d4f81085 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:25.276046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:25.278445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:25.394514 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3796/7515] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:25.531739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:25.533248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:25.676480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3147-e770-42a4-9c85-f2fd2dfb9c85 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:25.683775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6b841-ef62-4603-885f-2831173cca23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:25.684851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b841-ef62-4603-885f-2831173cca23 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:25.685302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b841-ef62-4603-885f-2831173cca23 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:25.685692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b841-ef62-4603-885f-2831173cca23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:25.713730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6b841-ef62-4603-885f-2831173cca23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:25.716974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6b841-ef62-4603-885f-2831173cca23 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:25.736162 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3720/7516] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:26.819500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:26.821584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:26.841657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69a5f-e5ec-42ef-a065-e6c9b333df94 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:26.853547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:26.854474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:26.854750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:26.855020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] PATH_INFO: `/v3/users/f72c06de101549b2894b2313b4844997` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:26.856317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72c06de101549b2894b2313b4844997)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:26.858496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:26.943396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72c06de101549b2894b2313b4844997'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:26.944222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72c06de101549b2894b2313b4844997'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:26.958441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72c06de101549b2894b2313b4844997'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:26.972278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72c06de101549b2894b2313b4844997'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:26.973630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72c06de101549b2894b2313b4844997'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:26.999579 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3797/7517] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:26 2022] DELETE /identity/v3/users/f72c06de101549b2894b2313b4844997 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:27.005194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:27.005673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:27.005832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:27.030600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:27.031902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:27.108681 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3721/7518] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:27.119574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:27.121621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:27.206335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d332-d453-4f12-b8c2-dc9e7ddbcef9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:27.211073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:27.211773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:27.212231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:27.212505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:27.222770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:27.224234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:27.249763 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3798/7519] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:27.550553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:27.552161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:27.566727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad936d44-b763-4aa1-9ec5-2b5e81f71310 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:27.571672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:27.572799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:27.573129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:27.573369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] PATH_INFO: `/v3/projects/3e726719fade492e816cc49974e26ebc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:27.574560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e726719fade492e816cc49974e26ebc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:27.578121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:27.635654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e726719fade492e816cc49974e26ebc', 'request_id': 'req-3e27056a-fb80-4ce6-b1a8-8954d23519f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.645755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e726719fade492e816cc49974e26ebc', 'request_id': 'req-3e27056a-fb80-4ce6-b1a8-8954d23519f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.655738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e726719fade492e816cc49974e26ebc', 'request_id': 'req-3e27056a-fb80-4ce6-b1a8-8954d23519f6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.668428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] The token cache is being invalidate because project 3e726719fade492e816cc49974e26ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:27.668717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.669498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.671343 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3722/7520] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:27 2022] DELETE /identity/v3/projects/3e726719fade492e816cc49974e26ebc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:27.675467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:27.683697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:27.685391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:27.687889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea78d1-b4d5-4af7-9687-20ec47e5341e service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:27.759808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:27.761010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:27.761669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:27.762170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] PATH_INFO: `/v3/users/e5594eb7619a4e9bb5833a5acdb1aa0a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:27.763946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5594eb7619a4e9bb5833a5acdb1aa0a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:27.767594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:27.781652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27056a-fb80-4ce6-b1a8-8954d23519f6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:27.791064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:27.792096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:27.792509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:27.792909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] PATH_INFO: `/v3/projects/d7173de83c5d48818793cbd7d5358eac` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:27.794303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7173de83c5d48818793cbd7d5358eac)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:27.796831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:27.832382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5594eb7619a4e9bb5833a5acdb1aa0a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.833475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5594eb7619a4e9bb5833a5acdb1aa0a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.842913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5594eb7619a4e9bb5833a5acdb1aa0a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.860985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7173de83c5d48818793cbd7d5358eac', 'request_id': 'req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.865179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5594eb7619a4e9bb5833a5acdb1aa0a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.865910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c20d0bb7-7f00-4af0-8d1a-3af1e352fec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5594eb7619a4e9bb5833a5acdb1aa0a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.868709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7173de83c5d48818793cbd7d5358eac', 'request_id': 'req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.881753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7173de83c5d48818793cbd7d5358eac', 'request_id': 'req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.892530 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3799/7521] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:27 2022] DELETE /identity/v3/users/e5594eb7619a4e9bb5833a5acdb1aa0a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:27.896663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] The token cache is being invalidate because project d7173de83c5d48818793cbd7d5358eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:27.896956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.897646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-aaf45c7b-55ee-44c7-930c-d2a86ac3b96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:27.899241 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3723/7522] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:27 2022] DELETE /identity/v3/projects/d7173de83c5d48818793cbd7d5358eac => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:27.904356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495df5b-3197-4e93-9db3-5aa208559638 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:27.904814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495df5b-3197-4e93-9db3-5aa208559638 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:27.905118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495df5b-3197-4e93-9db3-5aa208559638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:27.924448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f495df5b-3197-4e93-9db3-5aa208559638 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:27.925730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f495df5b-3197-4e93-9db3-5aa208559638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:27.995832 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3800/7523] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:28.004978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87ee41-036d-4316-8ecb-93639bea37e3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.005272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87ee41-036d-4316-8ecb-93639bea37e3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.006226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87ee41-036d-4316-8ecb-93639bea37e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.029566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8f87ee41-036d-4316-8ecb-93639bea37e3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:28.031447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f87ee41-036d-4316-8ecb-93639bea37e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:28.040606 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3724/7524] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:28.047120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495df5b-3197-4e93-9db3-5aa208559638 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.064984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495df5b-3197-4e93-9db3-5aa208559638 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.074108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.076016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.076333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.076609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.077779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:28.078093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.080147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.094095 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3801/7525] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:28.099334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87ee41-036d-4316-8ecb-93639bea37e3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.113710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87ee41-036d-4316-8ecb-93639bea37e3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.121766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.122629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.123080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.123570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.125846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.129329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.171584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3725/7526] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:28.175811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.187119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9939eb-130b-465b-9588-b26ee3ac3dbf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.253219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.254226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.254509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.254913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.255649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.258285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.288553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.289222 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3802/7527] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:28.290692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:28.292172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.306553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0cbe-6dc9-411d-90d0-c33e76b35ed3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.308442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f875-c003-475c-b150-17f25b15d7e4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.315291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.315956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.316440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.317344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] PATH_INFO: `/v3/projects/c588752f62c64b65802ce8b70895c79f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.318375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c588752f62c64b65802ce8b70895c79f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.321091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.324556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.325792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.326085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.326364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.327214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.332321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.345593 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3803/7528] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:28.349890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.361258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ed4e-9ff1-4137-814a-8818bbc23d8c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.366386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.367553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.368032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.368501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.369480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.371528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.385083 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3804/7529] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:28.389670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.405229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e356bac-ef74-47e9-937a-72fa6fd4f3a4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.410132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c588752f62c64b65802ce8b70895c79f', 'request_id': 'req-09c59857-4d41-41b7-9c8a-976ac6c1137b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:28.419715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c588752f62c64b65802ce8b70895c79f', 'request_id': 'req-09c59857-4d41-41b7-9c8a-976ac6c1137b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:28.433604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c588752f62c64b65802ce8b70895c79f', 'request_id': 'req-09c59857-4d41-41b7-9c8a-976ac6c1137b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:28.479405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] The token cache is being invalidate because project c588752f62c64b65802ce8b70895c79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:28.481214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:28.482655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-09c59857-4d41-41b7-9c8a-976ac6c1137b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:28.492453 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3726/7530] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:28 2022] DELETE /identity/v3/projects/c588752f62c64b65802ce8b70895c79f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:28.496563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdac3f-f5ba-47d8-826b-d2973f4c87c4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.496884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdac3f-f5ba-47d8-826b-d2973f4c87c4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.499568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdac3f-f5ba-47d8-826b-d2973f4c87c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.514500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd8f69-fbad-46c4-94b5-ca448ef80c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.515993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd8f69-fbad-46c4-94b5-ca448ef80c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.517142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd8f69-fbad-46c4-94b5-ca448ef80c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.517617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd8f69-fbad-46c4-94b5-ca448ef80c66 admin admin] PATH_INFO: `/v3/projects/97ed718660fd48bb9ed85454dc4e96dd/users/e9ce56a13fef45b0bba022abbd0570ad/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.538962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd8f69-fbad-46c4-94b5-ca448ef80c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ed718660fd48bb9ed85454dc4e96dd, user_id=e9ce56a13fef45b0bba022abbd0570ad, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.542387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd8f69-fbad-46c4-94b5-ca448ef80c66 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.547125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-21fdac3f-f5ba-47d8-826b-d2973f4c87c4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:28.551164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-21fdac3f-f5ba-47d8-826b-d2973f4c87c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:28.577503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3805/7531] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:28 2022] PUT /identity/v3/projects/97ed718660fd48bb9ed85454dc4e96dd/users/e9ce56a13fef45b0bba022abbd0570ad/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:28.585321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.585321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.585321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.585917 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3727/7532] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:28.598354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacebd5-a728-46d1-a77f-4a64e15bd585 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.598613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacebd5-a728-46d1-a77f-4a64e15bd585 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.598863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacebd5-a728-46d1-a77f-4a64e15bd585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.626067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] MFA Rules not processed for user `e9ce56a13fef45b0bba022abbd0570ad`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:28.628434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:28.642680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9bacebd5-a728-46d1-a77f-4a64e15bd585 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:28.645739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9bacebd5-a728-46d1-a77f-4a64e15bd585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:28.739592 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3806/7533] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:28.752283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.755210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:28.786283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3728/7534] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:28.790398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacebd5-a728-46d1-a77f-4a64e15bd585 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.800545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacebd5-a728-46d1-a77f-4a64e15bd585 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.806404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.808042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.808533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.809090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.810163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:28.810674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.812663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.830417 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3729/7535] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:28.835832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.860795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49710be-4c2c-496e-b747-aac186fa3a1a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.862036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e26da-468f-41b9-b420-94f8a74efd97 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:28.869980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.870358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:28.871269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.871679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:28.872105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.872398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.872773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:28.873222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.873570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:28.875461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.888984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:28.891858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:28.914919 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3807/7536] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:28.930410 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3730/7537] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:28.932543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.955523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:28.957327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:28.961784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c790-a107-48d8-8221-3a88e85b10ce service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.049643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956d58-ddce-443b-872d-55e35e10ff52 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.056332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:29.058267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.058826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.059296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] PATH_INFO: `/v3/users/e9ce56a13fef45b0bba022abbd0570ad` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.061208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ce56a13fef45b0bba022abbd0570ad)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:29.064166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:29.091963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:29.095566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.095891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.096176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.099112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:29.103179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:29.162298 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3808/7538] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:28 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:29.164057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:29.171122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ce56a13fef45b0bba022abbd0570ad'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:29.172576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ce56a13fef45b0bba022abbd0570ad'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:29.189251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf38a6-0d83-47e4-8324-1d25413d5f31 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.193442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ce56a13fef45b0bba022abbd0570ad'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:29.194699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ce56a13fef45b0bba022abbd0570ad'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:29.199567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:29.200392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.201307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.201640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.203641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:29.205720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:29.217911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-49283ac3-fad8-4441-a6fc-fb53596b29bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ce56a13fef45b0bba022abbd0570ad'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:29.227323 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3809/7539] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:29.228676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:29.230916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:29.243840 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3731/7540] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:28 2022] DELETE /identity/v3/users/e9ce56a13fef45b0bba022abbd0570ad => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:29.247181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098a48b-8fd3-4ced-b0b0-e03c727eb0df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.252253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.252253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.252253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.293539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:29.296768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:29.362115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:29.363166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.363416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.363827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.365289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:29.367144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:29.385501 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3810/7541] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:29.392752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:29.406103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53774980-c400-4d99-b992-106e94e52763 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.413702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf509-114f-4eb3-a8dc-fecd2dee68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:29.414630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf509-114f-4eb3-a8dc-fecd2dee68f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.414906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf509-114f-4eb3-a8dc-fecd2dee68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.415509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf509-114f-4eb3-a8dc-fecd2dee68f2 admin admin] PATH_INFO: `/v3/projects/fc745153a4ea4f2faeba50f4b001f6f6/users/228ef27aa8db4aba9811b8fd80954579/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.435601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaf509-114f-4eb3-a8dc-fecd2dee68f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc745153a4ea4f2faeba50f4b001f6f6, user_id=228ef27aa8db4aba9811b8fd80954579, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:29.438501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaf509-114f-4eb3-a8dc-fecd2dee68f2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:29.458624 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3732/7542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:29.471543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:29.473089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:29.489099 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3811/7543] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:29 2022] PUT /identity/v3/projects/fc745153a4ea4f2faeba50f4b001f6f6/users/228ef27aa8db4aba9811b8fd80954579/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:29.496614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a3d3-d3d4-4441-8db9-7b46be981ab3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.496902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a3d3-d3d4-4441-8db9-7b46be981ab3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.497213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a3d3-d3d4-4441-8db9-7b46be981ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.564721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8d793-8e44-47db-9a3a-42b2f4578d1a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.576852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b216a3d3-d3d4-4441-8db9-7b46be981ab3 None None] MFA Rules not processed for user `228ef27aa8db4aba9811b8fd80954579`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:29.578675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b216a3d3-d3d4-4441-8db9-7b46be981ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:29.679860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:29.680748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.680896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.681100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.737236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3812/7544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:29.743004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a3d3-d3d4-4441-8db9-7b46be981ab3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:29.806385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:29.808027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:29.841898 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3733/7545] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:29.868316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a3d3-d3d4-4441-8db9-7b46be981ab3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.875174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:29.876512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:29.876964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:29.877468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:29.878381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:29.880581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:29.918250 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3813/7546] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:29 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:29.924020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:29.938321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676812-c3e2-4184-92b1-ac6cddf88daa service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:29.946343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:29.948647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:30.016014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:30.018978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.019407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.020898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.021728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:30.029468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:30.076446 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3734/7547] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:29 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:30.078860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:30.109515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8871-853d-4d62-9159-bfb9d7266593 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:30.128469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:30.129217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.129504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.129783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.130688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:30.132346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:30.134400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47182bc9-c909-4c9f-a219-32535b737d92 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:30.154283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:30.154993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.155276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.155554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.161712 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3735/7548] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:30.161930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:30.162983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:30.175188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5694c4e-972d-486a-a7bc-b1d90aed107c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:30.181640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:30.182577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.182860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.183142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] PATH_INFO: `/v3/projects/a704ca4460c5472ba156f33589b1f8a0/users/67700fcf485a4901b50c00258302f949/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.193987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:30.195652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:30.215132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a704ca4460c5472ba156f33589b1f8a0, user_id=67700fcf485a4901b50c00258302f949, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:30.217967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:30.257861 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3814/7549] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:30.259591 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3736/7550] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:30 2022] PUT /identity/v3/projects/a704ca4460c5472ba156f33589b1f8a0/users/67700fcf485a4901b50c00258302f949/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:30.269588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:30.297279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a051-bc42-4b85-a6b0-e42fbd7e1605 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:30.440304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb6c6b-5665-4cd7-82db-1c1c3d41e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:30.440480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6c6b-5665-4cd7-82db-1c1c3d41e45c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.440755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6c6b-5665-4cd7-82db-1c1c3d41e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.441061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6c6b-5665-4cd7-82db-1c1c3d41e45c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.441806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb6c6b-5665-4cd7-82db-1c1c3d41e45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:30.443488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb6c6b-5665-4cd7-82db-1c1c3d41e45c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:30.482340 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3815/7551] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:30.482920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:30.495827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca103802-fdd4-47ed-8200-1cc703462726 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:30.507866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:30.509769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.510147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.510523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] PATH_INFO: `/v3/projects/a704ca4460c5472ba156f33589b1f8a0/users/67700fcf485a4901b50c00258302f949/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.513902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a704ca4460c5472ba156f33589b1f8a0, user_id=67700fcf485a4901b50c00258302f949, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:30.516630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:30.556035 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3737/7552] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:30 2022] PUT /identity/v3/projects/a704ca4460c5472ba156f33589b1f8a0/users/67700fcf485a4901b50c00258302f949/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:30.567446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.567816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.568027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.620320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] MFA Rules not processed for user `67700fcf485a4901b50c00258302f949`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:30.622442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:30.746854 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3816/7553] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:30.760479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:30.762373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:30.851361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be913277-5cb3-4b2d-a7b8-9c64bc107610 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:30.855667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:30.856474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:30.856916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:30.857325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:30.872062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:30.873724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:30.888637 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3738/7554] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:30.985548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:30.988628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:31.029445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2324da-faf7-43c0-abab-46ae52d7325d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:31.034515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf9932-55cf-4ef5-85b0-8921f89b81e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:31.035377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9932-55cf-4ef5-85b0-8921f89b81e8 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:31.035840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9932-55cf-4ef5-85b0-8921f89b81e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:31.036444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9932-55cf-4ef5-85b0-8921f89b81e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:31.208106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf9932-55cf-4ef5-85b0-8921f89b81e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:31.210019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf9932-55cf-4ef5-85b0-8921f89b81e8 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:31.237193 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3817/7555] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:32.092726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:32.094195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:32.243996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce22e6-a49f-45b3-bc5a-4efc1c61617a service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:32.260934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:32.261969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:32.262254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:32.262739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] PATH_INFO: `/v3/projects/97ed718660fd48bb9ed85454dc4e96dd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:32.266044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ed718660fd48bb9ed85454dc4e96dd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:32.268198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:32.375212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ed718660fd48bb9ed85454dc4e96dd', 'request_id': 'req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:32.388288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ed718660fd48bb9ed85454dc4e96dd', 'request_id': 'req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:32.405578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ed718660fd48bb9ed85454dc4e96dd', 'request_id': 'req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:32.423289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] The token cache is being invalidate because project 97ed718660fd48bb9ed85454dc4e96dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:32.423402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:32.427162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-356c77ea-ac8d-4f1d-94e2-5afaab419f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:32.443222 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3739/7556] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:32 2022] DELETE /identity/v3/projects/97ed718660fd48bb9ed85454dc4e96dd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:32.444461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18bb44-fd68-4985-9b55-6576f0940446 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:32.444909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18bb44-fd68-4985-9b55-6576f0940446 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:32.445024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18bb44-fd68-4985-9b55-6576f0940446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:32.491994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fa18bb44-fd68-4985-9b55-6576f0940446 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:32.493505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fa18bb44-fd68-4985-9b55-6576f0940446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:32.624807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706444-276f-40a7-8f60-104d8495160e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:32.625518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706444-276f-40a7-8f60-104d8495160e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:32.626071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706444-276f-40a7-8f60-104d8495160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:32.633687 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3818/7557] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:32.662260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c9706444-276f-40a7-8f60-104d8495160e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:32.666107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c9706444-276f-40a7-8f60-104d8495160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:32.685551 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3740/7558] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:32.689972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18bb44-fd68-4985-9b55-6576f0940446 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:32.720185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18bb44-fd68-4985-9b55-6576f0940446 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:32.741364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:32.742251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:32.742608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:32.742818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:32.743570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:32.743988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:32.745571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:32.782612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706444-276f-40a7-8f60-104d8495160e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:32.784251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3819/7559] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:32.796051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706444-276f-40a7-8f60-104d8495160e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:32.809901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:32.810804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:32.811315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:32.811625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:32.812429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:32.816263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:32.925881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:32.927536 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3741/7560] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:32 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:32.940840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046fe4-cebb-4cb7-a528-a3a928ab472b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:33.089427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:33.090789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:33.091212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:33.091643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:33.092455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:33.095815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:33.139139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:33.139727 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3820/7561] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:32 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:33.151037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dad695-683e-4149-9498-bb850841eaae admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:33.166552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:33.166693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:33.166875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:33.167158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:33.168047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:33.170686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:33.202382 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3742/7562] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:33.206651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:33.222946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf95eb-7f12-47f0-9b32-c31bad5f1f65 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:33.235386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b713c6-6f61-4c3b-9cd5-8dc3c32c2736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:33.236507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b713c6-6f61-4c3b-9cd5-8dc3c32c2736 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:33.236931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b713c6-6f61-4c3b-9cd5-8dc3c32c2736 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:33.237340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b713c6-6f61-4c3b-9cd5-8dc3c32c2736 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:33.238354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b713c6-6f61-4c3b-9cd5-8dc3c32c2736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:33.242163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b713c6-6f61-4c3b-9cd5-8dc3c32c2736 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:33.258186 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3821/7563] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:33.262309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:33.277016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816aadb-14c2-4ffc-8029-fce1cfc058e6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:33.294901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:33.299468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:33.301657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:33.304603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] PATH_INFO: `/v3/projects/2951f0f19d594a449c72e85667b784ab/users/ee8d0714488f4264aa53f142549501b4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:33.369074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2951f0f19d594a449c72e85667b784ab, user_id=ee8d0714488f4264aa53f142549501b4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:33.377957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:33.415173 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3743/7564] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:33 2022] PUT /identity/v3/projects/2951f0f19d594a449c72e85667b784ab/users/ee8d0714488f4264aa53f142549501b4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:33.417613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c9ff-1452-4edf-be50-27a8999673d8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:33.418535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c9ff-1452-4edf-be50-27a8999673d8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:33.419045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c9ff-1452-4edf-be50-27a8999673d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:33.478711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7d92c9ff-1452-4edf-be50-27a8999673d8 None None] MFA Rules not processed for user `ee8d0714488f4264aa53f142549501b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:33.480377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7d92c9ff-1452-4edf-be50-27a8999673d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:33.634673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3822/7565] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:33.636667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:33.798948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ff29-3967-4084-9d07-ef414b0233d9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:33.809389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:33.810164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:33.810450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:33.810842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:33.811613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:33.813817 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:33.866940 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3744/7566] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:33 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:33.869291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c9ff-1452-4edf-be50-27a8999673d8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:33.889572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c9ff-1452-4edf-be50-27a8999673d8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:33.971855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:33.972666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:33.973719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:33.974074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:33.975712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:33.981227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:34.031158 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3823/7567] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:33 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:34.034820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:34.047859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce39b0-77e5-4970-aa0a-74c57a6e406e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:34.064500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d49e7-f257-4f0a-943c-064360b321dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:34.065307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d49e7-f257-4f0a-943c-064360b321dc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:34.065598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d49e7-f257-4f0a-943c-064360b321dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:34.065879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d49e7-f257-4f0a-943c-064360b321dc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:34.066629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d49e7-f257-4f0a-943c-064360b321dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:34.068532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d49e7-f257-4f0a-943c-064360b321dc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:34.096033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:34.102426 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3745/7568] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:34.110352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a314-c3df-4431-9a4b-967c93f1796f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:34.121564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:34.122912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:34.123399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:34.124041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] PATH_INFO: `/v3/projects/189b1624bbfb4b41bb3f972afb463913/users/0095e321d5674c35a0d92757524290e5/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:34.144565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=189b1624bbfb4b41bb3f972afb463913, user_id=0095e321d5674c35a0d92757524290e5, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:34.148020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:34.177887 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3824/7569] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:34 2022] PUT /identity/v3/projects/189b1624bbfb4b41bb3f972afb463913/users/0095e321d5674c35a0d92757524290e5/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:34.185077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956584-e2cd-4037-a588-db06f6be9cba None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:34.185665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956584-e2cd-4037-a588-db06f6be9cba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:34.185665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956584-e2cd-4037-a588-db06f6be9cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:34.227582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-62956584-e2cd-4037-a588-db06f6be9cba None None] MFA Rules not processed for user `0095e321d5674c35a0d92757524290e5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:34.233427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-62956584-e2cd-4037-a588-db06f6be9cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:34.348183 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3746/7570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:34.399083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:34.401571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:34.523467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1f7b-b36f-4a4f-9477-f1dbaeb0a80d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:34.530206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:34.530906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:34.531190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:34.531469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:34.546563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:34.548591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:34.567996 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3825/7571] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:21:35.667828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956584-e2cd-4037-a588-db06f6be9cba None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:35.753826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956584-e2cd-4037-a588-db06f6be9cba None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:35.759679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:35.760816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:35.761209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:35.761547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] PATH_INFO: `/v3/users/ee8d0714488f4264aa53f142549501b4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:35.763646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8d0714488f4264aa53f142549501b4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:35.765950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:35.783703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:35.785516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:35.817675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d135-1309-4047-95af-a40217638f4f service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:35.825870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:35.827640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:35.827974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:35.828316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] PATH_INFO: `/v3/users/228ef27aa8db4aba9811b8fd80954579` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:35.831507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228ef27aa8db4aba9811b8fd80954579)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:35.835416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:35.863946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8d0714488f4264aa53f142549501b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.866126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8d0714488f4264aa53f142549501b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.877494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8d0714488f4264aa53f142549501b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.878615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8d0714488f4264aa53f142549501b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.893660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6f51c03f-c7c9-49f5-9ab1-0b119dc40659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8d0714488f4264aa53f142549501b4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.939771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228ef27aa8db4aba9811b8fd80954579'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.941097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228ef27aa8db4aba9811b8fd80954579'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.943702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3747/7572] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:35 2022] DELETE /identity/v3/users/ee8d0714488f4264aa53f142549501b4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:35.951605 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:35.953597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:35.954524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:35.961341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228ef27aa8db4aba9811b8fd80954579'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.975880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228ef27aa8db4aba9811b8fd80954579'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.976931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b8c5f0e-60b3-42f6-96d3-62425e9fa1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228ef27aa8db4aba9811b8fd80954579'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:35.977782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:35.979979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:36.012238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3826/7573] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:35 2022] DELETE /identity/v3/users/228ef27aa8db4aba9811b8fd80954579 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:36.014859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:36.015345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:36.015779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:36.041504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:36.043508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:36.086459 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3748/7574] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:36.098292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:36.100351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:36.138131 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3827/7575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:36.144410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:36.151719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:36.210015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1db40-6c19-4235-8732-4d4640f38652 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:36.264994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc355a-65f5-4def-a813-f7a6b8adde67 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:36.269959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:36.270896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:36.271371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:36.272326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:36.288701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:36.290912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:36.305204 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3828/7576] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:36.334466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:36.335164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:36.335447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:36.335723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:36.347929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:36.349719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:36.361656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3749/7577] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:37.157151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:37.158632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:37.171476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c914d3-f0e7-4d2b-b2f7-9909027b0539 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:37.176683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:37.177409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:37.178505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:37.178973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] PATH_INFO: `/v3/projects/fc745153a4ea4f2faeba50f4b001f6f6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:37.180449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc745153a4ea4f2faeba50f4b001f6f6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:37.193531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:37.243744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc745153a4ea4f2faeba50f4b001f6f6', 'request_id': 'req-5fc2619f-4095-42f1-8968-b2bee9be50f1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.249267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc745153a4ea4f2faeba50f4b001f6f6', 'request_id': 'req-5fc2619f-4095-42f1-8968-b2bee9be50f1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.259120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc745153a4ea4f2faeba50f4b001f6f6', 'request_id': 'req-5fc2619f-4095-42f1-8968-b2bee9be50f1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.273162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] The token cache is being invalidate because project fc745153a4ea4f2faeba50f4b001f6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:37.273450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.274216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.275887 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3829/7578] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:37 2022] DELETE /identity/v3/projects/fc745153a4ea4f2faeba50f4b001f6f6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:37.280402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:37.290814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83d73a-ae74-455e-9916-76bf3d31f130 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:37.347172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:37.348070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:37.348351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:37.348624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] PATH_INFO: `/v3/users/67700fcf485a4901b50c00258302f949` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:37.349849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=67700fcf485a4901b50c00258302f949)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:37.351819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:37.400532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67700fcf485a4901b50c00258302f949'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.401216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67700fcf485a4901b50c00258302f949'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.409067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67700fcf485a4901b50c00258302f949'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.410372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67700fcf485a4901b50c00258302f949'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.419891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67700fcf485a4901b50c00258302f949'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.450569 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3750/7579] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:37 2022] DELETE /identity/v3/users/67700fcf485a4901b50c00258302f949 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:37.502648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:37.505247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:37.520922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2619f-4095-42f1-8968-b2bee9be50f1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:37.582866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:37.583300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:37.583577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:37.583889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] PATH_INFO: `/v3/projects/2951f0f19d594a449c72e85667b784ab` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:37.585108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2951f0f19d594a449c72e85667b784ab)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:37.587076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:37.657175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2951f0f19d594a449c72e85667b784ab', 'request_id': 'req-b039fbe2-ab20-424e-8060-9b61aea9d703'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.668071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2951f0f19d594a449c72e85667b784ab', 'request_id': 'req-b039fbe2-ab20-424e-8060-9b61aea9d703'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.680057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2951f0f19d594a449c72e85667b784ab', 'request_id': 'req-b039fbe2-ab20-424e-8060-9b61aea9d703'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.696372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] The token cache is being invalidate because project 2951f0f19d594a449c72e85667b784ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:37.696719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.697954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.703025 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3830/7580] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:37 2022] DELETE /identity/v3/projects/2951f0f19d594a449c72e85667b784ab => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:37.704304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:37.705907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:37.725324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ff0df-d6d6-4736-8d49-bf48a13300cb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:37.821198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:37.822247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:37.822624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:37.822994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] PATH_INFO: `/v3/users/0095e321d5674c35a0d92757524290e5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:37.824881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0095e321d5674c35a0d92757524290e5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:37.828503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:37.882782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0095e321d5674c35a0d92757524290e5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.884412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0095e321d5674c35a0d92757524290e5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.893113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0095e321d5674c35a0d92757524290e5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.893970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0095e321d5674c35a0d92757524290e5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.904196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-674b6573-a14b-429a-9204-772f9f90e076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0095e321d5674c35a0d92757524290e5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:37.936173 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3751/7581] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:37 2022] DELETE /identity/v3/users/0095e321d5674c35a0d92757524290e5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:38.097841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:38.099279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:38.117438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039fbe2-ab20-424e-8060-9b61aea9d703 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:38.213138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:38.214746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.215193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.215629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] PATH_INFO: `/v3/projects/a704ca4460c5472ba156f33589b1f8a0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.217326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a704ca4460c5472ba156f33589b1f8a0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:38.219977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:38.311346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a704ca4460c5472ba156f33589b1f8a0', 'request_id': 'req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:38.323144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a704ca4460c5472ba156f33589b1f8a0', 'request_id': 'req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:38.339575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a704ca4460c5472ba156f33589b1f8a0', 'request_id': 'req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:38.363254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] The token cache is being invalidate because project a704ca4460c5472ba156f33589b1f8a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:38.363643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:38.364352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dd7c83c9-a83c-4672-9e9c-0473e13c1dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:38.369341 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3831/7582] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:38 2022] DELETE /identity/v3/projects/a704ca4460c5472ba156f33589b1f8a0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:38.371442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69eed-2cb2-4f1c-bce4-6a967e858c25 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.371930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69eed-2cb2-4f1c-bce4-6a967e858c25 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.372181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69eed-2cb2-4f1c-bce4-6a967e858c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.394673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-83b69eed-2cb2-4f1c-bce4-6a967e858c25 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:38.395843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-83b69eed-2cb2-4f1c-bce4-6a967e858c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:38.473656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3752/7583] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:38.474589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacde96e-3673-4fea-ba4f-b7901ff99148 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.474937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacde96e-3673-4fea-ba4f-b7901ff99148 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.475162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacde96e-3673-4fea-ba4f-b7901ff99148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.541750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-eacde96e-3673-4fea-ba4f-b7901ff99148 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:38.543052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eacde96e-3673-4fea-ba4f-b7901ff99148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:38.556015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3832/7584] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:38.560393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b69eed-2cb2-4f1c-bce4-6a967e858c25 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:38.578879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b69eed-2cb2-4f1c-bce4-6a967e858c25 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:38.585785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:38.588001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.588531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.589027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.591287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:38.591873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:38.595984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:38.620881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacde96e-3673-4fea-ba4f-b7901ff99148 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:38.621335 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3753/7585] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:21:38.643015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacde96e-3673-4fea-ba4f-b7901ff99148 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:38.652330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:38.653062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.653459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.653730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.654445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:38.657448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:38.707102 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3833/7586] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:38 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:38.711276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:38.727544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfac414-714d-4805-846c-6a53c55a8e41 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:38.823237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:38.824905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.825445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.825886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.827364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:38.831393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:38.880736 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3754/7587] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:38 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:38.885344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:38.899469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20cd67-cd38-4648-b6fc-1ad1cf301503 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:38.903784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:38.905007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.905181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.905556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.906456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:38.909340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:38.912208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:38.921174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:38.924163 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3834/7588] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:38.946282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:38.949905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e25e4b-065b-4b89-baf1-444bc172e51e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:38.957916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:38.959071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.959821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.960252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] PATH_INFO: `/v3/projects/189b1624bbfb4b41bb3f972afb463913` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.961766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1853310-1a8a-4250-9329-4ea2fc153d39 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:38.961902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] RBAC: Authorizing `identity:delete_project(project_id=189b1624bbfb4b41bb3f972afb463913)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:38.964752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:38.967676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:38.968379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:38.968636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:38.968916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:38.970021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:38.971709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:38.991661 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3835/7589] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:38.995959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.008186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7526058-0a1b-400b-bd1f-645d5d870132 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.013854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9459-16fb-4bc2-b55c-2e2bb0256e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.014779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9459-16fb-4bc2-b55c-2e2bb0256e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.015055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9459-16fb-4bc2-b55c-2e2bb0256e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.015327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9459-16fb-4bc2-b55c-2e2bb0256e27 admin admin] PATH_INFO: `/v3/projects/f48bd1a739ec430d9b576cf52efbe620/users/9edeaef206a24701bab2e28b2c7198a2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.028029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189b1624bbfb4b41bb3f972afb463913', 'request_id': 'req-d8aeca4e-abc2-45b1-93b3-23513b9970db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:39.030811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9459-16fb-4bc2-b55c-2e2bb0256e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48bd1a739ec430d9b576cf52efbe620, user_id=9edeaef206a24701bab2e28b2c7198a2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.033550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9459-16fb-4bc2-b55c-2e2bb0256e27 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.035739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189b1624bbfb4b41bb3f972afb463913', 'request_id': 'req-d8aeca4e-abc2-45b1-93b3-23513b9970db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:39.046496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189b1624bbfb4b41bb3f972afb463913', 'request_id': 'req-d8aeca4e-abc2-45b1-93b3-23513b9970db'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:39.054440 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3836/7590] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:38 2022] PUT /identity/v3/projects/f48bd1a739ec430d9b576cf52efbe620/users/9edeaef206a24701bab2e28b2c7198a2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:39.073865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.074145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.074415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.079385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] The token cache is being invalidate because project 189b1624bbfb4b41bb3f972afb463913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:39.079806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:39.080599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d8aeca4e-abc2-45b1-93b3-23513b9970db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:39.085662 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3755/7591] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:38 2022] DELETE /identity/v3/projects/189b1624bbfb4b41bb3f972afb463913 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:39.087993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770da5-fccc-4ad3-bce5-51359fd78d63 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.088393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770da5-fccc-4ad3-bce5-51359fd78d63 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.088770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770da5-fccc-4ad3-bce5-51359fd78d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.115688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e3770da5-fccc-4ad3-bce5-51359fd78d63 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:39.117387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e3770da5-fccc-4ad3-bce5-51359fd78d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:39.117580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] MFA Rules not processed for user `9edeaef206a24701bab2e28b2c7198a2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:39.119028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:39.194360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3756/7592] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:39.202637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825bc05-4ea2-4cdd-bdf0-5dd5002e17e0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.202926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825bc05-4ea2-4cdd-bdf0-5dd5002e17e0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.203386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825bc05-4ea2-4cdd-bdf0-5dd5002e17e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.229903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7825bc05-4ea2-4cdd-bdf0-5dd5002e17e0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:39.231212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7825bc05-4ea2-4cdd-bdf0-5dd5002e17e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:39.233167 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3837/7593] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:39.236287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.238482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:39.245090 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3757/7594] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:39.250017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825bc05-4ea2-4cdd-bdf0-5dd5002e17e0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.258739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5b66-15d4-447a-9e5e-8d46cdffaae9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.263946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825bc05-4ea2-4cdd-bdf0-5dd5002e17e0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.269735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.271316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.272455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.272455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.273770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.275011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.275789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.276168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.276958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.277569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:39.277810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.278066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.280036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.293557 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3758/7595] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:21:39.297741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.309881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379bbb6-a8e5-484b-bb6b-bc77c89d136e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.318186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.319118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.319567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.320476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.320860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.323187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.331483 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3838/7596] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:39.332508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.413692 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3759/7597] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:39.418093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.428985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c641c2-20ef-489c-ba3f-fc03ddaa6bc4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.509223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.510187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.510299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.510558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.510865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df445b6-bfa5-47bd-8f4b-730c5f7bce87 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.511225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.513526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.515911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.516603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.517349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.517642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.518593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.521422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.542536 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3839/7598] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:39.547314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.557149 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3760/7599] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:39.560081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30738d3c-0a7a-4810-af90-4fb711c0a2e4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.561587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.566692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.567451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.567791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.568076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.568865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.571650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.573896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b07b31-86e7-4b0a-9478-0f6246a31cf1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.579591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.580766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.581061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.581349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.582079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.583761 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3840/7600] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:39.586932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.587599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.610934 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3761/7601] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:39.612754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8032a-16f3-4d81-84d0-b94615ae5fdf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.615526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.628543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20cfcf-0efd-496f-b958-4c286a5e9337 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.631232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.632437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.632735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.632995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] PATH_INFO: `/v3/projects/a2bbb767081f4168a18d16823a2d1b7a/users/34513fc6689f4bcfb67206bd2aa676f4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.636907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.637755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.638039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.645613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.647207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.648336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.664341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3762/7602] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:39.669923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.670766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bbb767081f4168a18d16823a2d1b7a, user_id=34513fc6689f4bcfb67206bd2aa676f4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.675031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.683046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2182-b9d6-4e64-be6d-dc502c61de45 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.701086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b404e0c-0012-4589-bd2e-7af31fab5f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.704410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404e0c-0012-4589-bd2e-7af31fab5f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.704571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404e0c-0012-4589-bd2e-7af31fab5f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.704811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404e0c-0012-4589-bd2e-7af31fab5f92 admin admin] PATH_INFO: `/v3/projects/605e203fc5c04ed781bf67d309905d81/users/81497a47682c4a89ad792ee59c13fc6e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.710250 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3841/7603] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:39 2022] PUT /identity/v3/projects/a2bbb767081f4168a18d16823a2d1b7a/users/34513fc6689f4bcfb67206bd2aa676f4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:39.714170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.732799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b404e0c-0012-4589-bd2e-7af31fab5f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605e203fc5c04ed781bf67d309905d81, user_id=81497a47682c4a89ad792ee59c13fc6e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.736571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b404e0c-0012-4589-bd2e-7af31fab5f92 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.758082 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3763/7604] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:39 2022] PUT /identity/v3/projects/605e203fc5c04ed781bf67d309905d81/users/81497a47682c4a89ad792ee59c13fc6e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:39.765414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.765771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.766068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.793918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:39.795346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:39.856602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40f91-0635-4133-a95a-d1a5424ce7d2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:39.898349 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3764/7605] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:39.918013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:39.919868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:39.974237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:39.975209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:39.975649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:39.976058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:39.977237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:39.979359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:39.992993 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3842/7606] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:39.996711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:40.008066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac214-0c69-4cc3-8ac0-7a86270e3b5e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:40.013576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dafab-8e33-40bb-8666-6a09b5fab40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:40.014803 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dafab-8e33-40bb-8666-6a09b5fab40f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:40.015186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dafab-8e33-40bb-8666-6a09b5fab40f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:40.015562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dafab-8e33-40bb-8666-6a09b5fab40f admin admin] PATH_INFO: `/v3/projects/a2bbb767081f4168a18d16823a2d1b7a/users/34513fc6689f4bcfb67206bd2aa676f4/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:40.017784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dafab-8e33-40bb-8666-6a09b5fab40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bbb767081f4168a18d16823a2d1b7a, user_id=34513fc6689f4bcfb67206bd2aa676f4, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:40.020968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dafab-8e33-40bb-8666-6a09b5fab40f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:40.033876 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3843/7607] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:39 2022] PUT /identity/v3/projects/a2bbb767081f4168a18d16823a2d1b7a/users/34513fc6689f4bcfb67206bd2aa676f4/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:40.041371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca719bd-d470-4411-847c-b470a5205cb2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:40.045327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86ad5-82c2-44c2-b670-0ec73804a804 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:40.045684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86ad5-82c2-44c2-b670-0ec73804a804 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:40.046023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86ad5-82c2-44c2-b670-0ec73804a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:40.091022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9ed86ad5-82c2-44c2-b670-0ec73804a804 None None] MFA Rules not processed for user `34513fc6689f4bcfb67206bd2aa676f4`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:40.092572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9ed86ad5-82c2-44c2-b670-0ec73804a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:40.134135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:40.135007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:40.135292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:40.135569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:40.230066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:40.231744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:40.243996 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3765/7608] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:40.256240 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3844/7609] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:40.270772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:40.272398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:40.379489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61da11b-8798-4d48-8240-89628f62901b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:40.383831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e25a95-4051-46ee-b942-ee8a302fb33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:40.384890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25a95-4051-46ee-b942-ee8a302fb33f service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:40.385408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25a95-4051-46ee-b942-ee8a302fb33f service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:40.385716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25a95-4051-46ee-b942-ee8a302fb33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:40.399067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e25a95-4051-46ee-b942-ee8a302fb33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:40.402468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e25a95-4051-46ee-b942-ee8a302fb33f service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:40.433922 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3766/7610] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:41.421589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86ad5-82c2-44c2-b670-0ec73804a804 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:41.439091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86ad5-82c2-44c2-b670-0ec73804a804 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:41.454340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:41.456190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:41.456700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:41.457468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] PATH_INFO: `/v3/users/9edeaef206a24701bab2e28b2c7198a2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:41.473396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9edeaef206a24701bab2e28b2c7198a2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:41.486489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:41.564784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9edeaef206a24701bab2e28b2c7198a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:41.566007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9edeaef206a24701bab2e28b2c7198a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:41.573018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9edeaef206a24701bab2e28b2c7198a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:41.585606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9edeaef206a24701bab2e28b2c7198a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:41.586387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9edeaef206a24701bab2e28b2c7198a2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:41.615035 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3845/7611] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:41 2022] DELETE /identity/v3/users/9edeaef206a24701bab2e28b2c7198a2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:41.616681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:41.617207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:41.617303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:41.654419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:41.655708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:41.752360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3767/7612] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:41.770634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:41.772591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:41.886654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd5912-1504-4f36-aeac-6ec06147852e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:41.891812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b894f-b967-4d9b-a29c-3d205e33d356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:41.892736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b894f-b967-4d9b-a29c-3d205e33d356 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:41.893227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b894f-b967-4d9b-a29c-3d205e33d356 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:41.893629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b894f-b967-4d9b-a29c-3d205e33d356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:41.936467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b894f-b967-4d9b-a29c-3d205e33d356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:41.939060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b894f-b967-4d9b-a29c-3d205e33d356 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:41.965986 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3846/7613] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:42.594225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:42.596362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:42.609804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aabc3c-feff-4329-b3f9-0a70453595f3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:42.615424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:42.617062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:42.617679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:42.617679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] PATH_INFO: `/v3/users/24c289c983b244d5b48ff6782c9b1c42` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:42.619016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c289c983b244d5b48ff6782c9b1c42)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:42.620936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:42.714629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c289c983b244d5b48ff6782c9b1c42'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:42.715295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c289c983b244d5b48ff6782c9b1c42'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:42.726646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c289c983b244d5b48ff6782c9b1c42'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:42.728221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c289c983b244d5b48ff6782c9b1c42'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:42.744557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c289c983b244d5b48ff6782c9b1c42'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:42.777763 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3768/7614] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:42 2022] DELETE /identity/v3/users/24c289c983b244d5b48ff6782c9b1c42 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:42.783757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:42.785366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:42.785902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:42.805059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:42.806720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:42.831328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:42.833100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:42.897551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94b42-e923-4a5a-90fd-042af20fcab8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:42.902563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:42.903774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:42.904343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:42.904795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] PATH_INFO: `/v3/projects/f48bd1a739ec430d9b576cf52efbe620` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:42.910466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48bd1a739ec430d9b576cf52efbe620)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:42.912445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:42.926599 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3847/7615] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:42.937068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:42.938919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:43.003130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48bd1a739ec430d9b576cf52efbe620', 'request_id': 'req-84dd3dd9-c103-4c06-ba8e-4978812a63a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.013520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48bd1a739ec430d9b576cf52efbe620', 'request_id': 'req-84dd3dd9-c103-4c06-ba8e-4978812a63a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.030051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48bd1a739ec430d9b576cf52efbe620', 'request_id': 'req-84dd3dd9-c103-4c06-ba8e-4978812a63a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.032036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd22d-253d-4890-97e3-5a2d1a1150a4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:43.045807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] The token cache is being invalidate because project f48bd1a739ec430d9b576cf52efbe620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:43.046051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.046657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.048697 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3769/7616] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:42 2022] DELETE /identity/v3/projects/f48bd1a739ec430d9b576cf52efbe620 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:43.052265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:43.054046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:43.107756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:43.110149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:43.110149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:43.110149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:43.113324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:43.142360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd3dd9-c103-4c06-ba8e-4978812a63a2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:43.149203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:43.150412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:43.164700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:43.165650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] PATH_INFO: `/v3/users/34513fc6689f4bcfb67206bd2aa676f4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:43.170558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] RBAC: Authorizing `identity:delete_user(user_id=34513fc6689f4bcfb67206bd2aa676f4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:43.175742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:43.205736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:43.207948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:43.223952 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3848/7617] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:43.245181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34513fc6689f4bcfb67206bd2aa676f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.246130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34513fc6689f4bcfb67206bd2aa676f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.260275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34513fc6689f4bcfb67206bd2aa676f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.261215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34513fc6689f4bcfb67206bd2aa676f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.275826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1e3fabbc-f855-49e6-8756-6d580ddafade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34513fc6689f4bcfb67206bd2aa676f4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.325343 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3770/7618] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:43 2022] DELETE /identity/v3/users/34513fc6689f4bcfb67206bd2aa676f4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:43.522637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:43.524147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:43.542196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06f2ba-e371-48a4-90cb-4ddda475dabf service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:43.627661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:43.628706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:43.629064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:43.629431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] PATH_INFO: `/v3/projects/12a82117ca894ee3b2d8ca91ced1b886` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:43.631120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a82117ca894ee3b2d8ca91ced1b886)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:43.633207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:43.750948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a82117ca894ee3b2d8ca91ced1b886', 'request_id': 'req-dac39557-8d39-4034-9830-0a07e5c388ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.765459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a82117ca894ee3b2d8ca91ced1b886', 'request_id': 'req-dac39557-8d39-4034-9830-0a07e5c388ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.782377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a82117ca894ee3b2d8ca91ced1b886', 'request_id': 'req-dac39557-8d39-4034-9830-0a07e5c388ce'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.807322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] The token cache is being invalidate because project 12a82117ca894ee3b2d8ca91ced1b886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:43.808252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.810659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-dac39557-8d39-4034-9830-0a07e5c388ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:43.815196 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3849/7619] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:43 2022] DELETE /identity/v3/projects/12a82117ca894ee3b2d8ca91ced1b886 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:43.821209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9e4f-8194-42d4-b97f-428f55fddf36 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:43.821712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9e4f-8194-42d4-b97f-428f55fddf36 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:43.821965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9e4f-8194-42d4-b97f-428f55fddf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:43.843247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f3fc9e4f-8194-42d4-b97f-428f55fddf36 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:43.845410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f3fc9e4f-8194-42d4-b97f-428f55fddf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:43.921012 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3771/7620] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:43.931200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc602c2-07ec-4be2-a1ef-8ac3de850019 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:43.932014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc602c2-07ec-4be2-a1ef-8ac3de850019 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:43.932561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc602c2-07ec-4be2-a1ef-8ac3de850019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:43.955573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fbc602c2-07ec-4be2-a1ef-8ac3de850019 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:43.957904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fbc602c2-07ec-4be2-a1ef-8ac3de850019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:43.971705 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3850/7621] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:43.975484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc9e4f-8194-42d4-b97f-428f55fddf36 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:43.990461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc9e4f-8194-42d4-b97f-428f55fddf36 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:43.998924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:43.999764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.000181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.000615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.002607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:44.003034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:44.004854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:44.022608 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3772/7622] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:44.026868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc602c2-07ec-4be2-a1ef-8ac3de850019 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:44.037186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc602c2-07ec-4be2-a1ef-8ac3de850019 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:44.043230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:44.043591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.043985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.044326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.045271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:44.047646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:44.093921 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3851/7623] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:44.098955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:44.112198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412b652-5a07-410c-931c-5bd781817a8f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:44.222079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:44.223083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.223366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.223630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.224340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:44.226487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:44.272434 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3773/7624] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:44 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:44.276289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:44.298931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba004-a830-4645-baaf-b8f10789a7bc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:44.306992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:44.307735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.308017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.308292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.309197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:44.313524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:44.329977 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3852/7625] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:44.331237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:44.342872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e027ff-bb03-479c-ba49-580bfb1f9d46 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:44.348482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4a1c-6b47-4203-836a-4eb97d445d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:44.349478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4a1c-6b47-4203-836a-4eb97d445d00 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.349764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4a1c-6b47-4203-836a-4eb97d445d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.350044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4a1c-6b47-4203-836a-4eb97d445d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.350858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4a1c-6b47-4203-836a-4eb97d445d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:44.352513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4a1c-6b47-4203-836a-4eb97d445d00 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:44.375561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3774/7626] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:44.377134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:44.397773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ddbbb-e9ca-4d82-92ca-758ebb32dfa8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:44.405180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:44.406421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.406711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.407054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] PATH_INFO: `/v3/projects/9e474926f8b344cb9bcf1b43e9786c01/users/2d47aaedd20946d7b05386bab7d80563/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.445288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e474926f8b344cb9bcf1b43e9786c01, user_id=2d47aaedd20946d7b05386bab7d80563, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:44.463372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:44.484738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3853/7627] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:44 2022] PUT /identity/v3/projects/9e474926f8b344cb9bcf1b43e9786c01/users/2d47aaedd20946d7b05386bab7d80563/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:44.498770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.499286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.499610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.514367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:44.516404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:44.546428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] MFA Rules not processed for user `2d47aaedd20946d7b05386bab7d80563`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:44.547678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:44.692809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3997c-99b6-4624-9026-088700cd6a1b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:44.703996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:44.704910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.708722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.708833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] PATH_INFO: `/v3/projects/a2bbb767081f4168a18d16823a2d1b7a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.711133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2bbb767081f4168a18d16823a2d1b7a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:44.713245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:44.758002 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3775/7628] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:44.777171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:44.778965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:44.796371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2bbb767081f4168a18d16823a2d1b7a', 'request_id': 'req-7d1ba246-deec-4456-b49b-f2fb559060a6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:44.804840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2bbb767081f4168a18d16823a2d1b7a', 'request_id': 'req-7d1ba246-deec-4456-b49b-f2fb559060a6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:44.822786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2bbb767081f4168a18d16823a2d1b7a', 'request_id': 'req-7d1ba246-deec-4456-b49b-f2fb559060a6'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:44.852175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] The token cache is being invalidate because project a2bbb767081f4168a18d16823a2d1b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:44.852624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:44.853433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d1ba246-deec-4456-b49b-f2fb559060a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:44.855509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3854/7629] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:44 2022] DELETE /identity/v3/projects/a2bbb767081f4168a18d16823a2d1b7a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:44.861862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeba6-d615-4f52-af28-922e36e836e6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.862240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeba6-d615-4f52-af28-922e36e836e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.862499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeba6-d615-4f52-af28-922e36e836e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.876468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4df86-03e0-4598-bdb7-716ebeb9fcc2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:44.892514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4cdeeba6-d615-4f52-af28-922e36e836e6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:44.893806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4cdeeba6-d615-4f52-af28-922e36e836e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:44.989593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:44.992403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:44.992730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:44.993010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:44.995524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:45.121654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3855/7630] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:45.129543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85774c-11b2-4201-a71e-318f535b0017 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.130115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85774c-11b2-4201-a71e-318f535b0017 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.130568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85774c-11b2-4201-a71e-318f535b0017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:45.169653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:45.170922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:45.177244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ee85774c-11b2-4201-a71e-318f535b0017 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:45.178569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ee85774c-11b2-4201-a71e-318f535b0017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:45.199945 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3776/7631] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:21:45.209171 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3856/7632] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:21:45.210208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:45.228043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74d11-2be8-426f-8ab9-0daec3a0f832 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:45.242198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:45.242916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.243270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.243440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:45.244186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:45.244492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:45.249758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:45.286434 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3777/7633] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:45.287951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85774c-11b2-4201-a71e-318f535b0017 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:45.303687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85774c-11b2-4201-a71e-318f535b0017 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:45.318651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:45.319857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.321695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.322432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:45.323351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:45.326307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:45.426991 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3857/7634] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:45 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:45.432927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:45.468356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995458-6a97-44e5-a454-649abad8bb06 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:45.619748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:45.621810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.622986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.624050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:45.627264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:45.645576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:45.689159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:45.689392 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3778/7635] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:45 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:45.722793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f1b8-28ba-4e91-9740-7538c7490004 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:45.737258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:45.742320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.742741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.744522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:45.745620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:45.756652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:45.790392 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3858/7636] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:45.791228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:45.823837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6d4b-ecec-4589-bea5-b684d352c893 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:45.844707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02fcd3-c3b2-44ac-bfbc-4e5a9884ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:45.845458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02fcd3-c3b2-44ac-bfbc-4e5a9884ddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.846391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02fcd3-c3b2-44ac-bfbc-4e5a9884ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.846391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02fcd3-c3b2-44ac-bfbc-4e5a9884ddb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:45.846749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02fcd3-c3b2-44ac-bfbc-4e5a9884ddb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:45.848391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02fcd3-c3b2-44ac-bfbc-4e5a9884ddb9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:45.887451 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3779/7637] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:45.891866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:45.907241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c7be7-b05d-4dff-a038-044014e8232c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:45.916294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:45.917487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.918264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.918806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] PATH_INFO: `/v3/projects/4542400bc91449e09c44d33b478c731e/users/7c0b068a444b461cb5190024544c1291/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:45.953297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4542400bc91449e09c44d33b478c731e, user_id=7c0b068a444b461cb5190024544c1291, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:45.956348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:45.990948 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3859/7638] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:45 2022] PUT /identity/v3/projects/4542400bc91449e09c44d33b478c731e/users/7c0b068a444b461cb5190024544c1291/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:45.993286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c37173-ad91-4f51-bff0-7a9b32f7f89f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:45.994741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c37173-ad91-4f51-bff0-7a9b32f7f89f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:45.995243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c37173-ad91-4f51-bff0-7a9b32f7f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:46.021877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-95c37173-ad91-4f51-bff0-7a9b32f7f89f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:46.023470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95c37173-ad91-4f51-bff0-7a9b32f7f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:46.154249 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3780/7639] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:46.175778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:46.177616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:46.294847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a86693-75b7-4903-8b21-4c4fb86868d0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:46.299729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:46.300670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:46.301178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:46.301689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:46.318996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:46.320861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:46.347908 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3860/7640] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:49.198527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746011-c793-4ce1-a223-d066b0f36455 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:49.199103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746011-c793-4ce1-a223-d066b0f36455 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:49.199103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746011-c793-4ce1-a223-d066b0f36455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:49.254887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-57746011-c793-4ce1-a223-d066b0f36455 None None] MFA Rules not processed for user `7c0b068a444b461cb5190024544c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:49.256496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-57746011-c793-4ce1-a223-d066b0f36455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:49.402375 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3781/7641] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:49.417377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:49.419146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:49.581363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf110-133e-4423-9ab1-e3f7553633e8 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:49.588075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743f96e-b4ae-4110-bbdc-4cfced17c844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:49.589452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f96e-b4ae-4110-bbdc-4cfced17c844 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:49.590020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f96e-b4ae-4110-bbdc-4cfced17c844 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:49.590873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f96e-b4ae-4110-bbdc-4cfced17c844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:49.608467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743f96e-b4ae-4110-bbdc-4cfced17c844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:49.646472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743f96e-b4ae-4110-bbdc-4cfced17c844 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:49.693463 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3861/7642] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:51.331013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:51.331578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:51.331578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:51.369357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] MFA Rules not processed for user `7c0b068a444b461cb5190024544c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:51.370631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:51.399841 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3782/7643] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:52.126964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48640a0-4ab5-4905-9ac6-ac116b52b908 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:52.127504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48640a0-4ab5-4905-9ac6-ac116b52b908 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:52.127504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48640a0-4ab5-4905-9ac6-ac116b52b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:52.171588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f48640a0-4ab5-4905-9ac6-ac116b52b908 None None] MFA Rules not processed for user `81497a47682c4a89ad792ee59c13fc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:52.173528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f48640a0-4ab5-4905-9ac6-ac116b52b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:52.273211 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3862/7644] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:52.275502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:52.277569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:52.296995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aacd8-1a0f-4e64-b7d9-587e766c8b94 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:52.304928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:52.305843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:52.309762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:52.310429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:52.311537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:52.313859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:52.351177 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3783/7645] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:52 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:52.355720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48640a0-4ab5-4905-9ac6-ac116b52b908 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:52.372698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48640a0-4ab5-4905-9ac6-ac116b52b908 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:52.511952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:52.512920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:52.513321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:52.513713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:52.514512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:52.516591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:52.552128 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3863/7646] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:52 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:52.555850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:52.570956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ba78-9466-4688-aa43-39ecc0bba995 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:52.585398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:52.586070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:52.586602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:52.587253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:52.589433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:52.600124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:52.628464 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3784/7647] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:52.628718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:52.645342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024378ee-cf9c-4653-a3ac-72df9601ec81 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:52.658713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:52.663963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:52.665992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:52.667096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] PATH_INFO: `/v3/projects/7c204e0f1f1a4a9c97d0cde4129138ed/users/fd4651cc0e5540c5ba6165b61726d465/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:52.709152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c204e0f1f1a4a9c97d0cde4129138ed, user_id=fd4651cc0e5540c5ba6165b61726d465, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:52.712094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:52.734541 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3864/7648] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:52 2022] PUT /identity/v3/projects/7c204e0f1f1a4a9c97d0cde4129138ed/users/fd4651cc0e5540c5ba6165b61726d465/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:52.741828 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:52.759600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822315-4c00-4e06-8c1b-ba2af41716fd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:52.846163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:52.847477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:52.848007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:52.848499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:52.850673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:52.852590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:52.866313 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3785/7649] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:52.870540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:52.882216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cad7ee-dff0-4215-8b81-f712cd4012c6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:52.900491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372497f-ecd9-40c7-9917-0265d57f1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:52.902097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372497f-ecd9-40c7-9917-0265d57f1cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:52.902596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372497f-ecd9-40c7-9917-0265d57f1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:52.903143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372497f-ecd9-40c7-9917-0265d57f1cd1 admin admin] PATH_INFO: `/v3/projects/7c204e0f1f1a4a9c97d0cde4129138ed/users/fd4651cc0e5540c5ba6165b61726d465/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:52.906305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372497f-ecd9-40c7-9917-0265d57f1cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c204e0f1f1a4a9c97d0cde4129138ed, user_id=fd4651cc0e5540c5ba6165b61726d465, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:52.909680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372497f-ecd9-40c7-9917-0265d57f1cd1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:52.956437 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3865/7650] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:52 2022] PUT /identity/v3/projects/7c204e0f1f1a4a9c97d0cde4129138ed/users/fd4651cc0e5540c5ba6165b61726d465/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:53.081239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:53.083392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:53.108235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43f55-8674-42f7-8f17-110a4b02dcca admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:53.361785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:53.363460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:53.363912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:53.368531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] PATH_INFO: `/v3/users/2d47aaedd20946d7b05386bab7d80563` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:53.371739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d47aaedd20946d7b05386bab7d80563)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:53.374029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:53.536720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d47aaedd20946d7b05386bab7d80563'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:53.538064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d47aaedd20946d7b05386bab7d80563'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:53.560963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d47aaedd20946d7b05386bab7d80563'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:53.561754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d47aaedd20946d7b05386bab7d80563'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:53.574338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d47aaedd20946d7b05386bab7d80563'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:53.599832 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3786/7651] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:21:53 2022] DELETE /identity/v3/users/2d47aaedd20946d7b05386bab7d80563 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:53.604370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:53.604937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:53.604937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:53.623405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:53.625234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:53.723029 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3866/7652] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:53.979396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:53.981077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:54.130669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd832-dbac-4de3-a62f-96a689eb33dd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:54.136943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2d4f-4c19-478f-b7a7-e4af3a8e29b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:54.138233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2d4f-4c19-478f-b7a7-e4af3a8e29b8 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:54.138561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2d4f-4c19-478f-b7a7-e4af3a8e29b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:54.138848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2d4f-4c19-478f-b7a7-e4af3a8e29b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:54.173787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2d4f-4c19-478f-b7a7-e4af3a8e29b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:54.176969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2d4f-4c19-478f-b7a7-e4af3a8e29b8 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:54.208769 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3787/7653] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:21:55.761762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:55.763356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:55.787575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b5068-76df-4249-8910-cf79f1b132ae None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:55.794438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:55.795895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:55.796406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:55.796933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] PATH_INFO: `/v3/projects/9e474926f8b344cb9bcf1b43e9786c01` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:55.803412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e474926f8b344cb9bcf1b43e9786c01)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:55.805821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:55.897811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e474926f8b344cb9bcf1b43e9786c01', 'request_id': 'req-0f417437-ba81-46e2-816d-5c530a3bbc62'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:55.936561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e474926f8b344cb9bcf1b43e9786c01', 'request_id': 'req-0f417437-ba81-46e2-816d-5c530a3bbc62'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:55.953897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e474926f8b344cb9bcf1b43e9786c01', 'request_id': 'req-0f417437-ba81-46e2-816d-5c530a3bbc62'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:55.970099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] The token cache is being invalidate because project 9e474926f8b344cb9bcf1b43e9786c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:21:55.970390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:55.971112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0f417437-ba81-46e2-816d-5c530a3bbc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:21:55.972927 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3867/7654] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:21:55 2022] DELETE /identity/v3/projects/9e474926f8b344cb9bcf1b43e9786c01 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:21:55.979425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa86fd-fb5f-4d09-bc04-0035141c909b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:55.980328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa86fd-fb5f-4d09-bc04-0035141c909b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:55.981021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa86fd-fb5f-4d09-bc04-0035141c909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.012663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6faa86fd-fb5f-4d09-bc04-0035141c909b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:56.014459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6faa86fd-fb5f-4d09-bc04-0035141c909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:56.110343 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3788/7655] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:56.118379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735581b2-fd7f-4fbb-8838-de6d0350a961 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.118667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735581b2-fd7f-4fbb-8838-de6d0350a961 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.118964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735581b2-fd7f-4fbb-8838-de6d0350a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.150367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-735581b2-fd7f-4fbb-8838-de6d0350a961 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:56.155050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-735581b2-fd7f-4fbb-8838-de6d0350a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:56.217905 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3868/7656] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:56.223382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa86fd-fb5f-4d09-bc04-0035141c909b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:56.233786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa86fd-fb5f-4d09-bc04-0035141c909b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:56.264542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:56.265687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.266139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.266578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.267737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:21:56.268382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:56.271384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:56.298386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3789/7657] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:21:56.304100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735581b2-fd7f-4fbb-8838-de6d0350a961 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:56.321311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735581b2-fd7f-4fbb-8838-de6d0350a961 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:56.339271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:56.340118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.341158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.342770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.343505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:56.352819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:56.422011 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3869/7658] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:56 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:56.425414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:56.457113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61af62b-de86-477a-8f43-d6399a25d389 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:56.567626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:56.568504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.568880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.569273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.570277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:56.573432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:56.635855 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3790/7659] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:56 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:56.637576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:56.648576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6724580-a611-43a4-8f70-89ede9776457 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:56.659091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:56.663238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.664612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.665349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.666880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:56.671032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:56.685642 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3870/7660] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:56.689429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:56.702547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240e0d6-53ca-4af0-9b41-7f4c4abe9c54 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:56.710463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e5b67-37db-4bf7-bec7-4a07f8f25da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:56.711257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5b67-37db-4bf7-bec7-4a07f8f25da7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.711594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5b67-37db-4bf7-bec7-4a07f8f25da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.711877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5b67-37db-4bf7-bec7-4a07f8f25da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.712678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e5b67-37db-4bf7-bec7-4a07f8f25da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:56.714530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e5b67-37db-4bf7-bec7-4a07f8f25da7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:56.731399 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3791/7661] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:56.732626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:56.745527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb329d-ec29-4722-b070-ca78d19a90cc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:56.753191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:56.753412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.753676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.754178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] PATH_INFO: `/v3/projects/249211709ece485daf084a48fcbf819f/users/fdbc094dc029426799bf9d0e4903c5f5/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.775798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] RBAC: Authorizing `identity:create_grant(project_id=249211709ece485daf084a48fcbf819f, user_id=fdbc094dc029426799bf9d0e4903c5f5, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:56.785131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:56.813846 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3871/7662] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:56 2022] PUT /identity/v3/projects/249211709ece485daf084a48fcbf819f/users/fdbc094dc029426799bf9d0e4903c5f5/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:56.824101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac3a0-a72f-453f-94f4-e6d5087d8105 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:56.824556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac3a0-a72f-453f-94f4-e6d5087d8105 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:56.824946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac3a0-a72f-453f-94f4-e6d5087d8105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:56.880654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c61ac3a0-a72f-453f-94f4-e6d5087d8105 None None] MFA Rules not processed for user `fdbc094dc029426799bf9d0e4903c5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:56.882179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c61ac3a0-a72f-453f-94f4-e6d5087d8105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:57.029877 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3792/7663] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:57.031908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:57.114433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5350d1-b8ff-4ff1-a788-bf1262a7066e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:57.122371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:57.123328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:57.123694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:57.124205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:57.125261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:57.128276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:57.180476 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3872/7664] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:57 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:57.184356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac3a0-a72f-453f-94f4-e6d5087d8105 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:57.200502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac3a0-a72f-453f-94f4-e6d5087d8105 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:57.312158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:57.313597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:57.314302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:57.314748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:57.315792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:57.318710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:57.379501 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3793/7665] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:57 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:21:57.381184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:57.392269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557cd9c-f4c9-4664-bdcd-b9d6f67aad0f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:57.397984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:57.398970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:57.399412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:57.399847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:57.400782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:57.402727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:57.414893 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3873/7666] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:57.418729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:57.430849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425660-5491-420d-a4f7-f9ede0f8ac8f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:57.441021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd491ff-34a1-4365-889f-8b93c496638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:57.441021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd491ff-34a1-4365-889f-8b93c496638c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:57.441021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd491ff-34a1-4365-889f-8b93c496638c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:57.441021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd491ff-34a1-4365-889f-8b93c496638c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:57.441743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd491ff-34a1-4365-889f-8b93c496638c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:57.441743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd491ff-34a1-4365-889f-8b93c496638c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:57.466200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:57.467423 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3794/7667] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:57.479752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcdc2a-454f-40a7-a123-4d2736f7446f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:57.493984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:57.495317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:57.495571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:57.495890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] PATH_INFO: `/v3/projects/1d849d77e4844ac98f5708a8151f9f55/users/67337c40308a4c7897708976ccb2168a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:57.521848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d849d77e4844ac98f5708a8151f9f55, user_id=67337c40308a4c7897708976ccb2168a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:57.526232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:57.551461 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3874/7668] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:57 2022] PUT /identity/v3/projects/1d849d77e4844ac98f5708a8151f9f55/users/67337c40308a4c7897708976ccb2168a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:57.564908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e139e5d-db2b-4111-8894-5a8f63538249 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:57.565486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e139e5d-db2b-4111-8894-5a8f63538249 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:57.565863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e139e5d-db2b-4111-8894-5a8f63538249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:57.603595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3e139e5d-db2b-4111-8894-5a8f63538249 None None] MFA Rules not processed for user `67337c40308a4c7897708976ccb2168a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:57.605295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3e139e5d-db2b-4111-8894-5a8f63538249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:57.690934 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3795/7669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:57.691290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:57.789523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64423-7af0-45d4-8ba9-f89ddfcc66d4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:57.795558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:57.797774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:57.798065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:57.798345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:57.799063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:57.801924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:57.882381 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3875/7670] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:21:57 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:57.887122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e139e5d-db2b-4111-8894-5a8f63538249 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:57.904779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e139e5d-db2b-4111-8894-5a8f63538249 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:58.018701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:58.018967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:58.019234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:58.019917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:58.020267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:58.023791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:58.061969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:58.074993 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3796/7671] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:21:57 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:21:58.076916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de60828-a124-40a2-8376-6e3989d2970c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:58.081860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:58.082568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:58.082987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:58.083274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:58.084257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:58.086539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:58.104492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:58.115606 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3876/7672] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:21:58.124394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d13e6-e1ce-43a7-ab3e-6862dd0805bf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:58.130223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:58.131151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:58.131436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:58.131762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] PATH_INFO: `/v3/projects/85bebed8f1eb4fd2abd2c843030533e6/users/15e28ac2a7084329a7efc84ef4149716/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:58.152010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bebed8f1eb4fd2abd2c843030533e6, user_id=15e28ac2a7084329a7efc84ef4149716, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:58.155083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:58.178509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:58.194122 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3797/7673] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:58 2022] PUT /identity/v3/projects/85bebed8f1eb4fd2abd2c843030533e6/users/15e28ac2a7084329a7efc84ef4149716/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:58.208700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353308-6932-4ad5-9147-a21f3e2e4255 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:58.307688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e23d52-61a0-43ac-8270-8cf3ec678f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:58.318272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23d52-61a0-43ac-8270-8cf3ec678f71 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:58.318768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23d52-61a0-43ac-8270-8cf3ec678f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:58.319212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23d52-61a0-43ac-8270-8cf3ec678f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:58.320158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e23d52-61a0-43ac-8270-8cf3ec678f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:58.323996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e23d52-61a0-43ac-8270-8cf3ec678f71 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:58.336780 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3877/7674] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:21:58.341787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:58.355419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73e6f3-2c8e-4d10-a69b-b03d3d4d0538 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:58.360320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:58.361278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:58.361563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:58.361842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] PATH_INFO: `/v3/projects/85bebed8f1eb4fd2abd2c843030533e6/users/15e28ac2a7084329a7efc84ef4149716/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:58.363901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bebed8f1eb4fd2abd2c843030533e6, user_id=15e28ac2a7084329a7efc84ef4149716, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:58.367637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:58.379113 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3798/7675] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:21:58 2022] PUT /identity/v3/projects/85bebed8f1eb4fd2abd2c843030533e6/users/15e28ac2a7084329a7efc84ef4149716/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:21:58.391579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:58.392311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:58.392787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:58.456577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] MFA Rules not processed for user `15e28ac2a7084329a7efc84ef4149716`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:21:58.457883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:58.534022 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3878/7676] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:21:58.545440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:21:58.548057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:21:58.610442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78bc73-28b3-4f69-85b7-713607fccfe4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:21:58.615183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:21:58.615885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:21:58.616165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:21:58.616444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:21:58.689512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:21:58.691331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:21:58.704846 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3799/7677] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:21:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:00.546582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:00.548320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:00.570922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925ca4-d56a-4e67-af61-e1129d251add None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:00.583863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf87f1b-9a6f-4467-a85d-e19e59427383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:00.584784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf87f1b-9a6f-4467-a85d-e19e59427383 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:00.585309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf87f1b-9a6f-4467-a85d-e19e59427383 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:00.585789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf87f1b-9a6f-4467-a85d-e19e59427383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:00.707408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf87f1b-9a6f-4467-a85d-e19e59427383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:00.708904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf87f1b-9a6f-4467-a85d-e19e59427383 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:00.731341 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3879/7678] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:01.927126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:01.939761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f05a9-1c5e-44b5-b8cd-7ec01dbbacf6 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:01.943824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:01.944789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:01.945228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:01.945600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:01.964016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:01.965924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:01.994540 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3800/7679] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:02.208248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0618b26-2fab-4adb-8cb7-ec37d2c0c7ee None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:02.209203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0618b26-2fab-4adb-8cb7-ec37d2c0c7ee None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:02.209639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0618b26-2fab-4adb-8cb7-ec37d2c0c7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:02.247558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e0618b26-2fab-4adb-8cb7-ec37d2c0c7ee None None] MFA Rules not processed for user `fd4651cc0e5540c5ba6165b61726d465`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:02.249678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e0618b26-2fab-4adb-8cb7-ec37d2c0c7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:02.371062 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3880/7680] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:02.383106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:02.384894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:02.508754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265a52-0380-4822-992c-11f7b5e0411c service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:02.517909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:02.519315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:02.519809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:02.520622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:02.524596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:02.623227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:02.630755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:02.667128 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3801/7681] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:05.975816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f3b9-d56e-4f1a-ba8b-b3c54d7cd1a6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:05.976886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f3b9-d56e-4f1a-ba8b-b3c54d7cd1a6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:05.977407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f3b9-d56e-4f1a-ba8b-b3c54d7cd1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:06.051071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7970f3b9-d56e-4f1a-ba8b-b3c54d7cd1a6 None None] MFA Rules not processed for user `81497a47682c4a89ad792ee59c13fc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:06.055253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7970f3b9-d56e-4f1a-ba8b-b3c54d7cd1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:06.091792 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3881/7682] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:06.375465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:06.488397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36aa73-75a3-422c-8637-1c94852e1ea2 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:06.497049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:06.499170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:06.499630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:06.500088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] PATH_INFO: `/v3/users/fdbc094dc029426799bf9d0e4903c5f5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:06.502473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbc094dc029426799bf9d0e4903c5f5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:06.504674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:06.615535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbc094dc029426799bf9d0e4903c5f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:06.616311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbc094dc029426799bf9d0e4903c5f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:06.627881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbc094dc029426799bf9d0e4903c5f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:06.628711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbc094dc029426799bf9d0e4903c5f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:06.642776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbc094dc029426799bf9d0e4903c5f5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:06.672380 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3802/7683] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:22:06 2022] DELETE /identity/v3/users/fdbc094dc029426799bf9d0e4903c5f5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:06.679235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:06.679527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:06.680688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:06.711115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:06.712347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:06.773666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:06.775463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:06.798195 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3882/7684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:06.809549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:06.811260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:06.880766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5355-785e-4181-9c90-c24fdb4964cb admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:06.889075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:06.889900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:06.890543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:06.890543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:06.894024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:06.901833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551231-83cf-4ed6-a58a-436361233871 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:06.932970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:06.933554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:06.933940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:06.934347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:06.961346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:06.963860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:06.973581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:06.976320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:06.999872 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3803/7685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:07.011767 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3883/7686] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:08.008033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:08.009820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:08.049375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5486a9-0a2b-4df0-9732-fac5d768bcca service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:08.065270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:08.066437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:08.066952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:08.067442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] PATH_INFO: `/v3/projects/249211709ece485daf084a48fcbf819f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:08.069134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249211709ece485daf084a48fcbf819f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:08.071397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:08.158580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249211709ece485daf084a48fcbf819f', 'request_id': 'req-125ad0b2-e172-4f29-b5e6-d6192d08b352'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.174598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249211709ece485daf084a48fcbf819f', 'request_id': 'req-125ad0b2-e172-4f29-b5e6-d6192d08b352'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.195131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249211709ece485daf084a48fcbf819f', 'request_id': 'req-125ad0b2-e172-4f29-b5e6-d6192d08b352'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.232953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] The token cache is being invalidate because project 249211709ece485daf084a48fcbf819f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:22:08.233306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.234403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.239054 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3804/7687] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:22:08 2022] DELETE /identity/v3/projects/249211709ece485daf084a48fcbf819f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:08.240338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:08.253345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b00cc-a229-4653-a957-92f3de5255d8 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:08.366670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:08.367578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:08.368404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:08.368884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] PATH_INFO: `/v3/users/67337c40308a4c7897708976ccb2168a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:08.370724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67337c40308a4c7897708976ccb2168a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:08.386137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:08.489194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67337c40308a4c7897708976ccb2168a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.490338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67337c40308a4c7897708976ccb2168a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.510043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67337c40308a4c7897708976ccb2168a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.524927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67337c40308a4c7897708976ccb2168a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.525945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67337c40308a4c7897708976ccb2168a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:08.550173 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3884/7688] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:22:08 2022] DELETE /identity/v3/users/67337c40308a4c7897708976ccb2168a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:10.367674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:10.369181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:10.384673 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad0b2-e172-4f29-b5e6-d6192d08b352 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:10.511204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:10.512557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:10.513008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:10.513491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] PATH_INFO: `/v3/projects/1d849d77e4844ac98f5708a8151f9f55` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:10.515074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d849d77e4844ac98f5708a8151f9f55)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:10.517325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:10.577230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d849d77e4844ac98f5708a8151f9f55', 'request_id': 'req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.585938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d849d77e4844ac98f5708a8151f9f55', 'request_id': 'req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.613307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d849d77e4844ac98f5708a8151f9f55', 'request_id': 'req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.639613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] The token cache is being invalidate because project 1d849d77e4844ac98f5708a8151f9f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:22:10.640223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.641127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.648696 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3805/7689] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:22:10 2022] DELETE /identity/v3/projects/1d849d77e4844ac98f5708a8151f9f55 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:10.653011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:10.655095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:10.685216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2370-9d94-499f-8d0a-0caf50159d58 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:10.812050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:10.814059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:10.814653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:10.815128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] PATH_INFO: `/v3/users/15e28ac2a7084329a7efc84ef4149716` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:10.816858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e28ac2a7084329a7efc84ef4149716)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:10.820033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:10.899456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e28ac2a7084329a7efc84ef4149716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.900448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e28ac2a7084329a7efc84ef4149716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.910903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e28ac2a7084329a7efc84ef4149716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.936138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e28ac2a7084329a7efc84ef4149716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.936821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e1b9b877-f156-465b-92c3-3cef4c0e5719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e28ac2a7084329a7efc84ef4149716'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:10.967264 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3885/7690] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:22:10 2022] DELETE /identity/v3/users/15e28ac2a7084329a7efc84ef4149716 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:12.277322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:12.282203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:12.324192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25ae47-1a77-4cf3-b6e9-29e9aa7bde40 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:12.429862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:12.430785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:12.431069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:12.431348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] PATH_INFO: `/v3/projects/85bebed8f1eb4fd2abd2c843030533e6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:12.434869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bebed8f1eb4fd2abd2c843030533e6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:12.440085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:12.543083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bebed8f1eb4fd2abd2c843030533e6', 'request_id': 'req-2dadaa45-205a-4c46-9920-fbd032184465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:12.554717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bebed8f1eb4fd2abd2c843030533e6', 'request_id': 'req-2dadaa45-205a-4c46-9920-fbd032184465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:12.569119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bebed8f1eb4fd2abd2c843030533e6', 'request_id': 'req-2dadaa45-205a-4c46-9920-fbd032184465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:12.594795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] The token cache is being invalidate because project 85bebed8f1eb4fd2abd2c843030533e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:22:12.595419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:12.596274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2dadaa45-205a-4c46-9920-fbd032184465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:12.601475 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3806/7691] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:22:12 2022] DELETE /identity/v3/projects/85bebed8f1eb4fd2abd2c843030533e6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:12.603931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1ef1-a29c-47bf-9186-5fbd2ee596e1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:12.608266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1ef1-a29c-47bf-9186-5fbd2ee596e1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:12.612059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1ef1-a29c-47bf-9186-5fbd2ee596e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:12.640796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cd0a1ef1-a29c-47bf-9186-5fbd2ee596e1 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:12.642230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cd0a1ef1-a29c-47bf-9186-5fbd2ee596e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:12.720168 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3886/7692] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:12.729253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d707a-dced-4863-9960-5e5b6dbcd928 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:12.729875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d707a-dced-4863-9960-5e5b6dbcd928 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:12.730208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d707a-dced-4863-9960-5e5b6dbcd928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:12.776081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c65d707a-dced-4863-9960-5e5b6dbcd928 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:12.777220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c65d707a-dced-4863-9960-5e5b6dbcd928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:12.809147 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3807/7693] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:12.811765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1ef1-a29c-47bf-9186-5fbd2ee596e1 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:12.830080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1ef1-a29c-47bf-9186-5fbd2ee596e1 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:12.842816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:12.843582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:12.844219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:12.844499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:12.846256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:22:12.846570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:12.849486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:12.868141 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3887/7694] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:22:12.869364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d707a-dced-4863-9960-5e5b6dbcd928 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:12.879742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d707a-dced-4863-9960-5e5b6dbcd928 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:12.898680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:12.899387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:12.899669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:12.899945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:12.900654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:12.902731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:12.983667 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3808/7695] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:22:12 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:22:12.988251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:13.002974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59230ba3-ffc8-48b1-b0c3-2a266738c842 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:13.175978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:13.176708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:13.176995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:13.177393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:13.178108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:13.180138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:13.226255 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3888/7696] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:22:12 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:22:13.230136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:13.246834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fc83-3bb5-4364-8b2b-6890a8a677a6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:13.275993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:13.276549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:13.276872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:13.277199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:13.278153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:13.280175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:13.317629 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3809/7697] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:22:13.318924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:13.338829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4f1e-f8e2-4ca7-a204-dae713c70ccc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:13.352223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d498-7fbc-4029-9dc9-f5cf81b69486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:13.352935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d498-7fbc-4029-9dc9-f5cf81b69486 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:13.353252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d498-7fbc-4029-9dc9-f5cf81b69486 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:13.353526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d498-7fbc-4029-9dc9-f5cf81b69486 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:13.354271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783d498-7fbc-4029-9dc9-f5cf81b69486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:13.355997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783d498-7fbc-4029-9dc9-f5cf81b69486 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:13.375478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3889/7698] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:22:13.379444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:13.397022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d925ca-0bd6-4e09-9775-9abd0cb14c2b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:13.409920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:13.410967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:13.411176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:13.411458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] PATH_INFO: `/v3/projects/b3cd8a38803f4a8dbceba2c5a64f997f/users/dead4209e2844000bf7d563164daa14a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:13.439922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cd8a38803f4a8dbceba2c5a64f997f, user_id=dead4209e2844000bf7d563164daa14a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:13.445390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:13.498541 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3810/7699] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:22:13 2022] PUT /identity/v3/projects/b3cd8a38803f4a8dbceba2c5a64f997f/users/dead4209e2844000bf7d563164daa14a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:13.611430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7f4f-03d9-4669-978e-103de77b1ae8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:13.612267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7f4f-03d9-4669-978e-103de77b1ae8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:13.612785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7f4f-03d9-4669-978e-103de77b1ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:13.665609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-35ea7f4f-03d9-4669-978e-103de77b1ae8 None None] MFA Rules not processed for user `dead4209e2844000bf7d563164daa14a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:13.667371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35ea7f4f-03d9-4669-978e-103de77b1ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:13.794785 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3890/7700] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:13.805126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:13.807442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:13.943131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93383b5-e7f9-4380-b293-7b99174be22c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:13.947748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96611e36-5a03-468d-931e-e0ae87cc87ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:13.949337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96611e36-5a03-468d-931e-e0ae87cc87ce service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:13.949896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96611e36-5a03-468d-931e-e0ae87cc87ce service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:13.950486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96611e36-5a03-468d-931e-e0ae87cc87ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:13.965893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96611e36-5a03-468d-931e-e0ae87cc87ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:13.967863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96611e36-5a03-468d-931e-e0ae87cc87ce service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:13.983104 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3811/7701] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:16.016348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:16.021533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:16.021890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:16.052885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] MFA Rules not processed for user `b5534646a6384067bda99af7c864d494`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:16.054560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:16.163479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3891/7702] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:18.655199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68439c-f8e9-4601-92f6-b7299fc96109 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:18.655765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68439c-f8e9-4601-92f6-b7299fc96109 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:18.655765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68439c-f8e9-4601-92f6-b7299fc96109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:18.741515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5c68439c-f8e9-4601-92f6-b7299fc96109 None None] MFA Rules not processed for user `7c0b068a444b461cb5190024544c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:18.742773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c68439c-f8e9-4601-92f6-b7299fc96109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:18.830725 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3812/7703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:23.852973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:23.855743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:23.956686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266803-05b4-4b41-a0b2-4664e4f2fd97 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:23.967567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d39cc-ee6b-415e-8520-73023361fe90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:23.969146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d39cc-ee6b-415e-8520-73023361fe90 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:23.969890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d39cc-ee6b-415e-8520-73023361fe90 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:23.971003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d39cc-ee6b-415e-8520-73023361fe90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:23.973656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-601d39cc-ee6b-415e-8520-73023361fe90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:24.061775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d39cc-ee6b-415e-8520-73023361fe90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:24.063469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d39cc-ee6b-415e-8520-73023361fe90 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:24.075192 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3892/7704] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:24.749010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68439c-f8e9-4601-92f6-b7299fc96109 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:24.844629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68439c-f8e9-4601-92f6-b7299fc96109 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:24.864951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:24.866263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:24.867214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:24.867709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] PATH_INFO: `/v3/users/dead4209e2844000bf7d563164daa14a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:24.870022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dead4209e2844000bf7d563164daa14a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:24.873505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:24.980166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dead4209e2844000bf7d563164daa14a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:24.981517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dead4209e2844000bf7d563164daa14a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:25.002009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dead4209e2844000bf7d563164daa14a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:25.004409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dead4209e2844000bf7d563164daa14a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:25.025578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dead4209e2844000bf7d563164daa14a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:25.067074 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3813/7705] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:22:24 2022] DELETE /identity/v3/users/dead4209e2844000bf7d563164daa14a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:25.071831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:25.072340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:25.073289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:25.105315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:25.107322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:25.208550 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3893/7706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:25.222324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:25.224659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:25.392335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f55b-ab64-4b87-aade-5b161f51270a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:25.412888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:25.413925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:25.414377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:25.414819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:25.428861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:25.433814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:25.462542 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3814/7707] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:28.053841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:28.059631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:28.097520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cd623-250b-44c3-bd23-62cf45116ed5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:28.121742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:28.123544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:28.136177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:28.137658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] PATH_INFO: `/v3/projects/b3cd8a38803f4a8dbceba2c5a64f997f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:28.141683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cd8a38803f4a8dbceba2c5a64f997f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:28.144416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:28.236083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cd8a38803f4a8dbceba2c5a64f997f', 'request_id': 'req-90137045-9474-4cd0-8b6d-e280c2bd5039'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:28.245010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cd8a38803f4a8dbceba2c5a64f997f', 'request_id': 'req-90137045-9474-4cd0-8b6d-e280c2bd5039'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:28.261480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cd8a38803f4a8dbceba2c5a64f997f', 'request_id': 'req-90137045-9474-4cd0-8b6d-e280c2bd5039'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:28.281151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] The token cache is being invalidate because project b3cd8a38803f4a8dbceba2c5a64f997f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:22:28.281500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:28.282379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-90137045-9474-4cd0-8b6d-e280c2bd5039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:22:28.284589 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3894/7708] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:22:28 2022] DELETE /identity/v3/projects/b3cd8a38803f4a8dbceba2c5a64f997f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:22:39.041871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:39.043364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:39.146775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e402679-4fad-4f3f-a62f-b92c3095e823 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:39.248010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:39.249119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:39.249568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:39.250024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:39.254956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:39.270384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:39.273636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:39.294438 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3815/7709] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:44.750888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:44.751435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:44.751435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:44.770629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:44.771963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:44.852132 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3895/7710] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:44.908523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:44.910549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:45.016694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa00c-8bd3-41b4-9bf0-0b8fb064dad6 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:45.022694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffaa2f-c105-44b8-940f-d8af3c776501 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:45.023588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffaa2f-c105-44b8-940f-d8af3c776501 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:45.024040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffaa2f-c105-44b8-940f-d8af3c776501 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:45.024469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffaa2f-c105-44b8-940f-d8af3c776501 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:45.033821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffaa2f-c105-44b8-940f-d8af3c776501 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:45.035666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffaa2f-c105-44b8-940f-d8af3c776501 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:45.046341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3816/7711] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:22:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:22:45.207306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:45.208755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:45.239957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dde5f-4b20-444a-ad68-1f649853cef2 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:45.262160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:45.263190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:45.263639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:45.264278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:45.266497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:45.398062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:45.401022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:45.492517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3896/7712] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:46.702937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:46.703537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:46.703754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:46.728887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] MFA Rules not processed for user `1d343c69635a4412bf9ffcd9dec5c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:22:46.732528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:46.742002 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3817/7713] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:22:53.532362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:53.533977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:53.677422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f2f2-1201-4625-b67c-9b0cd6a42c55 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:53.683233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:53.684960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:53.686574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:53.689374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:53.691917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:53.713141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:53.714924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:53.746291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3897/7714] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:22:58.399708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:22:58.401834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:58.471570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e338f-0ead-41cc-ad14-5f9c12332d9e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:22:58.476043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebe179-e1b2-449a-ac34-e52afb019816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:22:58.476981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebe179-e1b2-449a-ac34-e52afb019816 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:22:58.477621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebe179-e1b2-449a-ac34-e52afb019816 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:22:58.478106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebe179-e1b2-449a-ac34-e52afb019816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:22:58.480429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d6ebe179-e1b2-449a-ac34-e52afb019816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:22:58.499461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebe179-e1b2-449a-ac34-e52afb019816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:22:58.501255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebe179-e1b2-449a-ac34-e52afb019816 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:22:58.528228 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3818/7715] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:03.710637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:03.712315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:03.870980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcd4-42d4-4d48-8c25-c9764cebd57b service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:03.875588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:03.876489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:03.876762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:03.877346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] PATH_INFO: `/v3/users/cb31ef3b238e4b579589cd3e84e0aaec` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:03.879099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb31ef3b238e4b579589cd3e84e0aaec)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:03.880504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:03.963616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb31ef3b238e4b579589cd3e84e0aaec'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:03.964493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb31ef3b238e4b579589cd3e84e0aaec'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:03.981684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb31ef3b238e4b579589cd3e84e0aaec'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:03.998635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb31ef3b238e4b579589cd3e84e0aaec'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:04.000636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb31ef3b238e4b579589cd3e84e0aaec'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:04.020015 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3898/7716] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:03 2022] DELETE /identity/v3/users/cb31ef3b238e4b579589cd3e84e0aaec => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:04.024551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779230-f492-4ea7-8ea9-2aba2c150c66 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.025296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779230-f492-4ea7-8ea9-2aba2c150c66 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.025404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779230-f492-4ea7-8ea9-2aba2c150c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.045938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f6779230-f492-4ea7-8ea9-2aba2c150c66 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:04.047727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f6779230-f492-4ea7-8ea9-2aba2c150c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:04.138040 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3819/7717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:04.147984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:04.149838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:04.248180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a5951-199e-41e4-8aad-a7be5612e9af admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:04.248180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:04.248180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.248180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.248666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.253362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e869e2d-945f-4aee-bb9d-a04c6f14901c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.253645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e869e2d-945f-4aee-bb9d-a04c6f14901c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.253919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e869e2d-945f-4aee-bb9d-a04c6f14901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.260699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:04.262477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:04.276458 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3899/7718] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:04.298706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5e869e2d-945f-4aee-bb9d-a04c6f14901c None None] MFA Rules not processed for user `1d343c69635a4412bf9ffcd9dec5c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:04.301883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e869e2d-945f-4aee-bb9d-a04c6f14901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:04.402851 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3820/7719] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:04.521311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:04.523320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:04.540713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a414-4019-4420-8f8a-24bbe47246e8 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:04.546732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:04.547543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.548246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.548246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] PATH_INFO: `/v3/projects/398c3ad38c5e41ceb8024cd8ba5fec34` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.553471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=398c3ad38c5e41ceb8024cd8ba5fec34)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:04.556082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:04.638350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398c3ad38c5e41ceb8024cd8ba5fec34', 'request_id': 'req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:04.646476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398c3ad38c5e41ceb8024cd8ba5fec34', 'request_id': 'req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:04.662763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398c3ad38c5e41ceb8024cd8ba5fec34', 'request_id': 'req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:04.679262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] The token cache is being invalidate because project 398c3ad38c5e41ceb8024cd8ba5fec34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:04.679708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:04.680545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-8e9a101b-fb6e-4aab-9e35-2b1a4a02d7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:04.682790 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3900/7720] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:04 2022] DELETE /identity/v3/projects/398c3ad38c5e41ceb8024cd8ba5fec34 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:04.687667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac37ea-1930-4dc6-907b-1b2190c82b2e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.688176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac37ea-1930-4dc6-907b-1b2190c82b2e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.688652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac37ea-1930-4dc6-907b-1b2190c82b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.730955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-74ac37ea-1930-4dc6-907b-1b2190c82b2e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:04.732597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-74ac37ea-1930-4dc6-907b-1b2190c82b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:04.810942 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3821/7721] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:04.818700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1bbb-1ff5-4613-8f9d-666c7c82401e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.819290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1bbb-1ff5-4613-8f9d-666c7c82401e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.819290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1bbb-1ff5-4613-8f9d-666c7c82401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.844584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-799d1bbb-1ff5-4613-8f9d-666c7c82401e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:04.847308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-799d1bbb-1ff5-4613-8f9d-666c7c82401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:04.861469 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3901/7722] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:04.865718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac37ea-1930-4dc6-907b-1b2190c82b2e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:04.878569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac37ea-1930-4dc6-907b-1b2190c82b2e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:04.887207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:04.887897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.888177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.888455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.889724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:23:04.890034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:04.891667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:04.916429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d1bbb-1ff5-4613-8f9d-666c7c82401e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:04.921728 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3822/7723] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:23:04.927635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d1bbb-1ff5-4613-8f9d-666c7c82401e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:04.933435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:04.934151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:04.934437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:04.934715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:04.935421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:04.937521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:04.983471 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3902/7724] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:04 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:04.985545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:04.997121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca00cb-ec5e-457d-ac2c-34bb3cde4a5f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:05.080513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:05.081794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:05.082323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:05.082802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:05.083559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:05.085618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:05.116025 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3823/7725] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:04 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:05.120053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:05.133847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440096-1174-48a0-ae59-666b95abbf70 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:05.141682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:05.143335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:05.144136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:05.144654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:05.145685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:05.147896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:05.165362 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3903/7726] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:05.166857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:05.180171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffec4d2-190a-41ac-b928-b4002bc31f06 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:05.199357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90d8ef-2e66-4538-971f-0f0d173d3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:05.200368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d8ef-2e66-4538-971f-0f0d173d3048 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:05.200856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d8ef-2e66-4538-971f-0f0d173d3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:05.201373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d8ef-2e66-4538-971f-0f0d173d3048 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:05.202286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90d8ef-2e66-4538-971f-0f0d173d3048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:05.204012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90d8ef-2e66-4538-971f-0f0d173d3048 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:05.216090 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3824/7727] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:05.220395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:05.238756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6a41-1fef-4bae-94c7-08de7fb6d487 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:05.245662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:05.247083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:05.247524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:05.247840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] PATH_INFO: `/v3/projects/0ab4ca683f044653b22a48be71d6f849/users/64bc40acb6c94d3ea5f3c0a6d6409c09/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:05.267502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab4ca683f044653b22a48be71d6f849, user_id=64bc40acb6c94d3ea5f3c0a6d6409c09, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:05.270981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:05.307171 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3904/7728] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:05 2022] PUT /identity/v3/projects/0ab4ca683f044653b22a48be71d6f849/users/64bc40acb6c94d3ea5f3c0a6d6409c09/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:23:05.309932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04ceb5-7413-44db-82b1-e0f953f5fe87 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:05.310228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04ceb5-7413-44db-82b1-e0f953f5fe87 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:05.310505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04ceb5-7413-44db-82b1-e0f953f5fe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:05.358759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ae04ceb5-7413-44db-82b1-e0f953f5fe87 None None] MFA Rules not processed for user `64bc40acb6c94d3ea5f3c0a6d6409c09`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:05.364351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ae04ceb5-7413-44db-82b1-e0f953f5fe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:05.589651 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3825/7729] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:05.603217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:05.605208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:05.681626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdee5-6027-4d79-b5f2-22f738869b11 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:05.686721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ac1a1-8256-4285-9786-822a11cb5938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:05.687408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac1a1-8256-4285-9786-822a11cb5938 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:05.687672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac1a1-8256-4285-9786-822a11cb5938 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:05.687943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac1a1-8256-4285-9786-822a11cb5938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:05.700704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ac1a1-8256-4285-9786-822a11cb5938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:05.702287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ac1a1-8256-4285-9786-822a11cb5938 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:05.714912 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3905/7730] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:05.730899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04ceb5-7413-44db-82b1-e0f953f5fe87 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:05.845447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04ceb5-7413-44db-82b1-e0f953f5fe87 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:05.860165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:05.862022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:05.862345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:05.862570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] PATH_INFO: `/v3/users/64bc40acb6c94d3ea5f3c0a6d6409c09` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:05.864153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bc40acb6c94d3ea5f3c0a6d6409c09)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:05.866609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:05.992893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bc40acb6c94d3ea5f3c0a6d6409c09'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:05.994870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bc40acb6c94d3ea5f3c0a6d6409c09'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:06.006457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bc40acb6c94d3ea5f3c0a6d6409c09'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:06.007268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bc40acb6c94d3ea5f3c0a6d6409c09'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:06.023781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bc40acb6c94d3ea5f3c0a6d6409c09'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:06.049516 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3826/7731] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:05 2022] DELETE /identity/v3/users/64bc40acb6c94d3ea5f3c0a6d6409c09 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:06.050912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:06.051439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:06.054392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:06.090869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:06.097281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:06.203000 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3906/7732] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:06.211108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:06.213551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:06.294433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221505-16e6-4625-a64e-1048a2b04807 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:06.298771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732f7ff-99d1-4e60-a6c3-7e0e1f2e6767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:06.299442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f7ff-99d1-4e60-a6c3-7e0e1f2e6767 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:06.299819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f7ff-99d1-4e60-a6c3-7e0e1f2e6767 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:06.300165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f7ff-99d1-4e60-a6c3-7e0e1f2e6767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:06.338070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732f7ff-99d1-4e60-a6c3-7e0e1f2e6767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:06.339641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732f7ff-99d1-4e60-a6c3-7e0e1f2e6767 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:06.361089 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3827/7733] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:23:06.951463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:06.953286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:06.989520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f13a3-9ec1-4ca7-a78c-afeb41bc2169 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:07.000172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:07.001587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.002453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.003296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] PATH_INFO: `/v3/projects/0ab4ca683f044653b22a48be71d6f849` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.005051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab4ca683f044653b22a48be71d6f849)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:07.007259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:07.081312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab4ca683f044653b22a48be71d6f849', 'request_id': 'req-c73405dd-dba6-4c9c-9132-0e03330af4be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:07.100983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab4ca683f044653b22a48be71d6f849', 'request_id': 'req-c73405dd-dba6-4c9c-9132-0e03330af4be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:07.117075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab4ca683f044653b22a48be71d6f849', 'request_id': 'req-c73405dd-dba6-4c9c-9132-0e03330af4be'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:07.151353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] The token cache is being invalidate because project 0ab4ca683f044653b22a48be71d6f849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:07.151639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:07.152371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c73405dd-dba6-4c9c-9132-0e03330af4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:07.157488 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3907/7734] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:06 2022] DELETE /identity/v3/projects/0ab4ca683f044653b22a48be71d6f849 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:07.159416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8ca3e-5b78-4663-8103-64f1369a413f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.160658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8ca3e-5b78-4663-8103-64f1369a413f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.161077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8ca3e-5b78-4663-8103-64f1369a413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.199292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8fa8ca3e-5b78-4663-8103-64f1369a413f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:07.200656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8fa8ca3e-5b78-4663-8103-64f1369a413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:07.275099 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3828/7735] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:07.277747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4630-c42e-4de3-99ba-ee312e871666 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.278065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4630-c42e-4de3-99ba-ee312e871666 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.278341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4630-c42e-4de3-99ba-ee312e871666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.298493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-da1b4630-c42e-4de3-99ba-ee312e871666 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:07.300041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-da1b4630-c42e-4de3-99ba-ee312e871666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:07.309421 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3908/7736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:07.313425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8ca3e-5b78-4663-8103-64f1369a413f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:07.326779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8ca3e-5b78-4663-8103-64f1369a413f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:07.333417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:07.334615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.335992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.336715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.337731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:23:07.338227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:07.340154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:07.357079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3829/7737] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:23:07.360273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4630-c42e-4de3-99ba-ee312e871666 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:07.376435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4630-c42e-4de3-99ba-ee312e871666 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:07.382779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:07.383754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.384270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.385017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.386608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:07.389321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:07.437179 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3909/7738] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:07 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:23:07.441642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:07.459901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ce797-bf98-4432-8594-760a73e8cb36 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:07.635331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:07.636062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.636345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.636613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.637334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:07.644733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:07.695846 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3830/7739] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:07 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:07.699714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:07.716003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c25ba3-ef60-4d0b-8268-b9687bceac0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:07.735411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:07.738389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.738681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.738963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.739720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:07.748919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:07.789892 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3910/7740] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:07.794020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:07.809685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e29db-3feb-40d3-b397-076b9be782fe admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:07.821541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5a73d-3f3f-4c9a-8364-102dad5e690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:07.822498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5a73d-3f3f-4c9a-8364-102dad5e690b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.823179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5a73d-3f3f-4c9a-8364-102dad5e690b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.823639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5a73d-3f3f-4c9a-8364-102dad5e690b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.826998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5a73d-3f3f-4c9a-8364-102dad5e690b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:07.830278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5a73d-3f3f-4c9a-8364-102dad5e690b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:07.858769 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3831/7741] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:23:07.859740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:07.874407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0f50-7e32-4836-982f-735db09ad935 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:07.886875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:07.891203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.891494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.891779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] PATH_INFO: `/v3/projects/2bed3b56e7a346f3acc2697a240e8cb4/users/b9b9ac65d6d9460c8d6a7307a5da4aca/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:07.933486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bed3b56e7a346f3acc2697a240e8cb4, user_id=b9b9ac65d6d9460c8d6a7307a5da4aca, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:07.936270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:07.964730 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3911/7742] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:07 2022] PUT /identity/v3/projects/2bed3b56e7a346f3acc2697a240e8cb4/users/b9b9ac65d6d9460c8d6a7307a5da4aca/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:23:07.975468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e595a6-71af-46df-acad-98688c93799e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:07.975793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e595a6-71af-46df-acad-98688c93799e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:07.976023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e595a6-71af-46df-acad-98688c93799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:08.009972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-16e595a6-71af-46df-acad-98688c93799e None None] MFA Rules not processed for user `b9b9ac65d6d9460c8d6a7307a5da4aca`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:08.011199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-16e595a6-71af-46df-acad-98688c93799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:08.103744 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3832/7743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:08.114750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:08.117443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:08.185829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d75a8-a8dd-47be-bd16-4022e22355db admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:08.191529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:08.192426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:08.192895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:08.193378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:08.203291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:08.204789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:08.227284 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3912/7744] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:09.048457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:09.049011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:09.049011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:09.072201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:09.073456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:09.149690 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3833/7745] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:23:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:09.163195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:09.164732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:09.248861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1f61c-5b60-4b6b-8ed9-446a373ee4a1 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:09.254541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:09.255203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:09.255483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:09.255753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:09.269193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:09.271481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:09.282288 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3913/7746] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:23:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:23:09.944915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:09.946504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:10.031184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41fc46-4077-4258-b006-0a05b9dc3aec None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:10.037738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:10.038455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:10.038750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:10.039057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:10.041380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:10.139414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:10.141711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:10.153555 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3834/7747] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:23:11.480831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:11.482351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:11.554407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd477b-8375-4cb6-8dc4-073c8bd2e10e service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:11.559694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:11.560670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:11.560925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:11.561257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] PATH_INFO: `/v3/users/7c0b068a444b461cb5190024544c1291` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:11.562498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0b068a444b461cb5190024544c1291)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:11.564637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:11.627835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0b068a444b461cb5190024544c1291'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:11.629001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0b068a444b461cb5190024544c1291'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:11.638778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0b068a444b461cb5190024544c1291'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:11.651898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0b068a444b461cb5190024544c1291'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:11.652627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0b068a444b461cb5190024544c1291'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:11.672129 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3914/7748] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:11 2022] DELETE /identity/v3/users/7c0b068a444b461cb5190024544c1291 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:11.951607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:11.962513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed16348-f2bd-487c-8722-4dc6556d1d53 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:12.037045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:12.037991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:12.038270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:12.038661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] PATH_INFO: `/v3/projects/4542400bc91449e09c44d33b478c731e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:12.040240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4542400bc91449e09c44d33b478c731e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:12.042371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:12.093282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4542400bc91449e09c44d33b478c731e', 'request_id': 'req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:12.098640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4542400bc91449e09c44d33b478c731e', 'request_id': 'req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:12.106039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4542400bc91449e09c44d33b478c731e', 'request_id': 'req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:12.118048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] The token cache is being invalidate because project 4542400bc91449e09c44d33b478c731e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:12.118395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:12.119054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9ff36787-9fa2-4d3d-8cc0-630dc01f448f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:12.121787 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3835/7749] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:11 2022] DELETE /identity/v3/projects/4542400bc91449e09c44d33b478c731e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:13.478404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:13.480238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:13.495830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dbedc-9912-4cb8-b68f-002e9be45658 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:13.556433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:13.557364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:13.557643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:13.557918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] PATH_INFO: `/v3/users/b9b9ac65d6d9460c8d6a7307a5da4aca` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:13.559179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b9ac65d6d9460c8d6a7307a5da4aca)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:13.561228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:13.610985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b9ac65d6d9460c8d6a7307a5da4aca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:13.611615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b9ac65d6d9460c8d6a7307a5da4aca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:13.618386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b9ac65d6d9460c8d6a7307a5da4aca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:13.627700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b9ac65d6d9460c8d6a7307a5da4aca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:13.628400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b9ac65d6d9460c8d6a7307a5da4aca'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:13.645673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3915/7750] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:13 2022] DELETE /identity/v3/users/b9b9ac65d6d9460c8d6a7307a5da4aca => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:13.650239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:13.650766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:13.650766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:13.669746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:13.670956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:13.732205 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3836/7751] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:13.742113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:13.743789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:13.803542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81f1b4-8b65-42cf-a6d8-eba0208369f4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:13.807675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeee26-e41c-40d4-9c87-20f2d92a72bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:13.808343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeee26-e41c-40d4-9c87-20f2d92a72bf service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:13.808624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeee26-e41c-40d4-9c87-20f2d92a72bf service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:13.808901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeee26-e41c-40d4-9c87-20f2d92a72bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:13.819108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeee26-e41c-40d4-9c87-20f2d92a72bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:13.820602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeee26-e41c-40d4-9c87-20f2d92a72bf service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:13.830794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3916/7752] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:14.010122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.011612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:14.027399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2703897-edd2-4581-bd87-c7090ce16259 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.034076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.034972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.035321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.035493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] PATH_INFO: `/v3/projects/2bed3b56e7a346f3acc2697a240e8cb4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.036851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bed3b56e7a346f3acc2697a240e8cb4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.038960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.088322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bed3b56e7a346f3acc2697a240e8cb4', 'request_id': 'req-7595bdc9-b305-4549-be26-92565122bcaa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:14.094546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bed3b56e7a346f3acc2697a240e8cb4', 'request_id': 'req-7595bdc9-b305-4549-be26-92565122bcaa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:14.103982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bed3b56e7a346f3acc2697a240e8cb4', 'request_id': 'req-7595bdc9-b305-4549-be26-92565122bcaa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:14.116027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] The token cache is being invalidate because project 2bed3b56e7a346f3acc2697a240e8cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:14.116315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:14.116986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-7595bdc9-b305-4549-be26-92565122bcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:14.118697 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3837/7753] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:14 2022] DELETE /identity/v3/projects/2bed3b56e7a346f3acc2697a240e8cb4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:14.123835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb798-a233-41d4-b458-63f0c887756d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.124174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb798-a233-41d4-b458-63f0c887756d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.124519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb798-a233-41d4-b458-63f0c887756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.144249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1f0bb798-a233-41d4-b458-63f0c887756d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:14.145918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1f0bb798-a233-41d4-b458-63f0c887756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:14.213864 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3917/7754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:14.223980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3a19-35e0-43fd-86c1-4e3258a3b9b2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.224354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3a19-35e0-43fd-86c1-4e3258a3b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.224628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3a19-35e0-43fd-86c1-4e3258a3b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.243395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fcea3a19-35e0-43fd-86c1-4e3258a3b9b2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:14.244607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fcea3a19-35e0-43fd-86c1-4e3258a3b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:14.252945 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3838/7755] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:14.257466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bb798-a233-41d4-b458-63f0c887756d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.267503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bb798-a233-41d4-b458-63f0c887756d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.272134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.272807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.273121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.273451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.274164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:23:14.274495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.276131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.288694 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3918/7756] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:23:14.292983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea3a19-35e0-43fd-86c1-4e3258a3b9b2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.302831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea3a19-35e0-43fd-86c1-4e3258a3b9b2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.307766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.308435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.308787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.309068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.309808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.311733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.341745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3839/7757] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:14 2022] POST /identity/v3/projects => generated 351 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:14.343664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.353897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2e65-c103-42f9-84d0-e8a7d4e1a41c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.418624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.419332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.419611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.419890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.420579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.422683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.448397 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3919/7758] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:14 2022] POST /identity/v3/users => generated 276 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:14.452514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.463529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034cb1-0db7-4f80-bcb7-714c0db0f61c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.468591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.469305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.469590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.469867 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.470604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.472214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.483991 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3840/7759] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:14.488412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.499629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a50e5-7227-444f-8556-04c62503ec89 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.504412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f5ca8-0a08-4261-8f25-21b3f30cb210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.505164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f5ca8-0a08-4261-8f25-21b3f30cb210 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.505605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f5ca8-0a08-4261-8f25-21b3f30cb210 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.505884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f5ca8-0a08-4261-8f25-21b3f30cb210 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.506608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f5ca8-0a08-4261-8f25-21b3f30cb210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.508245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f5ca8-0a08-4261-8f25-21b3f30cb210 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.518554 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3920/7760] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:23:14.522734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.533130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede41918-d246-4455-9ded-368f6e6614c5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.537928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.538821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.539106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.539382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] PATH_INFO: `/v3/projects/cedfbffdedf54f67b754200f3786ec61/users/8b7dfb24865b43eabffea988c748b66d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.553910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedfbffdedf54f67b754200f3786ec61, user_id=8b7dfb24865b43eabffea988c748b66d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.556675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.571838 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3841/7761] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:14 2022] PUT /identity/v3/projects/cedfbffdedf54f67b754200f3786ec61/users/8b7dfb24865b43eabffea988c748b66d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:14.583509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb43d-95f0-4ed5-a4cc-d14f7e93409b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.583805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb43d-95f0-4ed5-a4cc-d14f7e93409b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.584063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb43d-95f0-4ed5-a4cc-d14f7e93409b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.611930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bdcfb43d-95f0-4ed5-a4cc-d14f7e93409b None None] MFA Rules not processed for user `8b7dfb24865b43eabffea988c748b66d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:14.613196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bdcfb43d-95f0-4ed5-a4cc-d14f7e93409b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:14.680973 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3921/7762] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:14.691181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:14.693173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:14.782626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e210f-444f-4394-8660-b21b8c3abcef admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:14.787602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe531a-cc61-4df0-8be0-64d328946def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:14.788248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe531a-cc61-4df0-8be0-64d328946def service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:14.788524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe531a-cc61-4df0-8be0-64d328946def service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:14.788815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe531a-cc61-4df0-8be0-64d328946def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:14.798636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe531a-cc61-4df0-8be0-64d328946def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:14.800105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe531a-cc61-4df0-8be0-64d328946def service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:14.809281 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3842/7763] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:14 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:16.320098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb43d-95f0-4ed5-a4cc-d14f7e93409b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:16.389890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb43d-95f0-4ed5-a4cc-d14f7e93409b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:16.394774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:16.395979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:16.396261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:16.396534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] PATH_INFO: `/v3/users/8b7dfb24865b43eabffea988c748b66d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:16.397980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7dfb24865b43eabffea988c748b66d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:16.400075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:16.519208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7dfb24865b43eabffea988c748b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:16.519208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7dfb24865b43eabffea988c748b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:16.519208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7dfb24865b43eabffea988c748b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:16.519208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7dfb24865b43eabffea988c748b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:16.519208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7dfb24865b43eabffea988c748b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:16.524292 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3922/7764] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:16 2022] DELETE /identity/v3/users/8b7dfb24865b43eabffea988c748b66d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:16.528988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:16.529489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:16.529701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:16.547362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:16.548676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:16.607828 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3843/7765] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:16.617193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:16.618632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:16.679295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b980ff-93b2-4ac8-9952-bf03753ab7b1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:16.683447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2709d-f342-4bf9-a29e-54db5e6549c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:16.684184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2709d-f342-4bf9-a29e-54db5e6549c9 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:16.684471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2709d-f342-4bf9-a29e-54db5e6549c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:16.684761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2709d-f342-4bf9-a29e-54db5e6549c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:16.697065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2709d-f342-4bf9-a29e-54db5e6549c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:16.699296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2709d-f342-4bf9-a29e-54db5e6549c9 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:16.713811 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3923/7766] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:16.906809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:16.908337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:16.923773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42319f8-bb3c-4254-8078-16be1b832c32 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:16.929560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:16.930910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:16.931145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:16.931416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] PATH_INFO: `/v3/projects/cedfbffdedf54f67b754200f3786ec61` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:16.932606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedfbffdedf54f67b754200f3786ec61)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:16.934580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:16.981346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedfbffdedf54f67b754200f3786ec61', 'request_id': 'req-59a3d12a-2202-4a1f-b0fd-152a66258b73'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:16.988490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedfbffdedf54f67b754200f3786ec61', 'request_id': 'req-59a3d12a-2202-4a1f-b0fd-152a66258b73'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:16.998034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedfbffdedf54f67b754200f3786ec61', 'request_id': 'req-59a3d12a-2202-4a1f-b0fd-152a66258b73'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:17.009924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] The token cache is being invalidate because project cedfbffdedf54f67b754200f3786ec61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:17.010211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:17.010907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59a3d12a-2202-4a1f-b0fd-152a66258b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:17.012556 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3844/7767] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:16 2022] DELETE /identity/v3/projects/cedfbffdedf54f67b754200f3786ec61 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:17.018010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b4a7-2a76-4c0f-b3fd-8819accb0342 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.018299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b4a7-2a76-4c0f-b3fd-8819accb0342 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.018576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b4a7-2a76-4c0f-b3fd-8819accb0342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.037864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-84a5b4a7-2a76-4c0f-b3fd-8819accb0342 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:17.039079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-84a5b4a7-2a76-4c0f-b3fd-8819accb0342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:17.098308 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3924/7768] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:17.106647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb1e8c-8e5d-47ca-8571-6ff4acbab89c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.106935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb1e8c-8e5d-47ca-8571-6ff4acbab89c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.107208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb1e8c-8e5d-47ca-8571-6ff4acbab89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.128598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-addb1e8c-8e5d-47ca-8571-6ff4acbab89c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:17.129827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-addb1e8c-8e5d-47ca-8571-6ff4acbab89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:17.138356 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3845/7769] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:17.142675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5b4a7-2a76-4c0f-b3fd-8819accb0342 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.152521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5b4a7-2a76-4c0f-b3fd-8819accb0342 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.158172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.158839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.159243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.159520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.160245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:23:17.160535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.162228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.174831 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3925/7770] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:23:17.180951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb1e8c-8e5d-47ca-8571-6ff4acbab89c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.190261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb1e8c-8e5d-47ca-8571-6ff4acbab89c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.196217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.196876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.197198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.197463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.198149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.200063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.227028 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3846/7771] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:17 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:17.231198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.242193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443114b-f412-4e48-b6ed-585a9d0ec37a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.314068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.314757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.315035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.315305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.315988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.318059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.344000 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3926/7772] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:17 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:17.348868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.360924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3604-b16d-4c55-915e-f8ef67daf4e1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.366302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.367011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.367290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.367588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.368311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.369996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.380874 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3847/7773] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:17.384786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.395252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c550c-84eb-4535-918a-979b2235ecda admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.401012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ed91-77e0-42a8-93df-b030c1bc8b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.401714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ed91-77e0-42a8-93df-b030c1bc8b18 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.401994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ed91-77e0-42a8-93df-b030c1bc8b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.402249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ed91-77e0-42a8-93df-b030c1bc8b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.402969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ed91-77e0-42a8-93df-b030c1bc8b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.404595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ed91-77e0-42a8-93df-b030c1bc8b18 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.415644 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3927/7774] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:17.420041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.430355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31173a-de0a-4c0a-8a75-ce8d4cb6fa2b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.435612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.436442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.436724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.436995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] PATH_INFO: `/v3/projects/1e174490470347b2876f545c2ba2f532/users/1d04f26ec3c247adb0a62145486c496b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.456143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e174490470347b2876f545c2ba2f532, user_id=1d04f26ec3c247adb0a62145486c496b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.458871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.473903 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3848/7775] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:17 2022] PUT /identity/v3/projects/1e174490470347b2876f545c2ba2f532/users/1d04f26ec3c247adb0a62145486c496b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:17.566775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0885-66da-48b4-a0a0-8fc18ce926e6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.567563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0885-66da-48b4-a0a0-8fc18ce926e6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.567944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0885-66da-48b4-a0a0-8fc18ce926e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.602042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d29f0885-66da-48b4-a0a0-8fc18ce926e6 None None] MFA Rules not processed for user `1d04f26ec3c247adb0a62145486c496b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:17.603438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d29f0885-66da-48b4-a0a0-8fc18ce926e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:17.673848 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3928/7776] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:17.679525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.745053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2bdf4-255a-4c18-9923-987aa0ab9c21 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.750344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.750998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.751279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.751554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.752228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.754191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.782845 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3849/7777] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:17 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:17.787036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0885-66da-48b4-a0a0-8fc18ce926e6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.798058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0885-66da-48b4-a0a0-8fc18ce926e6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.857529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.858230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.858531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.858770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.859471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.861446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.884226 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3929/7778] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:17 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:17.888341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.900017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea13e4-230e-4caf-9e81-e11c5cdf6a38 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.905170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.905932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.906271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.906599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.907414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.909132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.920201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3850/7779] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:17.924626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.935204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca919f4-b17d-4ed2-b88f-f55a7743670b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:17.940214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:17.941266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:17.941398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:17.941685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] PATH_INFO: `/v3/projects/0c1b67a6eb224eb8a7c26036ec798725/users/55dc1fe9a78540398fbf11ebebe822db/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:17.957197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1b67a6eb224eb8a7c26036ec798725, user_id=55dc1fe9a78540398fbf11ebebe822db, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:17.959885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:17.975402 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3930/7780] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:17 2022] PUT /identity/v3/projects/0c1b67a6eb224eb8a7c26036ec798725/users/55dc1fe9a78540398fbf11ebebe822db/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:17.979324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:17.992493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dab404-bdeb-4f60-bb9c-0c9dd11cc123 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:18.050907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d964e-c85d-431e-a440-46ed15972201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:18.051666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d964e-c85d-431e-a440-46ed15972201 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:18.052017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d964e-c85d-431e-a440-46ed15972201 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:18.052379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d964e-c85d-431e-a440-46ed15972201 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:18.053209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d964e-c85d-431e-a440-46ed15972201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:18.054924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d964e-c85d-431e-a440-46ed15972201 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:18.065502 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3851/7781] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:18.069777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:18.080523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47761a04-257c-49ce-bc88-85402a6cb63a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:18.086151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:18.087082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:18.087371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:18.087634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] PATH_INFO: `/v3/projects/0c1b67a6eb224eb8a7c26036ec798725/users/55dc1fe9a78540398fbf11ebebe822db/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:18.089688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1b67a6eb224eb8a7c26036ec798725, user_id=55dc1fe9a78540398fbf11ebebe822db, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:18.093166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:18.103724 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3931/7782] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:18 2022] PUT /identity/v3/projects/0c1b67a6eb224eb8a7c26036ec798725/users/55dc1fe9a78540398fbf11ebebe822db/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:18.114048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851f5c2-1ed4-4980-bbe7-a2546c8da484 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:18.114354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851f5c2-1ed4-4980-bbe7-a2546c8da484 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:18.114634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851f5c2-1ed4-4980-bbe7-a2546c8da484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:18.143876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1851f5c2-1ed4-4980-bbe7-a2546c8da484 None None] MFA Rules not processed for user `55dc1fe9a78540398fbf11ebebe822db`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:18.145095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1851f5c2-1ed4-4980-bbe7-a2546c8da484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:18.216021 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3852/7783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:18.229800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:18.231751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:18.291563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99b24-cd25-4449-a2d8-138df17cc69d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:18.295294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dd3a7-c8da-4afe-ab9b-ac0da7eb8389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:18.295952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd3a7-c8da-4afe-ab9b-ac0da7eb8389 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:18.296235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd3a7-c8da-4afe-ab9b-ac0da7eb8389 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:18.296506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd3a7-c8da-4afe-ab9b-ac0da7eb8389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:18.305872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dd3a7-c8da-4afe-ab9b-ac0da7eb8389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:18.307490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dd3a7-c8da-4afe-ab9b-ac0da7eb8389 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:18.318333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3932/7784] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:18.406099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851f5c2-1ed4-4980-bbe7-a2546c8da484 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:18.418396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851f5c2-1ed4-4980-bbe7-a2546c8da484 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:18.422147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:18.422880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:18.423248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:18.423592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:18.480245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:18.481825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:18.491350 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3853/7785] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:20.862810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59fbe9-2263-4612-b942-d691f0db43b4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:20.863259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59fbe9-2263-4612-b942-d691f0db43b4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:20.863369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59fbe9-2263-4612-b942-d691f0db43b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:20.881537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5b59fbe9-2263-4612-b942-d691f0db43b4 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:20.882738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5b59fbe9-2263-4612-b942-d691f0db43b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:20.945333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3933/7786] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:23:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:20.957881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:20.959291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:21.035325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54b237-fac0-4a21-96c7-dc57cc311138 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:21.040883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ce6e4-e08a-4292-9806-95f4edad279c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:21.041583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce6e4-e08a-4292-9806-95f4edad279c service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:21.041863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce6e4-e08a-4292-9806-95f4edad279c service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:21.042116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce6e4-e08a-4292-9806-95f4edad279c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:21.051001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ce6e4-e08a-4292-9806-95f4edad279c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:21.052611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ce6e4-e08a-4292-9806-95f4edad279c service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:21.061807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3854/7787] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:23:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:23:27.098097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59fbe9-2263-4612-b942-d691f0db43b4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:27.176851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59fbe9-2263-4612-b942-d691f0db43b4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:27.179493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:27.180530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:27.180876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:27.181256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] PATH_INFO: `/v3/users/1d04f26ec3c247adb0a62145486c496b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:27.182712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d04f26ec3c247adb0a62145486c496b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:27.184753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:27.237993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d04f26ec3c247adb0a62145486c496b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.238589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d04f26ec3c247adb0a62145486c496b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.245793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d04f26ec3c247adb0a62145486c496b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.255688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d04f26ec3c247adb0a62145486c496b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.256421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d04f26ec3c247adb0a62145486c496b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.277550 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3934/7788] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:27 2022] DELETE /identity/v3/users/1d04f26ec3c247adb0a62145486c496b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:27.282229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:27.282700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:27.282773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:27.303783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:27.304989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:27.374728 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3855/7789] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:27.385903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:27.387633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:27.462439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84563b8-2aba-4cd9-a9ad-4e390130dd27 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:27.466466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:27.467151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:27.467777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:27.468053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:27.478246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:27.479727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:27.490858 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3935/7790] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:27.828985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:27.830407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:27.845743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d8e9b-e801-4ee2-9e46-97ae3c45db7e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:27.850480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:27.851849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:27.851849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:27.852105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] PATH_INFO: `/v3/projects/1e174490470347b2876f545c2ba2f532` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:27.853330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e174490470347b2876f545c2ba2f532)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:27.855322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:27.913512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e174490470347b2876f545c2ba2f532', 'request_id': 'req-b69e9ce4-bb50-4363-8f73-08bbf61af22f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.919102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e174490470347b2876f545c2ba2f532', 'request_id': 'req-b69e9ce4-bb50-4363-8f73-08bbf61af22f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.930921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e174490470347b2876f545c2ba2f532', 'request_id': 'req-b69e9ce4-bb50-4363-8f73-08bbf61af22f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.945510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] The token cache is being invalidate because project 1e174490470347b2876f545c2ba2f532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:27.945904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.948135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:27.953523 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3856/7791] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:27 2022] DELETE /identity/v3/projects/1e174490470347b2876f545c2ba2f532 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:23:27.954761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:27.965634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a0972-648b-40ff-ae93-25f3b42866e0 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:28.040341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:28.041603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:28.042019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:28.042450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] PATH_INFO: `/v3/users/55dc1fe9a78540398fbf11ebebe822db` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:28.045867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55dc1fe9a78540398fbf11ebebe822db)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:28.048374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:28.126722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55dc1fe9a78540398fbf11ebebe822db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.128218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55dc1fe9a78540398fbf11ebebe822db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.143897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55dc1fe9a78540398fbf11ebebe822db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.158247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55dc1fe9a78540398fbf11ebebe822db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.159307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad6fcd8a-990e-4cf7-a07f-9eb800b090d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55dc1fe9a78540398fbf11ebebe822db'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.211742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3936/7792] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:27 2022] DELETE /identity/v3/users/55dc1fe9a78540398fbf11ebebe822db => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:28.555466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:28.557110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:28.585427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9ce4-bb50-4363-8f73-08bbf61af22f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:28.653060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:28.654087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:28.654441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:28.654808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] PATH_INFO: `/v3/projects/0c1b67a6eb224eb8a7c26036ec798725` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:28.656047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1b67a6eb224eb8a7c26036ec798725)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:28.658015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:28.722906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1b67a6eb224eb8a7c26036ec798725', 'request_id': 'req-943b03cc-726d-4104-93ba-4d6513cf1cce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.729987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1b67a6eb224eb8a7c26036ec798725', 'request_id': 'req-943b03cc-726d-4104-93ba-4d6513cf1cce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.741767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1b67a6eb224eb8a7c26036ec798725', 'request_id': 'req-943b03cc-726d-4104-93ba-4d6513cf1cce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.756754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] The token cache is being invalidate because project 0c1b67a6eb224eb8a7c26036ec798725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:28.757147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.757935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-943b03cc-726d-4104-93ba-4d6513cf1cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:28.759875 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3857/7793] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:28 2022] DELETE /identity/v3/projects/0c1b67a6eb224eb8a7c26036ec798725 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:28.765327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df4512-6656-4676-8d9d-577fd6a1f846 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:28.765647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df4512-6656-4676-8d9d-577fd6a1f846 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:28.765927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df4512-6656-4676-8d9d-577fd6a1f846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:28.788632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-48df4512-6656-4676-8d9d-577fd6a1f846 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:28.789955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-48df4512-6656-4676-8d9d-577fd6a1f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:28.858961 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3937/7794] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:28.868193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bf65-15ae-4e9a-93a9-48f975ae23bc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:28.868480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bf65-15ae-4e9a-93a9-48f975ae23bc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:28.868786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bf65-15ae-4e9a-93a9-48f975ae23bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:28.889465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d716bf65-15ae-4e9a-93a9-48f975ae23bc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:28.890684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d716bf65-15ae-4e9a-93a9-48f975ae23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:28.900319 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3858/7795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:28.904115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df4512-6656-4676-8d9d-577fd6a1f846 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:28.914632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df4512-6656-4676-8d9d-577fd6a1f846 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:28.919499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:28.920234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:28.920468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:28.920740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:28.921511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:23:28.921847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:28.923461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:28.939805 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3938/7796] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:23:28.940779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716bf65-15ae-4e9a-93a9-48f975ae23bc None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:28.951265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716bf65-15ae-4e9a-93a9-48f975ae23bc None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:28.956550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:28.957630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:28.958078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:28.958414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:28.959174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:28.961196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.004794 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3859/7797] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:28 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:29.010130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.020512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1fc6-8a61-4c31-8e92-b85c6a75b697 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.089782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.090496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.090777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.091207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.091938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.094420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.122779 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3939/7798] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:29 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:29.124310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.138628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee564ac1-6ce4-4230-8d03-97cff10a65b1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.143698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.144402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.144681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.144954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.146573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.147400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.168693 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3860/7799] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:29.173455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.185617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcf7d8-a40b-4bc2-a344-ddc2e47649a2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.190667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87a0e4-3dbc-4be5-92d6-f45cf1e065a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.191392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a0e4-3dbc-4be5-92d6-f45cf1e065a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.191675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a0e4-3dbc-4be5-92d6-f45cf1e065a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.191949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a0e4-3dbc-4be5-92d6-f45cf1e065a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.192699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87a0e4-3dbc-4be5-92d6-f45cf1e065a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.194446 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87a0e4-3dbc-4be5-92d6-f45cf1e065a4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.206062 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3940/7800] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:29.213582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.224201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482b7cc-e9c2-4d3a-88bb-043953298d24 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.231606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.232531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.232837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.233245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] PATH_INFO: `/v3/projects/96d107dccfe94099bf6209223bd3e4d9/users/6ab957527fdc48f58b239b5755cc3084/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.248834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d107dccfe94099bf6209223bd3e4d9, user_id=6ab957527fdc48f58b239b5755cc3084, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.251555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.296953 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3861/7801] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:29 2022] PUT /identity/v3/projects/96d107dccfe94099bf6209223bd3e4d9/users/6ab957527fdc48f58b239b5755cc3084/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:29.307796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba76cca-d857-41ac-a1f2-2d331abc647d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.308107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba76cca-d857-41ac-a1f2-2d331abc647d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.308440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba76cca-d857-41ac-a1f2-2d331abc647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.337362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8ba76cca-d857-41ac-a1f2-2d331abc647d None None] MFA Rules not processed for user `6ab957527fdc48f58b239b5755cc3084`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:29.338593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8ba76cca-d857-41ac-a1f2-2d331abc647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:29.420879 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3941/7802] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:29.422000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.504602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8893b8-50b8-4c8c-a115-ca06d12555fd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.511011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.511890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.512166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.512439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.513172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.515138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.551681 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3862/7803] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:29 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:29.552225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba76cca-d857-41ac-a1f2-2d331abc647d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.565626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba76cca-d857-41ac-a1f2-2d331abc647d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.633837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.634529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.634808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.635081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.635772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.637852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.673886 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3942/7804] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:29 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:29.674075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.685169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c3b5-9436-4f4c-a97c-ca28f225ed54 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.690159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.690838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.691116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.691611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.692473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.694276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.706400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3863/7805] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:23:29.710989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.722538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b6d27-0333-40ba-9606-12f0a0b15310 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.728081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.729006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.729318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.729615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] PATH_INFO: `/v3/projects/ca4e357324c1471abc2e5c62271e9126/users/df6e8c3add0147259b8bd981ee77d4d0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.747981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4e357324c1471abc2e5c62271e9126, user_id=df6e8c3add0147259b8bd981ee77d4d0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.750839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.766723 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3943/7806] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:29 2022] PUT /identity/v3/projects/ca4e357324c1471abc2e5c62271e9126/users/df6e8c3add0147259b8bd981ee77d4d0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:29.772035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.787117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2978-dce4-4606-a5d6-b0e1e6cf6e57 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.845235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a47bc-109f-4409-b6e0-997e7953b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.845915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a47bc-109f-4409-b6e0-997e7953b7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.846197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a47bc-109f-4409-b6e0-997e7953b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.846474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a47bc-109f-4409-b6e0-997e7953b7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.847203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a47bc-109f-4409-b6e0-997e7953b7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.848822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a47bc-109f-4409-b6e0-997e7953b7f3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.859336 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3864/7807] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:29.863905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:29.874506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47187-7407-4232-94b8-af8a041ca1df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:29.879540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:29.880440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.880713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.881007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] PATH_INFO: `/v3/projects/ca4e357324c1471abc2e5c62271e9126/users/df6e8c3add0147259b8bd981ee77d4d0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.884185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4e357324c1471abc2e5c62271e9126, user_id=df6e8c3add0147259b8bd981ee77d4d0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:29.887024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:29.897808 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3944/7808] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:29 2022] PUT /identity/v3/projects/ca4e357324c1471abc2e5c62271e9126/users/df6e8c3add0147259b8bd981ee77d4d0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:23:29.908374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac18a-f30d-4a63-95a0-493618e146d0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:29.908374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac18a-f30d-4a63-95a0-493618e146d0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:29.908664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac18a-f30d-4a63-95a0-493618e146d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:29.935287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d84ac18a-f30d-4a63-95a0-493618e146d0 None None] MFA Rules not processed for user `df6e8c3add0147259b8bd981ee77d4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:29.936431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d84ac18a-f30d-4a63-95a0-493618e146d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:30.003200 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3865/7809] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:30.016563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:30.018649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:30.079376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd295e-51b0-41e3-8478-fcffdf74e299 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:30.083856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:30.084510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:30.084780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:30.085070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:30.095797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:30.097276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:30.107479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3945/7810] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:30.204105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac18a-f30d-4a63-95a0-493618e146d0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:30.216497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac18a-f30d-4a63-95a0-493618e146d0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:30.221510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a61f9-aba6-4334-a17e-353d366c1a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:30.222158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a61f9-aba6-4334-a17e-353d366c1a49 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:30.222437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a61f9-aba6-4334-a17e-353d366c1a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:30.222706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a61f9-aba6-4334-a17e-353d366c1a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:30.281464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a61f9-aba6-4334-a17e-353d366c1a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:30.282990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a61f9-aba6-4334-a17e-353d366c1a49 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:30.292554 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3866/7811] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:32.863559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:32.931798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c841b6-b9ff-4294-af8e-2328b5f7928f service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:32.937079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:32.937977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:32.938284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:32.938533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] PATH_INFO: `/v3/users/6ab957527fdc48f58b239b5755cc3084` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:32.939765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab957527fdc48f58b239b5755cc3084)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:32.941746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:32.990086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab957527fdc48f58b239b5755cc3084'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:32.990790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab957527fdc48f58b239b5755cc3084'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:32.997765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab957527fdc48f58b239b5755cc3084'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.007217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab957527fdc48f58b239b5755cc3084'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.008056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab957527fdc48f58b239b5755cc3084'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.025843 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3946/7812] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:32 2022] DELETE /identity/v3/users/6ab957527fdc48f58b239b5755cc3084 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:33.030508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:33.030990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:33.031074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:33.048118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:33.049355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:33.111200 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3867/7813] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:33.121599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:33.123044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:33.181698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0fcb-512d-482a-93da-ae9903bfde6d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:33.185627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:33.186296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:33.186574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:33.186845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:33.196231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:33.197737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:33.207907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3947/7814] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:33.564183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:33.565653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:33.579380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b2e7e-4b1e-4e7f-98d3-cec1ff6e851f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:33.584498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:33.587050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:33.587621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:33.587906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] PATH_INFO: `/v3/projects/96d107dccfe94099bf6209223bd3e4d9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:33.589520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d107dccfe94099bf6209223bd3e4d9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:33.591483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:33.644442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d107dccfe94099bf6209223bd3e4d9', 'request_id': 'req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.649967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d107dccfe94099bf6209223bd3e4d9', 'request_id': 'req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.658479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d107dccfe94099bf6209223bd3e4d9', 'request_id': 'req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.670365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] The token cache is being invalidate because project 96d107dccfe94099bf6209223bd3e4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:33.670660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.671516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.673384 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3868/7815] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:33 2022] DELETE /identity/v3/projects/96d107dccfe94099bf6209223bd3e4d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:33.677387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:33.687746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6abaec-05cb-49f8-ba95-e179b6d6bfa3 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:33.754179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:33.755084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:33.755370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:33.755673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] PATH_INFO: `/v3/users/df6e8c3add0147259b8bd981ee77d4d0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:33.756896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6e8c3add0147259b8bd981ee77d4d0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:33.759015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:33.807510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6e8c3add0147259b8bd981ee77d4d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.808172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6e8c3add0147259b8bd981ee77d4d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.815266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6e8c3add0147259b8bd981ee77d4d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.824372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6e8c3add0147259b8bd981ee77d4d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.824982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4f78abb0-fd4c-4b95-aa2d-ee1c4b1636e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6e8c3add0147259b8bd981ee77d4d0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:33.844538 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3948/7816] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:33 2022] DELETE /identity/v3/users/df6e8c3add0147259b8bd981ee77d4d0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:34.152358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.157470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:34.174705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bba4e-9b1b-477c-9747-d7cc064b50d6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.246125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.247012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.247311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.247583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] PATH_INFO: `/v3/projects/ca4e357324c1471abc2e5c62271e9126` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.248767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4e357324c1471abc2e5c62271e9126)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.250761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:34.303759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4e357324c1471abc2e5c62271e9126', 'request_id': 'req-a5301ccb-49b3-40d3-850e-a8816a663978'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:34.316330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4e357324c1471abc2e5c62271e9126', 'request_id': 'req-a5301ccb-49b3-40d3-850e-a8816a663978'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:34.326109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4e357324c1471abc2e5c62271e9126', 'request_id': 'req-a5301ccb-49b3-40d3-850e-a8816a663978'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:34.337923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] The token cache is being invalidate because project ca4e357324c1471abc2e5c62271e9126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:34.338223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:34.339166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5301ccb-49b3-40d3-850e-a8816a663978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:34.344878 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3869/7817] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:34 2022] DELETE /identity/v3/projects/ca4e357324c1471abc2e5c62271e9126 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:34.346694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0d039-bd97-4cce-9fc7-a4f41fdb0a8c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.347136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0d039-bd97-4cce-9fc7-a4f41fdb0a8c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.347310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0d039-bd97-4cce-9fc7-a4f41fdb0a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.369562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7fd0d039-bd97-4cce-9fc7-a4f41fdb0a8c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:34.370815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7fd0d039-bd97-4cce-9fc7-a4f41fdb0a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:34.435018 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3949/7818] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:34.444443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d18a61-db7e-4aeb-812a-c9a4e52337e0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.444931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d18a61-db7e-4aeb-812a-c9a4e52337e0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.445255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d18a61-db7e-4aeb-812a-c9a4e52337e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.467719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d9d18a61-db7e-4aeb-812a-c9a4e52337e0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:34.468927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d9d18a61-db7e-4aeb-812a-c9a4e52337e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:34.477857 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3870/7819] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:34.482296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0d039-bd97-4cce-9fc7-a4f41fdb0a8c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.492174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0d039-bd97-4cce-9fc7-a4f41fdb0a8c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.497024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.497787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.498071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.498348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.499125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:23:34.499609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.501612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:34.513424 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3950/7820] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:23:34.517809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d18a61-db7e-4aeb-812a-c9a4e52337e0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.527606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d18a61-db7e-4aeb-812a-c9a4e52337e0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.532816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.533501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.533891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.534440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.535132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.537068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:34.564319 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3871/7821] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:34 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:34.568423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.578911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a23b3-a49e-4094-80ee-8a814a04ea22 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.637836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.638526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.638809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.639084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.639813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.641859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:34.663951 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3951/7822] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:34 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:34.668209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.678781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2499-cd5c-4f2a-9d9e-2e33ec8bbfbd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.683791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.684459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.684734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.685007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.685757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.687367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:34.697975 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3872/7823] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:34.702160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.713516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d47a5-fde3-4f5a-9209-8ff95c4ceecd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.719789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249cadc-e516-44f8-8646-3ed2881f0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.720466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249cadc-e516-44f8-8646-3ed2881f0323 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.720773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249cadc-e516-44f8-8646-3ed2881f0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.721065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249cadc-e516-44f8-8646-3ed2881f0323 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.721843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249cadc-e516-44f8-8646-3ed2881f0323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.723486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249cadc-e516-44f8-8646-3ed2881f0323 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:34.733608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3952/7824] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:34.737858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.748057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd069a5-08aa-4366-982a-8bfdb99c1296 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.752966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.753860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.754143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.754421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] PATH_INFO: `/v3/projects/9651a59ae5d34821a7d10afe8a88a22d/users/218441e922cc491c9f3f0746bd50bae0/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.776051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9651a59ae5d34821a7d10afe8a88a22d, user_id=218441e922cc491c9f3f0746bd50bae0, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.778799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:34.795105 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3873/7825] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:34 2022] PUT /identity/v3/projects/9651a59ae5d34821a7d10afe8a88a22d/users/218441e922cc491c9f3f0746bd50bae0/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:34.805624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d6b4-e476-4515-8034-594bf604575b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.805918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d6b4-e476-4515-8034-594bf604575b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.806191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d6b4-e476-4515-8034-594bf604575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.833805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-be62d6b4-e476-4515-8034-594bf604575b None None] MFA Rules not processed for user `218441e922cc491c9f3f0746bd50bae0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:34.835077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-be62d6b4-e476-4515-8034-594bf604575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:34.903606 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3953/7826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:34.908887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:34.977774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493b7f7-eee0-43a7-963b-66509e749dca admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:34.983481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:34.984106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:34.984397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:34.984665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:34.985364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:34.987416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.015275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3874/7827] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:34 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:35.019496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d6b4-e476-4515-8034-594bf604575b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:35.030192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d6b4-e476-4515-8034-594bf604575b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:35.086483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:35.087373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.087653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.087928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.088643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:35.090697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.113864 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3954/7828] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:35 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:35.119485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:35.130111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3eb12-18f2-4831-8b75-c13b68d02ea0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:35.136013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:35.136676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.136952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.137253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.137970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:35.139576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.150645 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3875/7829] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:35.154619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:35.165318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6d843-9c08-45b8-932b-5b82b6c23c27 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:35.171265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:35.172159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.172437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.172708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] PATH_INFO: `/v3/projects/ae3a1b6b2d5e405e82494d6ba5716b81/users/78575a61cfb844a9b67a241e9ba54a1b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.188115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3a1b6b2d5e405e82494d6ba5716b81, user_id=78575a61cfb844a9b67a241e9ba54a1b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:35.192503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.207517 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3955/7830] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:35 2022] PUT /identity/v3/projects/ae3a1b6b2d5e405e82494d6ba5716b81/users/78575a61cfb844a9b67a241e9ba54a1b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:35.211633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:35.222853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404b25-90f6-419c-bf56-c7b3ab6a3c05 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:35.280239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638934c5-707e-4992-806e-d23014ccfbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:35.280832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638934c5-707e-4992-806e-d23014ccfbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.281136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638934c5-707e-4992-806e-d23014ccfbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.281427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638934c5-707e-4992-806e-d23014ccfbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.282144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638934c5-707e-4992-806e-d23014ccfbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:35.283883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638934c5-707e-4992-806e-d23014ccfbb4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.293951 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3876/7831] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:35.298355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:35.309476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf02c82-a584-404e-92e0-597cc4a78ba4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:35.315374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:35.316268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.316545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.316821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] PATH_INFO: `/v3/projects/ae3a1b6b2d5e405e82494d6ba5716b81/users/78575a61cfb844a9b67a241e9ba54a1b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.319099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3a1b6b2d5e405e82494d6ba5716b81, user_id=78575a61cfb844a9b67a241e9ba54a1b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:35.321913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.333346 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3956/7832] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:35 2022] PUT /identity/v3/projects/ae3a1b6b2d5e405e82494d6ba5716b81/users/78575a61cfb844a9b67a241e9ba54a1b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:35.344811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e7f65-323a-43d5-81dc-7b06a15b35f4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.345125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e7f65-323a-43d5-81dc-7b06a15b35f4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.345407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e7f65-323a-43d5-81dc-7b06a15b35f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.371881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-046e7f65-323a-43d5-81dc-7b06a15b35f4 None None] MFA Rules not processed for user `78575a61cfb844a9b67a241e9ba54a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:35.373088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-046e7f65-323a-43d5-81dc-7b06a15b35f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:35.449137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3877/7833] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:35.460993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:35.463098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:35.524704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd6acd-e557-4406-b4bf-fafd2ce029ff admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:35.528471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:35.529169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.529450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.529728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.538849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:35.540250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.550188 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3957/7834] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:35.634350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e7f65-323a-43d5-81dc-7b06a15b35f4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:35.646815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e7f65-323a-43d5-81dc-7b06a15b35f4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:35.651194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5934c3-53e5-4cb4-8413-c44a9cb1594c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:35.651843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5934c3-53e5-4cb4-8413-c44a9cb1594c service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:35.652118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5934c3-53e5-4cb4-8413-c44a9cb1594c service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:35.652385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5934c3-53e5-4cb4-8413-c44a9cb1594c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:35.710151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5934c3-53e5-4cb4-8413-c44a9cb1594c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:35.711688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5934c3-53e5-4cb4-8413-c44a9cb1594c service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:35.721568 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3878/7835] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:40.445487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:40.509320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6f4e-ad87-48a5-ba83-e5e727381f6c service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:40.514225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:40.515114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:40.515391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:40.515659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] PATH_INFO: `/v3/users/218441e922cc491c9f3f0746bd50bae0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:40.516964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] RBAC: Authorizing `identity:delete_user(user_id=218441e922cc491c9f3f0746bd50bae0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:40.518993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:40.570918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218441e922cc491c9f3f0746bd50bae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:40.571843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218441e922cc491c9f3f0746bd50bae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:40.580082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218441e922cc491c9f3f0746bd50bae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:40.588939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218441e922cc491c9f3f0746bd50bae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:40.589724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218441e922cc491c9f3f0746bd50bae0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:40.606945 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3958/7836] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:40 2022] DELETE /identity/v3/users/218441e922cc491c9f3f0746bd50bae0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:40.611703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:40.612181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:40.612266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:40.630041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:40.631258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:40.690517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3879/7837] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:40.700901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:40.702776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:40.765168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82d5be-0d05-41d9-939f-a01b6ca0586d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:40.769367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:40.770022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:40.770300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:40.770601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:40.780134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:40.781633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:40.791199 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3959/7838] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:41.087123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:41.088572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:41.101251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5835a-96fb-43a0-b344-2eca31dcbd02 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:41.107149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:41.108034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:41.108734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:41.108734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] PATH_INFO: `/v3/projects/9651a59ae5d34821a7d10afe8a88a22d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:41.110022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9651a59ae5d34821a7d10afe8a88a22d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:41.111979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:41.159845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9651a59ae5d34821a7d10afe8a88a22d', 'request_id': 'req-0003261c-5190-42b5-ab65-430fcf36e906'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.165016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9651a59ae5d34821a7d10afe8a88a22d', 'request_id': 'req-0003261c-5190-42b5-ab65-430fcf36e906'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.174095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9651a59ae5d34821a7d10afe8a88a22d', 'request_id': 'req-0003261c-5190-42b5-ab65-430fcf36e906'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.185464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] The token cache is being invalidate because project 9651a59ae5d34821a7d10afe8a88a22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:41.185750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.186408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.188033 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3880/7839] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:41 2022] DELETE /identity/v3/projects/9651a59ae5d34821a7d10afe8a88a22d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:41.192247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:41.202541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647968-46f4-469b-9ca8-8db9f34d97d5 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:41.263009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:41.263907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:41.264182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:41.264445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] PATH_INFO: `/v3/users/78575a61cfb844a9b67a241e9ba54a1b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:41.265755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=78575a61cfb844a9b67a241e9ba54a1b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:41.267742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:41.316829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78575a61cfb844a9b67a241e9ba54a1b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.317530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78575a61cfb844a9b67a241e9ba54a1b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.324644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78575a61cfb844a9b67a241e9ba54a1b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.333913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78575a61cfb844a9b67a241e9ba54a1b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.334566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7d29b41f-c37a-4d0e-b3e3-7b223a718dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78575a61cfb844a9b67a241e9ba54a1b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.353103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3960/7840] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:23:41 2022] DELETE /identity/v3/users/78575a61cfb844a9b67a241e9ba54a1b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:41.644847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:41.646962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:41.663312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003261c-5190-42b5-ab65-430fcf36e906 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:41.728141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:41.729020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:41.729399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:41.729591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] PATH_INFO: `/v3/projects/ae3a1b6b2d5e405e82494d6ba5716b81` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:41.730995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3a1b6b2d5e405e82494d6ba5716b81)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:41.732984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:41.780556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3a1b6b2d5e405e82494d6ba5716b81', 'request_id': 'req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.786165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3a1b6b2d5e405e82494d6ba5716b81', 'request_id': 'req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.795502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3a1b6b2d5e405e82494d6ba5716b81', 'request_id': 'req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.807700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] The token cache is being invalidate because project ae3a1b6b2d5e405e82494d6ba5716b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:23:41.807991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.808661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-14d385ed-3f1d-4aa7-92ec-e89c5ad7e3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:23:41.810389 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3881/7841] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:23:41 2022] DELETE /identity/v3/projects/ae3a1b6b2d5e405e82494d6ba5716b81 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:41.815632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d758d8a-75ee-423a-a0a5-6ce472b21e13 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:41.816083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d758d8a-75ee-423a-a0a5-6ce472b21e13 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:41.816190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d758d8a-75ee-423a-a0a5-6ce472b21e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:41.835769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6d758d8a-75ee-423a-a0a5-6ce472b21e13 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:41.836981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6d758d8a-75ee-423a-a0a5-6ce472b21e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:41.899393 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3961/7842] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:41.911751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53072830-0d91-41a9-b97c-1c80f0df5491 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:41.912032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53072830-0d91-41a9-b97c-1c80f0df5491 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:41.912325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53072830-0d91-41a9-b97c-1c80f0df5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:41.932135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-53072830-0d91-41a9-b97c-1c80f0df5491 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:41.933404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-53072830-0d91-41a9-b97c-1c80f0df5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:41.942148 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3882/7843] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:23:41.946488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d758d8a-75ee-423a-a0a5-6ce472b21e13 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:41.956351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d758d8a-75ee-423a-a0a5-6ce472b21e13 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:41.961335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:41.962019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:41.962272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:41.962546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:41.963288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:23:41.963587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:41.965257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:41.977502 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3962/7844] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:23:41.981948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53072830-0d91-41a9-b97c-1c80f0df5491 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:41.991352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53072830-0d91-41a9-b97c-1c80f0df5491 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:41.996472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:41.997157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:41.997434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:41.997702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:41.998375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.000274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.033169 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3883/7845] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:41 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:42.037884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.048566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849c1e-f52b-4512-a6f1-3a0ae8adaf87 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.107236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.107978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.108288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.108559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.109399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.111349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.134386 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3963/7846] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:42 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:23:42.138873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.149315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbd57-81c7-4850-82a7-4db100ae4ffe admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.154403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.155062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.155347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.155619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.156326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.157987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.168275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3884/7847] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:23:42.172661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.183951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3873f24-c73d-4bae-b625-e690b0ff34c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.188409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f91b2d-57f2-4568-8a19-8a7d89b8c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.189133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f91b2d-57f2-4568-8a19-8a7d89b8c7eb admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.189415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f91b2d-57f2-4568-8a19-8a7d89b8c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.189722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f91b2d-57f2-4568-8a19-8a7d89b8c7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.190435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f91b2d-57f2-4568-8a19-8a7d89b8c7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.192062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f91b2d-57f2-4568-8a19-8a7d89b8c7eb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.202163 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3964/7848] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:23:42.206558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.218169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376991df-49ee-4745-9b3e-d99e236fa442 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.223316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.224210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.224495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.224758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] PATH_INFO: `/v3/projects/7346ba2c9aef4d22ae03e0fa2bd3e7e1/users/f417c3f302d54800921c418c34e3d694/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.241021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7346ba2c9aef4d22ae03e0fa2bd3e7e1, user_id=f417c3f302d54800921c418c34e3d694, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.243800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.260478 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3885/7849] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:42 2022] PUT /identity/v3/projects/7346ba2c9aef4d22ae03e0fa2bd3e7e1/users/f417c3f302d54800921c418c34e3d694/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:42.271709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09f4c4-9fe7-4c5f-a07f-d9849a28e7d6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.272026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09f4c4-9fe7-4c5f-a07f-d9849a28e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.272402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09f4c4-9fe7-4c5f-a07f-d9849a28e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.302637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bd09f4c4-9fe7-4c5f-a07f-d9849a28e7d6 None None] MFA Rules not processed for user `f417c3f302d54800921c418c34e3d694`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:42.303837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bd09f4c4-9fe7-4c5f-a07f-d9849a28e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:42.368302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3965/7850] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:42.373249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.434373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da454c-e8b0-4858-a35f-9c254a2bc0f2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.439499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.440147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.440429 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.440699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.441400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.443315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.475024 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3886/7851] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:23:42 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:42.476099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09f4c4-9fe7-4c5f-a07f-d9849a28e7d6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.486688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09f4c4-9fe7-4c5f-a07f-d9849a28e7d6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.544084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.544754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.545061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.545365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.546071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.548086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.570408 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3966/7852] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:23:42 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:23:42.574708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.585332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71ce5-e325-4a0c-871a-b500045c5e98 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.590671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.592409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.592706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.592989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.593745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.595430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.609649 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3887/7853] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:42.610890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.621054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21dc14-e548-4349-83e8-c399e3763f7d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.626078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.626980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.627259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.627530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] PATH_INFO: `/v3/projects/def5ed4af2e9436b818fd79461b9583b/users/e94e63c192c84ad289c2c1cc617114ff/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.642230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] RBAC: Authorizing `identity:create_grant(project_id=def5ed4af2e9436b818fd79461b9583b, user_id=e94e63c192c84ad289c2c1cc617114ff, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.644908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.659333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3967/7854] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:42 2022] PUT /identity/v3/projects/def5ed4af2e9436b818fd79461b9583b/users/e94e63c192c84ad289c2c1cc617114ff/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:23:42.663390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.673715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408614e-15d9-48e5-819a-1f886b7f48b7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.731598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a8a6-8d40-4ee1-9763-07121ddb0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.732276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a8a6-8d40-4ee1-9763-07121ddb0f7e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.732571 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a8a6-8d40-4ee1-9763-07121ddb0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.732846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a8a6-8d40-4ee1-9763-07121ddb0f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.733592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7a8a6-8d40-4ee1-9763-07121ddb0f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.735191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7a8a6-8d40-4ee1-9763-07121ddb0f7e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.745004 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3888/7855] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:23:42.749559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.760639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bfb32-13f5-4ed1-9ab3-6bc33343306b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.765855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.766780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.767059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.767295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] PATH_INFO: `/v3/projects/def5ed4af2e9436b818fd79461b9583b/users/e94e63c192c84ad289c2c1cc617114ff/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.769406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] RBAC: Authorizing `identity:create_grant(project_id=def5ed4af2e9436b818fd79461b9583b, user_id=e94e63c192c84ad289c2c1cc617114ff, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:42.772074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:42.782255 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3968/7856] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:23:42 2022] PUT /identity/v3/projects/def5ed4af2e9436b818fd79461b9583b/users/e94e63c192c84ad289c2c1cc617114ff/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:23:42.793346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.793634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.793911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:42.820623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] MFA Rules not processed for user `e94e63c192c84ad289c2c1cc617114ff`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:42.821791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:42.888997 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3889/7857] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:42.900585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:42.902417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:42.964194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea3005-f207-4140-928f-c12c752a590a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:42.968697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:42.969368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:42.969625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:42.969892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:43.029219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:43.030782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:43.039863 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3969/7858] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:47.714599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:47.716291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:47.731753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb1d4-4c65-4af5-8972-c3a22c8c2efa None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:47.735945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d079-a9c3-46fe-b98b-38d362603167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:47.736594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d079-a9c3-46fe-b98b-38d362603167 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:47.736870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d079-a9c3-46fe-b98b-38d362603167 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:47.737190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d079-a9c3-46fe-b98b-38d362603167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:47.746939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d079-a9c3-46fe-b98b-38d362603167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:47.748318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d079-a9c3-46fe-b98b-38d362603167 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:47.758408 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3890/7859] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:49.320964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:49.322615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:49.398060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5ea2-d2ba-4404-bcfa-058f73fe5826 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:49.403470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:49.404144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:49.404399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:49.404673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:49.406604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:49.423719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:49.425498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:49.442478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3970/7860] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:23:51.557581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774cbe-baf8-40e9-88ca-363f77c81464 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:51.558017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774cbe-baf8-40e9-88ca-363f77c81464 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:51.558114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774cbe-baf8-40e9-88ca-363f77c81464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:51.576898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d5774cbe-baf8-40e9-88ca-363f77c81464 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:51.578175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d5774cbe-baf8-40e9-88ca-363f77c81464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:51.635408 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3891/7861] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:51.657751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:51.658919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:51.730030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7a75-d02e-4f66-8a04-4e34d40abd7a service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:51.735111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef1150-d4b4-4e6d-bf77-bdb3dc76273b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:51.735772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef1150-d4b4-4e6d-bf77-bdb3dc76273b service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:51.736081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef1150-d4b4-4e6d-bf77-bdb3dc76273b service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:51.736334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef1150-d4b4-4e6d-bf77-bdb3dc76273b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:51.744842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef1150-d4b4-4e6d-bf77-bdb3dc76273b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:51.746536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef1150-d4b4-4e6d-bf77-bdb3dc76273b service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:51.755010 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3971/7862] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:23:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:23:52.679254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688697-7f1d-451d-b31b-34f62ca4cadf None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:52.679734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688697-7f1d-451d-b31b-34f62ca4cadf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:52.679821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688697-7f1d-451d-b31b-34f62ca4cadf None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:52.685548 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3892/7863] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:23:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:23:52.692725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e354327-5f42-41aa-9271-8d458db9fd0a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:52.693276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e354327-5f42-41aa-9271-8d458db9fd0a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:52.693276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e354327-5f42-41aa-9271-8d458db9fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:52.734720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2e354327-5f42-41aa-9271-8d458db9fd0a None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:23:52.736674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2e354327-5f42-41aa-9271-8d458db9fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:23:52.766319 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3972/7864] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:23:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:23:52.787050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688697-7f1d-451d-b31b-34f62ca4cadf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:23:52.815527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688697-7f1d-451d-b31b-34f62ca4cadf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:23:52.821866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd57e5-bb0b-46a3-90cf-04c91176865c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:23:52.823058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd57e5-bb0b-46a3-90cf-04c91176865c service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:23:52.823406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd57e5-bb0b-46a3-90cf-04c91176865c service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:23:52.823782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd57e5-bb0b-46a3-90cf-04c91176865c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:23:52.837756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd57e5-bb0b-46a3-90cf-04c91176865c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:23:52.840898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd57e5-bb0b-46a3-90cf-04c91176865c service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:23:52.872074 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3893/7865] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:23:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:06.068467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e354327-5f42-41aa-9271-8d458db9fd0a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:06.148496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e354327-5f42-41aa-9271-8d458db9fd0a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:06.153137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:06.154047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:06.154463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:06.154749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] PATH_INFO: `/v3/users/f417c3f302d54800921c418c34e3d694` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:06.155952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f417c3f302d54800921c418c34e3d694)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:06.157965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:06.210811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f417c3f302d54800921c418c34e3d694'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.211525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f417c3f302d54800921c418c34e3d694'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.219304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f417c3f302d54800921c418c34e3d694'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.229584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f417c3f302d54800921c418c34e3d694'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.230245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f417c3f302d54800921c418c34e3d694'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.249159 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3973/7866] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:06 2022] DELETE /identity/v3/users/f417c3f302d54800921c418c34e3d694 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:06.254412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:06.254949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:06.255024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:06.276461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:06.277717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:06.340990 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3894/7867] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:24:06.353524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:06.355257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:06.418734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb594aa-83fb-4a20-be0b-436cbcaa9679 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:06.422640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:06.423313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:06.423593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:06.423867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:06.433933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:06.435407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:06.445999 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3974/7868] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:06.727027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:06.728535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:06.741928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ea3c-ad25-4e86-afcc-c4720883b13f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:06.747242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:06.748325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:06.748601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:06.748869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] PATH_INFO: `/v3/projects/7346ba2c9aef4d22ae03e0fa2bd3e7e1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:06.750168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7346ba2c9aef4d22ae03e0fa2bd3e7e1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:06.752538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:06.800509 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7346ba2c9aef4d22ae03e0fa2bd3e7e1', 'request_id': 'req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.806775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7346ba2c9aef4d22ae03e0fa2bd3e7e1', 'request_id': 'req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.817363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7346ba2c9aef4d22ae03e0fa2bd3e7e1', 'request_id': 'req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.829437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] The token cache is being invalidate because project 7346ba2c9aef4d22ae03e0fa2bd3e7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:06.829721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.830451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.832134 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3895/7869] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:06 2022] DELETE /identity/v3/projects/7346ba2c9aef4d22ae03e0fa2bd3e7e1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:24:06.836496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:06.848497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dffed-345d-4351-8c68-3c1d9a05f313 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:06.909841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:06.910959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:06.911353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:06.911629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] PATH_INFO: `/v3/users/e94e63c192c84ad289c2c1cc617114ff` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:06.912875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94e63c192c84ad289c2c1cc617114ff)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:06.914852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:06.962825 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94e63c192c84ad289c2c1cc617114ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.963614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94e63c192c84ad289c2c1cc617114ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.970838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94e63c192c84ad289c2c1cc617114ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.978516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94e63c192c84ad289c2c1cc617114ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.979137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-61b097d6-c89e-4501-b69a-cc32c61b9a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94e63c192c84ad289c2c1cc617114ff'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:06.995850 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3975/7870] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:06 2022] DELETE /identity/v3/users/e94e63c192c84ad289c2c1cc617114ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:24:07.295684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.297179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:07.310306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acbe98-9462-4eeb-8448-3b2f4c9b00a5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.370221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.371116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.371399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.371675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] PATH_INFO: `/v3/projects/def5ed4af2e9436b818fd79461b9583b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.372911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] RBAC: Authorizing `identity:delete_project(project_id=def5ed4af2e9436b818fd79461b9583b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.374851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.421806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def5ed4af2e9436b818fd79461b9583b', 'request_id': 'req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:07.427153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def5ed4af2e9436b818fd79461b9583b', 'request_id': 'req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:07.435481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def5ed4af2e9436b818fd79461b9583b', 'request_id': 'req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:07.448957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] The token cache is being invalidate because project def5ed4af2e9436b818fd79461b9583b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:07.449253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:07.449939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:07.451821 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3896/7871] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:07 2022] DELETE /identity/v3/projects/def5ed4af2e9436b818fd79461b9583b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:07.456950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e771-5cd0-4256-a2aa-13dede3b0654 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.457549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e771-5cd0-4256-a2aa-13dede3b0654 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.457662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e771-5cd0-4256-a2aa-13dede3b0654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.476871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4d50e771-5cd0-4256-a2aa-13dede3b0654 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:07.478041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d50e771-5cd0-4256-a2aa-13dede3b0654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:07.538742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3976/7872] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:07.541173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.542641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:07.546538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e15db-9647-4475-9421-246c2f249f08 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.546775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e15db-9647-4475-9421-246c2f249f08 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.547036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e15db-9647-4475-9421-246c2f249f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.567375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-886e15db-9647-4475-9421-246c2f249f08 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:07.568653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-886e15db-9647-4475-9421-246c2f249f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:07.577157 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3977/7873] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:24:07.581663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e15db-9647-4475-9421-246c2f249f08 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.591157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e15db-9647-4475-9421-246c2f249f08 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.596927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.597658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.597973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.598238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.598956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:24:07.599255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.600893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.604096 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6dde9-6755-4c0b-a8a8-b66f00b3845b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.607788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.608433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.608708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.608974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.610795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:07.613482 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3978/7874] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:24:07.617539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.623549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.625007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.626918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534716e1-cff1-48cc-8080-98bddec5f261 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.631869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.632623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.632907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.633320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.634016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.635202 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3897/7875] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:24:07.637892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.665891 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3979/7876] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:24:07 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:24:07.670285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.679997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe11b2-15b0-49b5-bace-ae6a8d4bd564 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.734284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.735247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.735525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.735781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.736490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.738504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.760834 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3898/7877] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:24:07 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:07.765226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.775581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db372eb-4c31-4d9a-9c52-414f9e97f9bd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.780425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.781209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.781554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.781895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.782691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.784410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.794733 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3980/7878] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:07.798869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.809134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41025-3924-4144-9792-7fbb5706fc9e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.813737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e41b5-f065-4e7d-a4e1-2651480b18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.814407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e41b5-f065-4e7d-a4e1-2651480b18c7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.814687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e41b5-f065-4e7d-a4e1-2651480b18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.814964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e41b5-f065-4e7d-a4e1-2651480b18c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.815715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e41b5-f065-4e7d-a4e1-2651480b18c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.817373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e41b5-f065-4e7d-a4e1-2651480b18c7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.827865 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3899/7879] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:07.833027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:07.846865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d8eaa-249a-499d-ae4d-94d4ebdfbc4f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:07.852644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:07.853635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.853915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.854176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] PATH_INFO: `/v3/projects/bd8288163d81458486ce15654fed24e3/users/e0ccd1099d6a4b148674add41fe48f28/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.869642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8288163d81458486ce15654fed24e3, user_id=e0ccd1099d6a4b148674add41fe48f28, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:07.872328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:07.886662 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3981/7880] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:24:07 2022] PUT /identity/v3/projects/bd8288163d81458486ce15654fed24e3/users/e0ccd1099d6a4b148674add41fe48f28/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:07.899022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3646b-469b-4d1e-931c-c16bda9d7567 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:07.899296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3646b-469b-4d1e-931c-c16bda9d7567 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:07.899598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3646b-469b-4d1e-931c-c16bda9d7567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:07.926401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d4a3646b-469b-4d1e-931c-c16bda9d7567 None None] MFA Rules not processed for user `e0ccd1099d6a4b148674add41fe48f28`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:07.927615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d4a3646b-469b-4d1e-931c-c16bda9d7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:07.991080 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3900/7881] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:07.995688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:08.055593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f3b08-ad05-4b70-a8f7-dd5348c27670 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:08.060658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:08.061376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.061656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.061928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.062614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:08.064551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:08.092039 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3982/7882] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:24:07 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:08.096264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3646b-469b-4d1e-931c-c16bda9d7567 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:08.107194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3646b-469b-4d1e-931c-c16bda9d7567 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:08.164706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:08.165430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.165711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.165985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.166678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:08.168654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:08.190166 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3901/7883] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:24:08 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:08.195420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:08.206760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e51c8-1293-43e5-a7ea-de5d3b3e55dd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:08.212740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:08.213733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.213733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.214001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.214690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:08.216348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:08.227643 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3983/7884] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:08.231824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:08.241920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea674-7b04-4961-b7ff-16369e8ee31e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:08.246563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:08.247481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.247758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.248034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] PATH_INFO: `/v3/projects/a1f91fc1fed74a2eaa3d597b3b5645c1/users/8ec34cc157714a2ba3f8f2298ca2d32c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.263226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f91fc1fed74a2eaa3d597b3b5645c1, user_id=8ec34cc157714a2ba3f8f2298ca2d32c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:08.265932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:08.280395 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3902/7885] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:24:08 2022] PUT /identity/v3/projects/a1f91fc1fed74a2eaa3d597b3b5645c1/users/8ec34cc157714a2ba3f8f2298ca2d32c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:24:08.284533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:08.295211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354a3c-3c3d-4923-bbba-cea37ade17ac admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:08.352977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c865-73ad-4f29-b7ec-156c15c2ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:08.353695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c865-73ad-4f29-b7ec-156c15c2ef49 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.353975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c865-73ad-4f29-b7ec-156c15c2ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.354314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c865-73ad-4f29-b7ec-156c15c2ef49 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.355049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2c865-73ad-4f29-b7ec-156c15c2ef49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:08.356708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2c865-73ad-4f29-b7ec-156c15c2ef49 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:08.369091 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3984/7886] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:24:08.371549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:08.382827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69ed89-b27b-4f19-a957-3de8b62c02d2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:08.388109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:08.389409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.389897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.390179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] PATH_INFO: `/v3/projects/a1f91fc1fed74a2eaa3d597b3b5645c1/users/8ec34cc157714a2ba3f8f2298ca2d32c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.392294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f91fc1fed74a2eaa3d597b3b5645c1, user_id=8ec34cc157714a2ba3f8f2298ca2d32c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:08.395248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:08.405925 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3903/7887] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:24:08 2022] PUT /identity/v3/projects/a1f91fc1fed74a2eaa3d597b3b5645c1/users/8ec34cc157714a2ba3f8f2298ca2d32c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:08.416453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.416708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.416985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.448230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] MFA Rules not processed for user `8ec34cc157714a2ba3f8f2298ca2d32c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:08.449519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:08.524939 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3985/7888] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:08.537510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:08.539482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:08.607714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19150790-9dc0-40a7-8cb1-34e5c3b7db76 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:08.612960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:08.613752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:08.614198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:08.614630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:08.673994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:08.675142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:08.685678 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3904/7889] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:10.760769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:10.762255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:10.856424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c86a3-1a51-4d46-a9cc-f343320aa417 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:10.860811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04450438-e611-47df-884d-08a870645b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:10.861734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450438-e611-47df-884d-08a870645b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:10.862011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450438-e611-47df-884d-08a870645b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:10.862278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450438-e611-47df-884d-08a870645b71 admin admin] PATH_INFO: `/v3/users/1d343c69635a4412bf9ffcd9dec5c13b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:10.863534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04450438-e611-47df-884d-08a870645b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d343c69635a4412bf9ffcd9dec5c13b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:10.865535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04450438-e611-47df-884d-08a870645b71 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:10.914104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-04450438-e611-47df-884d-08a870645b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d343c69635a4412bf9ffcd9dec5c13b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:10.914831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-04450438-e611-47df-884d-08a870645b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d343c69635a4412bf9ffcd9dec5c13b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:10.922506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-04450438-e611-47df-884d-08a870645b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d343c69635a4412bf9ffcd9dec5c13b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:10.932250 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-04450438-e611-47df-884d-08a870645b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d343c69635a4412bf9ffcd9dec5c13b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:10.932953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-04450438-e611-47df-884d-08a870645b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d343c69635a4412bf9ffcd9dec5c13b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:10.951169 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3986/7890] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:10 2022] DELETE /identity/v3/users/1d343c69635a4412bf9ffcd9dec5c13b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:11.134326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.147014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ea354-d1f1-4e7b-862e-8eb92626dfa2 service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.205919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.206795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.207073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.207343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] PATH_INFO: `/v3/projects/006419bf3bf84fd6807cd78e0ad59ef6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.208548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=006419bf3bf84fd6807cd78e0ad59ef6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.210493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.262184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006419bf3bf84fd6807cd78e0ad59ef6', 'request_id': 'req-8667beb1-e45a-42bf-ba59-262d755d47ff'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:11.268115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006419bf3bf84fd6807cd78e0ad59ef6', 'request_id': 'req-8667beb1-e45a-42bf-ba59-262d755d47ff'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:11.276978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006419bf3bf84fd6807cd78e0ad59ef6', 'request_id': 'req-8667beb1-e45a-42bf-ba59-262d755d47ff'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:11.288900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] The token cache is being invalidate because project 006419bf3bf84fd6807cd78e0ad59ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:11.289216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:11.289863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8667beb1-e45a-42bf-ba59-262d755d47ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:11.291464 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3905/7891] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:11 2022] DELETE /identity/v3/projects/006419bf3bf84fd6807cd78e0ad59ef6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:11.296923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06298f-66b8-4ec4-bea3-02da8873f193 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.297244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06298f-66b8-4ec4-bea3-02da8873f193 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.297514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06298f-66b8-4ec4-bea3-02da8873f193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.316565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1d06298f-66b8-4ec4-bea3-02da8873f193 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:11.317925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1d06298f-66b8-4ec4-bea3-02da8873f193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:11.389420 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3987/7892] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:11.400297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac40bdb-43f9-4b83-a1ae-6d1166367fc7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.400629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac40bdb-43f9-4b83-a1ae-6d1166367fc7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.401022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac40bdb-43f9-4b83-a1ae-6d1166367fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.422862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4ac40bdb-43f9-4b83-a1ae-6d1166367fc7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:11.424067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4ac40bdb-43f9-4b83-a1ae-6d1166367fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:11.434196 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3906/7893] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:11.442304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06298f-66b8-4ec4-bea3-02da8873f193 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.452913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06298f-66b8-4ec4-bea3-02da8873f193 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.458088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.458777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.459047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.459325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.460072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:24:11.460372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.462122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.478403 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3988/7894] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:24:11.479987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac40bdb-43f9-4b83-a1ae-6d1166367fc7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.489424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac40bdb-43f9-4b83-a1ae-6d1166367fc7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.494241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.494900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.495176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.495454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.496140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.498108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.527869 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3907/7895] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:24:11 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:11.529434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.539634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be2bb-6309-488e-8c35-62e8a59151ac admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.600723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.601439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.601713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.601987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.602676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.604637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.629189 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3989/7896] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:24:11 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:11.630478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.641168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddcb83-5cd5-4db6-9875-b3c8c5f1566f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.646188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.646857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.647138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.647414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.648146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.649809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.660570 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3908/7897] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:24:11.664730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.674866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e75a7-dd22-40e3-bcd5-2314e66d92d6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.679757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a88d-60a6-4553-ad15-d48585c35222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.680429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a88d-60a6-4553-ad15-d48585c35222 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.680845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a88d-60a6-4553-ad15-d48585c35222 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.681150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a88d-60a6-4553-ad15-d48585c35222 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.681894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a88d-60a6-4553-ad15-d48585c35222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.683580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a88d-60a6-4553-ad15-d48585c35222 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.694396 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3990/7898] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:11.698716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.709394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300888-0b8b-47ad-b1b4-398e61883047 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.714364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.715290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.715569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.715839 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] PATH_INFO: `/v3/projects/506378df4d4d4d4b9c0ea0412d234503/users/de25902bda8c4346a4bb7e70e38175fb/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.736633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] RBAC: Authorizing `identity:create_grant(project_id=506378df4d4d4d4b9c0ea0412d234503, user_id=de25902bda8c4346a4bb7e70e38175fb, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.739929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.756796 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3909/7899] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:24:11 2022] PUT /identity/v3/projects/506378df4d4d4d4b9c0ea0412d234503/users/de25902bda8c4346a4bb7e70e38175fb/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:11.762952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.763798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.765341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.791020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:11.791020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:11.849740 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3991/7900] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:11.859534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:11.862173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:11.920484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18618-1edf-4465-8aef-053af497493c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:11.924143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86e14e-8ec8-415a-accc-0262937e7903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:11.924967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e14e-8ec8-415a-accc-0262937e7903 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:11.925297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e14e-8ec8-415a-accc-0262937e7903 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:11.925570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e14e-8ec8-415a-accc-0262937e7903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:11.935922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86e14e-8ec8-415a-accc-0262937e7903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:11.937447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86e14e-8ec8-415a-accc-0262937e7903 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:11.947915 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3910/7901] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:12.904352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:12.905881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:12.967984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809c3bd-71c5-49e5-92a0-b9c23bfac5ac None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:12.971563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525a26-cc23-4818-84b6-994964fbe395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:12.972236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525a26-cc23-4818-84b6-994964fbe395 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:12.972604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525a26-cc23-4818-84b6-994964fbe395 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:12.972905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525a26-cc23-4818-84b6-994964fbe395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:12.974903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35525a26-cc23-4818-84b6-994964fbe395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:13.042452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35525a26-cc23-4818-84b6-994964fbe395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:13.044674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35525a26-cc23-4818-84b6-994964fbe395 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:13.055611 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3992/7902] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:16.446800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:16.447567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:16.447845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:16.476435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] MFA Rules not processed for user `de25902bda8c4346a4bb7e70e38175fb`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:16.477689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:16.544590 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3911/7903] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:16.623641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:16.624157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:16.624157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:16.643201 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] MFA Rules not processed for user `de25902bda8c4346a4bb7e70e38175fb`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:16.644463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:16.652080 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3993/7904] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:16.664068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:16.665564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:16.745345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9fb34-4df3-40cc-9c74-ed4e2d3e6ed1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:16.752200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bdc18-ae48-470a-a82a-de49532f1d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:16.752860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bdc18-ae48-470a-a82a-de49532f1d34 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:16.753194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bdc18-ae48-470a-a82a-de49532f1d34 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:16.753448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bdc18-ae48-470a-a82a-de49532f1d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:16.761639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bdc18-ae48-470a-a82a-de49532f1d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:16.763253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bdc18-ae48-470a-a82a-de49532f1d34 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:16.772719 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3912/7905] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:17.994709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:17.996338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:18.011649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db9f96-e383-4021-831d-8020ae1feed9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:18.016884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:18.017951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:18.018242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:18.018513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] PATH_INFO: `/v3/users/e0ccd1099d6a4b148674add41fe48f28` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:18.019778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ccd1099d6a4b148674add41fe48f28)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:18.022291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:18.079288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ccd1099d6a4b148674add41fe48f28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.080042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ccd1099d6a4b148674add41fe48f28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.087343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ccd1099d6a4b148674add41fe48f28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.095219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ccd1099d6a4b148674add41fe48f28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.095996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ccd1099d6a4b148674add41fe48f28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.113474 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3994/7906] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:17 2022] DELETE /identity/v3/users/e0ccd1099d6a4b148674add41fe48f28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:18.118126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:18.118603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:18.118691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:18.137410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:18.138719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:18.201903 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3913/7907] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:18.212831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:18.214589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:18.274142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052dcf2-1bb8-4d42-bafc-17f3502771b7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:18.278230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:18.278883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:18.279173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:18.279437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:18.289764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:18.291228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:18.302253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3995/7908] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:18.788985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:18.792833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:18.807546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2adbb-545b-4c05-a6ea-a1a0241bc190 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:18.814104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:18.815238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:18.815515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:18.815785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] PATH_INFO: `/v3/projects/bd8288163d81458486ce15654fed24e3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:18.817373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8288163d81458486ce15654fed24e3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:18.819255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:18.904274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8288163d81458486ce15654fed24e3', 'request_id': 'req-30a92d4a-41b2-4f80-88c4-7f84f16e532a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.912373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8288163d81458486ce15654fed24e3', 'request_id': 'req-30a92d4a-41b2-4f80-88c4-7f84f16e532a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.927158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8288163d81458486ce15654fed24e3', 'request_id': 'req-30a92d4a-41b2-4f80-88c4-7f84f16e532a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.940849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] The token cache is being invalidate because project bd8288163d81458486ce15654fed24e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:18.941284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.942085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:18.945129 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3914/7909] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:18 2022] DELETE /identity/v3/projects/bd8288163d81458486ce15654fed24e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:18.948235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:18.959388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c86ed2-580e-4310-801d-b0a3ca3008ae service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:19.025645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:19.026554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:19.026832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:19.027100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] PATH_INFO: `/v3/users/8ec34cc157714a2ba3f8f2298ca2d32c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:19.028307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec34cc157714a2ba3f8f2298ca2d32c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:19.031093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:19.098020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec34cc157714a2ba3f8f2298ca2d32c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.098669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec34cc157714a2ba3f8f2298ca2d32c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.108872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec34cc157714a2ba3f8f2298ca2d32c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.120720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec34cc157714a2ba3f8f2298ca2d32c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.121470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e8e5c6d0-2395-4b31-aa88-f703dfa9f591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec34cc157714a2ba3f8f2298ca2d32c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.142313 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3996/7910] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:18 2022] DELETE /identity/v3/users/8ec34cc157714a2ba3f8f2298ca2d32c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:24:19.676810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:19.680500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:19.696972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d4a-41b2-4f80-88c4-7f84f16e532a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:19.773270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:19.774197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:19.774475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:19.775057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] PATH_INFO: `/v3/projects/a1f91fc1fed74a2eaa3d597b3b5645c1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:19.776431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f91fc1fed74a2eaa3d597b3b5645c1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:19.778596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:19.832517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f91fc1fed74a2eaa3d597b3b5645c1', 'request_id': 'req-42c1f6c4-2df4-4996-895f-0185db13babe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.842461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f91fc1fed74a2eaa3d597b3b5645c1', 'request_id': 'req-42c1f6c4-2df4-4996-895f-0185db13babe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.853840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f91fc1fed74a2eaa3d597b3b5645c1', 'request_id': 'req-42c1f6c4-2df4-4996-895f-0185db13babe'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.867159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] The token cache is being invalidate because project a1f91fc1fed74a2eaa3d597b3b5645c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:19.867479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.868116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-42c1f6c4-2df4-4996-895f-0185db13babe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:19.870215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3915/7911] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:19 2022] DELETE /identity/v3/projects/a1f91fc1fed74a2eaa3d597b3b5645c1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:19.877297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1bf5-f067-4d06-b66a-3695eccc0735 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:19.877589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1bf5-f067-4d06-b66a-3695eccc0735 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:19.877868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1bf5-f067-4d06-b66a-3695eccc0735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:19.900103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bbef1bf5-f067-4d06-b66a-3695eccc0735 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:19.901517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bbef1bf5-f067-4d06-b66a-3695eccc0735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:19.976930 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3997/7912] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:19.979329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3ecbd-23b3-4fd8-9879-0950e5bd2517 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:19.979619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3ecbd-23b3-4fd8-9879-0950e5bd2517 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:19.979938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3ecbd-23b3-4fd8-9879-0950e5bd2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.004842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-18d3ecbd-23b3-4fd8-9879-0950e5bd2517 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:20.006141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-18d3ecbd-23b3-4fd8-9879-0950e5bd2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:20.015368 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3916/7913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:20.020386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1bf5-f067-4d06-b66a-3695eccc0735 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:20.033272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1bf5-f067-4d06-b66a-3695eccc0735 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:20.038058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:20.038850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.039200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.039680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.040626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:24:20.040998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:20.042772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:20.059007 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3998/7914] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:24:20.063656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3ecbd-23b3-4fd8-9879-0950e5bd2517 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:20.075007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3ecbd-23b3-4fd8-9879-0950e5bd2517 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:20.081609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:20.082368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.082822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.083158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.083918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:20.085966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:20.121128 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3917/7915] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:24:20 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:20.124221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:20.135318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc331f1-a28b-40fb-9174-1a02b97a0fd5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:20.196319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:20.197011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.197322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.197597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.198304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:20.200264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:20.229002 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 3999/7916] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:24:20 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:20.230372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:20.252243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a595e-4443-4857-b491-ee026dd835e6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:20.258496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:20.259194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.259475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.259751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.260657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:20.262585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:20.276856 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3918/7917] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:20.277882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:20.289248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53ff9-48b2-4fe2-8e1b-885634d2660e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:20.296072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56cea9-84e4-4d9c-8e85-e003e1865fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:20.296776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cea9-84e4-4d9c-8e85-e003e1865fca admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.297096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cea9-84e4-4d9c-8e85-e003e1865fca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.297380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cea9-84e4-4d9c-8e85-e003e1865fca admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.298884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56cea9-84e4-4d9c-8e85-e003e1865fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:20.300671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56cea9-84e4-4d9c-8e85-e003e1865fca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:20.311519 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4000/7918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:20.316139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:20.326348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca2fe2-b29d-44d7-a87f-e0def0d46c4b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:20.331391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:20.332315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.332596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.332871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] PATH_INFO: `/v3/projects/3e89472cd42f427093386f41e7d6d9c8/users/cc4ef3bd0bd9486ebc2d7b34305e4c8a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.348898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e89472cd42f427093386f41e7d6d9c8, user_id=cc4ef3bd0bd9486ebc2d7b34305e4c8a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:20.351894 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:20.367437 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3919/7919] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:24:20 2022] PUT /identity/v3/projects/3e89472cd42f427093386f41e7d6d9c8/users/cc4ef3bd0bd9486ebc2d7b34305e4c8a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:20.381673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33602fd-d9f0-407b-a9e8-75e057360716 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.381989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33602fd-d9f0-407b-a9e8-75e057360716 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.382251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33602fd-d9f0-407b-a9e8-75e057360716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.410687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c33602fd-d9f0-407b-a9e8-75e057360716 None None] MFA Rules not processed for user `cc4ef3bd0bd9486ebc2d7b34305e4c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:20.411969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c33602fd-d9f0-407b-a9e8-75e057360716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:20.482950 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4001/7920] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:20.494600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:20.496301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:20.571899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0edd7-0dc7-4e28-8922-bf6c8b042cb4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:20.575741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2408d-8cc0-40c5-8719-5d473ece2f17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:20.576390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2408d-8cc0-40c5-8719-5d473ece2f17 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:20.576667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2408d-8cc0-40c5-8719-5d473ece2f17 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:20.577025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2408d-8cc0-40c5-8719-5d473ece2f17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:20.585921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2408d-8cc0-40c5-8719-5d473ece2f17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:20.587398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2408d-8cc0-40c5-8719-5d473ece2f17 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:20.596810 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3920/7921] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:24.709804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33602fd-d9f0-407b-a9e8-75e057360716 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:24.786068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33602fd-d9f0-407b-a9e8-75e057360716 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:24.791846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:24.792872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:24.793515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:24.793623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] PATH_INFO: `/v3/users/cc4ef3bd0bd9486ebc2d7b34305e4c8a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:24.794855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4ef3bd0bd9486ebc2d7b34305e4c8a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:24.796966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:24.844359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4ef3bd0bd9486ebc2d7b34305e4c8a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:24.845014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4ef3bd0bd9486ebc2d7b34305e4c8a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:24.852273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4ef3bd0bd9486ebc2d7b34305e4c8a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:24.862293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4ef3bd0bd9486ebc2d7b34305e4c8a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:24.862991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4ef3bd0bd9486ebc2d7b34305e4c8a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:24.880501 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4002/7922] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:24 2022] DELETE /identity/v3/users/cc4ef3bd0bd9486ebc2d7b34305e4c8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:24.885799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:24.886319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:24.886397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:24.905151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:24.906487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:24.965571 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3921/7923] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:24.975755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:24.977393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:25.039868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3a321-62e3-47bc-bc49-13f328ed91d0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.044342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447670b-11fe-4ecf-b728-5931e9d9c215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.045006 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447670b-11fe-4ecf-b728-5931e9d9c215 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.045324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447670b-11fe-4ecf-b728-5931e9d9c215 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.045605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447670b-11fe-4ecf-b728-5931e9d9c215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.055015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447670b-11fe-4ecf-b728-5931e9d9c215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.056528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447670b-11fe-4ecf-b728-5931e9d9c215 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.066387 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4003/7924] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:25.338949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:25.340519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:25.355634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4eee-f091-4239-a4e9-50f70392b6f6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.361955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.363150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.363499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.363714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] PATH_INFO: `/v3/projects/3e89472cd42f427093386f41e7d6d9c8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.365081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e89472cd42f427093386f41e7d6d9c8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.367070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.415766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e89472cd42f427093386f41e7d6d9c8', 'request_id': 'req-deeb36fd-e632-4c0a-af02-df6315fa8e5d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:25.421855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e89472cd42f427093386f41e7d6d9c8', 'request_id': 'req-deeb36fd-e632-4c0a-af02-df6315fa8e5d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:25.430176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e89472cd42f427093386f41e7d6d9c8', 'request_id': 'req-deeb36fd-e632-4c0a-af02-df6315fa8e5d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:25.442695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] The token cache is being invalidate because project 3e89472cd42f427093386f41e7d6d9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:25.442695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:25.443070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-deeb36fd-e632-4c0a-af02-df6315fa8e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:25.444745 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3922/7925] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:25 2022] DELETE /identity/v3/projects/3e89472cd42f427093386f41e7d6d9c8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:24:25.451118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55003b1-4b4d-41bc-a5ac-e6488baaf317 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.451430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55003b1-4b4d-41bc-a5ac-e6488baaf317 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.451702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55003b1-4b4d-41bc-a5ac-e6488baaf317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.472181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e55003b1-4b4d-41bc-a5ac-e6488baaf317 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:25.473333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e55003b1-4b4d-41bc-a5ac-e6488baaf317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:25.538005 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4004/7926] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:25.546355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb73d0-1f29-4fa4-bf2b-9d58a07300f7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.546694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb73d0-1f29-4fa4-bf2b-9d58a07300f7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.546973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb73d0-1f29-4fa4-bf2b-9d58a07300f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.566872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-68fb73d0-1f29-4fa4-bf2b-9d58a07300f7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:25.568083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-68fb73d0-1f29-4fa4-bf2b-9d58a07300f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:25.577610 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3923/7927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:25.582315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55003b1-4b4d-41bc-a5ac-e6488baaf317 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:25.597430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55003b1-4b4d-41bc-a5ac-e6488baaf317 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.605530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.606345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.606759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.607154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.608226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:24:25.608699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.610909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.625291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4005/7928] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:24:25.629807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb73d0-1f29-4fa4-bf2b-9d58a07300f7 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:25.639397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb73d0-1f29-4fa4-bf2b-9d58a07300f7 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.645272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.645932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.646207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.646474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.647154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.649174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.681903 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3924/7929] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:24:25 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:25.684581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:25.694768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28a9d-b4e7-45c3-8f99-5ea3bd00ee9b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.759229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.759901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.760184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.760444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.761579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.763583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.788413 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4006/7930] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:24:25 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:25.790230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:25.801748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62960f4-04c0-4bcf-bfd9-9533db74e9d4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.807271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.808202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.808586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.808957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.809841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.811558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.824049 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3925/7931] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:24:25.828159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:25.838513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f8bc-4b45-401a-a885-b67e5d4f8f48 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.843747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa9a14-50c9-48af-9394-b7088a790cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.844434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa9a14-50c9-48af-9394-b7088a790cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.844714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa9a14-50c9-48af-9394-b7088a790cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.845014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa9a14-50c9-48af-9394-b7088a790cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.845789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa9a14-50c9-48af-9394-b7088a790cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.847433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa9a14-50c9-48af-9394-b7088a790cd3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.861351 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4007/7932] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:25.865072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:25.876533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eeb89-537f-45ef-b9ae-5a6a5fe27767 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:25.881931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:25.882861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.883143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.883476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] PATH_INFO: `/v3/projects/2d5e984e05754e3c81cce99a2ec0f5cf/users/4bdc981fc82e492095e1b4b8b11c3d2f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.900356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5e984e05754e3c81cce99a2ec0f5cf, user_id=4bdc981fc82e492095e1b4b8b11c3d2f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:25.903124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:25.918750 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3926/7933] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:24:25 2022] PUT /identity/v3/projects/2d5e984e05754e3c81cce99a2ec0f5cf/users/4bdc981fc82e492095e1b4b8b11c3d2f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:25.929279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02146679-e5e9-4360-851d-ff924d6201b7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:25.929567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02146679-e5e9-4360-851d-ff924d6201b7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:25.929842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02146679-e5e9-4360-851d-ff924d6201b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:25.955543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-02146679-e5e9-4360-851d-ff924d6201b7 None None] MFA Rules not processed for user `4bdc981fc82e492095e1b4b8b11c3d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:25.956840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-02146679-e5e9-4360-851d-ff924d6201b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:26.022769 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4008/7934] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:26.053566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:26.055375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:26.115683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6301-da1a-429b-892c-8fa7d12013d6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:26.120025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce59ab0-2d73-47dc-b068-fcf4a4eecbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:26.120685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce59ab0-2d73-47dc-b068-fcf4a4eecbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:26.120966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce59ab0-2d73-47dc-b068-fcf4a4eecbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:26.121278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce59ab0-2d73-47dc-b068-fcf4a4eecbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:26.129985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce59ab0-2d73-47dc-b068-fcf4a4eecbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:26.131438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce59ab0-2d73-47dc-b068-fcf4a4eecbc9 service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:26.140282 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3927/7935] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:26.154988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02146679-e5e9-4360-851d-ff924d6201b7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:26.216546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02146679-e5e9-4360-851d-ff924d6201b7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:26.221442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:26.222332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:26.222609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:26.222880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] PATH_INFO: `/v3/users/4bdc981fc82e492095e1b4b8b11c3d2f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:26.224069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bdc981fc82e492095e1b4b8b11c3d2f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:26.226099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:26.277138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bdc981fc82e492095e1b4b8b11c3d2f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.277745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bdc981fc82e492095e1b4b8b11c3d2f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.284284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bdc981fc82e492095e1b4b8b11c3d2f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.292814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bdc981fc82e492095e1b4b8b11c3d2f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.293552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bdc981fc82e492095e1b4b8b11c3d2f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.310212 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4009/7936] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:26 2022] DELETE /identity/v3/users/4bdc981fc82e492095e1b4b8b11c3d2f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:26.314889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:26.315180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:26.315454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:26.340113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:26.341700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:26.403117 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3928/7937] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:26.413072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:26.414748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:26.478974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14ce3-c367-4e88-82c3-dac2a935103b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:26.483567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208e404-e2c4-435d-96ad-5aa41000b1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:26.484228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208e404-e2c4-435d-96ad-5aa41000b1fd service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:26.484506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208e404-e2c4-435d-96ad-5aa41000b1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:26.484775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208e404-e2c4-435d-96ad-5aa41000b1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:26.494346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208e404-e2c4-435d-96ad-5aa41000b1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:26.495811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208e404-e2c4-435d-96ad-5aa41000b1fd service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:26.505694 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4010/7938] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:26.786905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:26.788363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:26.800595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2dc1-a40a-4f87-a723-da0d17a4c635 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:26.805450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:26.806336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:26.806634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:26.807363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] PATH_INFO: `/v3/projects/2d5e984e05754e3c81cce99a2ec0f5cf` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:26.808175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5e984e05754e3c81cce99a2ec0f5cf)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:26.810133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:26.859066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5e984e05754e3c81cce99a2ec0f5cf', 'request_id': 'req-a8941ed4-c91f-4209-91d0-f3137ae85f44'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.864464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5e984e05754e3c81cce99a2ec0f5cf', 'request_id': 'req-a8941ed4-c91f-4209-91d0-f3137ae85f44'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.875413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5e984e05754e3c81cce99a2ec0f5cf', 'request_id': 'req-a8941ed4-c91f-4209-91d0-f3137ae85f44'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.888086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] The token cache is being invalidate because project 2d5e984e05754e3c81cce99a2ec0f5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:26.888820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.889069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a8941ed4-c91f-4209-91d0-f3137ae85f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:26.890656 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3929/7939] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:26 2022] DELETE /identity/v3/projects/2d5e984e05754e3c81cce99a2ec0f5cf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:26.895996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0ae9-6adf-423e-8124-9519400c5f1d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:26.896517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0ae9-6adf-423e-8124-9519400c5f1d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:26.896517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0ae9-6adf-423e-8124-9519400c5f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:26.916640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d0ec0ae9-6adf-423e-8124-9519400c5f1d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:26.918058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0ec0ae9-6adf-423e-8124-9519400c5f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:26.988175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4011/7940] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:26.997677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410cd4-3600-488e-abef-3bd3c76f0658 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:26.998181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410cd4-3600-488e-abef-3bd3c76f0658 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:26.998256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410cd4-3600-488e-abef-3bd3c76f0658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.022318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-48410cd4-3600-488e-abef-3bd3c76f0658 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:27.023561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-48410cd4-3600-488e-abef-3bd3c76f0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:27.033727 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3930/7941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:27.037925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec0ae9-6adf-423e-8124-9519400c5f1d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:27.048109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec0ae9-6adf-423e-8124-9519400c5f1d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:27.052870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:27.053618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.053933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.054240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.055011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:24:27.055416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:27.057120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:27.074848 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4012/7942] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:24:27.079723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410cd4-3600-488e-abef-3bd3c76f0658 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:27.091054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410cd4-3600-488e-abef-3bd3c76f0658 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:27.096238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:27.096907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.097226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.097505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.098211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:27.100173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:27.131108 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3931/7943] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:24:27 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:24:27.135592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:27.145668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bda4-399c-4778-ab0b-197cf088a98d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:27.207322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:27.207897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.208210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.208517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.209273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:27.211921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:27.236291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4013/7944] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:24:27 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:24:27.240353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:27.256814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd8615-a2b8-4e08-89be-6de486c5664b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:27.261821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:27.262490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.262765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.263094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.263812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:27.265466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:27.276323 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3932/7945] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:24:27.280653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:27.291789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaa2ac-0ca1-4c1c-8d91-2de5d90e06c7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:27.296466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8531e6d-e4be-4db4-a323-1e7355b1361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:27.297195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531e6d-e4be-4db4-a323-1e7355b1361f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.297482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531e6d-e4be-4db4-a323-1e7355b1361f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.297759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531e6d-e4be-4db4-a323-1e7355b1361f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.298516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8531e6d-e4be-4db4-a323-1e7355b1361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:27.300189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8531e6d-e4be-4db4-a323-1e7355b1361f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:27.312655 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4014/7946] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:24:27.314724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:27.325412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedcc04-113d-4172-85d1-ef98a2a55b5f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:27.330722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:27.331620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.331897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.332169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] PATH_INFO: `/v3/projects/78050986045342139f0f0c8d083c1bb1/users/9491902cf8944956bad9b60807c98b6d/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.348416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78050986045342139f0f0c8d083c1bb1, user_id=9491902cf8944956bad9b60807c98b6d, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:27.351145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:27.366986 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3933/7947] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:24:27 2022] PUT /identity/v3/projects/78050986045342139f0f0c8d083c1bb1/users/9491902cf8944956bad9b60807c98b6d/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:27.377761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d421ab-ff9d-47d8-9688-405a62e5286d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.378091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d421ab-ff9d-47d8-9688-405a62e5286d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.378429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d421ab-ff9d-47d8-9688-405a62e5286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.405914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-10d421ab-ff9d-47d8-9688-405a62e5286d None None] MFA Rules not processed for user `9491902cf8944956bad9b60807c98b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:27.407184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-10d421ab-ff9d-47d8-9688-405a62e5286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:27.474718 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4015/7948] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:24:27.485795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:27.487600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:27.548824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e12cc-3a89-4743-a275-4d160855f919 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:27.552740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ed8d-8bbb-44bb-b354-6021266b4f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:27.553423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ed8d-8bbb-44bb-b354-6021266b4f3e service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:27.553727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ed8d-8bbb-44bb-b354-6021266b4f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:27.554002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ed8d-8bbb-44bb-b354-6021266b4f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:27.566086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ed8d-8bbb-44bb-b354-6021266b4f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:27.567574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ed8d-8bbb-44bb-b354-6021266b4f3e service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:27.577790 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3934/7949] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:39.728793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d421ab-ff9d-47d8-9688-405a62e5286d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:39.793738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d421ab-ff9d-47d8-9688-405a62e5286d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:39.798503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:39.799413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:39.799725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:39.800058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] PATH_INFO: `/v3/users/9491902cf8944956bad9b60807c98b6d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:39.801336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9491902cf8944956bad9b60807c98b6d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:39.803371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:39.852266 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9491902cf8944956bad9b60807c98b6d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:39.852983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9491902cf8944956bad9b60807c98b6d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:39.860283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9491902cf8944956bad9b60807c98b6d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:39.868970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9491902cf8944956bad9b60807c98b6d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:39.869701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9491902cf8944956bad9b60807c98b6d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:39.886391 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4016/7950] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:24:39 2022] DELETE /identity/v3/users/9491902cf8944956bad9b60807c98b6d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:39.891142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:39.891665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:39.891758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:39.908907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:39.910143 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:39.969116 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3935/7951] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:24:39.980143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:39.983360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:40.068374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e307bf9-d74b-49bc-94b6-945f744ff1e8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:40.072984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2fd6a-cbfa-4ffd-b062-b42e003e85c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:40.073708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2fd6a-cbfa-4ffd-b062-b42e003e85c1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:40.074030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2fd6a-cbfa-4ffd-b062-b42e003e85c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:40.074335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2fd6a-cbfa-4ffd-b062-b42e003e85c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:40.084477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2fd6a-cbfa-4ffd-b062-b42e003e85c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:40.086018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2fd6a-cbfa-4ffd-b062-b42e003e85c1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:40.096079 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4017/7952] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:24:40.456137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:24:40.457685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:40.470729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bcbcd-d097-4b20-8fbf-b986ef994f75 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:24:40.475998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:24:40.477072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:40.477415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:40.477739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] PATH_INFO: `/v3/projects/78050986045342139f0f0c8d083c1bb1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:40.479091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78050986045342139f0f0c8d083c1bb1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:24:40.481070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:24:40.530833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78050986045342139f0f0c8d083c1bb1', 'request_id': 'req-e8329ed2-e456-4fb5-900f-2e42645cccc4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:40.536008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78050986045342139f0f0c8d083c1bb1', 'request_id': 'req-e8329ed2-e456-4fb5-900f-2e42645cccc4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:40.545474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78050986045342139f0f0c8d083c1bb1', 'request_id': 'req-e8329ed2-e456-4fb5-900f-2e42645cccc4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:40.556300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] The token cache is being invalidate because project 78050986045342139f0f0c8d083c1bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:24:40.556581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:40.557210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:24:40.558807 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3936/7953] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:24:40 2022] DELETE /identity/v3/projects/78050986045342139f0f0c8d083c1bb1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:24:56.125947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd683-a672-476f-8380-e693ac622410 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:24:56.126440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd683-a672-476f-8380-e693ac622410 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:24:56.126662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd683-a672-476f-8380-e693ac622410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:24:56.146762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-250bd683-a672-476f-8380-e693ac622410 None None] MFA Rules not processed for user `de25902bda8c4346a4bb7e70e38175fb`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:24:56.147970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-250bd683-a672-476f-8380-e693ac622410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:24:56.206297 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4018/7954] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:25:02.597890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:02.599425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:02.693617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8329ed2-e456-4fb5-900f-2e42645cccc4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:02.697301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:02.697949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:02.698225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:02.698516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:02.700309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:02.810444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:02.811889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:02.827348 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3937/7955] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:25:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:25:06.359305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd683-a672-476f-8380-e693ac622410 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:06.377278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd683-a672-476f-8380-e693ac622410 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:06.381820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:06.382486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:06.382766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:06.383037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:06.385167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:06.401639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:06.403117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:06.416491 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4019/7956] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:25:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:25:51.862929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:51.864672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:51.950741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d6e5-a339-4f56-8d23-afaa530e83da service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:51.956396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:51.957345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:51.957625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:51.957893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] PATH_INFO: `/v3/users/de25902bda8c4346a4bb7e70e38175fb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:51.959213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de25902bda8c4346a4bb7e70e38175fb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:51.961214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.014947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de25902bda8c4346a4bb7e70e38175fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.015897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de25902bda8c4346a4bb7e70e38175fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.027515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de25902bda8c4346a4bb7e70e38175fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.028603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de25902bda8c4346a4bb7e70e38175fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.041180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac868933-1798-4647-9c22-f3dec43b09b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de25902bda8c4346a4bb7e70e38175fb'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.060391 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3938/7957] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:25:51 2022] DELETE /identity/v3/users/de25902bda8c4346a4bb7e70e38175fb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:25:52.243279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:52.254330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19a4d-755c-497b-a50c-f3321f2e6714 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:52.313673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:52.314486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.314762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.315051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] PATH_INFO: `/v3/projects/506378df4d4d4d4b9c0ea0412d234503` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.316219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506378df4d4d4d4b9c0ea0412d234503)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:52.318245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.373637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506378df4d4d4d4b9c0ea0412d234503', 'request_id': 'req-231865e8-6dbb-4cbd-ab40-41bc13e18781'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.379208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506378df4d4d4d4b9c0ea0412d234503', 'request_id': 'req-231865e8-6dbb-4cbd-ab40-41bc13e18781'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.388210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506378df4d4d4d4b9c0ea0412d234503', 'request_id': 'req-231865e8-6dbb-4cbd-ab40-41bc13e18781'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.400730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] The token cache is being invalidate because project 506378df4d4d4d4b9c0ea0412d234503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:25:52.401022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.401738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-231865e8-6dbb-4cbd-ab40-41bc13e18781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:25:52.403330 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4020/7958] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:25:52 2022] DELETE /identity/v3/projects/506378df4d4d4d4b9c0ea0412d234503 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:25:52.408608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfc014-ec97-4fae-bef9-c60320f50da6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.408897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfc014-ec97-4fae-bef9-c60320f50da6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.409220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfc014-ec97-4fae-bef9-c60320f50da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.467205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0dcfc014-ec97-4fae-bef9-c60320f50da6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:25:52.468428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0dcfc014-ec97-4fae-bef9-c60320f50da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:52.529724 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3939/7959] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:25:52.538697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020414c7-ac6a-408d-82e5-0d24eab1736e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.539016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020414c7-ac6a-408d-82e5-0d24eab1736e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.539320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020414c7-ac6a-408d-82e5-0d24eab1736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.560474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-020414c7-ac6a-408d-82e5-0d24eab1736e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:25:52.561732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-020414c7-ac6a-408d-82e5-0d24eab1736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:52.570985 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4021/7960] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:25:52.575240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfc014-ec97-4fae-bef9-c60320f50da6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:52.585760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfc014-ec97-4fae-bef9-c60320f50da6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:52.592024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:52.592719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.592977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.593310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.594034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:25:52.594338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:52.595929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.609008 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3940/7961] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:25:52.613433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020414c7-ac6a-408d-82e5-0d24eab1736e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:52.622898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020414c7-ac6a-408d-82e5-0d24eab1736e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:52.628258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:52.628852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.629164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.629434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.630123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:52.632036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.659546 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4022/7962] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:25:52 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:25:52.663762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:52.674588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dc055-bf46-4c04-b160-980c36d60159 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:52.745105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:52.745897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.746176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.746447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.747123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:52.749283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.772515 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3941/7963] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:25:52 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:25:52.776789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:52.790317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd022-e99f-408a-9a7f-3bace5f634ed admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:52.795549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:52.796305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.796538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.796804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.797596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:52.799259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.810219 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4023/7964] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:25:52.814271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:52.824299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e8f5-d456-439d-8192-fad69be350a9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:52.829814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d66fa-d66b-4c29-abac-09c972ccd733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:52.830472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d66fa-d66b-4c29-abac-09c972ccd733 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.830752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d66fa-d66b-4c29-abac-09c972ccd733 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.831019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d66fa-d66b-4c29-abac-09c972ccd733 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.831735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d66fa-d66b-4c29-abac-09c972ccd733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:52.833368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d66fa-d66b-4c29-abac-09c972ccd733 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.843762 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3942/7965] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:25:52.848299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:52.858686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a262d5-636a-43e1-b218-6ac7dd653a84 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:52.863941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77487525-8f04-4d31-9530-074f10688e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:52.864864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487525-8f04-4d31-9530-074f10688e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.865174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487525-8f04-4d31-9530-074f10688e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.865449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487525-8f04-4d31-9530-074f10688e2c admin admin] PATH_INFO: `/v3/projects/dbc3bda5bec94e2cba6e96394bb8d9c8/users/6ab3b662559847ceb8b103944488db63/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.882208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77487525-8f04-4d31-9530-074f10688e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc3bda5bec94e2cba6e96394bb8d9c8, user_id=6ab3b662559847ceb8b103944488db63, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:52.884849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77487525-8f04-4d31-9530-074f10688e2c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:52.901158 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4024/7966] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:25:52 2022] PUT /identity/v3/projects/dbc3bda5bec94e2cba6e96394bb8d9c8/users/6ab3b662559847ceb8b103944488db63/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:25:52.912286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:52.912856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:52.912856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:52.942766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] MFA Rules not processed for user `6ab3b662559847ceb8b103944488db63`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:25:52.944007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:53.009785 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3943/7967] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:25:53.020541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:53.020833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:53.021151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:53.038706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] MFA Rules not processed for user `6ab3b662559847ceb8b103944488db63`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:25:53.039905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:53.047048 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4025/7968] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:25:53.058974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:53.060474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:53.141487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb234eca-5ce6-4c03-9f1a-755946648d45 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:53.147492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:53.148145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:53.148426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:53.148700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:53.157317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:53.158930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:53.168137 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3944/7969] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:25:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:25:56.850469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:56.852009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:56.928457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89fd56-2d46-403c-b045-b5e0b3bda5bf None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:56.932462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:56.933191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:56.933517 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:56.933816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:56.936176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:56.948735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:56.950249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:56.960303 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4026/7970] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:25:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:25:59.792307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:25:59.795597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:59.811500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d36846-d41b-46ff-8d3f-eb058455b21a service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:25:59.815761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba5d1f-87e8-4900-8bf1-02326cd4ccc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:25:59.816510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba5d1f-87e8-4900-8bf1-02326cd4ccc4 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:25:59.816790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba5d1f-87e8-4900-8bf1-02326cd4ccc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:25:59.817093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba5d1f-87e8-4900-8bf1-02326cd4ccc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:25:59.818904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3ba5d1f-87e8-4900-8bf1-02326cd4ccc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:25:59.831230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba5d1f-87e8-4900-8bf1-02326cd4ccc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:25:59.832680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba5d1f-87e8-4900-8bf1-02326cd4ccc4 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:25:59.843439 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3945/7971] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:14.825296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:14.827950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:14.906582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d5fe6-9158-42c0-a5a4-4d3226404c2f service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:14.911892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:14.912925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:14.913228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:14.913523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] PATH_INFO: `/v3/users/b5534646a6384067bda99af7c864d494` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:14.914787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5534646a6384067bda99af7c864d494)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:14.916765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:14.969476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5534646a6384067bda99af7c864d494'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:14.970051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5534646a6384067bda99af7c864d494'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:14.976789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5534646a6384067bda99af7c864d494'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:14.985291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5534646a6384067bda99af7c864d494'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:14.985912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5534646a6384067bda99af7c864d494'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.003878 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4027/7972] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:26:14 2022] DELETE /identity/v3/users/b5534646a6384067bda99af7c864d494 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:26:15.008695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:15.009202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:15.009297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:15.025986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:15.027168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:15.091853 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3946/7973] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:15.103202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:15.105570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:15.166236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d97f2-3fa8-4d2c-ae46-cd36ef2f258c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:15.170348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:15.171098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:15.171372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:15.171669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:15.181024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:15.182515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:15.192474 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4028/7974] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:15.390031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:15.391797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:15.407923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae661b5-4f74-46ec-b6e7-c8a1a0ecac11 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:15.412591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:15.413579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:15.414033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:15.414374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] PATH_INFO: `/v3/projects/0cbaded0b4ad4c4587cc36402e326750` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:15.415623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbaded0b4ad4c4587cc36402e326750)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:15.417748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:15.470105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbaded0b4ad4c4587cc36402e326750', 'request_id': 'req-5df4776b-3671-4820-8e88-26781ab6baa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.475240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbaded0b4ad4c4587cc36402e326750', 'request_id': 'req-5df4776b-3671-4820-8e88-26781ab6baa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.484618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbaded0b4ad4c4587cc36402e326750', 'request_id': 'req-5df4776b-3671-4820-8e88-26781ab6baa4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.495665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] The token cache is being invalidate because project 0cbaded0b4ad4c4587cc36402e326750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:26:15.495952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.496602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.498227 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3947/7975] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:26:15 2022] DELETE /identity/v3/projects/0cbaded0b4ad4c4587cc36402e326750 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:15.502495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:15.517851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5448c0-5e28-4d97-a956-1243ebaeeb8b service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:15.574923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:15.575742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:15.576017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:15.576314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] PATH_INFO: `/v3/users/f9202e7a69af4d7aba0bdf5982972be9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:15.593547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9202e7a69af4d7aba0bdf5982972be9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:15.595464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:15.645153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9202e7a69af4d7aba0bdf5982972be9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.646283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9202e7a69af4d7aba0bdf5982972be9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.653786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9202e7a69af4d7aba0bdf5982972be9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.663361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9202e7a69af4d7aba0bdf5982972be9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.664041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d9387d67-6d34-4834-8728-1286060b7756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9202e7a69af4d7aba0bdf5982972be9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:15.680747 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4029/7976] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:26:15 2022] DELETE /identity/v3/users/f9202e7a69af4d7aba0bdf5982972be9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:15.866987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:15.868438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:15.885721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4776b-3671-4820-8e88-26781ab6baa4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:15.946563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:15.947460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:15.947748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:15.948055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] PATH_INFO: `/v3/projects/c05fb2ff69eb4e3e8464952cacd62c77` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:15.959014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05fb2ff69eb4e3e8464952cacd62c77)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:15.960943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.008162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05fb2ff69eb4e3e8464952cacd62c77', 'request_id': 'req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:16.013506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05fb2ff69eb4e3e8464952cacd62c77', 'request_id': 'req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:16.023257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05fb2ff69eb4e3e8464952cacd62c77', 'request_id': 'req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:16.035584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] The token cache is being invalidate because project c05fb2ff69eb4e3e8464952cacd62c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:26:16.036008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:16.036645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d6d1e75-93b5-4f5c-8bd5-81681f14ec7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:16.038321 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3948/7977] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:26:15 2022] DELETE /identity/v3/projects/c05fb2ff69eb4e3e8464952cacd62c77 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:16.043494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11628eaa-7ca2-4566-a325-deafc9cad7b9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.043995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11628eaa-7ca2-4566-a325-deafc9cad7b9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.043995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11628eaa-7ca2-4566-a325-deafc9cad7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.068249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-11628eaa-7ca2-4566-a325-deafc9cad7b9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:16.069491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-11628eaa-7ca2-4566-a325-deafc9cad7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:16.130514 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4030/7978] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:16.139221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87237cf-a8fa-4499-a0c7-8023145a4893 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.139499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87237cf-a8fa-4499-a0c7-8023145a4893 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.139770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87237cf-a8fa-4499-a0c7-8023145a4893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.157425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d87237cf-a8fa-4499-a0c7-8023145a4893 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:16.158618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d87237cf-a8fa-4499-a0c7-8023145a4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:16.166297 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3949/7979] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:26:16.170677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11628eaa-7ca2-4566-a325-deafc9cad7b9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.180768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11628eaa-7ca2-4566-a325-deafc9cad7b9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.186392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.187039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.187314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.187578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.188294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:26:16.188600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.190369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.203976 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4031/7980] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:26:16.208579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87237cf-a8fa-4499-a0c7-8023145a4893 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.218374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87237cf-a8fa-4499-a0c7-8023145a4893 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.223512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.224159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.224436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.224700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.225467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.227349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.254188 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3950/7981] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:26:16.258563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.268818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c674-b82f-460d-9975-d286e625f907 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.336703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.337417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.337701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.337964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.339078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.341101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.367143 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4032/7982] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:16.371533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.382237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0578ae-e2b9-4c95-9368-bea4264bddab admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.387016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.387702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.388034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.388241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.388989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.390624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.400616 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3951/7983] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:16.404744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.414983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58c213-36ba-4c0e-8043-02371d32fdf4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.420607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2bfb4-4f39-4745-b596-96732d2c91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.421346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bfb4-4f39-4745-b596-96732d2c91e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.421619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bfb4-4f39-4745-b596-96732d2c91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.421886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bfb4-4f39-4745-b596-96732d2c91e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.422602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2bfb4-4f39-4745-b596-96732d2c91e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.424220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2bfb4-4f39-4745-b596-96732d2c91e0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.434327 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4033/7984] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:16.441297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.451896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca054-e917-48b5-a979-3f3fc4cc7ef6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.456809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.457730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.458006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.458277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] PATH_INFO: `/v3/projects/f835ef5aefe44c96bc20308d450b5680/users/0818e5f0edb74b82821c07c88df54826/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.474659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f835ef5aefe44c96bc20308d450b5680, user_id=0818e5f0edb74b82821c07c88df54826, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.477372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.493444 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3952/7985] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:16 2022] PUT /identity/v3/projects/f835ef5aefe44c96bc20308d450b5680/users/0818e5f0edb74b82821c07c88df54826/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:16.504656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c34f-2970-4cc3-a286-fc1844485336 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.504962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c34f-2970-4cc3-a286-fc1844485336 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.505273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c34f-2970-4cc3-a286-fc1844485336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.533507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5901c34f-2970-4cc3-a286-fc1844485336 None None] MFA Rules not processed for user `0818e5f0edb74b82821c07c88df54826`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:16.534753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5901c34f-2970-4cc3-a286-fc1844485336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:16.606140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4034/7986] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:16.611279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.674123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90277d-95b8-47bd-b1ad-b98a09eb76fa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.679228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.679882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.680123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.680422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.681077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.683018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.710344 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3953/7987] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:16.714918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901c34f-2970-4cc3-a286-fc1844485336 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.726602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901c34f-2970-4cc3-a286-fc1844485336 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.783234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.783906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.784212 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.784457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.785153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.787102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.810166 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4035/7988] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:16.814361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.825054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf610-b474-494e-ae65-f56d8d2a4135 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.830641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.831307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.831580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.831848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.832570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.834198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.846794 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3954/7989] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:16.850694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.862567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38cbe-e72a-4468-aca3-269e770444f4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.867379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33780d6e-62c3-4f93-ab5e-2e182eb32903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.868084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33780d6e-62c3-4f93-ab5e-2e182eb32903 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.868393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33780d6e-62c3-4f93-ab5e-2e182eb32903 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.868666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33780d6e-62c3-4f93-ab5e-2e182eb32903 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.869434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33780d6e-62c3-4f93-ab5e-2e182eb32903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.871065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33780d6e-62c3-4f93-ab5e-2e182eb32903 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.881109 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4036/7990] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:16.885419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:16.895946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc14a89-8b54-4790-8c2f-aae3425a5874 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:16.901464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:16.902353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.902629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.902897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] PATH_INFO: `/v3/projects/035c9d4e141c4b53860620844a00a338/users/64084b72253b4e458009e93d215ec8fe/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.917918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035c9d4e141c4b53860620844a00a338, user_id=64084b72253b4e458009e93d215ec8fe, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:16.920575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:16.937374 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3955/7991] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:16 2022] PUT /identity/v3/projects/035c9d4e141c4b53860620844a00a338/users/64084b72253b4e458009e93d215ec8fe/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:26:16.948960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191f3ce-25da-45a2-80e6-3cd4e0824986 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:16.949305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191f3ce-25da-45a2-80e6-3cd4e0824986 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:16.949582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191f3ce-25da-45a2-80e6-3cd4e0824986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:16.976870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d191f3ce-25da-45a2-80e6-3cd4e0824986 None None] MFA Rules not processed for user `64084b72253b4e458009e93d215ec8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:16.978137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d191f3ce-25da-45a2-80e6-3cd4e0824986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:17.049061 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4037/7992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:17.054306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:17.118971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e934f8-2cfc-4ccb-bb58-7bb8a6648998 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:17.124996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:17.125227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.125500 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.125793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.126480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:17.128430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:17.157882 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3956/7993] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:26:17 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:17.162308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191f3ce-25da-45a2-80e6-3cd4e0824986 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:17.173338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191f3ce-25da-45a2-80e6-3cd4e0824986 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:17.228356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:17.229143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.229425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.229698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.230429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:17.232378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:17.254366 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4038/7994] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:26:17 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:26:17.258462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:17.269144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491f0b6-30dc-4f4b-ab3b-7d749e8d81fd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:17.273878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:17.274548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.274829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.275103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.275822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:17.277484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:17.289164 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3957/7995] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:17.293508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:17.304000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48529921-e1c6-4fb1-9db7-91a723fcd4bb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:17.309833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:17.310770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.311041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.311319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] PATH_INFO: `/v3/projects/9404593165ee4c7da2844a4ab235fc96/users/70f13c6533094617a83f21b58dc15c0b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.327200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9404593165ee4c7da2844a4ab235fc96, user_id=70f13c6533094617a83f21b58dc15c0b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:17.329668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:17.346201 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4039/7996] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:17 2022] PUT /identity/v3/projects/9404593165ee4c7da2844a4ab235fc96/users/70f13c6533094617a83f21b58dc15c0b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:17.350234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:17.360908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc24488-d684-4f2a-8d5d-fd1b88152903 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:17.421806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82250cc-c420-4368-bd3c-b810d149919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:17.422476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82250cc-c420-4368-bd3c-b810d149919a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.422756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82250cc-c420-4368-bd3c-b810d149919a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.423035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82250cc-c420-4368-bd3c-b810d149919a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.423771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82250cc-c420-4368-bd3c-b810d149919a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:17.425403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82250cc-c420-4368-bd3c-b810d149919a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:17.435402 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3958/7997] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:17.439701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:17.451473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127c96-c0b2-4b65-b2c5-d1b1b8112706 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:17.456890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:17.457474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.457755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.458031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] PATH_INFO: `/v3/projects/9404593165ee4c7da2844a4ab235fc96/users/70f13c6533094617a83f21b58dc15c0b/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.460068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9404593165ee4c7da2844a4ab235fc96, user_id=70f13c6533094617a83f21b58dc15c0b, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:17.462797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:17.473893 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4040/7998] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:17 2022] PUT /identity/v3/projects/9404593165ee4c7da2844a4ab235fc96/users/70f13c6533094617a83f21b58dc15c0b/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:17.484436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.484661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.484933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.511474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] MFA Rules not processed for user `70f13c6533094617a83f21b58dc15c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:17.512686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:17.593146 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3959/7999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:17.605794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:17.607644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:17.684626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64d6d-8789-4bef-a0f8-d9c9c4f935a3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:17.691493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a426a10-d0f8-4e80-9606-27999269c2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:17.692156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a426a10-d0f8-4e80-9606-27999269c2cb service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:17.692428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a426a10-d0f8-4e80-9606-27999269c2cb service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:17.692696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a426a10-d0f8-4e80-9606-27999269c2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:17.749067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a426a10-d0f8-4e80-9606-27999269c2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:17.750580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a426a10-d0f8-4e80-9606-27999269c2cb service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:17.759535 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4041/8000] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:20.294107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:20.295680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:20.354938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674225-8a83-453c-bfed-e893cb3cc553 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:20.358666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:20.359563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:20.359844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:20.360111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:20.369061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:20.370546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:20.380339 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3960/8001] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:23.874152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:23.874632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:23.874708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:23.901296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] MFA Rules not processed for user `0818e5f0edb74b82821c07c88df54826`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:23.904765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:23.912664 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4042/8002] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:24.696745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:24.698253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:24.783775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778740-54e3-43af-80a2-7b91124c6aea service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:24.789094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:24.789754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:24.790031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:24.790302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:24.792075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:24.805858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:24.807464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:24.820782 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3961/8003] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:33.393543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:33.396292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:33.418101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16da549-c373-4424-8b87-ef4f7861a7b9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:33.423896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7103c0-543e-4a86-8b1b-d312eb8e824b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:33.424569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7103c0-543e-4a86-8b1b-d312eb8e824b service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:33.424847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7103c0-543e-4a86-8b1b-d312eb8e824b service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:33.425158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7103c0-543e-4a86-8b1b-d312eb8e824b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:33.426976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ef7103c0-543e-4a86-8b1b-d312eb8e824b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:33.457332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7103c0-543e-4a86-8b1b-d312eb8e824b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:33.459180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7103c0-543e-4a86-8b1b-d312eb8e824b service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:33.474810 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4043/8004] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:33.540868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:33.542520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:33.608970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bc38e-489c-4eed-bc01-eecc249fddc7 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:33.613763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:33.614721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:33.615004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:33.615337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] PATH_INFO: `/v3/users/6ab3b662559847ceb8b103944488db63` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:33.616680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab3b662559847ceb8b103944488db63)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:33.618708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:33.667296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab3b662559847ceb8b103944488db63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:33.667950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab3b662559847ceb8b103944488db63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:33.674926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab3b662559847ceb8b103944488db63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:33.675585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab3b662559847ceb8b103944488db63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:33.683834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab3b662559847ceb8b103944488db63'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:33.702440 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3962/8005] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:26:33 2022] DELETE /identity/v3/users/6ab3b662559847ceb8b103944488db63 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:33.709653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:33.710103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:33.710540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:33.737138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:33.738358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:33.796743 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4044/8006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:33.806898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:33.808557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:33.871397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda268-fb8b-4217-ae72-f9084a565ca7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:33.875008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b3ad-28c7-4890-aa06-6b947e5511ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:33.875696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b3ad-28c7-4890-aa06-6b947e5511ad service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:33.875974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b3ad-28c7-4890-aa06-6b947e5511ad service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:33.876245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b3ad-28c7-4890-aa06-6b947e5511ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:33.885193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b3ad-28c7-4890-aa06-6b947e5511ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:33.886654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b3ad-28c7-4890-aa06-6b947e5511ad service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:33.896023 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3963/8007] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:34.164859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.166521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:34.179023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf3996-61fa-4001-94b0-569070ceba7d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.184546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.185470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.185746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.186016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] PATH_INFO: `/v3/projects/dbc3bda5bec94e2cba6e96394bb8d9c8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.187682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc3bda5bec94e2cba6e96394bb8d9c8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.189784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.245404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'request_id': 'req-b9a9a344-7083-4c34-a16b-81507f1071ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:34.250853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'request_id': 'req-b9a9a344-7083-4c34-a16b-81507f1071ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:34.260315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'request_id': 'req-b9a9a344-7083-4c34-a16b-81507f1071ef'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:34.271737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] The token cache is being invalidate because project dbc3bda5bec94e2cba6e96394bb8d9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:26:34.272018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:34.272657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9a9a344-7083-4c34-a16b-81507f1071ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:34.274290 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4045/8008] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:26:34 2022] DELETE /identity/v3/projects/dbc3bda5bec94e2cba6e96394bb8d9c8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:34.279486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae17fc-fb88-48ed-b259-d20cc5dff911 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.279771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae17fc-fb88-48ed-b259-d20cc5dff911 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.280041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae17fc-fb88-48ed-b259-d20cc5dff911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.298780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-baae17fc-fb88-48ed-b259-d20cc5dff911 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:34.299997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-baae17fc-fb88-48ed-b259-d20cc5dff911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:34.363637 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3964/8009] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:34.371756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95a2f-4a35-4b14-8922-81ba9ad09efc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.372035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95a2f-4a35-4b14-8922-81ba9ad09efc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.372306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95a2f-4a35-4b14-8922-81ba9ad09efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.390797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-85b95a2f-4a35-4b14-8922-81ba9ad09efc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:34.392010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85b95a2f-4a35-4b14-8922-81ba9ad09efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:34.400413 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4046/8010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:34.404734 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae17fc-fb88-48ed-b259-d20cc5dff911 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.414803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae17fc-fb88-48ed-b259-d20cc5dff911 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.420036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.420688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.420967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.421259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.421986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:26:34.422288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.424000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.436307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3965/8011] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:26:34.440813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95a2f-4a35-4b14-8922-81ba9ad09efc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.452653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95a2f-4a35-4b14-8922-81ba9ad09efc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.458700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.459381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.459662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.459936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.460624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.462640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.492366 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4047/8012] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:26:34 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:34.496486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.506966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207d153-ead4-4723-ad84-bb331352448c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.574086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.574823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.575016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.575285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.575983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.578036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.599131 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3966/8013] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:26:34 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:34.603417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.613995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbb931-dd9f-493b-8716-90317b9d59ea admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.620305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.620305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.620305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.620305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.621244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.623021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.634581 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4048/8014] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:34.639368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.650376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90825d-809d-42b3-b34c-bc7a3a64cd17 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.655784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c9eb8-f44d-4366-9c46-b37daf32f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.656471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c9eb8-f44d-4366-9c46-b37daf32f616 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.656753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c9eb8-f44d-4366-9c46-b37daf32f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.657054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c9eb8-f44d-4366-9c46-b37daf32f616 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.657823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c9eb8-f44d-4366-9c46-b37daf32f616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.659554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c9eb8-f44d-4366-9c46-b37daf32f616 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.670936 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3967/8015] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:26:34.675285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.685255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d81-2324-4675-9056-03890c3f2e3f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.689985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.690890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.691165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.691431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] PATH_INFO: `/v3/projects/ba99b682561b49caafd954b3a1cd65cc/users/95db37215f2444d1987829e5861c8d4b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.706227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba99b682561b49caafd954b3a1cd65cc, user_id=95db37215f2444d1987829e5861c8d4b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.708891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.724095 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4049/8016] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:34 2022] PUT /identity/v3/projects/ba99b682561b49caafd954b3a1cd65cc/users/95db37215f2444d1987829e5861c8d4b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:34.730792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ba94-fb78-4a30-add4-04407d268cfc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.731211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ba94-fb78-4a30-add4-04407d268cfc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.731592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ba94-fb78-4a30-add4-04407d268cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.751090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9750ba94-fb78-4a30-add4-04407d268cfc None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:34.752296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9750ba94-fb78-4a30-add4-04407d268cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:34.812890 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3968/8017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:34.822979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:34.824992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:34.887766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0dcad-cc38-4552-9de6-2eeaaf841b58 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:34.892321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:34.893146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:34.893428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:34.893698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:34.903468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:34.904904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:34.914366 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4050/8018] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:35.504872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a33fe-e081-4e73-88a9-6f24a4b82b1e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:35.505267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a33fe-e081-4e73-88a9-6f24a4b82b1e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:35.505546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a33fe-e081-4e73-88a9-6f24a4b82b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:35.534430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2a9a33fe-e081-4e73-88a9-6f24a4b82b1e None None] MFA Rules not processed for user `95db37215f2444d1987829e5861c8d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:35.535878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2a9a33fe-e081-4e73-88a9-6f24a4b82b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:35.604754 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3969/8019] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:35.609639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:35.619152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97dfe5-98c8-4d89-8a26-61570b2dbe8c service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:35.623670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:35.624326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:35.624597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:35.624862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:35.625583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:35.627554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:35.654385 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4051/8020] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:26:35 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:35.659718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a33fe-e081-4e73-88a9-6f24a4b82b1e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:35.670522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a33fe-e081-4e73-88a9-6f24a4b82b1e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:35.726628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:35.727308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:35.727585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:35.727852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:35.728536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:35.730479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:35.752294 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3970/8021] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:26:35 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:35.756489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:35.767185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fd026-cb8b-42c4-bd97-3e1836c35bcb admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:35.772056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:35.772814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:35.773189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:35.773549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:35.774393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:35.776090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:35.787398 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4052/8022] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:26:35.791461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:35.802075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae549b6-de0b-410a-8da3-bc8c7b520d63 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:35.807012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b26ea-da07-4696-8307-ef27b90d84c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:35.807683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b26ea-da07-4696-8307-ef27b90d84c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:35.807958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b26ea-da07-4696-8307-ef27b90d84c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:35.808226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b26ea-da07-4696-8307-ef27b90d84c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:35.808993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b26ea-da07-4696-8307-ef27b90d84c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:35.810757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b26ea-da07-4696-8307-ef27b90d84c5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:35.824172 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3971/8023] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:35.825631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:35.835772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4581f-f223-4c4e-82c5-dd257fc89d2b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:35.840727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc1515-4974-46d2-a4e3-0556c6d81e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:35.841665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc1515-4974-46d2-a4e3-0556c6d81e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:35.841940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc1515-4974-46d2-a4e3-0556c6d81e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:35.842208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc1515-4974-46d2-a4e3-0556c6d81e6b admin admin] PATH_INFO: `/v3/projects/9cecfd5cedc14deba5fecaa9183caddc/users/62f62d5586c14487abb2b4e505f0db13/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:35.856554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc1515-4974-46d2-a4e3-0556c6d81e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cecfd5cedc14deba5fecaa9183caddc, user_id=62f62d5586c14487abb2b4e505f0db13, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:35.859287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc1515-4974-46d2-a4e3-0556c6d81e6b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:35.874065 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4053/8024] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:35 2022] PUT /identity/v3/projects/9cecfd5cedc14deba5fecaa9183caddc/users/62f62d5586c14487abb2b4e505f0db13/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:36.597068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:36.597380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:36.597656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:36.628740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] MFA Rules not processed for user `62f62d5586c14487abb2b4e505f0db13`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:36.631047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:36.710918 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3972/8025] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:36.720923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:36.721467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:36.721569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:36.744086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] MFA Rules not processed for user `95db37215f2444d1987829e5861c8d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:36.745727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:36.808809 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4054/8026] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:36.815892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:36.817318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:36.896885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b717bb8-3446-423f-8f71-ba07df5b2e8f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:36.902531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:36.903246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:36.903522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:36.903792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:36.912016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:36.913962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:36.923400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3973/8027] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:37.156340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:37.157914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:37.215831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3885f9-9909-4ad8-8f01-0e7b56b7f048 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:37.219613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:37.220279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:37.220560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:37.220827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:37.222703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:37.234672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:37.236172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:37.246970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4055/8028] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:48.464375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:48.465993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:48.483005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057c37-a5c7-4667-8887-33a61adf6ca6 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:48.489303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:48.490012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:48.490288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:48.490580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:48.498570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:48.500165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:48.509154 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3974/8029] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:53.435525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:53.515750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efb861-89d9-4d25-89d4-ec592b2d619a service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:53.523974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:53.525216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:53.525624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:53.525990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] PATH_INFO: `/v3/users/95db37215f2444d1987829e5861c8d4b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:53.528092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95db37215f2444d1987829e5861c8d4b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:53.531341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:53.587353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95db37215f2444d1987829e5861c8d4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.588559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95db37215f2444d1987829e5861c8d4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.598302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95db37215f2444d1987829e5861c8d4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.607355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95db37215f2444d1987829e5861c8d4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.608022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95db37215f2444d1987829e5861c8d4b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.625307 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4056/8030] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:26:53 2022] DELETE /identity/v3/users/95db37215f2444d1987829e5861c8d4b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:53.802464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:53.813594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a0f9-88d6-423c-a2bb-93d4a7707e3a service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:53.879903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:53.880770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:53.881029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:53.881483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] PATH_INFO: `/v3/projects/ba99b682561b49caafd954b3a1cd65cc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:53.882701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba99b682561b49caafd954b3a1cd65cc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:53.884736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:53.935519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba99b682561b49caafd954b3a1cd65cc', 'request_id': 'req-9b0c3e45-718f-4e66-b850-4febc772ebc4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.942100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba99b682561b49caafd954b3a1cd65cc', 'request_id': 'req-9b0c3e45-718f-4e66-b850-4febc772ebc4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.951136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba99b682561b49caafd954b3a1cd65cc', 'request_id': 'req-9b0c3e45-718f-4e66-b850-4febc772ebc4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.962334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] The token cache is being invalidate because project ba99b682561b49caafd954b3a1cd65cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:26:53.962617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.963570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:53.965186 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3975/8031] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:26:53 2022] DELETE /identity/v3/projects/ba99b682561b49caafd954b3a1cd65cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:53.969290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:53.970845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:53.984631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619477c4-35e6-41d7-85b1-d56358dab880 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.042733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.043614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.043887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.044153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] PATH_INFO: `/v3/users/62f62d5586c14487abb2b4e505f0db13` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.045542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f62d5586c14487abb2b4e505f0db13)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.047510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.097005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f62d5586c14487abb2b4e505f0db13'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.097754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f62d5586c14487abb2b4e505f0db13'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.105019 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f62d5586c14487abb2b4e505f0db13'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.113871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f62d5586c14487abb2b4e505f0db13'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.114531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4a3cddc9-4175-4bd4-879b-eefe7e4191c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f62d5586c14487abb2b4e505f0db13'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.130749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4057/8032] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:26:53 2022] DELETE /identity/v3/users/62f62d5586c14487abb2b4e505f0db13 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:54.309204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:54.311453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:54.328727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c3e45-718f-4e66-b850-4febc772ebc4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.387013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.387886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.388157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.388424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] PATH_INFO: `/v3/projects/9cecfd5cedc14deba5fecaa9183caddc` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.389777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cecfd5cedc14deba5fecaa9183caddc)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.391728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.439148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cecfd5cedc14deba5fecaa9183caddc', 'request_id': 'req-8117d996-2d13-4b4c-98e0-646f3a9bcc46'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.445313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cecfd5cedc14deba5fecaa9183caddc', 'request_id': 'req-8117d996-2d13-4b4c-98e0-646f3a9bcc46'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.453978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cecfd5cedc14deba5fecaa9183caddc', 'request_id': 'req-8117d996-2d13-4b4c-98e0-646f3a9bcc46'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.465966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] The token cache is being invalidate because project 9cecfd5cedc14deba5fecaa9183caddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:26:54.466243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.466877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8117d996-2d13-4b4c-98e0-646f3a9bcc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:54.468479 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3976/8033] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:26:54 2022] DELETE /identity/v3/projects/9cecfd5cedc14deba5fecaa9183caddc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:54.473761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c430-4fa6-4e25-8d2d-0fea4ded34ea None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.474244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c430-4fa6-4e25-8d2d-0fea4ded34ea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.474333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c430-4fa6-4e25-8d2d-0fea4ded34ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.492948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dd89c430-4fa6-4e25-8d2d-0fea4ded34ea None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:54.494152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dd89c430-4fa6-4e25-8d2d-0fea4ded34ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:54.563342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4058/8034] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:54.571173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021b42-0405-4468-8bd4-ccf47e784db2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.571483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021b42-0405-4468-8bd4-ccf47e784db2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.571759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021b42-0405-4468-8bd4-ccf47e784db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.592202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-40021b42-0405-4468-8bd4-ccf47e784db2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:54.593477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-40021b42-0405-4468-8bd4-ccf47e784db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:54.602918 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3977/8035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:54.607380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c430-4fa6-4e25-8d2d-0fea4ded34ea None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:54.617952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c430-4fa6-4e25-8d2d-0fea4ded34ea None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.623362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.624034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.624317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.624589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.625354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:26:54.625656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.627320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.639529 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4059/8036] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:26:54.643911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021b42-0405-4468-8bd4-ccf47e784db2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:54.653778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021b42-0405-4468-8bd4-ccf47e784db2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.660227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.660889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.661207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.661478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.662165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.664093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.693395 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3978/8037] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:26:54 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:54.697772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:54.708173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a47a-1617-40e6-9295-3071d2198b9d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.765783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.766380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.766687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.766957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.767641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.769620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.793711 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4060/8038] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:26:54 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:54.798030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:54.808869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec674ee-7d71-4ab5-9d6d-66d8aa5562a2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.814522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.815196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.815478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.815751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.816478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.818139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.830478 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3979/8039] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:54.834834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:54.847117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad85f-93b2-4938-bdf8-79ccca0e8820 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.855507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073c8a-6eb5-4613-8e68-eb2c0e0fb767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.856564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073c8a-6eb5-4613-8e68-eb2c0e0fb767 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.856984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073c8a-6eb5-4613-8e68-eb2c0e0fb767 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.857423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073c8a-6eb5-4613-8e68-eb2c0e0fb767 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.858553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073c8a-6eb5-4613-8e68-eb2c0e0fb767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.861177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073c8a-6eb5-4613-8e68-eb2c0e0fb767 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.873194 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4061/8040] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:54.877302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:54.887823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53de96-3548-4a62-a30b-10b1d9e8a470 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:54.892909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:54.893820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.894060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.894367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] PATH_INFO: `/v3/projects/33418238b82a450997b3e3d4152633ac/users/06c08594caf14e4285c0d3885029e816/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.910009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33418238b82a450997b3e3d4152633ac, user_id=06c08594caf14e4285c0d3885029e816, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:54.912715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:54.927964 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3980/8041] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:54 2022] PUT /identity/v3/projects/33418238b82a450997b3e3d4152633ac/users/06c08594caf14e4285c0d3885029e816/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:54.939170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db086-8e5c-42bf-b252-7338b0d33d00 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:54.939455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db086-8e5c-42bf-b252-7338b0d33d00 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:54.939732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db086-8e5c-42bf-b252-7338b0d33d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:54.966917 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-108db086-8e5c-42bf-b252-7338b0d33d00 None None] MFA Rules not processed for user `06c08594caf14e4285c0d3885029e816`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:54.968131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-108db086-8e5c-42bf-b252-7338b0d33d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:55.035178 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4062/8042] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:55.048445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:55.110974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25222e76-5849-478b-9617-51db33bdbb28 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:55.115940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:55.116813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.117117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.117387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] PATH_INFO: `/v3/users/06c08594caf14e4285c0d3885029e816` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.118579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c08594caf14e4285c0d3885029e816)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:55.120510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:55.169029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c08594caf14e4285c0d3885029e816'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.169623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c08594caf14e4285c0d3885029e816'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.176614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c08594caf14e4285c0d3885029e816'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.177370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c08594caf14e4285c0d3885029e816'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.187490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c08594caf14e4285c0d3885029e816'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.205316 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3981/8043] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:26:55 2022] DELETE /identity/v3/users/06c08594caf14e4285c0d3885029e816 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:55.209995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.210298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.210573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.230726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:55.231662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:55.291920 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4063/8044] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:55.302014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:55.303448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:55.363697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20465c-298f-4292-ad27-dfd688276873 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:55.367915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b49d7-7420-4a2d-a35e-8c55cc7badad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:55.368569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b49d7-7420-4a2d-a35e-8c55cc7badad service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.368845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b49d7-7420-4a2d-a35e-8c55cc7badad service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.369146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b49d7-7420-4a2d-a35e-8c55cc7badad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.379108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b49d7-7420-4a2d-a35e-8c55cc7badad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:55.380555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b49d7-7420-4a2d-a35e-8c55cc7badad service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:55.390349 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3982/8045] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:55.681694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:55.683378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:55.697248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3826-81c5-4408-8975-0de284447c2a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:55.702224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:55.703578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.703902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.704174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] PATH_INFO: `/v3/projects/33418238b82a450997b3e3d4152633ac` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.705614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33418238b82a450997b3e3d4152633ac)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:55.707641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:55.755987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33418238b82a450997b3e3d4152633ac', 'request_id': 'req-b9b5464c-4333-45fd-bd55-a35b3f300a74'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.761353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33418238b82a450997b3e3d4152633ac', 'request_id': 'req-b9b5464c-4333-45fd-bd55-a35b3f300a74'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.771055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33418238b82a450997b3e3d4152633ac', 'request_id': 'req-b9b5464c-4333-45fd-bd55-a35b3f300a74'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.782389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] The token cache is being invalidate because project 33418238b82a450997b3e3d4152633ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:26:55.782671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.783304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b9b5464c-4333-45fd-bd55-a35b3f300a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:55.785019 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4064/8046] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:26:55 2022] DELETE /identity/v3/projects/33418238b82a450997b3e3d4152633ac => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:55.790877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27141e3c-8274-4e31-9321-cd61caeac13c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.791156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27141e3c-8274-4e31-9321-cd61caeac13c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.791425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27141e3c-8274-4e31-9321-cd61caeac13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.809263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-27141e3c-8274-4e31-9321-cd61caeac13c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:55.810407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-27141e3c-8274-4e31-9321-cd61caeac13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:55.871991 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3983/8047] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:55.880057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dcc45-ed3e-4f7c-af9c-6f3d1de60e68 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.880335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dcc45-ed3e-4f7c-af9c-6f3d1de60e68 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.880614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dcc45-ed3e-4f7c-af9c-6f3d1de60e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.899966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-635dcc45-ed3e-4f7c-af9c-6f3d1de60e68 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:55.901209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-635dcc45-ed3e-4f7c-af9c-6f3d1de60e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:55.909898 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4065/8048] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:55.914366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27141e3c-8274-4e31-9321-cd61caeac13c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:55.925321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27141e3c-8274-4e31-9321-cd61caeac13c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:55.931072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:55.931731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.932009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.932279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.933010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:26:55.933342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:55.934951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:55.946547 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3984/8049] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:26:55.951048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dcc45-ed3e-4f7c-af9c-6f3d1de60e68 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:55.960489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dcc45-ed3e-4f7c-af9c-6f3d1de60e68 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:55.965928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:55.966585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:55.966977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:55.967249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:55.967965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:55.969908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:55.998768 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4066/8050] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:26:55 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:56.003037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:56.013060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7ec0-9acc-411c-aa4f-5bdbe27a685a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:56.072397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:56.072997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:56.073316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:56.073596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:56.074259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:56.076200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:56.099693 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3985/8051] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:26:56 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:26:56.103639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:56.114686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2789780-0a75-45eb-8d89-2b7575f33568 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:56.119853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:56.120525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:56.120827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:56.121125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:56.121839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:56.123518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:56.134586 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4067/8052] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:26:56.138881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:56.149233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb9af-ae01-4af9-b13d-06e2ca754ee8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:56.153908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ff921-fcdd-4cad-a5a2-c8e326b22343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:56.154581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ff921-fcdd-4cad-a5a2-c8e326b22343 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:56.154852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ff921-fcdd-4cad-a5a2-c8e326b22343 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:56.155128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ff921-fcdd-4cad-a5a2-c8e326b22343 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:56.155852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ff921-fcdd-4cad-a5a2-c8e326b22343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:56.157506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ff921-fcdd-4cad-a5a2-c8e326b22343 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:56.167315 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3986/8053] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:26:56.171426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:56.182568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186f9ac-20d3-4aa6-b2b9-6a3ded9b5685 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:56.189449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:56.190697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:56.191007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:56.191273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] PATH_INFO: `/v3/projects/2884cbdbc9c143169084d8786530533b/users/0a1235f8c65245ed9dba39794299233c/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:56.211717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2884cbdbc9c143169084d8786530533b, user_id=0a1235f8c65245ed9dba39794299233c, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:56.214935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:56.230599 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4068/8054] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:26:56 2022] PUT /identity/v3/projects/2884cbdbc9c143169084d8786530533b/users/0a1235f8c65245ed9dba39794299233c/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:56.241330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0c55d-a28c-4656-bde5-2b84362a1004 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:56.241621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0c55d-a28c-4656-bde5-2b84362a1004 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:56.241896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0c55d-a28c-4656-bde5-2b84362a1004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:56.269365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b3b0c55d-a28c-4656-bde5-2b84362a1004 None None] MFA Rules not processed for user `0a1235f8c65245ed9dba39794299233c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:56.270616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b3b0c55d-a28c-4656-bde5-2b84362a1004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:56.335588 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3987/8055] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:56.347644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:56.349642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:56.430610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a0fe2-0519-48ac-8396-4e58623348d0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:56.436996 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc223e7-486e-4995-99ff-7aad9c60ffb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:56.437696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc223e7-486e-4995-99ff-7aad9c60ffb8 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:56.437971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc223e7-486e-4995-99ff-7aad9c60ffb8 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:56.438261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc223e7-486e-4995-99ff-7aad9c60ffb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:56.447248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc223e7-486e-4995-99ff-7aad9c60ffb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:56.448945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc223e7-486e-4995-99ff-7aad9c60ffb8 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:56.461192 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4069/8056] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:59.128166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0c55d-a28c-4656-bde5-2b84362a1004 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:59.198056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0c55d-a28c-4656-bde5-2b84362a1004 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:59.203823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:59.204707 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:59.204977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:59.205279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] PATH_INFO: `/v3/users/0a1235f8c65245ed9dba39794299233c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:59.206519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1235f8c65245ed9dba39794299233c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:59.208507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:59.266115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1235f8c65245ed9dba39794299233c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.266787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1235f8c65245ed9dba39794299233c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.273972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1235f8c65245ed9dba39794299233c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.274627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1235f8c65245ed9dba39794299233c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.283596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1235f8c65245ed9dba39794299233c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.300945 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3988/8057] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:26:59 2022] DELETE /identity/v3/users/0a1235f8c65245ed9dba39794299233c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:59.305765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:59.306236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:59.306335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:59.325813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:59.327036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:59.395586 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4070/8058] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:26:59.405808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:59.407325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:59.467336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e9e0-117a-4d0a-9421-da2e8d06be36 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:59.471382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7701b4-f097-4a68-8e14-1e01d990da47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:59.472033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7701b4-f097-4a68-8e14-1e01d990da47 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:59.472312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7701b4-f097-4a68-8e14-1e01d990da47 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:59.472585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7701b4-f097-4a68-8e14-1e01d990da47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:59.482192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7701b4-f097-4a68-8e14-1e01d990da47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:59.483641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7701b4-f097-4a68-8e14-1e01d990da47 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:59.493360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3989/8059] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:26:59.779753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:26:59.781242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:59.799712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd38b-5f72-4038-9a52-079b4a24296c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:26:59.805450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:26:59.806228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:59.806538 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:59.806770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] PATH_INFO: `/v3/projects/2884cbdbc9c143169084d8786530533b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:59.807952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2884cbdbc9c143169084d8786530533b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:26:59.809931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:26:59.857865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2884cbdbc9c143169084d8786530533b', 'request_id': 'req-7fece3d2-101a-420f-a585-40f8d42a3df8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.863499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2884cbdbc9c143169084d8786530533b', 'request_id': 'req-7fece3d2-101a-420f-a585-40f8d42a3df8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.872492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2884cbdbc9c143169084d8786530533b', 'request_id': 'req-7fece3d2-101a-420f-a585-40f8d42a3df8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.883651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] The token cache is being invalidate because project 2884cbdbc9c143169084d8786530533b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:26:59.883929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.884554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fece3d2-101a-420f-a585-40f8d42a3df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:26:59.886301 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4071/8060] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:26:59 2022] DELETE /identity/v3/projects/2884cbdbc9c143169084d8786530533b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:26:59.891277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b3199-5f24-4de8-adf7-2c769f4de08b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:59.891568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b3199-5f24-4de8-adf7-2c769f4de08b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:59.891830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b3199-5f24-4de8-adf7-2c769f4de08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:26:59.911826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-708b3199-5f24-4de8-adf7-2c769f4de08b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:26:59.913297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-708b3199-5f24-4de8-adf7-2c769f4de08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:26:59.984331 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3990/8061] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:26:59.993850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3776b7-27e9-4ab8-8ef2-851c682efc09 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:26:59.994121 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3776b7-27e9-4ab8-8ef2-851c682efc09 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:26:59.994400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3776b7-27e9-4ab8-8ef2-851c682efc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.014243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ad3776b7-27e9-4ab8-8ef2-851c682efc09 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:00.015439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ad3776b7-27e9-4ab8-8ef2-851c682efc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:00.024376 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4072/8062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:00.028858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b3199-5f24-4de8-adf7-2c769f4de08b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.039156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b3199-5f24-4de8-adf7-2c769f4de08b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.044657 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.045357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.045635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.045907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.046639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:00.046942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.048567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.060706 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3991/8063] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:00.065196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3776b7-27e9-4ab8-8ef2-851c682efc09 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.074555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3776b7-27e9-4ab8-8ef2-851c682efc09 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.079800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.080460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.080742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.081017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.081697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.083910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.110863 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4073/8064] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:00 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:00.115098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.125200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad020-8922-4bb5-9e49-492f533ce46d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.185562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.186250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.186534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.186812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.187490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.189458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.213666 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3992/8065] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:00 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:00.214838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.225120 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac74fc-40bd-466b-98a8-7eb8a4637d61 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.229735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.230402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.230680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.230953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.231671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.233335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.243730 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4074/8066] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:00.247793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.258285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3cb64-8b4d-4a17-9571-336fa8297ee1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.264910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0567-83bc-42f4-943a-d05724319a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.266086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0567-83bc-42f4-943a-d05724319a52 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.266364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0567-83bc-42f4-943a-d05724319a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.266676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0567-83bc-42f4-943a-d05724319a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.267413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0567-83bc-42f4-943a-d05724319a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.269055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0567-83bc-42f4-943a-d05724319a52 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.280647 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3993/8067] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:00.285153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.295787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974bda5-d5dc-46bd-a8d4-4f2b38af9c9f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.300954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.301882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.302159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.302433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] PATH_INFO: `/v3/projects/9b62f1c9c81c4187abe5ef490500cd36/users/96acfaf5be4b4de5a2747fb6d886dfe8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.318420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b62f1c9c81c4187abe5ef490500cd36, user_id=96acfaf5be4b4de5a2747fb6d886dfe8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.321179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.338632 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4075/8068] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:00 2022] PUT /identity/v3/projects/9b62f1c9c81c4187abe5ef490500cd36/users/96acfaf5be4b4de5a2747fb6d886dfe8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:00.353092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8654a-5e06-43b7-b828-24026172d5eb None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.353401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8654a-5e06-43b7-b828-24026172d5eb None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.353679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8654a-5e06-43b7-b828-24026172d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.382699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3ef8654a-5e06-43b7-b828-24026172d5eb None None] MFA Rules not processed for user `96acfaf5be4b4de5a2747fb6d886dfe8`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:00.383912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3ef8654a-5e06-43b7-b828-24026172d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:00.449874 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3994/8069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:00.454327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.517829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482758b-99fa-4b59-bd28-5a95d0dde92b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.523068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.523737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.524014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.524286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.524967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.527035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.555141 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4076/8070] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:00 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:00.558593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8654a-5e06-43b7-b828-24026172d5eb None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.569584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8654a-5e06-43b7-b828-24026172d5eb None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.628126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.628805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.629116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.629395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.630117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.632145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.657293 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3995/8071] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:00 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:00.661484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.672506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792bd8a-c350-417f-83c4-ed1aac464cee admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.677915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.678592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.678868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.679139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.679854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.681520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.691922 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4077/8072] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:00.696108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.706124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1cbd-9b0e-49b0-9b17-48674aad832d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.711221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.712120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.712395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.713028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] PATH_INFO: `/v3/projects/8c18033a5d594a66860362f9ae32899c/users/c6fb0c5da903494193eee87daddd9625/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.728323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c18033a5d594a66860362f9ae32899c, user_id=c6fb0c5da903494193eee87daddd9625, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.731108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.746651 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3996/8073] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:00 2022] PUT /identity/v3/projects/8c18033a5d594a66860362f9ae32899c/users/c6fb0c5da903494193eee87daddd9625/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:00.750676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.761067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f2f8d-4771-460e-9266-b57f2ed02993 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.816359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17102-5f31-4636-b5a3-c84cf93ddb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.817028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17102-5f31-4636-b5a3-c84cf93ddb2e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.817325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17102-5f31-4636-b5a3-c84cf93ddb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.817610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17102-5f31-4636-b5a3-c84cf93ddb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.818390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17102-5f31-4636-b5a3-c84cf93ddb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.820298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17102-5f31-4636-b5a3-c84cf93ddb2e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.834880 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4078/8074] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:00.839742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:00.850811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41cb76-e83e-4596-b917-30e40d9595f7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:00.856612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:00.857557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.857848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.858116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] PATH_INFO: `/v3/projects/8c18033a5d594a66860362f9ae32899c/users/c6fb0c5da903494193eee87daddd9625/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.860383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c18033a5d594a66860362f9ae32899c, user_id=c6fb0c5da903494193eee87daddd9625, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:00.863058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:00.874572 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3997/8075] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:00 2022] PUT /identity/v3/projects/8c18033a5d594a66860362f9ae32899c/users/c6fb0c5da903494193eee87daddd9625/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:00.885144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db591-cf25-4216-b25b-5a1271488e89 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:00.885552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db591-cf25-4216-b25b-5a1271488e89 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:00.885827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db591-cf25-4216-b25b-5a1271488e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:00.914712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-df4db591-cf25-4216-b25b-5a1271488e89 None None] MFA Rules not processed for user `c6fb0c5da903494193eee87daddd9625`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:00.915986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-df4db591-cf25-4216-b25b-5a1271488e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:00.994921 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4079/8076] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:00.999576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.010786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849063c-da68-4bba-baa2-b25b73e59ccc admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.015994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.016663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.016945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.017253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/services` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.017980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.019632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.035741 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3998/8077] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:00 2022] POST /identity/v3/services => generated 289 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:01.041790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db591-cf25-4216-b25b-5a1271488e89 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.051459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db591-cf25-4216-b25b-5a1271488e89 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.067281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.068026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.068305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.068577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.069354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.070987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.076361 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 09 21:27:01.076361 ncdv-master-1 devstack@keystone.service[102532]: Failed validating 'type' in schema['properties']['enabled']: Apr 09 21:27:01.076361 ncdv-master-1 devstack@keystone.service[102532]: {'enum': [True, False, None], 'type': 'boolean'} Apr 09 21:27:01.076361 ncdv-master-1 devstack@keystone.service[102532]: On instance['enabled']: Apr 09 21:27:01.076361 ncdv-master-1 devstack@keystone.service[102532]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 09 21:27:01.077593 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4080/8078] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:27:01 2022] POST /identity/v3/endpoints => generated 283 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:27:01.082629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.094091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8168-dbe7-44bd-8971-5ace9e92a770 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.099560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.100216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.100499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.100773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.101550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.103227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.108442 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 09 21:27:01.108442 ncdv-master-1 devstack@keystone.service[102531]: Failed validating 'type' in schema['properties']['enabled']: Apr 09 21:27:01.108442 ncdv-master-1 devstack@keystone.service[102531]: {'enum': [True, False, None], 'type': 'boolean'} Apr 09 21:27:01.108442 ncdv-master-1 devstack@keystone.service[102531]: On instance['enabled']: Apr 09 21:27:01.108442 ncdv-master-1 devstack@keystone.service[102531]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 09 21:27:01.109670 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 3999/8079] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:27:01 2022] POST /identity/v3/endpoints => generated 281 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:27:01.115282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.129512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be57921-f7a1-4fd2-ac07-ef0770951d9e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.135327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.135975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.136254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.136524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.137310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.138913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.155536 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1214886669. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:27:01.155536 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:27:01.155536 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:27:01.187687 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4081/8080] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:27:01 2022] POST /identity/v3/endpoints => generated 361 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:01.188915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.199287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd055b-f794-4238-93f3-3eb0383bf5b4 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.215579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.216441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.216725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.216996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/regions/tempest-region-1214886669` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.217690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1214886669)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.218837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.224363 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4000/8081] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 21:27:01 2022] GET /identity/v3/regions/tempest-region-1214886669 => generated 180 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:01.225419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.236463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f522-d4a2-489e-9ce2-2f591ed7e8a1 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.241939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.242809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.243095 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.243372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints/8dd4269685164c528c13e436df55030b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.249270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8dd4269685164c528c13e436df55030b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.250356 ncdv-master-1 devstack@keystone.service[102532]: WARNING py.warnings [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:27:01.250356 ncdv-master-1 devstack@keystone.service[102532]: warnings.warn(msg) Apr 09 21:27:01.250356 ncdv-master-1 devstack@keystone.service[102532]: Apr 09 21:27:01.251317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.261206 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 09 21:27:01.261206 ncdv-master-1 devstack@keystone.service[102532]: Failed validating 'type' in schema['properties']['enabled']: Apr 09 21:27:01.261206 ncdv-master-1 devstack@keystone.service[102532]: {'enum': [True, False, None], 'type': 'boolean'} Apr 09 21:27:01.261206 ncdv-master-1 devstack@keystone.service[102532]: On instance['enabled']: Apr 09 21:27:01.261206 ncdv-master-1 devstack@keystone.service[102532]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 09 21:27:01.262455 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4082/8082] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Apr 9 21:27:01 2022] PATCH /identity/v3/endpoints/8dd4269685164c528c13e436df55030b => generated 283 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:27:01.266653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.277284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8028d-b20a-438f-86d0-3257c36b416f tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.283198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.284173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.284455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.284795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints/8dd4269685164c528c13e436df55030b` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.286206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8dd4269685164c528c13e436df55030b)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.287884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.297722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8dd4269685164c528c13e436df55030b', 'request_id': 'req-59551340-7360-48f6-a639-a04fd36f5dd7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:01.307363 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4001/8083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:01 2022] DELETE /identity/v3/endpoints/8dd4269685164c528c13e436df55030b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:01.311553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.322471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5467ceb-0baf-49a8-aed5-c5676d3ecc5e tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.337953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.338806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.339083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.339351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/regions/tempest-region-1214886669` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.340015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1214886669)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.341679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.361512 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4083/8084] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 21:27:01 2022] DELETE /identity/v3/regions/tempest-region-1214886669 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:01.366687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.377783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59551340-7360-48f6-a639-a04fd36f5dd7 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.393182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.393846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.394125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.394394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.395115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.396808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.418111 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2103212734. To ensure interoperability, identifiers should be a valid uuid. Apr 09 21:27:01.418111 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 09 21:27:01.418111 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:27:01.447506 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4002/8085] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:27:01 2022] POST /identity/v3/endpoints => generated 360 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:01.450397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.461283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0e1a-a806-4570-83a4-0b6c08001e48 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.476827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.477697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.477977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.478249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/regions/tempest-region-2103212734` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.478926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2103212734)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.480028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.482470 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4084/8086] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 21:27:01 2022] GET /identity/v3/regions/tempest-region-2103212734 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:01.486234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.499292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ca8b1-a92d-42be-8fb2-006e81df8c9d tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.505097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.506008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.506291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.506555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints/af72141d41e5448098e6ff586279f8f0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.512232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=af72141d41e5448098e6ff586279f8f0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.513881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.523811 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 09 21:27:01.523811 ncdv-master-1 devstack@keystone.service[102531]: Failed validating 'type' in schema['properties']['enabled']: Apr 09 21:27:01.523811 ncdv-master-1 devstack@keystone.service[102531]: {'enum': [True, False, None], 'type': 'boolean'} Apr 09 21:27:01.523811 ncdv-master-1 devstack@keystone.service[102531]: On instance['enabled']: Apr 09 21:27:01.523811 ncdv-master-1 devstack@keystone.service[102531]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 09 21:27:01.525100 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4003/8087] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Apr 9 21:27:01 2022] PATCH /identity/v3/endpoints/af72141d41e5448098e6ff586279f8f0 => generated 281 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 09 21:27:01.530051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.540619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eadec-bc2c-4c9c-bdeb-59dd03d5fe35 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.545560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.546426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.546701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.546973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/endpoints/af72141d41e5448098e6ff586279f8f0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.548218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=af72141d41e5448098e6ff586279f8f0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.549869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.559137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'af72141d41e5448098e6ff586279f8f0', 'request_id': 'req-44e056cb-da4a-40f2-b97a-8bf771552026'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:01.568377 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4085/8088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:01 2022] DELETE /identity/v3/endpoints/af72141d41e5448098e6ff586279f8f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:01.572496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.583180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986431e-7aeb-4197-b231-d85749cc8e5a tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.598164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.599043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.599320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.599593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/regions/tempest-region-2103212734` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.600256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2103212734)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.601903 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.623093 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4004/8089] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 21:27:01 2022] DELETE /identity/v3/regions/tempest-region-2103212734 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:01.628590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.639953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e056cb-da4a-40f2-b97a-8bf771552026 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.655352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcf05a-958a-4c5a-8e96-2040b806bca6 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6fb0c5da903494193eee87daddd9625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c18033a5d594a66860362f9ae32899c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.656279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf05a-958a-4c5a-8e96-2040b806bca6 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.656550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf05a-958a-4c5a-8e96-2040b806bca6 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.656831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf05a-958a-4c5a-8e96-2040b806bca6 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] PATH_INFO: `/v3/services/24613674e361402390b74f4187c8d3d9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.657520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcf05a-958a-4c5a-8e96-2040b806bca6 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorizing `identity:delete_service(service_id=24613674e361402390b74f4187c8d3d9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.659181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcf05a-958a-4c5a-8e96-2040b806bca6 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.681979 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4086/8090] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:01 2022] DELETE /identity/v3/services/24613674e361402390b74f4187c8d3d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:01.686018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.761089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83831c4-f0a7-402f-b76d-1ba1060fee30 tempest-EndpointsNegativeTestJSON-812753433 tempest-EndpointsNegativeTestJSON-812753433-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:01.779873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:01.780766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.782530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.783001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] PATH_INFO: `/v3/users/96acfaf5be4b4de5a2747fb6d886dfe8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.785720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=96acfaf5be4b4de5a2747fb6d886dfe8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:01.788363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:01.841538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96acfaf5be4b4de5a2747fb6d886dfe8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:01.842339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96acfaf5be4b4de5a2747fb6d886dfe8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:01.849067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96acfaf5be4b4de5a2747fb6d886dfe8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:01.850318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96acfaf5be4b4de5a2747fb6d886dfe8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:01.858896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96acfaf5be4b4de5a2747fb6d886dfe8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:01.876098 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4005/8091] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:01 2022] DELETE /identity/v3/users/96acfaf5be4b4de5a2747fb6d886dfe8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:01.880921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:01.881238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:01.881540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:01.900174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:01.901416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:01.970096 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4087/8092] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:01.980245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:01.981787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:02.056796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e079c-b6f8-4819-891e-b2a7c0da98bf admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:02.061953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:02.062604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:02.062879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:02.063146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:02.073488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:02.074935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:02.084614 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4006/8093] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:02.367491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:02.368983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:02.381742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901ba4-b570-48e1-9323-2fc99232687b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:02.387380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:02.388260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:02.388553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:02.388820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] PATH_INFO: `/v3/projects/9b62f1c9c81c4187abe5ef490500cd36` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:02.390240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b62f1c9c81c4187abe5ef490500cd36)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:02.392154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:02.441550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b62f1c9c81c4187abe5ef490500cd36', 'request_id': 'req-c3af70ee-69ff-4d3f-a17a-d9628e368137'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.447626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b62f1c9c81c4187abe5ef490500cd36', 'request_id': 'req-c3af70ee-69ff-4d3f-a17a-d9628e368137'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.457779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b62f1c9c81c4187abe5ef490500cd36', 'request_id': 'req-c3af70ee-69ff-4d3f-a17a-d9628e368137'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.469214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] The token cache is being invalidate because project 9b62f1c9c81c4187abe5ef490500cd36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:02.469494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.470158 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.471738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4088/8094] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:02 2022] DELETE /identity/v3/projects/9b62f1c9c81c4187abe5ef490500cd36 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:02.475999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:02.485962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6caa-448d-41e3-837d-b6b99df22440 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:02.543315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:02.544186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:02.544457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:02.544725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] PATH_INFO: `/v3/users/c6fb0c5da903494193eee87daddd9625` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:02.545904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fb0c5da903494193eee87daddd9625)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:02.547818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:02.601272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fb0c5da903494193eee87daddd9625'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.601986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fb0c5da903494193eee87daddd9625'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.608836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fb0c5da903494193eee87daddd9625'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.609504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fb0c5da903494193eee87daddd9625'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.619390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fb0c5da903494193eee87daddd9625'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:02.635611 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4007/8095] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:02 2022] DELETE /identity/v3/users/c6fb0c5da903494193eee87daddd9625 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:03.213777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.215194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:03.231440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af70ee-69ff-4d3f-a17a-d9628e368137 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.294757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.295712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.295982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.296258 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] PATH_INFO: `/v3/projects/8c18033a5d594a66860362f9ae32899c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.297512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c18033a5d594a66860362f9ae32899c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.299490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.303085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.304587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:03.349166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c18033a5d594a66860362f9ae32899c', 'request_id': 'req-6e324497-47aa-4aac-8d57-a74a9c6e9295'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:03.355037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c18033a5d594a66860362f9ae32899c', 'request_id': 'req-6e324497-47aa-4aac-8d57-a74a9c6e9295'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:03.364176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c18033a5d594a66860362f9ae32899c', 'request_id': 'req-6e324497-47aa-4aac-8d57-a74a9c6e9295'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:03.375587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] The token cache is being invalidate because project 8c18033a5d594a66860362f9ae32899c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:03.376254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:03.376535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-6e324497-47aa-4aac-8d57-a74a9c6e9295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:03.378726 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4089/8096] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:03 2022] DELETE /identity/v3/projects/8c18033a5d594a66860362f9ae32899c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:03.383377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f1a3-b76c-4a06-b2a6-7f23e3f1e459 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.383668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f1a3-b76c-4a06-b2a6-7f23e3f1e459 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.383949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f1a3-b76c-4a06-b2a6-7f23e3f1e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.394549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde3a6-4adf-48ab-88f7-f6e4f6244ba7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.402278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0cd0f1a3-b76c-4a06-b2a6-7f23e3f1e459 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:03.403738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0cd0f1a3-b76c-4a06-b2a6-7f23e3f1e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:03.461578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.462475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.463093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.463384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.465376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:03.468352 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4090/8097] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:03.476507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbb1b1-4b0c-4044-b456-4f19a1c40872 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.476792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbb1b1-4b0c-4044-b456-4f19a1c40872 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.477068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbb1b1-4b0c-4044-b456-4f19a1c40872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.495054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3fbbb1b1-4b0c-4044-b456-4f19a1c40872 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:03.496257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3fbbb1b1-4b0c-4044-b456-4f19a1c40872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:03.504480 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4091/8098] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:03.508596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbb1b1-4b0c-4044-b456-4f19a1c40872 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.517747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbb1b1-4b0c-4044-b456-4f19a1c40872 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.522371 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.523057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.523332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.523606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.524328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.524787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:03.524787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.526203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.526344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.541967 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4092/8099] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:03.542944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.545783 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4008/8100] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:03.552479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a5d79-6e59-4a63-8a9e-d19b2a98a21e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.557321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.557983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.558260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.558555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.559234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.561200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.594562 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4093/8101] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:03 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:03.595726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.606564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a94b97-67f9-41b1-a5c7-5319eba601d9 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.663495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.664108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.664390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.664660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.665390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.667345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.689858 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4009/8102] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:03 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:03.694031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.704398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46066ad-c57a-4378-b780-ab32365da52c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.708986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.709687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.709964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.710227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.710950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.712900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.722927 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4094/8103] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:03.726893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.737060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314c703-c3dc-4e0c-bf7f-b4f0fba21274 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.741767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b1a76-fee9-4332-a028-a4e8c2d52969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.742436 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b1a76-fee9-4332-a028-a4e8c2d52969 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.742714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b1a76-fee9-4332-a028-a4e8c2d52969 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.742981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b1a76-fee9-4332-a028-a4e8c2d52969 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.743698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b1a76-fee9-4332-a028-a4e8c2d52969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.745319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b1a76-fee9-4332-a028-a4e8c2d52969 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.755833 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4010/8104] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:03.759962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.770021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15ce93-cd67-4b13-8a3c-dfcd4c6804e6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.774884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.775786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.776063 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.776333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] PATH_INFO: `/v3/projects/ee6c4d4c328e4a5a9ed02f2cd1ebd348/users/da4b5c2d4fbf4348b69177ac5c3d4763/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.791977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6c4d4c328e4a5a9ed02f2cd1ebd348, user_id=da4b5c2d4fbf4348b69177ac5c3d4763, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.794947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:03.808709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4095/8105] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:03 2022] PUT /identity/v3/projects/ee6c4d4c328e4a5a9ed02f2cd1ebd348/users/da4b5c2d4fbf4348b69177ac5c3d4763/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:03.819174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56644-635b-40ef-b1bd-17ca8dce5a07 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.819479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56644-635b-40ef-b1bd-17ca8dce5a07 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.819744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56644-635b-40ef-b1bd-17ca8dce5a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.848086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0fa56644-635b-40ef-b1bd-17ca8dce5a07 None None] MFA Rules not processed for user `da4b5c2d4fbf4348b69177ac5c3d4763`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:03.849367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0fa56644-635b-40ef-b1bd-17ca8dce5a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:03.911169 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4011/8106] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:03.915923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:03.980708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a77f-6c4d-43d8-862b-766d6304873c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:03.986162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:03.986828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:03.987107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:03.987408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:03.988093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:03.990113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.020292 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4096/8107] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:03 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:04.026587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa56644-635b-40ef-b1bd-17ca8dce5a07 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.040397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa56644-635b-40ef-b1bd-17ca8dce5a07 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.104310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.104985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.105293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.105561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.106243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.108188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.129216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4012/8108] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:04 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:04.133475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.143885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8377-d5b5-411a-b918-bf4092f912a2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.149195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.149889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.150167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.150456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.151179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.152835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.163403 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4097/8109] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:04.167637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.178075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b9cc-ad5d-48f5-81a4-0f2e4d0a14ff admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.183747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.184633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.184907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.185233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] PATH_INFO: `/v3/projects/d0ccef1d53074c659faa7027d3f10c68/users/7a9cd43d69544b39bb18515413e150c0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.202091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ccef1d53074c659faa7027d3f10c68, user_id=7a9cd43d69544b39bb18515413e150c0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.204968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.220038 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4013/8110] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:04 2022] PUT /identity/v3/projects/d0ccef1d53074c659faa7027d3f10c68/users/7a9cd43d69544b39bb18515413e150c0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:04.224227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.234613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167611-6b5c-4a8b-b4cc-9a9f134a055d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.295930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d963f6f-6972-4f6c-b0a9-4dfdc89c834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.296603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963f6f-6972-4f6c-b0a9-4dfdc89c834e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.296882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963f6f-6972-4f6c-b0a9-4dfdc89c834e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.297182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963f6f-6972-4f6c-b0a9-4dfdc89c834e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.297898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963f6f-6972-4f6c-b0a9-4dfdc89c834e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.299535 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963f6f-6972-4f6c-b0a9-4dfdc89c834e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.311539 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4098/8111] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:04.315925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.327201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3d413-0aab-43e8-9976-22fb58d63de4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.333117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.334006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.334281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.334555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] PATH_INFO: `/v3/projects/d0ccef1d53074c659faa7027d3f10c68/users/7a9cd43d69544b39bb18515413e150c0/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.336806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ccef1d53074c659faa7027d3f10c68, user_id=7a9cd43d69544b39bb18515413e150c0, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.339868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.350895 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4014/8112] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:04 2022] PUT /identity/v3/projects/d0ccef1d53074c659faa7027d3f10c68/users/7a9cd43d69544b39bb18515413e150c0/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:04.362567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf286a-bb7b-435b-b7fa-987cc14fe33c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.362853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf286a-bb7b-435b-b7fa-987cc14fe33c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.363127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf286a-bb7b-435b-b7fa-987cc14fe33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.389279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8ebf286a-bb7b-435b-b7fa-987cc14fe33c None None] MFA Rules not processed for user `7a9cd43d69544b39bb18515413e150c0`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:04.390500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8ebf286a-bb7b-435b-b7fa-987cc14fe33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:04.467826 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4099/8113] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:04.472961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.484562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b877a1-e54c-447e-9558-57775e39318f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.490235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.490900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.491168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.491435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.492145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.494066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.529194 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4015/8114] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:04 2022] POST /identity/v3/projects => generated 358 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:04.533753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf286a-bb7b-435b-b7fa-987cc14fe33c None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.543646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf286a-bb7b-435b-b7fa-987cc14fe33c None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.599980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.600633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.600908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.601281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.601974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.603857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.627900 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4100/8115] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:04 2022] POST /identity/v3/users => generated 413 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:04.632394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.643794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb113-ef23-4635-9715-618aec5ab74c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.649680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.650563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.650842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.651113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/users/e9402ba287bb4f6384bc99a9d0cc4220` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.666313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_user(user_id=e9402ba287bb4f6384bc99a9d0cc4220)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.668529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.670215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4016/8116] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:27:04 2022] GET /identity/v3/users/e9402ba287bb4f6384bc99a9d0cc4220 => generated 413 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:04.674656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.685789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a52c4d-2eb1-41cb-b0b9-7110a233ca37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.691592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.692483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.692810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.693152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/users/e9402ba287bb4f6384bc99a9d0cc4220` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.694551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e9402ba287bb4f6384bc99a9d0cc4220)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.696730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.745553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9402ba287bb4f6384bc99a9d0cc4220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.746408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9402ba287bb4f6384bc99a9d0cc4220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.753874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9402ba287bb4f6384bc99a9d0cc4220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.764335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9402ba287bb4f6384bc99a9d0cc4220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.765430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9402ba287bb4f6384bc99a9d0cc4220'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.787394 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4101/8117] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:04 2022] DELETE /identity/v3/users/e9402ba287bb4f6384bc99a9d0cc4220 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:04.791689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.793987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:04.807786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458d464-5ef5-4712-afc1-5ff5d60ee0eb tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:04.873121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:04.874022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:04.874301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:04.874569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/cd6aeb57ad2d4d849e63ec1fe473ca97` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:04.875945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd6aeb57ad2d4d849e63ec1fe473ca97)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:04.878248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:04.931425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6aeb57ad2d4d849e63ec1fe473ca97', 'request_id': 'req-e031da91-2944-4d25-bd20-5d6ff5cd5f27'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.936860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6aeb57ad2d4d849e63ec1fe473ca97', 'request_id': 'req-e031da91-2944-4d25-bd20-5d6ff5cd5f27'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.945940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6aeb57ad2d4d849e63ec1fe473ca97', 'request_id': 'req-e031da91-2944-4d25-bd20-5d6ff5cd5f27'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.957680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project cd6aeb57ad2d4d849e63ec1fe473ca97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:04.957973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.958836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:04.960617 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4017/8118] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:04 2022] DELETE /identity/v3/projects/cd6aeb57ad2d4d849e63ec1fe473ca97 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:04.967767 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:04.978211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd40c0-eb2a-4706-931a-d8aa9b523792 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.038396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.039222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.039496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.039766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.040469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.042231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.059133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4102/8119] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:04 2022] POST /identity/v3/projects => generated 348 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:05.065327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.067430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:05.085304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031da91-2944-4d25-bd20-5d6ff5cd5f27 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.150001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.150706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.150990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.151265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.152043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:05.152353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.154303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.167878 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4018/8120] 10.222.0.30 () {58 vars in 1159 bytes} [Sat Apr 9 21:27:05 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:05.172013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.183136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fd02-9848-44a4-8a81-41bdc265c0f7 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.187993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.188672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.188983 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.189286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.189982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.191600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.204643 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4103/8121] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 21:27:05 2022] GET /identity/v3/domains => generated 829 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:05.209225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.219449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587751e3-ba4d-4d5c-b1af-64a49d9a084c tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.224250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.225137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.225421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.225688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/0e959430e0164722a01e697ec76c7e28` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.227294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:update_project(project_id=0e959430e0164722a01e697ec76c7e28)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.228325 ncdv-master-1 devstack@keystone.service[102531]: WARNING py.warnings [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:27:05.228325 ncdv-master-1 devstack@keystone.service[102531]: warnings.warn(msg) Apr 09 21:27:05.228325 ncdv-master-1 devstack@keystone.service[102531]: Apr 09 21:27:05.229364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.240784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e959430e0164722a01e697ec76c7e28'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.241572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e959430e0164722a01e697ec76c7e28'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.269300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e959430e0164722a01e697ec76c7e28'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.269974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e959430e0164722a01e697ec76c7e28'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.272713 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4019/8122] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Apr 9 21:27:05 2022] PATCH /identity/v3/projects/0e959430e0164722a01e697ec76c7e28 => generated 362 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:05.277045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.279741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:05.293257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764f52f-3299-4e8a-9293-e0d25c2987e5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.349931 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.350826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.351109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.351384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/0e959430e0164722a01e697ec76c7e28` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.361916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0e959430e0164722a01e697ec76c7e28)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.363684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.385656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e959430e0164722a01e697ec76c7e28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.389206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e959430e0164722a01e697ec76c7e28'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.436317 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e959430e0164722a01e697ec76c7e28', 'request_id': 'req-c6cd5eb1-368e-45cc-bc53-e180994b2afa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.443114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e959430e0164722a01e697ec76c7e28', 'request_id': 'req-c6cd5eb1-368e-45cc-bc53-e180994b2afa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.453568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e959430e0164722a01e697ec76c7e28', 'request_id': 'req-c6cd5eb1-368e-45cc-bc53-e180994b2afa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.466243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 0e959430e0164722a01e697ec76c7e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:05.466534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.467132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.475137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e959430e0164722a01e697ec76c7e28', 'request_id': 'req-c6cd5eb1-368e-45cc-bc53-e180994b2afa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.478388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e959430e0164722a01e697ec76c7e28', 'request_id': 'req-c6cd5eb1-368e-45cc-bc53-e180994b2afa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.479185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e959430e0164722a01e697ec76c7e28', 'request_id': 'req-c6cd5eb1-368e-45cc-bc53-e180994b2afa'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.485156 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4104/8123] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:05 2022] DELETE /identity/v3/projects/0e959430e0164722a01e697ec76c7e28 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:05.490420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.501398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17150d0-b649-471f-8f43-6656702ad450 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.561062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.561797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.561986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.562272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.563146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.565064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.596601 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4020/8124] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:05 2022] POST /identity/v3/projects => generated 360 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:05.601233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.602721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:05.615735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd5eb1-368e-45cc-bc53-e180994b2afa tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.683703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.684715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.685185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.685397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/acf3ceffe9de43f9a0773c159d8d5c01` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.686713 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=acf3ceffe9de43f9a0773c159d8d5c01)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.688971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.690835 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4105/8125] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:05 2022] GET /identity/v3/projects/acf3ceffe9de43f9a0773c159d8d5c01 => generated 360 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:05.695540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.708400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2581-f1b0-4a7d-9708-27f77e579420 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.713554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.714444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.714723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.714994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/acf3ceffe9de43f9a0773c159d8d5c01` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.716203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=acf3ceffe9de43f9a0773c159d8d5c01)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.718398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.770462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf3ceffe9de43f9a0773c159d8d5c01', 'request_id': 'req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.776712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf3ceffe9de43f9a0773c159d8d5c01', 'request_id': 'req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.786672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf3ceffe9de43f9a0773c159d8d5c01', 'request_id': 'req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.800196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project acf3ceffe9de43f9a0773c159d8d5c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:05.800502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.801400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:05.803366 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4021/8126] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:05 2022] DELETE /identity/v3/projects/acf3ceffe9de43f9a0773c159d8d5c01 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:05.808763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.810994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:05.825548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820975-44b6-4f81-8051-822ae6dc1ec5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:05.884728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:05.885459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:05.885746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:05.886025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:05.886729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:05.888666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:05.924249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4106/8127] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:05 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:05.925629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:05.936724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4afd6-9b03-41bf-bbf8-c2e1db1e1e3a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.000760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.001689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.002136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.002414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/1bb08e979db34abe9857dd28c9102f82` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.003789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=1bb08e979db34abe9857dd28c9102f82)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.006031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.008213 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4022/8128] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:05 2022] GET /identity/v3/projects/1bb08e979db34abe9857dd28c9102f82 => generated 361 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:06.012207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.023430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f11685-3a63-4b81-8177-245b4c2c6db3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.030724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.032137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.032357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.032686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/1bb08e979db34abe9857dd28c9102f82` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.034378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1bb08e979db34abe9857dd28c9102f82)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.037281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.097785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb08e979db34abe9857dd28c9102f82', 'request_id': 'req-02a51b3e-5d62-433c-86f8-4142055e654f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.104133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb08e979db34abe9857dd28c9102f82', 'request_id': 'req-02a51b3e-5d62-433c-86f8-4142055e654f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.114123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb08e979db34abe9857dd28c9102f82', 'request_id': 'req-02a51b3e-5d62-433c-86f8-4142055e654f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.127929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 1bb08e979db34abe9857dd28c9102f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:06.128592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.129620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.131785 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4107/8129] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:06 2022] DELETE /identity/v3/projects/1bb08e979db34abe9857dd28c9102f82 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:06.136612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.138700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:06.152693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eecc2-fc00-473a-9a05-5d2d121c76db tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.225989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.226723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.227032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.227312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.228058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.230109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.263108 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4023/8130] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:27:06 2022] POST /identity/v3/projects => generated 347 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:06.266962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.277336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a51b3e-5d62-433c-86f8-4142055e654f tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.333783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.334682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.334962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.335235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/21dcd4b8e9b4432a963181a2d4a46ef0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.336466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=21dcd4b8e9b4432a963181a2d4a46ef0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.338929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.341248 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4108/8131] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:06 2022] GET /identity/v3/projects/21dcd4b8e9b4432a963181a2d4a46ef0 => generated 347 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:06.344922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.355530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b95d21-efb4-4a89-ae33-8e681307d455 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.360344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.361319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.361668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.362007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/21dcd4b8e9b4432a963181a2d4a46ef0` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.363704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21dcd4b8e9b4432a963181a2d4a46ef0)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.365923 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.390356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.393911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:06.433239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dcd4b8e9b4432a963181a2d4a46ef0', 'request_id': 'req-83ca0b58-747b-40c1-868a-b6b462268969'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.440649 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dcd4b8e9b4432a963181a2d4a46ef0', 'request_id': 'req-83ca0b58-747b-40c1-868a-b6b462268969'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.456129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dcd4b8e9b4432a963181a2d4a46ef0', 'request_id': 'req-83ca0b58-747b-40c1-868a-b6b462268969'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.470309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 21dcd4b8e9b4432a963181a2d4a46ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:06.470869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.471850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.474116 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4024/8132] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:06 2022] DELETE /identity/v3/projects/21dcd4b8e9b4432a963181a2d4a46ef0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:06.479305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.481702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:06.496512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0dbfa-b3f2-4e97-9a9d-906704f2c5ee tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.570474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca0b58-747b-40c1-868a-b6b462268969 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.576659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.577521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.578331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.578661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.579011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.579171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.579524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.579859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.580418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.581852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:06.583680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.597311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.599111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.602110 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4025/8133] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:27:06 2022] POST /identity/v3/domains => generated 276 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:06.605863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.614155 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4109/8134] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:27:06.670877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3b50-ea07-4954-b714-49824e7ae348 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.676074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.676750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.677198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.677511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.678197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.680115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.716754 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4026/8135] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:06 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:06.720676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.731703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dc7fc-a084-4a90-b216-58142a697274 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.790595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.791757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.792157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.792525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/4f96e9aff24346e481cf7a145ca7aa7c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.794050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f96e9aff24346e481cf7a145ca7aa7c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.796265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.798261 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4110/8136] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:06 2022] GET /identity/v3/projects/4f96e9aff24346e481cf7a145ca7aa7c => generated 405 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:06.802451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.814008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff7e7-e1d9-4e63-ae35-97d58a236efd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:06.834413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:06.835615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:06.836000 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:06.836395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/4f96e9aff24346e481cf7a145ca7aa7c` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:06.839007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f96e9aff24346e481cf7a145ca7aa7c)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:06.841681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:06.904303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f96e9aff24346e481cf7a145ca7aa7c', 'request_id': 'req-d1ff7b52-0711-4b97-8964-9bb354958d1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.910647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f96e9aff24346e481cf7a145ca7aa7c', 'request_id': 'req-d1ff7b52-0711-4b97-8964-9bb354958d1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.918836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f96e9aff24346e481cf7a145ca7aa7c', 'request_id': 'req-d1ff7b52-0711-4b97-8964-9bb354958d1d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.930874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 4f96e9aff24346e481cf7a145ca7aa7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:06.931164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.931835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:06.933763 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4027/8137] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:06 2022] DELETE /identity/v3/projects/4f96e9aff24346e481cf7a145ca7aa7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:06.938375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:06.942400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:06.958341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeb93c-5455-41f6-9705-da3e4101d862 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:07.016186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:07.017275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:07.017676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:07.018052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains/71264651a6a84608a75a5157118e7148` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:07.019474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=71264651a6a84608a75a5157118e7148)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:07.021314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:07.040935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '71264651a6a84608a75a5157118e7148'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.041707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '71264651a6a84608a75a5157118e7148'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.068609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '71264651a6a84608a75a5157118e7148'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.069254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '71264651a6a84608a75a5157118e7148'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.073077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4111/8138] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:27:06 2022] PATCH /identity/v3/domains/71264651a6a84608a75a5157118e7148 => generated 277 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:07.076066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:07.086877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff7b52-0711-4b97-8964-9bb354958d1d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:07.145700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:07.146711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:07.147098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:07.147467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains/71264651a6a84608a75a5157118e7148` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:07.160762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=71264651a6a84608a75a5157118e7148)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:07.162572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:07.186660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '71264651a6a84608a75a5157118e7148'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.190074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '71264651a6a84608a75a5157118e7148'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.241341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71264651a6a84608a75a5157118e7148', 'request_id': 'req-fe098941-768a-4e0f-a40e-b87fef1c62f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.249322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71264651a6a84608a75a5157118e7148', 'request_id': 'req-fe098941-768a-4e0f-a40e-b87fef1c62f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.258437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71264651a6a84608a75a5157118e7148', 'request_id': 'req-fe098941-768a-4e0f-a40e-b87fef1c62f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.271304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 71264651a6a84608a75a5157118e7148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:07.271587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.272272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.280227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '71264651a6a84608a75a5157118e7148', 'request_id': 'req-fe098941-768a-4e0f-a40e-b87fef1c62f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.280892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '71264651a6a84608a75a5157118e7148', 'request_id': 'req-fe098941-768a-4e0f-a40e-b87fef1c62f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.284052 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '71264651a6a84608a75a5157118e7148', 'request_id': 'req-fe098941-768a-4e0f-a40e-b87fef1c62f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.290458 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4028/8139] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:07 2022] DELETE /identity/v3/domains/71264651a6a84608a75a5157118e7148 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:07.295540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:07.296975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:07.310325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06329-7bea-46f6-9e41-1ddac295361d tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:07.370874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:07.371568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:07.371845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:07.372116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:07.372860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:07.374584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:07.394812 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4112/8140] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Apr 9 21:27:07 2022] POST /identity/v3/domains => generated 277 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:07.396207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:07.397957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:07.412852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098941-768a-4e0f-a40e-b87fef1c62f8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:07.482049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:07.482730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:07.483009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:07.483281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:07.483972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:07.486187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:07.528275 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4029/8141] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:07 2022] POST /identity/v3/projects => generated 409 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:07.529968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:07.541644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e255049-2531-4e9a-b8b2-6053c1f959da tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:07.604722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:07.605499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:07.605756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:07.605989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:07.606687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:07.608626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:07.646873 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4113/8142] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:07 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:07.648172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:07.658517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757aedb-3361-417e-aea5-0e0d51a99c37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:07.719482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:07.720494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:07.720780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:07.721100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/cddb0c0d76824257ae15436b4717b30a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:07.722297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cddb0c0d76824257ae15436b4717b30a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:07.724314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:07.771873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cddb0c0d76824257ae15436b4717b30a', 'request_id': 'req-77fcf2a8-634f-47e3-9536-01fc188ae0dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.780310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cddb0c0d76824257ae15436b4717b30a', 'request_id': 'req-77fcf2a8-634f-47e3-9536-01fc188ae0dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.789711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cddb0c0d76824257ae15436b4717b30a', 'request_id': 'req-77fcf2a8-634f-47e3-9536-01fc188ae0dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.801135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project cddb0c0d76824257ae15436b4717b30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:07.801423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.802198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.803788 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4030/8143] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:07 2022] DELETE /identity/v3/projects/cddb0c0d76824257ae15436b4717b30a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:07.808512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:07.810387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:07.823471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63176e-50f8-4e06-bc33-0b2ea30a6021 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:07.878337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:07.879343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:07.879743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:07.880447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/b17f1d446f7e4dc9979a89a693316dce` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:07.881567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b17f1d446f7e4dc9979a89a693316dce)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:07.883808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:07.929524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17f1d446f7e4dc9979a89a693316dce', 'request_id': 'req-0c65fb38-d59f-4ce0-be23-c868f3b5d119'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.935425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17f1d446f7e4dc9979a89a693316dce', 'request_id': 'req-0c65fb38-d59f-4ce0-be23-c868f3b5d119'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.943057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17f1d446f7e4dc9979a89a693316dce', 'request_id': 'req-0c65fb38-d59f-4ce0-be23-c868f3b5d119'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.955754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project b17f1d446f7e4dc9979a89a693316dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:07.956017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.956677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:07.958336 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4114/8144] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:07 2022] DELETE /identity/v3/projects/b17f1d446f7e4dc9979a89a693316dce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:07.963283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:07.973520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcf2a8-634f-47e3-9536-01fc188ae0dd tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.033336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.034947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:08.038895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.039785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.040066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.040340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains/245dc724eaea40d7ae534bcad995eac7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.041683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=245dc724eaea40d7ae534bcad995eac7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.043293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.064138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '245dc724eaea40d7ae534bcad995eac7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.065026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '245dc724eaea40d7ae534bcad995eac7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.090595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '245dc724eaea40d7ae534bcad995eac7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.091208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '245dc724eaea40d7ae534bcad995eac7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.093625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fb38-d59f-4ce0-be23-c868f3b5d119 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.093767 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4031/8145] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:27:07 2022] PATCH /identity/v3/domains/245dc724eaea40d7ae534bcad995eac7 => generated 278 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:08.097695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.099022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:08.141170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.141749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.142026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.142298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.144449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:08.159390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5bb28-3509-458b-baba-4103695c1930 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.164149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.165018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.165324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.165591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains/245dc724eaea40d7ae534bcad995eac7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.175875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=245dc724eaea40d7ae534bcad995eac7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.177603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.200561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '245dc724eaea40d7ae534bcad995eac7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.203821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '245dc724eaea40d7ae534bcad995eac7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.207431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.208948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.219002 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4115/8146] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:27:08.249397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245dc724eaea40d7ae534bcad995eac7', 'request_id': 'req-4b72879d-40bb-44c8-8ce6-9a4e967457b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.254616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245dc724eaea40d7ae534bcad995eac7', 'request_id': 'req-4b72879d-40bb-44c8-8ce6-9a4e967457b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.263639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245dc724eaea40d7ae534bcad995eac7', 'request_id': 'req-4b72879d-40bb-44c8-8ce6-9a4e967457b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.275836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 245dc724eaea40d7ae534bcad995eac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:08.276122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.276855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.285410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '245dc724eaea40d7ae534bcad995eac7', 'request_id': 'req-4b72879d-40bb-44c8-8ce6-9a4e967457b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.286085 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '245dc724eaea40d7ae534bcad995eac7', 'request_id': 'req-4b72879d-40bb-44c8-8ce6-9a4e967457b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.289259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '245dc724eaea40d7ae534bcad995eac7', 'request_id': 'req-4b72879d-40bb-44c8-8ce6-9a4e967457b5'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.295003 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4032/8147] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:08 2022] DELETE /identity/v3/domains/245dc724eaea40d7ae534bcad995eac7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:08.300298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.311706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de13bcc-bc99-486a-ae23-402a2096a04d service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.368814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.369529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.369804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.370061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.370748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.372619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.406784 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4116/8148] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:08 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:08.410910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.412360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:08.424825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72879d-40bb-44c8-8ce6-9a4e967457b5 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.484641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.485568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.485853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.486126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/e791827b80934769a2e98aed22668e22` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.487392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=e791827b80934769a2e98aed22668e22)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.489536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.491454 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4033/8149] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:08 2022] GET /identity/v3/projects/e791827b80934769a2e98aed22668e22 => generated 377 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:08.495509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.506242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d9d2f-4c13-4054-8e06-3c458f112c67 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.510950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.511654 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.511952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.512225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.512956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.515100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.538354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4117/8150] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Apr 9 21:27:08 2022] GET /identity/v3/projects => generated 5481 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:08.539585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.549682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298a27-0148-471e-a4df-82865c5ebcf2 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.554518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.555410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.555688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.555975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/e791827b80934769a2e98aed22668e22` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.557216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e791827b80934769a2e98aed22668e22)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.559138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.612008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e791827b80934769a2e98aed22668e22', 'request_id': 'req-713422a2-11ae-4b60-af72-8ac9986df49b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.617703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e791827b80934769a2e98aed22668e22', 'request_id': 'req-713422a2-11ae-4b60-af72-8ac9986df49b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.626663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e791827b80934769a2e98aed22668e22', 'request_id': 'req-713422a2-11ae-4b60-af72-8ac9986df49b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.637892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project e791827b80934769a2e98aed22668e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:08.638177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.638860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.640472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4034/8151] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:08 2022] DELETE /identity/v3/projects/e791827b80934769a2e98aed22668e22 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:08.645759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.648519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:08.662496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7b579-e664-4eb8-8e8d-4bb20ec4ae97 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.721434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.722106 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.722387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.722660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.723330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.725301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.758414 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4118/8152] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Apr 9 21:27:08 2022] POST /identity/v3/projects => generated 348 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:08.762333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.772723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713422a2-11ae-4b60-af72-8ac9986df49b tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.828014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.828892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.829203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.829476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/0a1081caae374d4ea713eac1dc19e565` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.830740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:update_project(project_id=0a1081caae374d4ea713eac1dc19e565)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.832639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.864651 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4035/8153] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Apr 9 21:27:08 2022] PATCH /identity/v3/projects/0a1081caae374d4ea713eac1dc19e565 => generated 362 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:08.869093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.880358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b057f-2cb6-4a39-9d1c-3d188a7c7b24 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.888810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.889791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.890077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.890351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/0a1081caae374d4ea713eac1dc19e565` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.902668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a1081caae374d4ea713eac1dc19e565)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.905015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.909916 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4119/8154] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:08 2022] GET /identity/v3/projects/0a1081caae374d4ea713eac1dc19e565 => generated 349 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:08.911358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:08.921664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692936-7320-42f9-ac7d-47c00367f491 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:08.926333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:08.927352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:08.927720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:08.928060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/0a1081caae374d4ea713eac1dc19e565` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:08.929345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a1081caae374d4ea713eac1dc19e565)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:08.931261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:08.979274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1081caae374d4ea713eac1dc19e565', 'request_id': 'req-651e4545-90e0-43a7-9c8f-8680fe292477'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.985001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1081caae374d4ea713eac1dc19e565', 'request_id': 'req-651e4545-90e0-43a7-9c8f-8680fe292477'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:08.993688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1081caae374d4ea713eac1dc19e565', 'request_id': 'req-651e4545-90e0-43a7-9c8f-8680fe292477'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.005153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 0a1081caae374d4ea713eac1dc19e565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:09.005715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.006370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.012010 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4036/8155] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:08 2022] DELETE /identity/v3/projects/0a1081caae374d4ea713eac1dc19e565 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:09.013205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.015230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:09.028503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46375a-1186-4483-8188-79709888cf42 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.084703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.085740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.085999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.086315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.087155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.089664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.121535 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4120/8156] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:09 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:09.125484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.136787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e4545-90e0-43a7-9c8f-8680fe292477 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.223194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.224161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.224435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.224709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/379064ffcbb040ddb4e8082478006cd9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.226053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:update_project(project_id=379064ffcbb040ddb4e8082478006cd9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.227986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.281454 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4037/8157] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Apr 9 21:27:09 2022] PATCH /identity/v3/projects/379064ffcbb040ddb4e8082478006cd9 => generated 373 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:09.285359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.297669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318e94b-c2d5-4680-ae0b-406598c6771e tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.303588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.304699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.304943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.305320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/379064ffcbb040ddb4e8082478006cd9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.320649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=379064ffcbb040ddb4e8082478006cd9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.323135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.325456 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4121/8158] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:09 2022] GET /identity/v3/projects/379064ffcbb040ddb4e8082478006cd9 => generated 360 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:09.329449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.341530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5b8a5-422c-4d9c-94c4-cdb686bbb236 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.346326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.347214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.347598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.347788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/379064ffcbb040ddb4e8082478006cd9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.349146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=379064ffcbb040ddb4e8082478006cd9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.351081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.398345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379064ffcbb040ddb4e8082478006cd9', 'request_id': 'req-0063c655-f479-4c1a-8469-e42a44091f37'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.403865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379064ffcbb040ddb4e8082478006cd9', 'request_id': 'req-0063c655-f479-4c1a-8469-e42a44091f37'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.412676 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379064ffcbb040ddb4e8082478006cd9', 'request_id': 'req-0063c655-f479-4c1a-8469-e42a44091f37'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.424243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 379064ffcbb040ddb4e8082478006cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:09.424639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.425237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.426883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4038/8159] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:09 2022] DELETE /identity/v3/projects/379064ffcbb040ddb4e8082478006cd9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:09.432060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.433981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:09.452217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992c51-0ef5-40b1-85fe-9a42fae2ee86 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.508389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.509109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.509433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.509681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.510375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.512378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.547270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4122/8160] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:09 2022] POST /identity/v3/projects => generated 355 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:09.549187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.559851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063c655-f479-4c1a-8469-e42a44091f37 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.616796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.617709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.617992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.618265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/3c8a6084f1744b2da5ec4606865632d5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.619607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:update_project(project_id=3c8a6084f1744b2da5ec4606865632d5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.621680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.662163 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4039/8161] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Apr 9 21:27:09 2022] PATCH /identity/v3/projects/3c8a6084f1744b2da5ec4606865632d5 => generated 369 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:09.663945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.675046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3945be9-601f-4ec1-9ab8-958a6d4556ad tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.680145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.681144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.682477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.682477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/3c8a6084f1744b2da5ec4606865632d5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.694143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:get_project(project_id=3c8a6084f1744b2da5ec4606865632d5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.696304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.701253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4123/8162] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:27:09 2022] GET /identity/v3/projects/3c8a6084f1744b2da5ec4606865632d5 => generated 356 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:09.702685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.713442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc62fd-f980-47f9-8e9e-8dc174201b5a tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.719020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.719597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.719883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.720153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/projects/3c8a6084f1744b2da5ec4606865632d5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.721405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c8a6084f1744b2da5ec4606865632d5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:09.723315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:09.772778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8a6084f1744b2da5ec4606865632d5', 'request_id': 'req-2b851f75-a977-4285-a980-7b2d7b32a8d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.779614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8a6084f1744b2da5ec4606865632d5', 'request_id': 'req-2b851f75-a977-4285-a980-7b2d7b32a8d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.789019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8a6084f1744b2da5ec4606865632d5', 'request_id': 'req-2b851f75-a977-4285-a980-7b2d7b32a8d8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.800343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] The token cache is being invalidate because project 3c8a6084f1744b2da5ec4606865632d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:09.800720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.801443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:09.803672 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4040/8163] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:09 2022] DELETE /identity/v3/projects/3c8a6084f1744b2da5ec4606865632d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:09.808699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.810673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:09.824551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055b1e4-1ae2-4f96-8baa-57666ecf2c56 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.885927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.887075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.887807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.887807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains/245dc724eaea40d7ae534bcad995eac7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.896402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:27:09.906394 ncdv-master-1 devstack@keystone.service[102532]: WARNING keystone.server.flask.application [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Could not find domain: 245dc724eaea40d7ae534bcad995eac7.: keystone.exception.DomainNotFound: Could not find domain: 245dc724eaea40d7ae534bcad995eac7. Apr 09 21:27:09.907883 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4124/8164] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:27:09 2022] PATCH /identity/v3/domains/245dc724eaea40d7ae534bcad995eac7 => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 09 21:27:09.912011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.921912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b851f75-a977-4285-a980-7b2d7b32a8d8 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:09.931098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6c29f-3446-48ff-9b6c-799faab85f45 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9cd43d69544b39bb18515413e150c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ccef1d53074c659faa7027d3f10c68', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:09.932563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6c29f-3446-48ff-9b6c-799faab85f45 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:09.932563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6c29f-3446-48ff-9b6c-799faab85f45 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:09.932883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6c29f-3446-48ff-9b6c-799faab85f45 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] PATH_INFO: `/v3/domains/71264651a6a84608a75a5157118e7148` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:09.941280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6c29f-3446-48ff-9b6c-799faab85f45 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 09 21:27:09.952694 ncdv-master-1 devstack@keystone.service[102531]: WARNING keystone.server.flask.application [None req-fdf6c29f-3446-48ff-9b6c-799faab85f45 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Could not find domain: 71264651a6a84608a75a5157118e7148.: keystone.exception.DomainNotFound: Could not find domain: 71264651a6a84608a75a5157118e7148. Apr 09 21:27:09.956989 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4041/8165] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Apr 9 21:27:09 2022] PATCH /identity/v3/domains/71264651a6a84608a75a5157118e7148 => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 09 21:27:09.958231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:09.960610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:10.035359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4968d3-8262-4719-886e-2a2db2c3c8d3 tempest-ProjectsTestJSON-1192941772 tempest-ProjectsTestJSON-1192941772-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:10.043089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:10.044147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:10.044500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:10.044841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] PATH_INFO: `/v3/users/da4b5c2d4fbf4348b69177ac5c3d4763` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:10.046309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4b5c2d4fbf4348b69177ac5c3d4763)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:10.048451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:10.101733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4b5c2d4fbf4348b69177ac5c3d4763'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.102634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4b5c2d4fbf4348b69177ac5c3d4763'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.110247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4b5c2d4fbf4348b69177ac5c3d4763'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.120331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4b5c2d4fbf4348b69177ac5c3d4763'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.121116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4b5c2d4fbf4348b69177ac5c3d4763'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.142267 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4125/8166] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:09 2022] DELETE /identity/v3/users/da4b5c2d4fbf4348b69177ac5c3d4763 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:10.145949 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:10.146384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:10.146720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:10.174913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:10.176298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:10.243837 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4042/8167] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:10.254134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:10.256546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:10.315420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca23f5-2725-4a7f-8151-afd79e990bb9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:10.319528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:10.320198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:10.320455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:10.320745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:10.330457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:10.331910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:10.341831 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4126/8168] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:10.627702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:10.629158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:10.641581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eec71-ce4d-486b-b1b0-2fc8d3ab48d0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:10.646847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:10.647802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:10.648142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:10.648560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] PATH_INFO: `/v3/projects/ee6c4d4c328e4a5a9ed02f2cd1ebd348` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:10.649919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6c4d4c328e4a5a9ed02f2cd1ebd348)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:10.651984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:10.701388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6c4d4c328e4a5a9ed02f2cd1ebd348', 'request_id': 'req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.706990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6c4d4c328e4a5a9ed02f2cd1ebd348', 'request_id': 'req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.715896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6c4d4c328e4a5a9ed02f2cd1ebd348', 'request_id': 'req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.728172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] The token cache is being invalidate because project ee6c4d4c328e4a5a9ed02f2cd1ebd348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:10.728470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.729170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.730813 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4043/8169] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:10 2022] DELETE /identity/v3/projects/ee6c4d4c328e4a5a9ed02f2cd1ebd348 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:10.735091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:10.745307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16ebb-7c67-431e-a412-422f0dac6897 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:10.815966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:10.816870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:10.817178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:10.819534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] PATH_INFO: `/v3/users/7a9cd43d69544b39bb18515413e150c0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:10.820504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9cd43d69544b39bb18515413e150c0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:10.822564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:10.881152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9cd43d69544b39bb18515413e150c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.881991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9cd43d69544b39bb18515413e150c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.893384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9cd43d69544b39bb18515413e150c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.903685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9cd43d69544b39bb18515413e150c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.904965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a9691a46-375d-4959-a99c-8c139ec7433c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9cd43d69544b39bb18515413e150c0'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:10.923654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4127/8170] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:10 2022] DELETE /identity/v3/users/7a9cd43d69544b39bb18515413e150c0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:11.414193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:11.415678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:11.430882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba723c7-e069-4d95-9ab3-9551f35ecf7d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:11.505600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:11.506393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.506671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.506973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] PATH_INFO: `/v3/projects/d0ccef1d53074c659faa7027d3f10c68` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.508159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ccef1d53074c659faa7027d3f10c68)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:11.510251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:11.557187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ccef1d53074c659faa7027d3f10c68', 'request_id': 'req-57a73b22-10bc-429e-90b9-d01e3ba13584'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:11.562560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ccef1d53074c659faa7027d3f10c68', 'request_id': 'req-57a73b22-10bc-429e-90b9-d01e3ba13584'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:11.571345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ccef1d53074c659faa7027d3f10c68', 'request_id': 'req-57a73b22-10bc-429e-90b9-d01e3ba13584'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:11.583087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] The token cache is being invalidate because project d0ccef1d53074c659faa7027d3f10c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:11.583362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:11.583993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-57a73b22-10bc-429e-90b9-d01e3ba13584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:11.586343 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4044/8171] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:11 2022] DELETE /identity/v3/projects/d0ccef1d53074c659faa7027d3f10c68 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:11.592455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a9cb-0069-431c-99e7-352efaf35f76 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.592770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a9cb-0069-431c-99e7-352efaf35f76 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.593061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a9cb-0069-431c-99e7-352efaf35f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.611474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6df7a9cb-0069-431c-99e7-352efaf35f76 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:11.612686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6df7a9cb-0069-431c-99e7-352efaf35f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:11.671184 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4128/8172] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:11.679740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b57bc-fa87-4bd1-81ff-b0b55694d858 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.680028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b57bc-fa87-4bd1-81ff-b0b55694d858 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.680304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b57bc-fa87-4bd1-81ff-b0b55694d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.698806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e39b57bc-fa87-4bd1-81ff-b0b55694d858 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:11.700045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e39b57bc-fa87-4bd1-81ff-b0b55694d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:11.708760 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4045/8173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:11.713417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a9cb-0069-431c-99e7-352efaf35f76 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:11.723642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a9cb-0069-431c-99e7-352efaf35f76 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:11.728450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:11.729183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.729445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.729720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.730468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:11.730768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:11.732413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:11.748676 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4129/8174] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:11.750264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b57bc-fa87-4bd1-81ff-b0b55694d858 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:11.760725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b57bc-fa87-4bd1-81ff-b0b55694d858 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:11.765948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:11.766638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.766928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.767190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.767900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:11.769952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:11.805767 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4046/8175] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:11 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:11.810428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:11.821014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50148c3-a4ff-4395-8e9c-62bbaa74cf2b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:11.878679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:11.879369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.879617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.879965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.880670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:11.882684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:11.905924 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4130/8176] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:11 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:11.910409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:11.923932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee2b9-fec4-4aec-a801-e76bb81e99c3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:11.929213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:11.929904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.930180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.930440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.931172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:11.932820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:11.944429 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4047/8177] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:11.948555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:11.958909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813d09-5622-49e7-86b6-49a0549c478a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:11.964254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:11.965192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:11.965470 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:11.965744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] PATH_INFO: `/v3/projects/d152817448544bf693c0b7fddc4d41f9/users/3590c792bbcb47d18494d4e64db053bd/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:11.981519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d152817448544bf693c0b7fddc4d41f9, user_id=3590c792bbcb47d18494d4e64db053bd, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:11.984214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:11.999093 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4131/8178] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:11 2022] PUT /identity/v3/projects/d152817448544bf693c0b7fddc4d41f9/users/3590c792bbcb47d18494d4e64db053bd/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:12.003224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.014581 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9fa6-45a8-43ed-95e1-436d7ef0e713 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.074267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938117-187b-48e2-9adb-dac92b728baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.074957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938117-187b-48e2-9adb-dac92b728baf admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.075239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938117-187b-48e2-9adb-dac92b728baf admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.075510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938117-187b-48e2-9adb-dac92b728baf admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.076246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938117-187b-48e2-9adb-dac92b728baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.077914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938117-187b-48e2-9adb-dac92b728baf admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.091240 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4048/8179] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:12.092409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.103081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e85e5-9696-42f7-afc2-5ef593607111 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.107945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.108845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.109156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.109429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] PATH_INFO: `/v3/projects/d152817448544bf693c0b7fddc4d41f9/users/3590c792bbcb47d18494d4e64db053bd/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.111407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d152817448544bf693c0b7fddc4d41f9, user_id=3590c792bbcb47d18494d4e64db053bd, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.114099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.124842 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4132/8180] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:12 2022] PUT /identity/v3/projects/d152817448544bf693c0b7fddc4d41f9/users/3590c792bbcb47d18494d4e64db053bd/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:12.135271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68d4b-365a-40e0-9365-b382920ce9db None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.135528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68d4b-365a-40e0-9365-b382920ce9db None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.135806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68d4b-365a-40e0-9365-b382920ce9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.164962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7ac68d4b-365a-40e0-9365-b382920ce9db None None] MFA Rules not processed for user `3590c792bbcb47d18494d4e64db053bd`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:12.166246 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7ac68d4b-365a-40e0-9365-b382920ce9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:12.235405 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4049/8181] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:12.240151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.300075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed479-a3b6-4236-98c7-d0cf6ae015e0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.304739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.305445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.305718 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.305987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.306673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.308599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.334925 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4133/8182] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:12 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:12.339475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68d4b-365a-40e0-9365-b382920ce9db None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.350212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68d4b-365a-40e0-9365-b382920ce9db None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.407636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.408324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.408613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.408879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.409613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.411614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.439287 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4050/8183] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:12 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:12.443087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.454277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c0e6-1ec2-4deb-87e1-fcaea8e76b69 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.459224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.460055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.460341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.460611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.461502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.463751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.477416 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4134/8184] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:12.478633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.489780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdc8ce-9030-490c-9144-dd7fa1e2cf1d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.495086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b292d-96c8-4688-902e-a055521212d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.495989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b292d-96c8-4688-902e-a055521212d1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.496417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b292d-96c8-4688-902e-a055521212d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.496863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b292d-96c8-4688-902e-a055521212d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.497769 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b292d-96c8-4688-902e-a055521212d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.499575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b292d-96c8-4688-902e-a055521212d1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.511063 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4051/8185] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:12.514976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.525243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d627-cad2-4ad8-820d-998f5537a744 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.533061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.533844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.534097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.534364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] PATH_INFO: `/v3/projects/25b46d511a304e33a2d8077077f96efc/users/071bb326b32f4bef88a535ea58dfbea2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.550146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b46d511a304e33a2d8077077f96efc, user_id=071bb326b32f4bef88a535ea58dfbea2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.552830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.570541 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4135/8186] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:12 2022] PUT /identity/v3/projects/25b46d511a304e33a2d8077077f96efc/users/071bb326b32f4bef88a535ea58dfbea2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:12.582219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510750-3b4c-4ff9-b09e-892e9e924118 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.582503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510750-3b4c-4ff9-b09e-892e9e924118 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.582775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510750-3b4c-4ff9-b09e-892e9e924118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.612369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bd510750-3b4c-4ff9-b09e-892e9e924118 None None] MFA Rules not processed for user `071bb326b32f4bef88a535ea58dfbea2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:12.613795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bd510750-3b4c-4ff9-b09e-892e9e924118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:12.701358 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4052/8187] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:12.710386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:12.712216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:12.796182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d44ae-21f3-47f5-9be9-f524405222c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:12.803812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728ae7-749e-4f93-b44a-22bac6eb722c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:12.804871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728ae7-749e-4f93-b44a-22bac6eb722c service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:12.805427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728ae7-749e-4f93-b44a-22bac6eb722c service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:12.805844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728ae7-749e-4f93-b44a-22bac6eb722c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:12.888809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64728ae7-749e-4f93-b44a-22bac6eb722c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:12.890685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64728ae7-749e-4f93-b44a-22bac6eb722c service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:12.918465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4136/8188] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:13.239011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510750-3b4c-4ff9-b09e-892e9e924118 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:13.304213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510750-3b4c-4ff9-b09e-892e9e924118 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:13.309098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:13.309993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:13.310271 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:13.310541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] PATH_INFO: `/v3/users/3590c792bbcb47d18494d4e64db053bd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:13.311788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3590c792bbcb47d18494d4e64db053bd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:13.313872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:13.363823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3590c792bbcb47d18494d4e64db053bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:13.365317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3590c792bbcb47d18494d4e64db053bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:13.372704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3590c792bbcb47d18494d4e64db053bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:13.373405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3590c792bbcb47d18494d4e64db053bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:13.382188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3590c792bbcb47d18494d4e64db053bd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:13.399472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4053/8189] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:13 2022] DELETE /identity/v3/users/3590c792bbcb47d18494d4e64db053bd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:13.404393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:13.404665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:13.404935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:13.422823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:13.424037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:13.486001 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4137/8190] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:13.495703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:13.497299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:13.559933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4669d5-d2cc-451e-a187-3e3c3b9b37a5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:13.564255 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:13.564920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:13.565240 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:13.565517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:13.575431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:13.576901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:13.587129 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4054/8191] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:13.885670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:13.887113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:13.902968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06daf4-9d70-4ec5-a842-9be23688c226 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:13.908859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:13.910065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:13.910602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:13.911111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] PATH_INFO: `/v3/projects/d152817448544bf693c0b7fddc4d41f9` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:13.912546 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d152817448544bf693c0b7fddc4d41f9)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:13.914521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:13.978794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd152817448544bf693c0b7fddc4d41f9', 'request_id': 'req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:13.985161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd152817448544bf693c0b7fddc4d41f9', 'request_id': 'req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:13.995012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd152817448544bf693c0b7fddc4d41f9', 'request_id': 'req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.006919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] The token cache is being invalidate because project d152817448544bf693c0b7fddc4d41f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:14.007452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.008372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.010085 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4138/8192] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:13 2022] DELETE /identity/v3/projects/d152817448544bf693c0b7fddc4d41f9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:14.015235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:14.026080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a087-b6b5-4f12-bbab-488db236c607 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:14.090280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:14.091175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:14.091446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:14.091888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] PATH_INFO: `/v3/users/071bb326b32f4bef88a535ea58dfbea2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:14.093267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071bb326b32f4bef88a535ea58dfbea2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:14.095196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:14.146980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071bb326b32f4bef88a535ea58dfbea2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.147627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071bb326b32f4bef88a535ea58dfbea2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.155160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071bb326b32f4bef88a535ea58dfbea2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.156230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071bb326b32f4bef88a535ea58dfbea2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.168701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-15d71ce6-9aa8-447e-837c-54bc00af3974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071bb326b32f4bef88a535ea58dfbea2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.190354 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4055/8193] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:14 2022] DELETE /identity/v3/users/071bb326b32f4bef88a535ea58dfbea2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:14.502051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:14.503650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:14.522021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf79bb1-8d60-4761-9cef-98a6dfe3b66d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:14.585822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:14.586711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:14.586987 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:14.587595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] PATH_INFO: `/v3/projects/25b46d511a304e33a2d8077077f96efc` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:14.589921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b46d511a304e33a2d8077077f96efc)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:14.591956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:14.638537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b46d511a304e33a2d8077077f96efc', 'request_id': 'req-aa3977e4-94a2-4184-8464-430f63123847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.643863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b46d511a304e33a2d8077077f96efc', 'request_id': 'req-aa3977e4-94a2-4184-8464-430f63123847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.652625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b46d511a304e33a2d8077077f96efc', 'request_id': 'req-aa3977e4-94a2-4184-8464-430f63123847'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.664841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] The token cache is being invalidate because project 25b46d511a304e33a2d8077077f96efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:14.665084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.665783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-aa3977e4-94a2-4184-8464-430f63123847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:14.667391 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4139/8194] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:14 2022] DELETE /identity/v3/projects/25b46d511a304e33a2d8077077f96efc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:14.672409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b28316-34ff-47e1-9f63-60def3267c24 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:14.672868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b28316-34ff-47e1-9f63-60def3267c24 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:14.673003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b28316-34ff-47e1-9f63-60def3267c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:14.692400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-77b28316-34ff-47e1-9f63-60def3267c24 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:14.694023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-77b28316-34ff-47e1-9f63-60def3267c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:14.759531 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4056/8195] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:14.768410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a1d0d-f46f-47c5-9e30-0985094892da None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:14.768724 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a1d0d-f46f-47c5-9e30-0985094892da None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:14.768964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a1d0d-f46f-47c5-9e30-0985094892da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:14.790076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6e1a1d0d-f46f-47c5-9e30-0985094892da None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:14.791337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e1a1d0d-f46f-47c5-9e30-0985094892da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:14.802139 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4140/8196] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:14.806133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b28316-34ff-47e1-9f63-60def3267c24 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:14.818731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b28316-34ff-47e1-9f63-60def3267c24 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:14.825510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:14.826190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:14.826466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:14.826847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:14.827462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:14.827765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:14.829413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:14.849231 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4057/8197] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:14.853135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a1d0d-f46f-47c5-9e30-0985094892da None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:14.865046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a1d0d-f46f-47c5-9e30-0985094892da None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:14.869896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:14.870650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:14.870999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:14.871345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:14.872112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:14.874229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:14.903081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4141/8198] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:14 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:14.907247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:14.917506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afcfb-5fab-4d15-b41d-38137c4369b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:14.980693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:14.981386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:14.981677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:14.981926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:14.982616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:14.984523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.005270 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4058/8199] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:14 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:15.009599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.020314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edd960-def2-4039-8575-cc08ac14eee3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.029588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.030283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.030765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.031218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.032576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.034253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.045557 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4142/8200] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:15.049800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.060247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246eae7-4307-4860-98eb-0ebff2d18ac6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.065168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7200f85-7bc8-43f6-95a3-897f8c8d1848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.065835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7200f85-7bc8-43f6-95a3-897f8c8d1848 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.066111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7200f85-7bc8-43f6-95a3-897f8c8d1848 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.066347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7200f85-7bc8-43f6-95a3-897f8c8d1848 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.067327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7200f85-7bc8-43f6-95a3-897f8c8d1848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.068927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7200f85-7bc8-43f6-95a3-897f8c8d1848 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.082890 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4059/8201] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:15.084217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.095073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d10a2-d576-4c29-874a-56c16f18fe6c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.099957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.100843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.101156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.101425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] PATH_INFO: `/v3/projects/ea1745c7f149457194a0528d84c85cfd/users/2b1fc44f7a6946189911f87d4797d9d4/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.116656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1745c7f149457194a0528d84c85cfd, user_id=2b1fc44f7a6946189911f87d4797d9d4, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.119350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.137813 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4143/8202] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:15 2022] PUT /identity/v3/projects/ea1745c7f149457194a0528d84c85cfd/users/2b1fc44f7a6946189911f87d4797d9d4/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:15.148572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3f04-63e1-414e-a2a5-2eb24c1c6655 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.148875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3f04-63e1-414e-a2a5-2eb24c1c6655 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.149172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3f04-63e1-414e-a2a5-2eb24c1c6655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.183315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-375a3f04-63e1-414e-a2a5-2eb24c1c6655 None None] MFA Rules not processed for user `2b1fc44f7a6946189911f87d4797d9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:15.184893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-375a3f04-63e1-414e-a2a5-2eb24c1c6655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:15.273755 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4060/8203] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:15.273894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.346558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e0e4-4c7d-456e-ad2c-009e0303072d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.351331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.352017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.352286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.352557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.353288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.355224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.389616 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4144/8204] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:15 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:15.393681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3f04-63e1-414e-a2a5-2eb24c1c6655 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.406059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3f04-63e1-414e-a2a5-2eb24c1c6655 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.488519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.489368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.489800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.490223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.490917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.493063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.524928 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4061/8205] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:15 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:15.527214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.539995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a5b66-7180-4b1e-8953-3ee83d96a0ea admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.546130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.547262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.547537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.548022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.548933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.551062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.564542 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4145/8206] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:15.568751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.579932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8ff72-0fd1-4805-b2b5-d0b3d434c110 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.584755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a207bb-cff6-49ee-98f2-6e89c79795b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.587910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a207bb-cff6-49ee-98f2-6e89c79795b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.587910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a207bb-cff6-49ee-98f2-6e89c79795b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.587910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a207bb-cff6-49ee-98f2-6e89c79795b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.587910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a207bb-cff6-49ee-98f2-6e89c79795b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.588781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a207bb-cff6-49ee-98f2-6e89c79795b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.601672 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4062/8207] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:15.605648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.619009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5799d5-c855-4635-b6cb-045fbc9cc7e2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.624315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.625352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.625701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.626042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] PATH_INFO: `/v3/projects/08273b5d5b644105a89b9bd14370a044/users/53c81ae4f351465fa29444c27d4ef96e/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.649530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08273b5d5b644105a89b9bd14370a044, user_id=53c81ae4f351465fa29444c27d4ef96e, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:15.654029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:15.681571 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4146/8208] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:15 2022] PUT /identity/v3/projects/08273b5d5b644105a89b9bd14370a044/users/53c81ae4f351465fa29444c27d4ef96e/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:15.694299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6f9db-1427-4457-a53c-6c7924bd48dd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.695187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6f9db-1427-4457-a53c-6c7924bd48dd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.695621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6f9db-1427-4457-a53c-6c7924bd48dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:15.734069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e0d6f9db-1427-4457-a53c-6c7924bd48dd None None] MFA Rules not processed for user `53c81ae4f351465fa29444c27d4ef96e`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:15.735341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e0d6f9db-1427-4457-a53c-6c7924bd48dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:15.846675 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4063/8209] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:15.855320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:15.857729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:15.978123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386419a6-9057-4561-920a-240ebbf9bc31 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:15.985314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:15.986658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:15.987610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:15.988100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:16.064458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:16.066781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:16.084526 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4147/8210] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:16.256026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:16.256312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:16.256591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:16.320174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:16.328316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:16.423272 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4064/8211] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:27:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:16.502222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:16.503698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:16.584784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:16.587838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:16.632416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a233e0e-e352-41fd-a9dd-56327500fee3 service glance] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:16.640132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:16.641014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:16.641438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:16.641860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:16.652861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:16.654734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:16.665119 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4148/8212] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:27:16.679954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36955e96-f69a-4b34-a0e9-00f5ef2f1b34 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:16.699241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:16.700835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:16.701616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:16.702191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] PATH_INFO: `/v3/users/81497a47682c4a89ad792ee59c13fc6e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:16.703979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81497a47682c4a89ad792ee59c13fc6e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:16.707722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:16.818524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81497a47682c4a89ad792ee59c13fc6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:16.818750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81497a47682c4a89ad792ee59c13fc6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:16.833749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81497a47682c4a89ad792ee59c13fc6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:16.835074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81497a47682c4a89ad792ee59c13fc6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:16.854221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81497a47682c4a89ad792ee59c13fc6e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:16.887247 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4065/8213] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:16 2022] DELETE /identity/v3/users/81497a47682c4a89ad792ee59c13fc6e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:16.921397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:16.923107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:16.943936 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8570e8f-fe6a-4911-b677-28535e4ce5f3 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:17.038811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93012a3d-64a6-4019-8669-3f34717264ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:17.041434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012a3d-64a6-4019-8669-3f34717264ff service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:17.041911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012a3d-64a6-4019-8669-3f34717264ff service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:17.042389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012a3d-64a6-4019-8669-3f34717264ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:17.046151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-93012a3d-64a6-4019-8669-3f34717264ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:17.148666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:17.152988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93012a3d-64a6-4019-8669-3f34717264ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:17.153410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:17.154664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93012a3d-64a6-4019-8669-3f34717264ff service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:17.194366 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4149/8214] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:17.290332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d48e-da3e-47b4-9609-72f09cdd4938 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:17.302567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:17.304794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:17.305341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:17.306763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] PATH_INFO: `/v3/projects/605e203fc5c04ed781bf67d309905d81` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:17.308663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605e203fc5c04ed781bf67d309905d81)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:17.310940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:17.347490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:17.347993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:17.348597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:17.373758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:17.375347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:17.387063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605e203fc5c04ed781bf67d309905d81', 'request_id': 'req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.393715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605e203fc5c04ed781bf67d309905d81', 'request_id': 'req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.406190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605e203fc5c04ed781bf67d309905d81', 'request_id': 'req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.422304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] The token cache is being invalidate because project 605e203fc5c04ed781bf67d309905d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:17.422680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.423457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.427366 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4066/8215] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:17 2022] DELETE /identity/v3/projects/605e203fc5c04ed781bf67d309905d81 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:17.433531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:17.437333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:17.468660 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4150/8216] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:17.488153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:17.492040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:17.545021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8e12-f5ab-447c-9b97-08ef92e70ad6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:17.551911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:17.553121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:17.553561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:17.553840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] PATH_INFO: `/v3/users/fd4651cc0e5540c5ba6165b61726d465` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:17.555105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4651cc0e5540c5ba6165b61726d465)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:17.557553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:17.610511 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4a854-6e82-4a65-9b35-19e871bcbd9a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:17.631231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:17.632309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:17.637053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4651cc0e5540c5ba6165b61726d465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.637759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4651cc0e5540c5ba6165b61726d465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.639484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:17.639908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:17.661761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4651cc0e5540c5ba6165b61726d465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.662524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4651cc0e5540c5ba6165b61726d465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.665629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:17.667394 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:17.673781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4651cc0e5540c5ba6165b61726d465'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:17.679511 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4151/8217] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:27:17.702517 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4067/8218] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:17 2022] DELETE /identity/v3/users/fd4651cc0e5540c5ba6165b61726d465 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:17.860791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:17.863364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:17.882065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a65fd-ffde-40fb-9664-32693a2da4c9 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:17.986367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:17.987702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:17.988187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:17.988607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] PATH_INFO: `/v3/users/2b1fc44f7a6946189911f87d4797d9d4` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:17.993956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1fc44f7a6946189911f87d4797d9d4)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:17.994892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:17.996405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:17.996589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:18.020655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc0ff-dc9a-4122-a935-7757dd962a06 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:18.041766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:18.043375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:18.043375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:18.043725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] PATH_INFO: `/v3/projects/7c204e0f1f1a4a9c97d0cde4129138ed` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:18.045247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c204e0f1f1a4a9c97d0cde4129138ed)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:18.047441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:18.092236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1fc44f7a6946189911f87d4797d9d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.095715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1fc44f7a6946189911f87d4797d9d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.117670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1fc44f7a6946189911f87d4797d9d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.133600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1fc44f7a6946189911f87d4797d9d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.134256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-903affeb-3042-4675-82d8-249b84e60349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1fc44f7a6946189911f87d4797d9d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.139917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c204e0f1f1a4a9c97d0cde4129138ed', 'request_id': 'req-9c386f82-9621-452e-97b1-1e2a026fe20f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.145765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c204e0f1f1a4a9c97d0cde4129138ed', 'request_id': 'req-9c386f82-9621-452e-97b1-1e2a026fe20f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.155865 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4152/8219] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:17 2022] DELETE /identity/v3/users/2b1fc44f7a6946189911f87d4797d9d4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:18.160441 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:18.161234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:18.161690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:18.171269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c204e0f1f1a4a9c97d0cde4129138ed', 'request_id': 'req-9c386f82-9621-452e-97b1-1e2a026fe20f'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.192807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] The token cache is being invalidate because project 7c204e0f1f1a4a9c97d0cde4129138ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:18.193276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.194028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:18.194422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:18.195807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:18.202226 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4068/8220] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:17 2022] DELETE /identity/v3/projects/7c204e0f1f1a4a9c97d0cde4129138ed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:18.300770 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4153/8221] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:18.314682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:18.321510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:18.435168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386f82-9621-452e-97b1-1e2a026fe20f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:18.505889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:18.507156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:18.507821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:18.508241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:18.521909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:18.524253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:18.543915 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4069/8222] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:18.898629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:18.900038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:18.916986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a817be-bf9f-4808-9561-fcf4594650cd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:18.922848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:18.923948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:18.924323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:18.924796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] PATH_INFO: `/v3/projects/ea1745c7f149457194a0528d84c85cfd` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:18.926177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1745c7f149457194a0528d84c85cfd)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:18.928430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:18.996305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1745c7f149457194a0528d84c85cfd', 'request_id': 'req-f299d7bc-71a6-4a89-ad53-d6ebdecee468'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.002214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1745c7f149457194a0528d84c85cfd', 'request_id': 'req-f299d7bc-71a6-4a89-ad53-d6ebdecee468'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.011320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1745c7f149457194a0528d84c85cfd', 'request_id': 'req-f299d7bc-71a6-4a89-ad53-d6ebdecee468'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.025900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] The token cache is being invalidate because project ea1745c7f149457194a0528d84c85cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:19.029468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.032264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.035787 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4154/8223] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:18 2022] DELETE /identity/v3/projects/ea1745c7f149457194a0528d84c85cfd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:19.039744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:19.051154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237854-bb0a-4a45-a632-667097204946 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:19.123941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:19.125230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:19.125230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:19.125535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] PATH_INFO: `/v3/users/53c81ae4f351465fa29444c27d4ef96e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:19.126668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c81ae4f351465fa29444c27d4ef96e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:19.128632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:19.181080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c81ae4f351465fa29444c27d4ef96e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.181848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c81ae4f351465fa29444c27d4ef96e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.195410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c81ae4f351465fa29444c27d4ef96e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.196146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c81ae4f351465fa29444c27d4ef96e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.210435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-505bfef4-b01d-4c1d-8ebd-3c1890f05c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c81ae4f351465fa29444c27d4ef96e'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.240034 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4070/8224] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:19 2022] DELETE /identity/v3/users/53c81ae4f351465fa29444c27d4ef96e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:19.742337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:19.744100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:19.760608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d7bc-71a6-4a89-ad53-d6ebdecee468 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:19.870457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:19.871405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:19.871799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:19.872837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] PATH_INFO: `/v3/projects/08273b5d5b644105a89b9bd14370a044` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:19.875655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08273b5d5b644105a89b9bd14370a044)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:19.878530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:19.940296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08273b5d5b644105a89b9bd14370a044', 'request_id': 'req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.946447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08273b5d5b644105a89b9bd14370a044', 'request_id': 'req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.958960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08273b5d5b644105a89b9bd14370a044', 'request_id': 'req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.971844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c435a7-56ce-4819-beca-77242849a552 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:19.972371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c435a7-56ce-4819-beca-77242849a552 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:19.972800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c435a7-56ce-4819-beca-77242849a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:19.978595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] The token cache is being invalidate because project 08273b5d5b644105a89b9bd14370a044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:19.979149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.980464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e14f2d27-6d37-4f7a-9ba4-cf8b96ab2c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:19.983189 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4155/8225] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:19 2022] DELETE /identity/v3/projects/08273b5d5b644105a89b9bd14370a044 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:19.990507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619fa5e-0ab6-40a3-b84b-9843d1d447a9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:19.991310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619fa5e-0ab6-40a3-b84b-9843d1d447a9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:19.991791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619fa5e-0ab6-40a3-b84b-9843d1d447a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:19.998462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e1c435a7-56ce-4819-beca-77242849a552 None None] MFA Rules not processed for user `0818e5f0edb74b82821c07c88df54826`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:19.999842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e1c435a7-56ce-4819-beca-77242849a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:20.016332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1619fa5e-0ab6-40a3-b84b-9843d1d447a9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:20.017607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1619fa5e-0ab6-40a3-b84b-9843d1d447a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:20.080244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4071/8226] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:20.088622 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4156/8227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:20.098825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0f3ac-9261-4d03-bdbc-a882d862b11f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.099186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0f3ac-9261-4d03-bdbc-a882d862b11f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.100105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0f3ac-9261-4d03-bdbc-a882d862b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.124837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a5f0f3ac-9261-4d03-bdbc-a882d862b11f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:20.126206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a5f0f3ac-9261-4d03-bdbc-a882d862b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:20.137484 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4072/8228] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:20.142096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619fa5e-0ab6-40a3-b84b-9843d1d447a9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.154804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619fa5e-0ab6-40a3-b84b-9843d1d447a9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.160743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.161932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.162074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.162381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.163246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:20.163900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.165638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.184236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4157/8229] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:20.185520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0f3ac-9261-4d03-bdbc-a882d862b11f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.197602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0f3ac-9261-4d03-bdbc-a882d862b11f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.203966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.204815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.205198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.205598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.206390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.208703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.240524 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4073/8230] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:20 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:20.245131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.257177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb7ec-1416-433f-a74f-8f058adefa3d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.334283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.335149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.335432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.335704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.336398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.338746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.361140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4158/8231] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:20 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:20.366849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.380623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9739bf-96af-4387-909e-0bfd1b49b0c4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.388523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.389248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.389546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.389886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.390658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.392270 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.403292 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4074/8232] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:20.407477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.412814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.414533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:20.418580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9898-434b-4df1-8fdf-a42ef498ceba admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.424054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.424749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.425042 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.425341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.426088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.428074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.444592 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4159/8233] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:20.451737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.463461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ade8-e1cb-4988-bedd-c99d9cc4d5f4 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.468251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912281d-dfb7-4588-b548-02806215b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.469208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912281d-dfb7-4588-b548-02806215b2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.469478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912281d-dfb7-4588-b548-02806215b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.469749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912281d-dfb7-4588-b548-02806215b2d0 admin admin] PATH_INFO: `/v3/projects/9a029a4905bd46f9a23a0d9815896694/users/0d8dc179ba32415a9ace2f3eec527d53/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.488988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912281d-dfb7-4588-b548-02806215b2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a029a4905bd46f9a23a0d9815896694, user_id=0d8dc179ba32415a9ace2f3eec527d53, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.491870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912281d-dfb7-4588-b548-02806215b2d0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.500996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd4085-0676-4027-8aca-2ac4bfc971f2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.505386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.506058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.506337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.506637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.508482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:20.510203 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4160/8234] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:20 2022] PUT /identity/v3/projects/9a029a4905bd46f9a23a0d9815896694/users/0d8dc179ba32415a9ace2f3eec527d53/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:20.521874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe08fb-8dcb-4c47-a307-5addfcd99138 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.522139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe08fb-8dcb-4c47-a307-5addfcd99138 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.522430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe08fb-8dcb-4c47-a307-5addfcd99138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.522859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.524668 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.539087 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4075/8235] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:27:20.555993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fcfe08fb-8dcb-4c47-a307-5addfcd99138 None None] MFA Rules not processed for user `0d8dc179ba32415a9ace2f3eec527d53`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:20.557396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fcfe08fb-8dcb-4c47-a307-5addfcd99138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:20.626314 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4161/8236] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:20.631228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.643363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12042e-f78d-4021-8eb7-5d1fff15faf9 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.718070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.719018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.719140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.719340 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.720662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.722664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.750118 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4076/8237] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:20 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:20.755507 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe08fb-8dcb-4c47-a307-5addfcd99138 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.771012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe08fb-8dcb-4c47-a307-5addfcd99138 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.835863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.836663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.836964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.837698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.838464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.840488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.880472 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4162/8238] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:20 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:20.884280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.910915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6af217-ebac-4eb7-975c-55843f967058 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.918888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.919915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.921928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.922892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.925400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.928184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.949082 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4077/8239] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:20.958387 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:20.968810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39588a-b17c-4244-9006-eb0bed763005 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:20.975581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c30b8-0d89-4b10-8c5d-dc7fe4c4d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:20.976812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c30b8-0d89-4b10-8c5d-dc7fe4c4d23a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:20.977133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c30b8-0d89-4b10-8c5d-dc7fe4c4d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:20.977502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c30b8-0d89-4b10-8c5d-dc7fe4c4d23a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:20.978734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c30b8-0d89-4b10-8c5d-dc7fe4c4d23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:20.980427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c30b8-0d89-4b10-8c5d-dc7fe4c4d23a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:20.994411 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4163/8240] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:20.998189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:21.011825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2c59c-6d96-4279-89ef-fb1a903477e3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:21.019127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:21.020898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:21.020898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:21.021256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] PATH_INFO: `/v3/projects/512f28e6cb0d4d95988f862ffaa986ee/users/275fdf5059eb43cb82dc93cba34beb16/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:21.038741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512f28e6cb0d4d95988f862ffaa986ee, user_id=275fdf5059eb43cb82dc93cba34beb16, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:21.041982 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:21.058906 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4078/8241] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:20 2022] PUT /identity/v3/projects/512f28e6cb0d4d95988f862ffaa986ee/users/275fdf5059eb43cb82dc93cba34beb16/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:21.070950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b79a5-7688-4d0f-b49d-aac5bad3e368 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:21.071294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b79a5-7688-4d0f-b49d-aac5bad3e368 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:21.071643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b79a5-7688-4d0f-b49d-aac5bad3e368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:21.103461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-799b79a5-7688-4d0f-b49d-aac5bad3e368 None None] MFA Rules not processed for user `275fdf5059eb43cb82dc93cba34beb16`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:21.105066 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-799b79a5-7688-4d0f-b49d-aac5bad3e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:21.176601 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4164/8242] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:21.190098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:21.192162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:21.268418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f7e91-3a7e-4559-bda5-39304172b771 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:21.280016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:21.280209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:21.280374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:21.280674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:21.377837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:21.379303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:21.391993 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4079/8243] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:21.545187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b79a5-7688-4d0f-b49d-aac5bad3e368 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:21.557541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b79a5-7688-4d0f-b49d-aac5bad3e368 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:21.562553 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707753e2-42cd-4b66-88fd-cd4bc5ae4868 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:21.563341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707753e2-42cd-4b66-88fd-cd4bc5ae4868 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:21.563907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707753e2-42cd-4b66-88fd-cd4bc5ae4868 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:21.564279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707753e2-42cd-4b66-88fd-cd4bc5ae4868 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:21.574077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707753e2-42cd-4b66-88fd-cd4bc5ae4868 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:21.575732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707753e2-42cd-4b66-88fd-cd4bc5ae4868 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:21.588518 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4165/8244] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:23.070556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:23.226193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108025f-b1c7-405d-bc6d-616371141923 service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:23.249613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:23.256632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:23.257010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:23.257735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] PATH_INFO: `/v3/users/0d8dc179ba32415a9ace2f3eec527d53` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:23.259244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8dc179ba32415a9ace2f3eec527d53)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:23.261331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:23.355319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8dc179ba32415a9ace2f3eec527d53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:23.355996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8dc179ba32415a9ace2f3eec527d53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:23.365536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8dc179ba32415a9ace2f3eec527d53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:23.365948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8dc179ba32415a9ace2f3eec527d53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:23.390036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8dc179ba32415a9ace2f3eec527d53'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:23.419537 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4080/8245] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:23 2022] DELETE /identity/v3/users/0d8dc179ba32415a9ace2f3eec527d53 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:23.424140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:23.425206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:23.425667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:23.450119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:23.452027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:23.564332 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4166/8246] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:23.575498 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:23.577154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:23.663371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f48065-68ba-4182-aa13-63dbb379199d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:23.667478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:23.668415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:23.668697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:23.668973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:23.679893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:23.681425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:23.696324 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4081/8247] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:24.032174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:24.034197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:24.058516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452b53e-819e-4735-b457-b562bcac1493 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:24.074138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:24.075056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:24.075340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:24.075617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] PATH_INFO: `/v3/projects/9a029a4905bd46f9a23a0d9815896694` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:24.077007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a029a4905bd46f9a23a0d9815896694)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:24.079175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:24.127349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a029a4905bd46f9a23a0d9815896694', 'request_id': 'req-759c7994-2caa-428c-b7ac-4b1266cf61f3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.132960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a029a4905bd46f9a23a0d9815896694', 'request_id': 'req-759c7994-2caa-428c-b7ac-4b1266cf61f3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.140597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a029a4905bd46f9a23a0d9815896694', 'request_id': 'req-759c7994-2caa-428c-b7ac-4b1266cf61f3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.153901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] The token cache is being invalidate because project 9a029a4905bd46f9a23a0d9815896694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:24.154232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.154844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.160591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4167/8248] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:24 2022] DELETE /identity/v3/projects/9a029a4905bd46f9a23a0d9815896694 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:24.162453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:24.174168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d292e3-6345-41a8-8de8-41e0fe144d48 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:24.230110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:24.231247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:24.231521 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:24.231791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] PATH_INFO: `/v3/users/275fdf5059eb43cb82dc93cba34beb16` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:24.233063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=275fdf5059eb43cb82dc93cba34beb16)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:24.235023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:24.283757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275fdf5059eb43cb82dc93cba34beb16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.284424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275fdf5059eb43cb82dc93cba34beb16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.291277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275fdf5059eb43cb82dc93cba34beb16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.291927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275fdf5059eb43cb82dc93cba34beb16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.300732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6d70ac5d-1ed9-464e-88a9-8a2c45a8e9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275fdf5059eb43cb82dc93cba34beb16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.318167 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4082/8249] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:24 2022] DELETE /identity/v3/users/275fdf5059eb43cb82dc93cba34beb16 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:24.604392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:24.606613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:24.621701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c7994-2caa-428c-b7ac-4b1266cf61f3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:24.680703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:24.681609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:24.681887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:24.682156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] PATH_INFO: `/v3/projects/512f28e6cb0d4d95988f862ffaa986ee` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:24.683320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512f28e6cb0d4d95988f862ffaa986ee)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:24.685336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:24.742170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512f28e6cb0d4d95988f862ffaa986ee', 'request_id': 'req-da5ac5c0-ed68-4feb-858d-98752a070569'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.747911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512f28e6cb0d4d95988f862ffaa986ee', 'request_id': 'req-da5ac5c0-ed68-4feb-858d-98752a070569'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.757540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512f28e6cb0d4d95988f862ffaa986ee', 'request_id': 'req-da5ac5c0-ed68-4feb-858d-98752a070569'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.768393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] The token cache is being invalidate because project 512f28e6cb0d4d95988f862ffaa986ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:24.768607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.769268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-da5ac5c0-ed68-4feb-858d-98752a070569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:24.770944 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4168/8250] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:24 2022] DELETE /identity/v3/projects/512f28e6cb0d4d95988f862ffaa986ee => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:24.776879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cebba-dd02-464a-90c8-f23f5cfae047 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:24.777232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cebba-dd02-464a-90c8-f23f5cfae047 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:24.777506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cebba-dd02-464a-90c8-f23f5cfae047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:24.795550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f56cebba-dd02-464a-90c8-f23f5cfae047 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:24.796757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f56cebba-dd02-464a-90c8-f23f5cfae047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:24.857001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4083/8251] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:24.865721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df071156-df69-45d9-a504-2d1c79eab9ef None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:24.866010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df071156-df69-45d9-a504-2d1c79eab9ef None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:24.866289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df071156-df69-45d9-a504-2d1c79eab9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:24.884620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-df071156-df69-45d9-a504-2d1c79eab9ef None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:24.885828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-df071156-df69-45d9-a504-2d1c79eab9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:24.893895 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4169/8252] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:24.898440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cebba-dd02-464a-90c8-f23f5cfae047 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:24.908001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cebba-dd02-464a-90c8-f23f5cfae047 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:24.913192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:24.913908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:24.914186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:24.914460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:24.915190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:24.915496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:24.917226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:24.928875 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4084/8253] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:27:24.933577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df071156-df69-45d9-a504-2d1c79eab9ef None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:24.943276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df071156-df69-45d9-a504-2d1c79eab9ef None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:24.948817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:24.949550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:24.949827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:24.950093 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:24.950778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:24.952732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:24.982048 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4170/8254] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:24 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:24.986379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:24.996578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ce5a-4879-4c08-968e-5624556d24a5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:25.056098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:25.056738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.057012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.057314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.057989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:25.060036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:25.083091 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4085/8255] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:24 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:25.089336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:25.101102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbce0d-88cb-45dd-a4a4-133f764480e1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:25.106444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:25.107123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.107400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.107679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.108451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:25.110122 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:25.120501 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4171/8256] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:25.124638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:25.135375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5e66-1d04-477b-af9e-85a43f6b2ff3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:25.140990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd67b5-b643-4123-8e50-1a43d8bbe293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:25.141755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd67b5-b643-4123-8e50-1a43d8bbe293 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.142033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd67b5-b643-4123-8e50-1a43d8bbe293 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.142302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd67b5-b643-4123-8e50-1a43d8bbe293 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.143032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd67b5-b643-4123-8e50-1a43d8bbe293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:25.144633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd67b5-b643-4123-8e50-1a43d8bbe293 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:25.154581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4086/8257] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:25.158726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:25.169208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cc34-82aa-4483-b142-f97af5249799 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:25.177107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:25.178010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.178286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.178557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] PATH_INFO: `/v3/projects/4f6a0894305f4d60bf521f077a5ef936/users/a7dc27251fde483280b32e955a34c862/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.193594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6a0894305f4d60bf521f077a5ef936, user_id=a7dc27251fde483280b32e955a34c862, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:25.196276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:25.214090 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4172/8258] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:25 2022] PUT /identity/v3/projects/4f6a0894305f4d60bf521f077a5ef936/users/a7dc27251fde483280b32e955a34c862/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:25.226757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713245e-ff9c-43d5-ba9a-f2c7f7958d36 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.227288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713245e-ff9c-43d5-ba9a-f2c7f7958d36 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.227288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713245e-ff9c-43d5-ba9a-f2c7f7958d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.254996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9713245e-ff9c-43d5-ba9a-f2c7f7958d36 None None] MFA Rules not processed for user `a7dc27251fde483280b32e955a34c862`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:25.256216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9713245e-ff9c-43d5-ba9a-f2c7f7958d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:25.340038 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4087/8259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:25.354630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:25.357183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:25.418884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506943d7-e391-4b19-be19-b2ef342152df admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:25.422990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e452-c110-4ddd-9fa7-125d15c6fc72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:25.423685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e452-c110-4ddd-9fa7-125d15c6fc72 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.424001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e452-c110-4ddd-9fa7-125d15c6fc72 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.424277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e452-c110-4ddd-9fa7-125d15c6fc72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.433830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e452-c110-4ddd-9fa7-125d15c6fc72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:25.435301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e452-c110-4ddd-9fa7-125d15c6fc72 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:25.445144 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4173/8260] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:25.539680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713245e-ff9c-43d5-ba9a-f2c7f7958d36 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:25.602963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713245e-ff9c-43d5-ba9a-f2c7f7958d36 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:25.608318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:25.609229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.609506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.609777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] PATH_INFO: `/v3/users/a7dc27251fde483280b32e955a34c862` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.611336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dc27251fde483280b32e955a34c862)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:25.613585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:25.662499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dc27251fde483280b32e955a34c862'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:25.663167 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dc27251fde483280b32e955a34c862'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:25.670224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dc27251fde483280b32e955a34c862'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:25.670870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dc27251fde483280b32e955a34c862'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:25.679352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dc27251fde483280b32e955a34c862'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:25.696795 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4088/8261] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:25 2022] DELETE /identity/v3/users/a7dc27251fde483280b32e955a34c862 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:25.701574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.702052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.702164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.720498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:25.721748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:25.783609 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4174/8262] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:25.793522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:25.795160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:25.854967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500e8d-136b-486e-b438-95d819573c5d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:25.859130 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3de1a-6d29-4b53-8749-fa5111bbf3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:25.859789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3de1a-6d29-4b53-8749-fa5111bbf3fa service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:25.860063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3de1a-6d29-4b53-8749-fa5111bbf3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:25.860358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3de1a-6d29-4b53-8749-fa5111bbf3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:25.870532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3de1a-6d29-4b53-8749-fa5111bbf3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:25.871984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3de1a-6d29-4b53-8749-fa5111bbf3fa service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:25.882012 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4089/8263] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:26.151537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.153085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:26.165289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8df73-e25a-41eb-bdec-6a25e3ee12f5 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.170728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.171596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.171881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.172247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] PATH_INFO: `/v3/projects/4f6a0894305f4d60bf521f077a5ef936` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.175352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6a0894305f4d60bf521f077a5ef936)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.178360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:26.234291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6a0894305f4d60bf521f077a5ef936', 'request_id': 'req-68d6c02d-24d8-4af6-9819-8416e04f2bc9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:26.239590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6a0894305f4d60bf521f077a5ef936', 'request_id': 'req-68d6c02d-24d8-4af6-9819-8416e04f2bc9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:26.248481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6a0894305f4d60bf521f077a5ef936', 'request_id': 'req-68d6c02d-24d8-4af6-9819-8416e04f2bc9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:26.259838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] The token cache is being invalidate because project 4f6a0894305f4d60bf521f077a5ef936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:26.260118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:26.260752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-68d6c02d-24d8-4af6-9819-8416e04f2bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:26.262441 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4175/8264] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:26 2022] DELETE /identity/v3/projects/4f6a0894305f4d60bf521f077a5ef936 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:26.267361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72f1cc-9eb5-400e-8217-6096649543c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.267854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72f1cc-9eb5-400e-8217-6096649543c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.267934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72f1cc-9eb5-400e-8217-6096649543c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.286195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2a72f1cc-9eb5-400e-8217-6096649543c6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:26.287388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2a72f1cc-9eb5-400e-8217-6096649543c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:26.349301 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4090/8265] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:26.433796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb3a7-5e68-4ce2-86ea-12aafdd95995 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.434088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb3a7-5e68-4ce2-86ea-12aafdd95995 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.434368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb3a7-5e68-4ce2-86ea-12aafdd95995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.457729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ceedb3a7-5e68-4ce2-86ea-12aafdd95995 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:26.458953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ceedb3a7-5e68-4ce2-86ea-12aafdd95995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:26.468318 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4176/8266] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:26.472790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72f1cc-9eb5-400e-8217-6096649543c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.483106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72f1cc-9eb5-400e-8217-6096649543c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.488260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.489011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.489324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.489643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.490484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:26.490790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.492477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:26.506387 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4091/8267] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:26.510481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb3a7-5e68-4ce2-86ea-12aafdd95995 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.522418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb3a7-5e68-4ce2-86ea-12aafdd95995 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.527646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.529197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.529197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.529197 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.530032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.532366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:26.566654 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4177/8268] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:26 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:26.567542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.578413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a064389-afa6-4de6-999b-1182b8006d12 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.641718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.642407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.642687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.642959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.643654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.645687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:26.669497 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4092/8269] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:26 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:26.673639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.684323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2ca14-b58c-4326-a6ab-8263edc40e82 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.689373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.690323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.690635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.690903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.691692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.693345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:26.705485 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4178/8270] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:26.709749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.720933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8a00-83fa-499e-b5b0-df2090435314 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.726214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef4e00-c87d-4314-99c9-c751031c6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.726900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4e00-c87d-4314-99c9-c751031c6f10 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.727188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4e00-c87d-4314-99c9-c751031c6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.727467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4e00-c87d-4314-99c9-c751031c6f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.728197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef4e00-c87d-4314-99c9-c751031c6f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.729843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef4e00-c87d-4314-99c9-c751031c6f10 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:26.740620 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4093/8271] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:26.745055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.756490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd738-2e5a-4841-b4b9-22c2f70e3e8a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.761488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.762395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.762669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.762937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] PATH_INFO: `/v3/projects/a4a236fd3bda42338dc134c2e6ab12f0/users/ed7d938bf089440e8eea41db319580f9/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.778845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a236fd3bda42338dc134c2e6ab12f0, user_id=ed7d938bf089440e8eea41db319580f9, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.781575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:26.796826 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4179/8272] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:26 2022] PUT /identity/v3/projects/a4a236fd3bda42338dc134c2e6ab12f0/users/ed7d938bf089440e8eea41db319580f9/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:26.807621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832981-7e7b-4580-8041-9fa791c844f9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.807999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832981-7e7b-4580-8041-9fa791c844f9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.808375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832981-7e7b-4580-8041-9fa791c844f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.835610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-77832981-7e7b-4580-8041-9fa791c844f9 None None] MFA Rules not processed for user `ed7d938bf089440e8eea41db319580f9`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:26.836843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-77832981-7e7b-4580-8041-9fa791c844f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:26.906489 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4094/8273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:26.917904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:26.919722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:26.980310 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5244c55-0c7c-43bb-9886-87873f88f12e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:26.984307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a127b-6005-440b-9c3d-d94b1a28aa58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:26.984989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a127b-6005-440b-9c3d-d94b1a28aa58 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:26.985314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a127b-6005-440b-9c3d-d94b1a28aa58 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:26.985590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a127b-6005-440b-9c3d-d94b1a28aa58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:26.994949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a127b-6005-440b-9c3d-d94b1a28aa58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:26.996440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a127b-6005-440b-9c3d-d94b1a28aa58 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:27.005584 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4180/8274] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:27.310421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77832981-7e7b-4580-8041-9fa791c844f9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:27.381427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77832981-7e7b-4580-8041-9fa791c844f9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:27.386674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:27.387560 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:27.387845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:27.388116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] PATH_INFO: `/v3/users/ed7d938bf089440e8eea41db319580f9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:27.389389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7d938bf089440e8eea41db319580f9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:27.391333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:27.442442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7d938bf089440e8eea41db319580f9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:27.443116 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7d938bf089440e8eea41db319580f9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:27.450027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7d938bf089440e8eea41db319580f9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:27.450674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7d938bf089440e8eea41db319580f9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:27.459590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7d938bf089440e8eea41db319580f9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:27.477340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4095/8275] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:27 2022] DELETE /identity/v3/users/ed7d938bf089440e8eea41db319580f9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:27.482400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:27.482723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:27.482999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:27.502259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:27.503475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:27.568008 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4181/8276] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:27.578013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:27.579469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:27.641205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf2d6-51c0-47dc-a937-b88115687c3f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:27.645659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7baa51-2115-4a0b-889c-f1572b2d2a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:27.646426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7baa51-2115-4a0b-889c-f1572b2d2a3f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:27.646703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7baa51-2115-4a0b-889c-f1572b2d2a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:27.646972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7baa51-2115-4a0b-889c-f1572b2d2a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:27.656911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7baa51-2115-4a0b-889c-f1572b2d2a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:27.658411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7baa51-2115-4a0b-889c-f1572b2d2a3f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:27.668456 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4096/8277] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:27.981759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:27.983381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:27.997376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacc63-6228-4b2e-abee-d7c53024b9b4 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.002953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.003846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.004129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.004422 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] PATH_INFO: `/v3/projects/a4a236fd3bda42338dc134c2e6ab12f0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.005812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a236fd3bda42338dc134c2e6ab12f0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.007971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.056611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a236fd3bda42338dc134c2e6ab12f0', 'request_id': 'req-bd3f1aa0-4f56-4f89-9af8-503f5da11297'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:28.061856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a236fd3bda42338dc134c2e6ab12f0', 'request_id': 'req-bd3f1aa0-4f56-4f89-9af8-503f5da11297'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:28.071192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a236fd3bda42338dc134c2e6ab12f0', 'request_id': 'req-bd3f1aa0-4f56-4f89-9af8-503f5da11297'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:28.082565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] The token cache is being invalidate because project a4a236fd3bda42338dc134c2e6ab12f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:28.082851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:28.083528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd3f1aa0-4f56-4f89-9af8-503f5da11297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:28.085159 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4182/8278] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:27 2022] DELETE /identity/v3/projects/a4a236fd3bda42338dc134c2e6ab12f0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:28.090504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d2e14-a984-4a2d-ab98-0d7ec6a4be38 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.090794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d2e14-a984-4a2d-ab98-0d7ec6a4be38 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.091066 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d2e14-a984-4a2d-ab98-0d7ec6a4be38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.109752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8f3d2e14-a984-4a2d-ab98-0d7ec6a4be38 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:28.110966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8f3d2e14-a984-4a2d-ab98-0d7ec6a4be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:28.170818 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4097/8279] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:28.178714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743ddf7-6b38-44f2-8109-894e61839686 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.179007 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743ddf7-6b38-44f2-8109-894e61839686 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.179285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743ddf7-6b38-44f2-8109-894e61839686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.199743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8743ddf7-6b38-44f2-8109-894e61839686 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:28.200985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8743ddf7-6b38-44f2-8109-894e61839686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:28.211104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4183/8280] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:28.215927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d2e14-a984-4a2d-ab98-0d7ec6a4be38 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.226930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d2e14-a984-4a2d-ab98-0d7ec6a4be38 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.232781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.233504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.233784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.234056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.234820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:28.235125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.236744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.248849 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4098/8281] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:28.253263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743ddf7-6b38-44f2-8109-894e61839686 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.262848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743ddf7-6b38-44f2-8109-894e61839686 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.268088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.268756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.269069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.269352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.270044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.272014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.300791 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4184/8282] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:28 2022] POST /identity/v3/projects => generated 411 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:28.306237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.316210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1578-6f61-4f00-9268-8f12503792ce admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.383458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.384408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.384751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.385083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.386011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.388742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.414839 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4099/8283] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:28 2022] POST /identity/v3/users => generated 306 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:28.419013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.429445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6c3a5-702a-4f4f-b90f-4a9c00da74ca admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.434472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.435154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.435752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.435752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.436418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.438429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.449844 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4185/8284] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:28.453996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.464849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af713323-702a-4ac8-8326-42d3a1089671 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.469860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21609284-12d3-4c0b-82d6-5c0be4bd5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.470548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21609284-12d3-4c0b-82d6-5c0be4bd5efb admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.470849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21609284-12d3-4c0b-82d6-5c0be4bd5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.471132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21609284-12d3-4c0b-82d6-5c0be4bd5efb admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.471855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21609284-12d3-4c0b-82d6-5c0be4bd5efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.473504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21609284-12d3-4c0b-82d6-5c0be4bd5efb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.483654 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4100/8285] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:28.487731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.497884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457b9f-e813-490b-bc54-573903da32a6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.502672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.503579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.503856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.504493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] PATH_INFO: `/v3/projects/4d2926a1b62c48e9898ab868ba0c2661/users/035f3bad82744604be4a1c1b5efebb49/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.519381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2926a1b62c48e9898ab868ba0c2661, user_id=035f3bad82744604be4a1c1b5efebb49, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.522216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.538185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4186/8286] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:28 2022] PUT /identity/v3/projects/4d2926a1b62c48e9898ab868ba0c2661/users/035f3bad82744604be4a1c1b5efebb49/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:28.548807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1924e-0c98-4c19-ae9c-961162726e33 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.549182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1924e-0c98-4c19-ae9c-961162726e33 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.549458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1924e-0c98-4c19-ae9c-961162726e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.576826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-26e1924e-0c98-4c19-ae9c-961162726e33 None None] MFA Rules not processed for user `035f3bad82744604be4a1c1b5efebb49`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:28.578065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26e1924e-0c98-4c19-ae9c-961162726e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:28.648400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4101/8287] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:28.653160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.713335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b33f6-8d2a-45de-b715-ad795ff855c3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.718406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.719074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.719352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.719622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.720299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.722261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.753251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4187/8288] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:28 2022] POST /identity/v3/projects => generated 411 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:28.757513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1924e-0c98-4c19-ae9c-961162726e33 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.768743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1924e-0c98-4c19-ae9c-961162726e33 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.825782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.826477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.826785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.827034 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.827765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.829926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.856902 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4102/8289] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:28 2022] POST /identity/v3/users => generated 312 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:28.858293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.868852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb726aac-9cd4-4655-9f97-0c2beed05d17 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.873864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.874696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.874823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.875097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.875819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.877495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.889608 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4188/8290] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:28.893660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.904151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17cac-324b-47ff-9685-2f9e3335a293 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:28.909136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:28.910043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:28.910299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:28.910569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] PATH_INFO: `/v3/projects/624cc07289ec4d2d949c15a17b31407d/users/a6a967e646544a41a79115882a18769a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:28.925826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=624cc07289ec4d2d949c15a17b31407d, user_id=a6a967e646544a41a79115882a18769a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:28.928534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:28.942850 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4103/8291] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:28 2022] PUT /identity/v3/projects/624cc07289ec4d2d949c15a17b31407d/users/a6a967e646544a41a79115882a18769a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:28.946882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:28.957018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47a5d-a64c-44b6-b90e-52b3658abda5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:29.015976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad16f62-e749-4695-b451-31f3803c2385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:29.016592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16f62-e749-4695-b451-31f3803c2385 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:29.016907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16f62-e749-4695-b451-31f3803c2385 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:29.017211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16f62-e749-4695-b451-31f3803c2385 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:29.017940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad16f62-e749-4695-b451-31f3803c2385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:29.019606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad16f62-e749-4695-b451-31f3803c2385 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:29.029795 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4189/8292] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:29.034237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:29.045141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c382e2-66fb-4e3c-813e-385af8ca3e6f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:29.051376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:29.052324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:29.052602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:29.052874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] PATH_INFO: `/v3/projects/624cc07289ec4d2d949c15a17b31407d/users/a6a967e646544a41a79115882a18769a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:29.054989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624cc07289ec4d2d949c15a17b31407d, user_id=a6a967e646544a41a79115882a18769a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:29.057665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:29.068002 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4104/8293] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:29 2022] PUT /identity/v3/projects/624cc07289ec4d2d949c15a17b31407d/users/a6a967e646544a41a79115882a18769a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:29.078632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b663c-ba0e-4c38-a26c-e1ef91db16eb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:29.079025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b663c-ba0e-4c38-a26c-e1ef91db16eb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:29.079362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b663c-ba0e-4c38-a26c-e1ef91db16eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:29.106410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-788b663c-ba0e-4c38-a26c-e1ef91db16eb None None] MFA Rules not processed for user `a6a967e646544a41a79115882a18769a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:29.107646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-788b663c-ba0e-4c38-a26c-e1ef91db16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:29.178795 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4190/8294] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:29 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:29.189441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:29.191344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:29.251243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364f19-7cc2-48a4-abb5-b317542f6fc8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:29.255331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440597a-7017-4737-949f-5281fdd44e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:29.255964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440597a-7017-4737-949f-5281fdd44e80 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:29.256239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440597a-7017-4737-949f-5281fdd44e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:29.256497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440597a-7017-4737-949f-5281fdd44e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:29.265920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440597a-7017-4737-949f-5281fdd44e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:29.267426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440597a-7017-4737-949f-5281fdd44e80 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:29.276796 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4105/8295] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:29 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:30.961814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b663c-ba0e-4c38-a26c-e1ef91db16eb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:31.028086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b663c-ba0e-4c38-a26c-e1ef91db16eb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:31.032954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:31.033928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:31.034327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:31.034624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] PATH_INFO: `/v3/users/035f3bad82744604be4a1c1b5efebb49` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:31.035823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035f3bad82744604be4a1c1b5efebb49)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:31.037943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:31.086526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035f3bad82744604be4a1c1b5efebb49'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.087512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035f3bad82744604be4a1c1b5efebb49'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.094862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035f3bad82744604be4a1c1b5efebb49'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.103677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035f3bad82744604be4a1c1b5efebb49'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.104944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035f3bad82744604be4a1c1b5efebb49'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.123341 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4191/8296] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:30 2022] DELETE /identity/v3/users/035f3bad82744604be4a1c1b5efebb49 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:31.127960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:31.128415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:31.128529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:31.146489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:31.147683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:31.206206 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4106/8297] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:31.217249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:31.219147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:31.284024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7425-8056-444c-a720-bae67196fa39 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:31.288835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:31.289536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:31.289811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:31.290081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:31.300280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:31.301787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:31.311493 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4192/8298] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:31.591441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:31.592877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:31.607963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb609-2105-461c-9cc3-2770560c751e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:31.614098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:31.615019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:31.615290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:31.615544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] PATH_INFO: `/v3/projects/4d2926a1b62c48e9898ab868ba0c2661` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:31.616831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2926a1b62c48e9898ab868ba0c2661)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:31.619525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:31.667262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2926a1b62c48e9898ab868ba0c2661', 'request_id': 'req-e159a8c7-a37b-491f-bb48-e6ae307a8ade'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.672918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2926a1b62c48e9898ab868ba0c2661', 'request_id': 'req-e159a8c7-a37b-491f-bb48-e6ae307a8ade'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.681624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2926a1b62c48e9898ab868ba0c2661', 'request_id': 'req-e159a8c7-a37b-491f-bb48-e6ae307a8ade'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.693288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] The token cache is being invalidate because project 4d2926a1b62c48e9898ab868ba0c2661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:31.693566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.694190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.695734 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4107/8299] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:31 2022] DELETE /identity/v3/projects/4d2926a1b62c48e9898ab868ba0c2661 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:31.700025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:31.709842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe401f-45ed-458d-807a-364d7dc9b4ff service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:31.767940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:31.768835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:31.769138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:31.769412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] PATH_INFO: `/v3/users/a6a967e646544a41a79115882a18769a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:31.770652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a967e646544a41a79115882a18769a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:31.772636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:31.820923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a967e646544a41a79115882a18769a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.821513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a967e646544a41a79115882a18769a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.828187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a967e646544a41a79115882a18769a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.838270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a967e646544a41a79115882a18769a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.838975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4681db77-d795-4d55-bb0e-85c8b1365a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a967e646544a41a79115882a18769a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:31.855709 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4193/8300] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:31 2022] DELETE /identity/v3/users/a6a967e646544a41a79115882a18769a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:32.036355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.038179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:32.051751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159a8c7-a37b-491f-bb48-e6ae307a8ade admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.111964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.112826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.113142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.113418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] PATH_INFO: `/v3/projects/624cc07289ec4d2d949c15a17b31407d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.114648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624cc07289ec4d2d949c15a17b31407d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.116747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.168774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624cc07289ec4d2d949c15a17b31407d', 'request_id': 'req-b31da685-0805-4c0a-ac46-63298c70f6e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:32.174335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624cc07289ec4d2d949c15a17b31407d', 'request_id': 'req-b31da685-0805-4c0a-ac46-63298c70f6e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:32.183110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624cc07289ec4d2d949c15a17b31407d', 'request_id': 'req-b31da685-0805-4c0a-ac46-63298c70f6e8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:32.194289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] The token cache is being invalidate because project 624cc07289ec4d2d949c15a17b31407d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:32.194573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:32.195242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b31da685-0805-4c0a-ac46-63298c70f6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:32.196838 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4108/8301] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:32 2022] DELETE /identity/v3/projects/624cc07289ec4d2d949c15a17b31407d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:32.203616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f8c2-6594-4aec-aa51-ab0edd7e7118 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.204183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f8c2-6594-4aec-aa51-ab0edd7e7118 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.204183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f8c2-6594-4aec-aa51-ab0edd7e7118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.223298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-98b4f8c2-6594-4aec-aa51-ab0edd7e7118 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:32.224528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-98b4f8c2-6594-4aec-aa51-ab0edd7e7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:32.286666 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4194/8302] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:32.295822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a867f-c96c-4707-b9c2-9cf55c17c94c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.296114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a867f-c96c-4707-b9c2-9cf55c17c94c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.296347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a867f-c96c-4707-b9c2-9cf55c17c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.315267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c17a867f-c96c-4707-b9c2-9cf55c17c94c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:32.316478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c17a867f-c96c-4707-b9c2-9cf55c17c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:32.325069 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4109/8303] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:32.329549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4f8c2-6594-4aec-aa51-ab0edd7e7118 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.340038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4f8c2-6594-4aec-aa51-ab0edd7e7118 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.345253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.345962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.346239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.346508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.347239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:32.347545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.349242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.361176 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4195/8304] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:32.365796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a867f-c96c-4707-b9c2-9cf55c17c94c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.375353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a867f-c96c-4707-b9c2-9cf55c17c94c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.380462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.381262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.381614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.381958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.382775 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.384800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.411330 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4110/8305] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:32 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:32.415669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.426107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb878bb-f6ef-461a-b0a7-b746f7bd51fc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.484709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.485445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.485722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.485992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.486712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.488660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.512412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4196/8306] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:32 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:32.513792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.524198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beeb42-620b-4f38-9b4c-e2b6413967df admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.529113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.529788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.530071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.530348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.531076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.532694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.548489 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4111/8307] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:32.549826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.560234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57854d4-928f-4eee-a01c-94eeb268e2e9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.564812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d86ec-1ee5-49a4-a063-127eb600b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.565626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d86ec-1ee5-49a4-a063-127eb600b267 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.565899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d86ec-1ee5-49a4-a063-127eb600b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.566165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d86ec-1ee5-49a4-a063-127eb600b267 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.566880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d86ec-1ee5-49a4-a063-127eb600b267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.568591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d86ec-1ee5-49a4-a063-127eb600b267 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.579081 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4197/8308] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:32.583625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.594113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a538-8f46-487e-ab2e-cb641a653d7e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.598879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.599787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.600068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.600338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] PATH_INFO: `/v3/projects/b9116e25235c4f1f8631dc72fc5a2092/users/074faed3274e4d1dacf678e2b9e08f39/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.615706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9116e25235c4f1f8631dc72fc5a2092, user_id=074faed3274e4d1dacf678e2b9e08f39, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.618501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.632572 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4112/8309] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:32 2022] PUT /identity/v3/projects/b9116e25235c4f1f8631dc72fc5a2092/users/074faed3274e4d1dacf678e2b9e08f39/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:32.643302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3879d-28a9-4a59-a12b-ab0c4f0f5467 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.643590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3879d-28a9-4a59-a12b-ab0c4f0f5467 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.643865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3879d-28a9-4a59-a12b-ab0c4f0f5467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.671306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-79d3879d-28a9-4a59-a12b-ab0c4f0f5467 None None] MFA Rules not processed for user `074faed3274e4d1dacf678e2b9e08f39`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:32.672531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-79d3879d-28a9-4a59-a12b-ab0c4f0f5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:32.738165 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4198/8310] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:32.742850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.808745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5567-39cb-4098-a82f-3478d04907b8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.814145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.814825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.815104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.815375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.816072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.818058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.849072 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4113/8311] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:32 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:32.852000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3879d-28a9-4a59-a12b-ab0c4f0f5467 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.863533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3879d-28a9-4a59-a12b-ab0c4f0f5467 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.918589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.919284 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.919567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.919838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.920650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.922652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.944203 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4199/8312] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:32 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:32.948420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.959092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f070-9ba2-4c4e-8656-05ead0f44537 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.964626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:32.965439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:32.965725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:32.966004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:32.966760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:32.968394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:32.979307 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4114/8313] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:32.983074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:32.993684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f61e-2d1d-40bf-b5f1-3f5c930cd427 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:32.999606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801753-adba-468c-bbf7-d6b63fa5a02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.000272 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801753-adba-468c-bbf7-d6b63fa5a02f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.000550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801753-adba-468c-bbf7-d6b63fa5a02f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.000819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801753-adba-468c-bbf7-d6b63fa5a02f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.001574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24801753-adba-468c-bbf7-d6b63fa5a02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.003192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24801753-adba-468c-bbf7-d6b63fa5a02f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.013485 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4200/8314] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:33.017747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.028338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c55b6-41e2-4291-8e6b-ad261c66ba48 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.034328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.035326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.035607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.035878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] PATH_INFO: `/v3/projects/03e0efb2335a40faa1414aaaabc1b8e6/users/a8a9ceafe6674292802726d752c7a239/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.051499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e0efb2335a40faa1414aaaabc1b8e6, user_id=a8a9ceafe6674292802726d752c7a239, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.054236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.070126 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4115/8315] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:33 2022] PUT /identity/v3/projects/03e0efb2335a40faa1414aaaabc1b8e6/users/a8a9ceafe6674292802726d752c7a239/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:33.080595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd381f8d-2fd5-4e94-af06-b91e4e3210b8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.080877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd381f8d-2fd5-4e94-af06-b91e4e3210b8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.081185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd381f8d-2fd5-4e94-af06-b91e4e3210b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.109737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-dd381f8d-2fd5-4e94-af06-b91e4e3210b8 None None] MFA Rules not processed for user `a8a9ceafe6674292802726d752c7a239`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:33.111015 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-dd381f8d-2fd5-4e94-af06-b91e4e3210b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:33.180213 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4201/8316] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:33.184978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.250147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6d23-3e83-4840-a705-86d7c8a13412 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.255333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.255997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.256305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.256610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.257327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.259278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.286874 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4116/8317] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:33 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:33.293779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd381f8d-2fd5-4e94-af06-b91e4e3210b8 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.308305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd381f8d-2fd5-4e94-af06-b91e4e3210b8 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.367777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.368465 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.368742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.369010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.369738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.371695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.391760 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4202/8318] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:33 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:33.395917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.406704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a059-4267-4130-9745-32f7ba59352f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.412593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.413289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.413576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.413857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.414637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.416252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.427369 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4117/8319] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:33.431505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.442341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5db5-e370-486b-8b64-5a368a40f7ec admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.448498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.449475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.449751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.450028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] PATH_INFO: `/v3/projects/e69f3e39a75848f2bbaac23e9e4938c3/users/9abb74b94f1a4b17858c639a6af159ba/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.466346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69f3e39a75848f2bbaac23e9e4938c3, user_id=9abb74b94f1a4b17858c639a6af159ba, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.469071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.484642 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4203/8320] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:33 2022] PUT /identity/v3/projects/e69f3e39a75848f2bbaac23e9e4938c3/users/9abb74b94f1a4b17858c639a6af159ba/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:33.488723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.499491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f855-c179-47c5-b3ed-73da659e25c5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.559759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9091b-da0b-4ce7-b82c-84a8405c8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.560432 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9091b-da0b-4ce7-b82c-84a8405c8ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.560712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9091b-da0b-4ce7-b82c-84a8405c8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.560986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9091b-da0b-4ce7-b82c-84a8405c8ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.561747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9091b-da0b-4ce7-b82c-84a8405c8ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.563369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9091b-da0b-4ce7-b82c-84a8405c8ad8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.573363 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4118/8321] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:33.577851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.588985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b980808-3cb6-4fd8-aa4c-3e2e4b87b98f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.594223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.595259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.595543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.595821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] PATH_INFO: `/v3/projects/e69f3e39a75848f2bbaac23e9e4938c3/users/9abb74b94f1a4b17858c639a6af159ba/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.598033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69f3e39a75848f2bbaac23e9e4938c3, user_id=9abb74b94f1a4b17858c639a6af159ba, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.600711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.611745 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4204/8322] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:33 2022] PUT /identity/v3/projects/e69f3e39a75848f2bbaac23e9e4938c3/users/9abb74b94f1a4b17858c639a6af159ba/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:33.623108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.623423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.623704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.652057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] MFA Rules not processed for user `9abb74b94f1a4b17858c639a6af159ba`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:33.653915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:33.724661 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4119/8323] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:33.734761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:33.736688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:33.801952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e232e-46c0-4266-99c1-21b4f2fbf008 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:33.806512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:33.807178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:33.807459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:33.807738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:33.864230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:33.865804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:33.874669 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4205/8324] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:41.782684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:41.784175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:41.806553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166e19-80ed-4eef-9741-0ffdf2417279 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:41.810471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:41.811141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:41.811424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:41.811700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:41.826314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:41.827870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:41.839235 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4120/8325] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:42.002542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:42.004406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:42.111072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc30e9-a699-42ee-b50a-d8e958bef4e1 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:42.117113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:42.117887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:42.118427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:42.118899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:42.120911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:42.137677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:42.139772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:42.154749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4206/8326] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:47.820820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:47.832408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516629b-a0a0-401a-a639-79f31844dc14 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:47.837610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca757-073c-4211-9328-142b084c3f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:47.838373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca757-073c-4211-9328-142b084c3f24 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:47.838713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca757-073c-4211-9328-142b084c3f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:47.839072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca757-073c-4211-9328-142b084c3f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:47.900659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca757-073c-4211-9328-142b084c3f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:47.902145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca757-073c-4211-9328-142b084c3f24 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:47.912155 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4121/8327] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:51.090505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:51.093166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:51.163211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f718-7c2f-4c5a-bbd7-fec537c142a3 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:51.169268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:51.170182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:51.170461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:51.170851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] PATH_INFO: `/v3/users/0818e5f0edb74b82821c07c88df54826` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:51.172080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0818e5f0edb74b82821c07c88df54826)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:51.174102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:51.229592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0818e5f0edb74b82821c07c88df54826'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.230268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0818e5f0edb74b82821c07c88df54826'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.238219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0818e5f0edb74b82821c07c88df54826'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.247487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0818e5f0edb74b82821c07c88df54826'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.248169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0818e5f0edb74b82821c07c88df54826'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.266749 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4207/8328] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:51 2022] DELETE /identity/v3/users/0818e5f0edb74b82821c07c88df54826 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:51.271460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:51.271922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:51.272076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:51.289900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:51.291104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:51.362774 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4122/8329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:51.377379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:51.378943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:51.455892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7202e6-7c77-405e-9044-436a0d4cd878 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:51.461793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:51.462485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:51.462753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:51.463691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:51.476414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:51.478643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:51.490574 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4208/8330] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:51.725450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:51.727542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:51.750375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2acfbc-d23e-4d84-9d37-bc859623be50 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:51.758993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:51.760250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:51.760534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:51.760813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] PATH_INFO: `/v3/projects/f835ef5aefe44c96bc20308d450b5680` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:51.762152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f835ef5aefe44c96bc20308d450b5680)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:51.764123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:51.823965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f835ef5aefe44c96bc20308d450b5680', 'request_id': 'req-a35fc952-9a49-4f3b-8bef-99f4f375404b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.834031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f835ef5aefe44c96bc20308d450b5680', 'request_id': 'req-a35fc952-9a49-4f3b-8bef-99f4f375404b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.843998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f835ef5aefe44c96bc20308d450b5680', 'request_id': 'req-a35fc952-9a49-4f3b-8bef-99f4f375404b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.856535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] The token cache is being invalidate because project f835ef5aefe44c96bc20308d450b5680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:51.856827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.857533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.859202 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4123/8331] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:51 2022] DELETE /identity/v3/projects/f835ef5aefe44c96bc20308d450b5680 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:51.863412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:51.873934 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0abb82-538a-4993-ac72-1af8c30e2291 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:51.935435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:51.936376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:51.936679 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:51.936957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] PATH_INFO: `/v3/users/64084b72253b4e458009e93d215ec8fe` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:51.938223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64084b72253b4e458009e93d215ec8fe)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:51.940223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:51.990656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64084b72253b4e458009e93d215ec8fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.991598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64084b72253b4e458009e93d215ec8fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:51.998737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64084b72253b4e458009e93d215ec8fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.007458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64084b72253b4e458009e93d215ec8fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.008074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64084b72253b4e458009e93d215ec8fe'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.024934 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4209/8332] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:51 2022] DELETE /identity/v3/users/64084b72253b4e458009e93d215ec8fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:52.303329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:52.304988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:52.322226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fc952-9a49-4f3b-8bef-99f4f375404b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:52.384909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:52.385749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:52.386030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:52.386294 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] PATH_INFO: `/v3/projects/035c9d4e141c4b53860620844a00a338` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:52.387514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035c9d4e141c4b53860620844a00a338)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:52.389479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:52.442055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035c9d4e141c4b53860620844a00a338', 'request_id': 'req-ed440502-d936-40bf-ac17-6d671d063d34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.450286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035c9d4e141c4b53860620844a00a338', 'request_id': 'req-ed440502-d936-40bf-ac17-6d671d063d34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.460339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035c9d4e141c4b53860620844a00a338', 'request_id': 'req-ed440502-d936-40bf-ac17-6d671d063d34'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.474169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] The token cache is being invalidate because project 035c9d4e141c4b53860620844a00a338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:52.474453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.475184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.476846 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4124/8333] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:52 2022] DELETE /identity/v3/projects/035c9d4e141c4b53860620844a00a338 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:52.480939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:52.482585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:52.496175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb4dd9-9fb0-4301-85f4-da6c0f528b00 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:52.561604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:52.561877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:52.562154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:52.562426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] PATH_INFO: `/v3/users/70f13c6533094617a83f21b58dc15c0b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:52.563643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f13c6533094617a83f21b58dc15c0b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:52.565745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:52.619313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f13c6533094617a83f21b58dc15c0b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.620376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f13c6533094617a83f21b58dc15c0b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.627218 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f13c6533094617a83f21b58dc15c0b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.636725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f13c6533094617a83f21b58dc15c0b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.637308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3bfa356d-ca2e-448f-b053-f323b1e27882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f13c6533094617a83f21b58dc15c0b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.655622 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4210/8334] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:52 2022] DELETE /identity/v3/users/70f13c6533094617a83f21b58dc15c0b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:52.834689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:52.836229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:52.849979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed440502-d936-40bf-ac17-6d671d063d34 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:52.910049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:52.910834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:52.911105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:52.911452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] PATH_INFO: `/v3/projects/9404593165ee4c7da2844a4ab235fc96` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:52.912694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9404593165ee4c7da2844a4ab235fc96)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:52.914659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:52.965174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9404593165ee4c7da2844a4ab235fc96', 'request_id': 'req-f2d6a3cb-34c7-4994-ab8a-717448f4264b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.970634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9404593165ee4c7da2844a4ab235fc96', 'request_id': 'req-f2d6a3cb-34c7-4994-ab8a-717448f4264b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.979549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9404593165ee4c7da2844a4ab235fc96', 'request_id': 'req-f2d6a3cb-34c7-4994-ab8a-717448f4264b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.991241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] The token cache is being invalidate because project 9404593165ee4c7da2844a4ab235fc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:52.991632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.992223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f2d6a3cb-34c7-4994-ab8a-717448f4264b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:52.993850 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4125/8335] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:52 2022] DELETE /identity/v3/projects/9404593165ee4c7da2844a4ab235fc96 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:52.998966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa39db-a025-4b4e-83f0-6c8235254d48 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:52.999254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa39db-a025-4b4e-83f0-6c8235254d48 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:52.999527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa39db-a025-4b4e-83f0-6c8235254d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.018440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b7aa39db-a025-4b4e-83f0-6c8235254d48 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:53.019665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b7aa39db-a025-4b4e-83f0-6c8235254d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:53.088422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4211/8336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:53.096291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bbcfa-fc31-4bd0-bbb4-f89cb99bd524 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.096576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bbcfa-fc31-4bd0-bbb4-f89cb99bd524 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.096850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bbcfa-fc31-4bd0-bbb4-f89cb99bd524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.117181 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-425bbcfa-fc31-4bd0-bbb4-f89cb99bd524 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:53.118424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-425bbcfa-fc31-4bd0-bbb4-f89cb99bd524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:53.126902 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4126/8337] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:53.131041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa39db-a025-4b4e-83f0-6c8235254d48 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:53.140846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa39db-a025-4b4e-83f0-6c8235254d48 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:53.146391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:53.150536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.150873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.151082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.152109 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:53.152419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:53.154099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:53.166566 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4212/8338] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:53.171038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bbcfa-fc31-4bd0-bbb4-f89cb99bd524 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:53.180631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bbcfa-fc31-4bd0-bbb4-f89cb99bd524 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:53.185695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:53.186309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.186585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.186875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.187545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:53.189610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:53.216917 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4127/8339] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:53 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:53.221320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:53.231838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737f2bf-3a34-420c-87b7-a352c94c10bc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:53.287225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:53.287971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.288305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.288601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.289359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:53.291460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:53.312124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4213/8340] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:53 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:53.317515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:53.328044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b68a4d-537c-4844-8fba-ef676e82716b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:53.333348 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:53.334083 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.334380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.334635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.335365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:53.337433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:53.348179 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4128/8341] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:53.352314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:53.362540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2cee-d32a-4ad8-a001-e32b3f8ae45c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:53.367575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ce131-02d0-41f9-b62e-ee2f622504a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:53.368262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce131-02d0-41f9-b62e-ee2f622504a9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.368543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce131-02d0-41f9-b62e-ee2f622504a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.368865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce131-02d0-41f9-b62e-ee2f622504a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.369672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ce131-02d0-41f9-b62e-ee2f622504a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:53.371349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ce131-02d0-41f9-b62e-ee2f622504a9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:53.384663 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4214/8342] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:53.385943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:53.395959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42137c-c475-4215-8131-7f55aafb7186 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:53.400686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:53.401610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.401889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.402158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] PATH_INFO: `/v3/projects/4c30644570a142579638908937b6ccac/users/aabb89139f3c48c1a70b7cb01f214f73/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.417770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c30644570a142579638908937b6ccac, user_id=aabb89139f3c48c1a70b7cb01f214f73, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:53.420385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:53.435620 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4129/8343] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:53 2022] PUT /identity/v3/projects/4c30644570a142579638908937b6ccac/users/aabb89139f3c48c1a70b7cb01f214f73/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:53.440753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.441048 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.441343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.459435 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:53.460628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:53.519828 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4215/8344] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:53.529909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:53.531898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:53.592451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f3e0d-0057-45b6-9431-6a1f5db7c6b9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:53.596655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcb73f-1cf8-49d6-9431-4dbee6567cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:53.597416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb73f-1cf8-49d6-9431-4dbee6567cae service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:53.597693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb73f-1cf8-49d6-9431-4dbee6567cae service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:53.598065 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb73f-1cf8-49d6-9431-4dbee6567cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:53.607534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcb73f-1cf8-49d6-9431-4dbee6567cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:53.608983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcb73f-1cf8-49d6-9431-4dbee6567cae service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:53.618819 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4130/8345] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:55.684524 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:55.686303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:55.699115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b703b-d76d-4fae-aae5-a35374fff9cd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:55.703890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:55.704820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:55.705358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:55.705635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] PATH_INFO: `/v3/users/074faed3274e4d1dacf678e2b9e08f39` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:55.707043 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074faed3274e4d1dacf678e2b9e08f39)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:55.709089 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:55.767275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074faed3274e4d1dacf678e2b9e08f39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:55.767921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074faed3274e4d1dacf678e2b9e08f39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:55.774776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074faed3274e4d1dacf678e2b9e08f39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:55.783154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074faed3274e4d1dacf678e2b9e08f39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:55.784016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074faed3274e4d1dacf678e2b9e08f39'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:55.801161 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4216/8346] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:55 2022] DELETE /identity/v3/users/074faed3274e4d1dacf678e2b9e08f39 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:55.806015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80215e70-764f-4743-8579-067237975394 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:55.806487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80215e70-764f-4743-8579-067237975394 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:55.806852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80215e70-764f-4743-8579-067237975394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:55.826070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-80215e70-764f-4743-8579-067237975394 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:55.827194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-80215e70-764f-4743-8579-067237975394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:55.887407 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4131/8347] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:55.897477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:55.898989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:55.964037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d430e6-91a2-4b71-858a-5f575defe858 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:55.968636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:55.969442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:55.969731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:55.970013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:55.981477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:55.983081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:55.994201 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4217/8348] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:27:56.206665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80215e70-764f-4743-8579-067237975394 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:56.208307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-80215e70-764f-4743-8579-067237975394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:56.236748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80215e70-764f-4743-8579-067237975394 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:56.255448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:56.256713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:56.257228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:56.257816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] PATH_INFO: `/v3/projects/b9116e25235c4f1f8631dc72fc5a2092` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:56.259344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9116e25235c4f1f8631dc72fc5a2092)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:56.261772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:56.322459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9116e25235c4f1f8631dc72fc5a2092', 'request_id': 'req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.328807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9116e25235c4f1f8631dc72fc5a2092', 'request_id': 'req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.341601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9116e25235c4f1f8631dc72fc5a2092', 'request_id': 'req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.355739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] The token cache is being invalidate because project b9116e25235c4f1f8631dc72fc5a2092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:56.356029 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.356697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.361355 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4132/8349] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:56 2022] DELETE /identity/v3/projects/b9116e25235c4f1f8631dc72fc5a2092 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:56.362721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:56.380028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c3c3c-4685-42d2-8f6b-901f49c59150 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:56.469708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:56.471343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:56.471343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:56.471587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] PATH_INFO: `/v3/users/a8a9ceafe6674292802726d752c7a239` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:56.473022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a9ceafe6674292802726d752c7a239)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:56.475740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:56.558279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a9ceafe6674292802726d752c7a239'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.559414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a9ceafe6674292802726d752c7a239'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.568291 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a9ceafe6674292802726d752c7a239'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.579818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a9ceafe6674292802726d752c7a239'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.580673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a9ceafe6674292802726d752c7a239'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:56.600752 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4218/8350] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:56 2022] DELETE /identity/v3/users/a8a9ceafe6674292802726d752c7a239 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:56.972364 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:56.973988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:56.994079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837e4e2-e2b8-49b9-94bf-21c1d78b0b32 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:57.078991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:57.079792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:57.080069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:57.080524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] PATH_INFO: `/v3/projects/03e0efb2335a40faa1414aaaabc1b8e6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:57.081809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e0efb2335a40faa1414aaaabc1b8e6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:57.083825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:57.141619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e0efb2335a40faa1414aaaabc1b8e6', 'request_id': 'req-702755f2-e54a-4009-9ac4-04533a70053c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.148038 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e0efb2335a40faa1414aaaabc1b8e6', 'request_id': 'req-702755f2-e54a-4009-9ac4-04533a70053c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.161706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e0efb2335a40faa1414aaaabc1b8e6', 'request_id': 'req-702755f2-e54a-4009-9ac4-04533a70053c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.176207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] The token cache is being invalidate because project 03e0efb2335a40faa1414aaaabc1b8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:57.176564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.177959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.181098 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4133/8351] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:56 2022] DELETE /identity/v3/projects/03e0efb2335a40faa1414aaaabc1b8e6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:57.185991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:57.190874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:57.216686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b74179-e8f0-4af7-a2a9-2a5514509847 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:57.328112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:57.329193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:57.330022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:57.330309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] PATH_INFO: `/v3/users/9abb74b94f1a4b17858c639a6af159ba` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:57.332091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9abb74b94f1a4b17858c639a6af159ba)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:57.335186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:57.396990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9abb74b94f1a4b17858c639a6af159ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.398192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9abb74b94f1a4b17858c639a6af159ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.407828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9abb74b94f1a4b17858c639a6af159ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.421477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9abb74b94f1a4b17858c639a6af159ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.422226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1e50e954-aca0-43a7-b259-cb63225504b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9abb74b94f1a4b17858c639a6af159ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.442358 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4219/8352] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:27:57 2022] DELETE /identity/v3/users/9abb74b94f1a4b17858c639a6af159ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:57.778897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:57.780939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:57.804330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702755f2-e54a-4009-9ac4-04533a70053c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:57.874689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:57.875858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:57.876695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:57.876966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] PATH_INFO: `/v3/projects/e69f3e39a75848f2bbaac23e9e4938c3` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:57.878695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69f3e39a75848f2bbaac23e9e4938c3)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:57.881338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:57.950008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69f3e39a75848f2bbaac23e9e4938c3', 'request_id': 'req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.956252 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69f3e39a75848f2bbaac23e9e4938c3', 'request_id': 'req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.970771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69f3e39a75848f2bbaac23e9e4938c3', 'request_id': 'req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.993373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] The token cache is being invalidate because project e69f3e39a75848f2bbaac23e9e4938c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:27:57.994457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.995471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-5b9e9152-7b03-44e7-89f0-f8f9e6a2231a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:27:57.997618 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4134/8353] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:27:57 2022] DELETE /identity/v3/projects/e69f3e39a75848f2bbaac23e9e4938c3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:58.003866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c203-bb4b-49c0-a61e-e33cdb0586dd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.004150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c203-bb4b-49c0-a61e-e33cdb0586dd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.004427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c203-bb4b-49c0-a61e-e33cdb0586dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.026607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6e38c203-bb4b-49c0-a61e-e33cdb0586dd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:58.027865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e38c203-bb4b-49c0-a61e-e33cdb0586dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:58.108019 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4220/8354] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:58.116023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1d5a-833a-4e78-93c6-9c9f509a0321 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.116315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1d5a-833a-4e78-93c6-9c9f509a0321 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.116596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1d5a-833a-4e78-93c6-9c9f509a0321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.141879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-737a1d5a-833a-4e78-93c6-9c9f509a0321 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:58.143126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-737a1d5a-833a-4e78-93c6-9c9f509a0321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:58.166847 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c203-bb4b-49c0-a61e-e33cdb0586dd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.167340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4135/8355] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:58.177744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c203-bb4b-49c0-a61e-e33cdb0586dd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.183509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.184431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.184542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.184783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.185921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:27:58.186234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.187919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.207531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.209415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.209849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.226673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4221/8356] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:27:58.230412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.241261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0f66-4175-4875-9867-5ac4c8cb061b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.254084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.254382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] MFA Rules not processed for user `aabb89139f3c48c1a70b7cb01f214f73`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:58.254824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.255108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.256081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.262332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.262932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:58.263230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.308380 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4222/8357] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:58.309970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.348199 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4136/8358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:58.352239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.353679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:58.368494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449f019-700a-42af-9b4e-7b0b7a1275f6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.384448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93d1b-c6d2-4544-a819-6ec5d1f9a15e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.389629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.390487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.390831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.391178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.391962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.394021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.422980 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4223/8359] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:58.426850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.434129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.434948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.435234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.435512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.436225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.438662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.441664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b9a34-6235-453a-8d73-a5d9d3242f61 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.446572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.447554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.447838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.448119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.448839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.450751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.464392 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4224/8360] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:58.470229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.475562 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4137/8361] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:58.477101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.481999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dcf4a-7546-4b88-8125-dff0e85cb178 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.543251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.543540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2b4d-afb9-45bf-93f5-8bd40c87ec68 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.543951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.544228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.544566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.545260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.547033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.548709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.549548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.549741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.549977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.550667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.552838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.561770 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4225/8362] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:58.563239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.574776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c094e2-0031-42aa-b247-75a21d1d6271 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.578577 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4138/8363] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:58.579917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.584318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8cdd0-c6ac-4069-897e-db7282f8ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.585274 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8cdd0-c6ac-4069-897e-db7282f8ce8f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.585555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8cdd0-c6ac-4069-897e-db7282f8ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.585831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8cdd0-c6ac-4069-897e-db7282f8ce8f admin admin] PATH_INFO: `/v3/projects/badc9609b4694dac954d050e422d5c83/users/f345935144dd4e3597b4fff506e74fd3/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.591698 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9498f6d-e6f2-4439-a3c8-767e5e50d940 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.597403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.598082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.598367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.598716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.599448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.601163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.605251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8cdd0-c6ac-4069-897e-db7282f8ce8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=badc9609b4694dac954d050e422d5c83, user_id=f345935144dd4e3597b4fff506e74fd3, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.607951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8cdd0-c6ac-4069-897e-db7282f8ce8f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.612215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4139/8364] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:58.616510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.623747 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4226/8365] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:58 2022] PUT /identity/v3/projects/badc9609b4694dac954d050e422d5c83/users/f345935144dd4e3597b4fff506e74fd3/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:58.635765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fd77-b595-4025-912d-50d4b93dc86e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.636060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fd77-b595-4025-912d-50d4b93dc86e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.636409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fd77-b595-4025-912d-50d4b93dc86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.638385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41215a0-eb7d-4e14-9f3a-6c39a7d72351 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.664877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9818fd77-b595-4025-912d-50d4b93dc86e None None] MFA Rules not processed for user `f345935144dd4e3597b4fff506e74fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:58.666307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9818fd77-b595-4025-912d-50d4b93dc86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:58.697944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.698861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.699139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.699412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] PATH_INFO: `/v3/projects/f9c697ea47df45069a2be9e2124600f9/users/c90ad32122404dd59aeead26f9764953/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.715082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c697ea47df45069a2be9e2124600f9, user_id=c90ad32122404dd59aeead26f9764953, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.718373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.738444 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4140/8366] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:58 2022] PUT /identity/v3/projects/f9c697ea47df45069a2be9e2124600f9/users/c90ad32122404dd59aeead26f9764953/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:58.740318 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4227/8367] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:27:58.742204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.745205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818fd77-b595-4025-912d-50d4b93dc86e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.757390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818fd77-b595-4025-912d-50d4b93dc86e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.818205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f4b94-b5fe-432c-b68b-ff37db0a4f95 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.821406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.822113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.822458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.822793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.822947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.823633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.823781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.824033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.824309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.825218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.825953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.826822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.838212 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4141/8368] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:58.842222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.852996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbc0d-f9fb-4573-b2cb-539c679779c3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:58.857858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:58.858750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:58.859091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:58.859175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4228/8369] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:27:58.859428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] PATH_INFO: `/v3/projects/f9c697ea47df45069a2be9e2124600f9/users/c90ad32122404dd59aeead26f9764953/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:58.863062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:58.863363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c697ea47df45069a2be9e2124600f9, user_id=c90ad32122404dd59aeead26f9764953, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:58.866486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:58.877909 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4142/8370] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:58 2022] PUT /identity/v3/projects/f9c697ea47df45069a2be9e2124600f9/users/c90ad32122404dd59aeead26f9764953/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:58.934802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2956a-b744-4e3e-aed9-0973c62dc3c9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:59.012486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:59.013227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.013669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.013949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.014652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:59.017587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:59.058570 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4229/8371] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:27:58 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:27:59.062064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:59.079415 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e608-ec49-45b2-8135-297bb133c2e6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:59.091834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:59.092565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.092976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.093490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.094208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:59.095983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:59.109870 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4143/8372] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:27:59.113739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:59.127673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cfc0b-c329-48cb-9ec9-63bfc37266cd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:59.134415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:59.135362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.135639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.135914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] PATH_INFO: `/v3/projects/3aa19b3fc8404b6eb54fd97533d7c162/users/3b920265dae042a0a34b1cf704b4d4ae/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.152349 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa19b3fc8404b6eb54fd97533d7c162, user_id=3b920265dae042a0a34b1cf704b4d4ae, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:59.155621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:59.174481 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4230/8373] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:59 2022] PUT /identity/v3/projects/3aa19b3fc8404b6eb54fd97533d7c162/users/3b920265dae042a0a34b1cf704b4d4ae/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:27:59.178750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:59.198829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdfbb-2413-4fcb-9d7c-0b5655499848 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:59.310248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc15f5-99da-48bb-a90d-dc85afcbc880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:59.311019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc15f5-99da-48bb-a90d-dc85afcbc880 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.311593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc15f5-99da-48bb-a90d-dc85afcbc880 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.311704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc15f5-99da-48bb-a90d-dc85afcbc880 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.312437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc15f5-99da-48bb-a90d-dc85afcbc880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:59.314274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc15f5-99da-48bb-a90d-dc85afcbc880 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:59.330879 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4144/8374] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:27:59.335022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:59.346396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2047850-f14b-4637-91a6-edc276a591f5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:59.351610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:59.352712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.353021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.354070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] PATH_INFO: `/v3/projects/3aa19b3fc8404b6eb54fd97533d7c162/users/3b920265dae042a0a34b1cf704b4d4ae/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.356192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa19b3fc8404b6eb54fd97533d7c162, user_id=3b920265dae042a0a34b1cf704b4d4ae, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:59.359078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:59.379900 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4231/8375] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:27:59 2022] PUT /identity/v3/projects/3aa19b3fc8404b6eb54fd97533d7c162/users/3b920265dae042a0a34b1cf704b4d4ae/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:27:59.383749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.384037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.384317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.416202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] MFA Rules not processed for user `3b920265dae042a0a34b1cf704b4d4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:27:59.417841 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:59.453324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:59.456174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:59.558400 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4145/8376] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:27:59.568680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:27:59.577688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:59.614749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2b4b6-e6b4-4ef0-824f-1573281a47af admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:59.625697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:59.626526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.626737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.626961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.629055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:27:59.645914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:59.647577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:59.672539 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4232/8377] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:27:59.685854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc12e-b8a0-4be1-bbec-dca6786fc306 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:27:59.691024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816165f0-bb91-4b84-8b5f-2ee7d73a4407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:27:59.691805 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816165f0-bb91-4b84-8b5f-2ee7d73a4407 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:27:59.692043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816165f0-bb91-4b84-8b5f-2ee7d73a4407 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:27:59.692324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816165f0-bb91-4b84-8b5f-2ee7d73a4407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:27:59.711543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816165f0-bb91-4b84-8b5f-2ee7d73a4407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:27:59.713765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816165f0-bb91-4b84-8b5f-2ee7d73a4407 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:27:59.738459 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4146/8378] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:27:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:28:02.117260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:02.236854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53465dbf-124e-4fea-b8bc-fd64ad742bcc service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:02.252464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:02.253746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:02.254215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:02.254824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] PATH_INFO: `/v3/users/f345935144dd4e3597b4fff506e74fd3` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:02.257882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f345935144dd4e3597b4fff506e74fd3)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:02.261300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:02.353419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f345935144dd4e3597b4fff506e74fd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:02.354420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f345935144dd4e3597b4fff506e74fd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:02.363466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f345935144dd4e3597b4fff506e74fd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:02.378998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f345935144dd4e3597b4fff506e74fd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:02.380187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f345935144dd4e3597b4fff506e74fd3'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:02.400915 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4233/8379] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:02 2022] DELETE /identity/v3/users/f345935144dd4e3597b4fff506e74fd3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:02.415150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:02.415629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:02.415823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:02.437286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:02.438797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:02.503581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4147/8380] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:02.515193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:02.516885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:02.599852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb02d6-5ef0-459c-a5e4-ccd88254ec59 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:02.604892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:02.606761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:02.607309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:02.607898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:02.622697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:02.624939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:02.643744 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4234/8381] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:03.495998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:03.497525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:03.512051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3809bf-6edb-4cee-ba3b-df64454e16de None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:03.518743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:03.519830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:03.520218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:03.520604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] PATH_INFO: `/v3/projects/badc9609b4694dac954d050e422d5c83` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:03.522045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=badc9609b4694dac954d050e422d5c83)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:03.524490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:03.586659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badc9609b4694dac954d050e422d5c83', 'request_id': 'req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.593405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badc9609b4694dac954d050e422d5c83', 'request_id': 'req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.603019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badc9609b4694dac954d050e422d5c83', 'request_id': 'req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.615512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] The token cache is being invalidate because project badc9609b4694dac954d050e422d5c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:03.615859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.616455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.618384 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4148/8382] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:03 2022] DELETE /identity/v3/projects/badc9609b4694dac954d050e422d5c83 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:03.622178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:03.632169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a173-bd52-43b3-995f-ef6cbc8d8ecc service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:03.695086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:03.696289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:03.696577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:03.696865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] PATH_INFO: `/v3/users/3b920265dae042a0a34b1cf704b4d4ae` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:03.698107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b920265dae042a0a34b1cf704b4d4ae)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:03.700192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:03.763904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b920265dae042a0a34b1cf704b4d4ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.764762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b920265dae042a0a34b1cf704b4d4ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.772180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b920265dae042a0a34b1cf704b4d4ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.784026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b920265dae042a0a34b1cf704b4d4ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.784853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-08a9a330-e2db-41fb-93dc-151294a3e63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b920265dae042a0a34b1cf704b4d4ae'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:03.808633 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4235/8383] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:03 2022] DELETE /identity/v3/users/3b920265dae042a0a34b1cf704b4d4ae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:04.134724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:04.137489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:04.182541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f67c-64fd-45b9-aa55-afa3f2edd9fa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:04.264907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:04.266859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.267438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.267893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] PATH_INFO: `/v3/projects/3aa19b3fc8404b6eb54fd97533d7c162` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.269458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa19b3fc8404b6eb54fd97533d7c162)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:04.271475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:04.349590 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa19b3fc8404b6eb54fd97533d7c162', 'request_id': 'req-100be4d5-f18f-487d-8c31-5b819690849d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:04.355915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa19b3fc8404b6eb54fd97533d7c162', 'request_id': 'req-100be4d5-f18f-487d-8c31-5b819690849d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:04.366324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa19b3fc8404b6eb54fd97533d7c162', 'request_id': 'req-100be4d5-f18f-487d-8c31-5b819690849d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:04.383267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] The token cache is being invalidate because project 3aa19b3fc8404b6eb54fd97533d7c162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:04.383493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:04.384159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-100be4d5-f18f-487d-8c31-5b819690849d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:04.385950 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4149/8384] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:04 2022] DELETE /identity/v3/projects/3aa19b3fc8404b6eb54fd97533d7c162 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:04.394600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb5017-53a6-43b2-9576-81279abc6c18 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.395028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb5017-53a6-43b2-9576-81279abc6c18 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.395516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb5017-53a6-43b2-9576-81279abc6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.422613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0ffb5017-53a6-43b2-9576-81279abc6c18 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:04.424921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0ffb5017-53a6-43b2-9576-81279abc6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:04.494726 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4236/8385] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:04.502413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aa860-babc-4063-bf84-fa8d19f864b6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.502909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aa860-babc-4063-bf84-fa8d19f864b6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.503230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aa860-babc-4063-bf84-fa8d19f864b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.523806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-325aa860-babc-4063-bf84-fa8d19f864b6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:04.524087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-325aa860-babc-4063-bf84-fa8d19f864b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:04.539082 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4150/8386] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:28:04.544188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb5017-53a6-43b2-9576-81279abc6c18 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:04.554821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb5017-53a6-43b2-9576-81279abc6c18 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:04.559673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:04.560442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.560627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.560895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.561710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:04.561928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:04.563750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:04.581133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4237/8387] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:28:04.585988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aa860-babc-4063-bf84-fa8d19f864b6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:04.597584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aa860-babc-4063-bf84-fa8d19f864b6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:04.603854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:04.604544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.604824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.605408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.606124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:04.608069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:04.660237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:04.667892 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4151/8388] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:04 2022] POST /identity/v3/projects => generated 355 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:28:04.672881 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa99b6-0b8b-47cb-bfb9-f0b547256845 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:04.747866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:04.748577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.748854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.749176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.749933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:04.752186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:04.785388 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4238/8389] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:04 2022] POST /identity/v3/users => generated 278 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:04.786418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:04.803998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccb1ab-d1cf-46a9-ba24-a16629295c42 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:04.809303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:04.809937 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.810220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.810495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.811233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:04.812875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:04.832533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:04.839910 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4152/8390] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:28:04.844690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902874d-5956-4ef3-b36e-201934859542 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:04.850080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1f69-0a42-4310-8a40-e94cf7f9916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:04.850916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1f69-0a42-4310-8a40-e94cf7f9916c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.851293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1f69-0a42-4310-8a40-e94cf7f9916c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.851839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1f69-0a42-4310-8a40-e94cf7f9916c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.852671 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b1f69-0a42-4310-8a40-e94cf7f9916c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:04.854523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b1f69-0a42-4310-8a40-e94cf7f9916c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:04.873266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:04.878668 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4239/8391] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:04.884737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca27a31-14c8-48e2-8b9f-7813afa10a1e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:04.890126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d4fad-40a4-4d76-b644-04c97d5fc195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:04.891162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4fad-40a4-4d76-b644-04c97d5fc195 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.891540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4fad-40a4-4d76-b644-04c97d5fc195 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.891904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4fad-40a4-4d76-b644-04c97d5fc195 admin admin] PATH_INFO: `/v3/projects/c343d3deac3343d3ba42545fbdc7e742/users/1db29aa0ac3e42028d3dcaaae25ba3ba/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.913945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d4fad-40a4-4d76-b644-04c97d5fc195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c343d3deac3343d3ba42545fbdc7e742, user_id=1db29aa0ac3e42028d3dcaaae25ba3ba, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:04.916730 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d4fad-40a4-4d76-b644-04c97d5fc195 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:04.944254 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4153/8392] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:04 2022] PUT /identity/v3/projects/c343d3deac3343d3ba42545fbdc7e742/users/1db29aa0ac3e42028d3dcaaae25ba3ba/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:28:04.960034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2ba5-0ac8-4fcf-9cc4-6a6ee0a327b6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:04.960359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2ba5-0ac8-4fcf-9cc4-6a6ee0a327b6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:04.960613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2ba5-0ac8-4fcf-9cc4-6a6ee0a327b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:04.990770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f2ac2ba5-0ac8-4fcf-9cc4-6a6ee0a327b6 None None] MFA Rules not processed for user `1db29aa0ac3e42028d3dcaaae25ba3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:04.992159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f2ac2ba5-0ac8-4fcf-9cc4-6a6ee0a327b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:05.036138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.036569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.036948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.069631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] MFA Rules not processed for user `c90ad32122404dd59aeead26f9764953`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:05.071039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:05.075500 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4240/8393] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:05.080186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac2ba5-0ac8-4fcf-9cc4-6a6ee0a327b6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.151883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac2ba5-0ac8-4fcf-9cc4-6a6ee0a327b6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.156780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.160923 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4154/8394] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:28:05.161068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.161068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.161068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.161068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.161068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.169721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.171247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:05.193185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4241/8395] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:05 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:28:05.195600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.271028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f26b6-4e67-4c27-8b0d-f81f369d72e2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.271710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a754-6cdd-473b-974d-e242b4fa1667 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.276504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.278398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.279392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.279829 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.280687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.284210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.321671 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4242/8396] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:05 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:05.322477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.333223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353a10-8fe8-458f-a9d1-6ae57e1d86e5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.340920 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.341664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.341945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.342221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.342968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.344762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.353640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3f869-7622-4216-a35a-8b08bffd7898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.354325 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3f869-7622-4216-a35a-8b08bffd7898 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.354609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3f869-7622-4216-a35a-8b08bffd7898 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.354880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3f869-7622-4216-a35a-8b08bffd7898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.366983 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4243/8397] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:05.368034 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.379027 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baa727-3745-4db3-b87f-2fbc8ceb62d8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.384978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.386556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.386862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.387146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] PATH_INFO: `/v3/projects/17b53db1840a42abb95ad17aa00372e1/users/0f44d814240c47438f5fa41a48d4bb5f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.406750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b53db1840a42abb95ad17aa00372e1, user_id=0f44d814240c47438f5fa41a48d4bb5f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.409542 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.426657 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4244/8398] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:05 2022] PUT /identity/v3/projects/17b53db1840a42abb95ad17aa00372e1/users/0f44d814240c47438f5fa41a48d4bb5f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:05.430341 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.444183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3f869-7622-4216-a35a-8b08bffd7898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.445789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3f869-7622-4216-a35a-8b08bffd7898 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.456345 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4155/8399] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:05.503000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4660-5f90-4f66-acd2-be9dbe692f0d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.506472 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862e12-5980-47c2-97f3-c68993bc711a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.506974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862e12-5980-47c2-97f3-c68993bc711a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.506974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862e12-5980-47c2-97f3-c68993bc711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.508779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.509674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.510114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.510492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.511322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.513139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.524059 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4245/8400] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:28:05.524524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3f862e12-5980-47c2-97f3-c68993bc711a None None] MFA Rules not processed for user `aabb89139f3c48c1a70b7cb01f214f73`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:05.525783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3f862e12-5980-47c2-97f3-c68993bc711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:05.527895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.538267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391a908-e6ac-4a98-9517-d6800dd3cc7b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.543460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264233-66b6-4f27-8089-5d0d58972a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.544375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264233-66b6-4f27-8089-5d0d58972a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.544657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264233-66b6-4f27-8089-5d0d58972a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.545080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264233-66b6-4f27-8089-5d0d58972a66 admin admin] PATH_INFO: `/v3/projects/17b53db1840a42abb95ad17aa00372e1/users/0f44d814240c47438f5fa41a48d4bb5f/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.547264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8264233-66b6-4f27-8089-5d0d58972a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b53db1840a42abb95ad17aa00372e1, user_id=0f44d814240c47438f5fa41a48d4bb5f, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.549990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8264233-66b6-4f27-8089-5d0d58972a66 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.563388 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4246/8401] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:05 2022] PUT /identity/v3/projects/17b53db1840a42abb95ad17aa00372e1/users/0f44d814240c47438f5fa41a48d4bb5f/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:28:05.574137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f014-4517-4bd1-aa76-41b45d988f13 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.574355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f014-4517-4bd1-aa76-41b45d988f13 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.574630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f014-4517-4bd1-aa76-41b45d988f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.584386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4156/8402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:28:05.602899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-2763f014-4517-4bd1-aa76-41b45d988f13 None None] MFA Rules not processed for user `0f44d814240c47438f5fa41a48d4bb5f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:05.604139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2763f014-4517-4bd1-aa76-41b45d988f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:05.673678 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4247/8403] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:05 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:05.678890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f862e12-5980-47c2-97f3-c68993bc711a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.741442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f862e12-5980-47c2-97f3-c68993bc711a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.746301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f44d814240c47438f5fa41a48d4bb5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b53db1840a42abb95ad17aa00372e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.746980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.747265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.747545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.748330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:05.748622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.750298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.762375 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4157/8404] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:28:05.766296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763f014-4517-4bd1-aa76-41b45d988f13 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.775567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763f014-4517-4bd1-aa76-41b45d988f13 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.780742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f44d814240c47438f5fa41a48d4bb5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b53db1840a42abb95ad17aa00372e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.781529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.781805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.782065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.782759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.784680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.814288 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4248/8405] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:05 2022] POST /identity/v3/projects => generated 350 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:05.818589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.829722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857241-e7d3-483d-8394-8cc1537d7d90 tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.891630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f44d814240c47438f5fa41a48d4bb5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b53db1840a42abb95ad17aa00372e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.892295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.892573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.892840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.893675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:05.893974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.895689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:05.907465 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4158/8406] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:28:05.917263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:05.918982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:05.979712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abb7c-06a2-417d-870f-5babb51a95ad tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:05.983828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:05.984326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:05.984715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:05.985115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:05.996722 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:05.998269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:06.009458 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4249/8407] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:06.143825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:06.155305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4180f-d981-4a40-a0f0-0f09272291ee tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:06.161990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f44d814240c47438f5fa41a48d4bb5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b53db1840a42abb95ad17aa00372e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:06.163168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:06.163286 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:06.163543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] PATH_INFO: `/v3/projects/e986d7ebdbf14fb694ed3656642bd6b8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:06.164844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e986d7ebdbf14fb694ed3656642bd6b8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:06.166809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:06.235059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e986d7ebdbf14fb694ed3656642bd6b8', 'request_id': 'req-8d87bb56-79aa-46c7-b495-0f05f90cb73a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.241089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e986d7ebdbf14fb694ed3656642bd6b8', 'request_id': 'req-8d87bb56-79aa-46c7-b495-0f05f90cb73a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.251853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e986d7ebdbf14fb694ed3656642bd6b8', 'request_id': 'req-8d87bb56-79aa-46c7-b495-0f05f90cb73a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.271089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] The token cache is being invalidate because project e986d7ebdbf14fb694ed3656642bd6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:06.271311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.271984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-8d87bb56-79aa-46c7-b495-0f05f90cb73a tempest-QuotasTest-2142757219 tempest-QuotasTest-2142757219-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.278958 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4159/8408] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:06 2022] DELETE /identity/v3/projects/e986d7ebdbf14fb694ed3656642bd6b8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:06.410966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:06.481894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d00b-c7da-490f-a46c-a94d4bb45683 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:06.704136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:06.705215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:06.705564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:06.706391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] PATH_INFO: `/v3/users/1db29aa0ac3e42028d3dcaaae25ba3ba` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:06.707365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db29aa0ac3e42028d3dcaaae25ba3ba)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:06.709501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:06.765612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db29aa0ac3e42028d3dcaaae25ba3ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.766269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db29aa0ac3e42028d3dcaaae25ba3ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.775057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db29aa0ac3e42028d3dcaaae25ba3ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.784653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db29aa0ac3e42028d3dcaaae25ba3ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.785730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db29aa0ac3e42028d3dcaaae25ba3ba'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:06.805848 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4250/8409] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:06 2022] DELETE /identity/v3/users/1db29aa0ac3e42028d3dcaaae25ba3ba => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:06.811469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:06.812703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:06.813293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:06.832756 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:06.834295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:06.909708 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4160/8410] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:06.923573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:06.925651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:06.985975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbf4f0-ab32-4dc6-9e26-0c72dcd6ad24 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:06.989932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:06.990726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:06.991004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:06.991278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:07.001871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:07.003375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:07.013772 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4251/8411] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:07.435823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:07.437332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:07.478764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9e47-cc2a-4e41-ad01-da29f85a3235 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:07.498374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:07.499477 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:07.499909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:07.500324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] PATH_INFO: `/v3/projects/c343d3deac3343d3ba42545fbdc7e742` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:07.503280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c343d3deac3343d3ba42545fbdc7e742)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:07.505721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:07.614737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c343d3deac3343d3ba42545fbdc7e742', 'request_id': 'req-b798a486-12ec-4285-807f-6ef53dad47e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.627634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c343d3deac3343d3ba42545fbdc7e742', 'request_id': 'req-b798a486-12ec-4285-807f-6ef53dad47e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.643394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c343d3deac3343d3ba42545fbdc7e742', 'request_id': 'req-b798a486-12ec-4285-807f-6ef53dad47e7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.678224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] The token cache is being invalidate because project c343d3deac3343d3ba42545fbdc7e742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:07.679310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.682433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.687544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4161/8412] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:07 2022] DELETE /identity/v3/projects/c343d3deac3343d3ba42545fbdc7e742 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:07.691471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:07.702203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8c53c-d2cb-4621-89e2-c0e471db1fdb service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:07.777002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:07.778074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:07.778359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:07.778631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] PATH_INFO: `/v3/users/0f44d814240c47438f5fa41a48d4bb5f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:07.779887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f44d814240c47438f5fa41a48d4bb5f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:07.782067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:07.850716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f44d814240c47438f5fa41a48d4bb5f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.851582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f44d814240c47438f5fa41a48d4bb5f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.858681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f44d814240c47438f5fa41a48d4bb5f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.869353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f44d814240c47438f5fa41a48d4bb5f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.870097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c9a88ae2-cf39-45f1-bc79-bb045e15af90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f44d814240c47438f5fa41a48d4bb5f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:07.889326 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4252/8413] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:07 2022] DELETE /identity/v3/users/0f44d814240c47438f5fa41a48d4bb5f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:08.241674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:08.245341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:08.264857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a486-12ec-4285-807f-6ef53dad47e7 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:08.350664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:08.351948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.352430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.353257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] PATH_INFO: `/v3/projects/17b53db1840a42abb95ad17aa00372e1` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.354796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b53db1840a42abb95ad17aa00372e1)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:08.357152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:08.412202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b53db1840a42abb95ad17aa00372e1', 'request_id': 'req-69749e39-4f31-4dba-b8ea-77a3412211c4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:08.417717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b53db1840a42abb95ad17aa00372e1', 'request_id': 'req-69749e39-4f31-4dba-b8ea-77a3412211c4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:08.437086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b53db1840a42abb95ad17aa00372e1', 'request_id': 'req-69749e39-4f31-4dba-b8ea-77a3412211c4'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:08.458582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] The token cache is being invalidate because project 17b53db1840a42abb95ad17aa00372e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:08.459156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:08.459951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-69749e39-4f31-4dba-b8ea-77a3412211c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:08.467511 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4162/8414] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:08 2022] DELETE /identity/v3/projects/17b53db1840a42abb95ad17aa00372e1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:08.473709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e885509-2c08-40d2-b2e7-bbcc8c725d53 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.474241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e885509-2c08-40d2-b2e7-bbcc8c725d53 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.474732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e885509-2c08-40d2-b2e7-bbcc8c725d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.493903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6e885509-2c08-40d2-b2e7-bbcc8c725d53 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:08.495628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6e885509-2c08-40d2-b2e7-bbcc8c725d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:08.568060 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4253/8415] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:08.576170 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9eb6-c8f9-4f74-b5c6-a1600f8d28c0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.576702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9eb6-c8f9-4f74-b5c6-a1600f8d28c0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.576984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9eb6-c8f9-4f74-b5c6-a1600f8d28c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.604222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cf2a9eb6-c8f9-4f74-b5c6-a1600f8d28c0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:08.605755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cf2a9eb6-c8f9-4f74-b5c6-a1600f8d28c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:08.620591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e885509-2c08-40d2-b2e7-bbcc8c725d53 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:08.621251 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4163/8416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:08.631731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e885509-2c08-40d2-b2e7-bbcc8c725d53 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:08.637635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:08.638661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.638834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.639148 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.639930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:08.640356 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:08.642328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:08.658520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4254/8417] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:28:08.659850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9eb6-c8f9-4f74-b5c6-a1600f8d28c0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:08.674120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9eb6-c8f9-4f74-b5c6-a1600f8d28c0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:08.679538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:08.680921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.680921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.681339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.682716 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:08.684250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:08.734444 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4164/8418] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:08 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:08.734786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:08.746186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd63e22-c147-4e9a-b4bf-28e6fd418273 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:08.812184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:08.814331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.814810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.815283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.816413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:08.818789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:08.849547 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4255/8419] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:08 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:28:08.853456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:08.865690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c06d6-5442-413d-811f-e57da206bb09 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:08.871227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:08.872067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.872589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.872965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.873850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:08.876115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:08.890981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4165/8420] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:28:08.892224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:08.905915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d56aa-6074-4d55-81a2-d2f8a7bd62d5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:08.912381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d044a5-a382-41b6-af2a-bc183b0fd255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:08.913233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d044a5-a382-41b6-af2a-bc183b0fd255 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.913764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d044a5-a382-41b6-af2a-bc183b0fd255 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.914360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d044a5-a382-41b6-af2a-bc183b0fd255 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.915340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d044a5-a382-41b6-af2a-bc183b0fd255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:08.917018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d044a5-a382-41b6-af2a-bc183b0fd255 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:08.932311 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4256/8421] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:08.934245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:08.950818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b87ff-58b4-445b-baee-8fa33fbb2e2f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:08.956438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:08.957481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:08.957920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:08.958199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] PATH_INFO: `/v3/projects/df41679c6b98493f800e1f1adce4270b/users/100765b326e04968a92e981dddecb1f8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:08.976180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df41679c6b98493f800e1f1adce4270b, user_id=100765b326e04968a92e981dddecb1f8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:08.979137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.006340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4166/8422] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:08 2022] PUT /identity/v3/projects/df41679c6b98493f800e1f1adce4270b/users/100765b326e04968a92e981dddecb1f8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:09.020398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b1d2-ec38-4d32-8fa3-48d54dab0272 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.020978 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b1d2-ec38-4d32-8fa3-48d54dab0272 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.021367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b1d2-ec38-4d32-8fa3-48d54dab0272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.062403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b751b1d2-ec38-4d32-8fa3-48d54dab0272 None None] MFA Rules not processed for user `100765b326e04968a92e981dddecb1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:09.064183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b751b1d2-ec38-4d32-8fa3-48d54dab0272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:09.154131 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4257/8423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:09.158450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:09.250553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a44b3-1d8c-4430-a7eb-89d8af751a0f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:09.270013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:09.271068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.271569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.272027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.273234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:09.275548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.312689 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4167/8424] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:09 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:09.316455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b1d2-ec38-4d32-8fa3-48d54dab0272 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:09.328525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b1d2-ec38-4d32-8fa3-48d54dab0272 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:09.392562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:09.393413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.393755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.394099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.394907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:09.397189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.434566 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4258/8425] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:09 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:09.435938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:09.451389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce1ca-46a0-42c3-93cd-84a198dc936a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:09.477484 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:09.478441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.478898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.479315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.480218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:09.482025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.502276 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4168/8426] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:09.503758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:09.516518 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6ac1-1364-4feb-8949-277011d214ed admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:09.522355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:09.523999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.524282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.524551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] PATH_INFO: `/v3/projects/f15110a9921f40fc94b367ac1399336d/users/910044161c1144e0b5e1102914c3ff16/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.560530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15110a9921f40fc94b367ac1399336d, user_id=910044161c1144e0b5e1102914c3ff16, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:09.564608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.580981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4259/8427] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:09 2022] PUT /identity/v3/projects/f15110a9921f40fc94b367ac1399336d/users/910044161c1144e0b5e1102914c3ff16/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:09.585781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:09.596718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dda6-e7de-4cb5-b6b0-d1fd7170d5b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:09.653738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f791e4b-2543-4569-8711-223491c916da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:09.654427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791e4b-2543-4569-8711-223491c916da admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.654681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791e4b-2543-4569-8711-223491c916da admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.654952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791e4b-2543-4569-8711-223491c916da admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.655686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f791e4b-2543-4569-8711-223491c916da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:09.657330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f791e4b-2543-4569-8711-223491c916da admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.667935 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4169/8428] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:28:09.672385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:09.683259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b426fa-0d78-4130-98cc-4f9431202646 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:09.689228 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:09.690217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.690583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.690922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] PATH_INFO: `/v3/projects/f15110a9921f40fc94b367ac1399336d/users/910044161c1144e0b5e1102914c3ff16/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.693489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15110a9921f40fc94b367ac1399336d, user_id=910044161c1144e0b5e1102914c3ff16, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:09.697303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.708422 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4260/8429] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:09 2022] PUT /identity/v3/projects/f15110a9921f40fc94b367ac1399336d/users/910044161c1144e0b5e1102914c3ff16/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:28:09.719059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c15bbe-d132-4952-88cd-b0de0329c90a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.719351 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c15bbe-d132-4952-88cd-b0de0329c90a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.719624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c15bbe-d132-4952-88cd-b0de0329c90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.746758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-48c15bbe-d132-4952-88cd-b0de0329c90a None None] MFA Rules not processed for user `910044161c1144e0b5e1102914c3ff16`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:09.747986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-48c15bbe-d132-4952-88cd-b0de0329c90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:09.821934 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4170/8430] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:09.833367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:09.835186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:09.895610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a162-b71d-43ed-8d28-fc1b1cc220cc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:09.899574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977911c5-5095-4fdf-8c81-27801af0a174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:09.900241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977911c5-5095-4fdf-8c81-27801af0a174 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:09.900523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977911c5-5095-4fdf-8c81-27801af0a174 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:09.900802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977911c5-5095-4fdf-8c81-27801af0a174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:09.909925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977911c5-5095-4fdf-8c81-27801af0a174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:09.911454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977911c5-5095-4fdf-8c81-27801af0a174 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:09.920848 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4261/8431] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:11.736895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c15bbe-d132-4952-88cd-b0de0329c90a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:11.804330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c15bbe-d132-4952-88cd-b0de0329c90a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:11.809242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:11.810133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:11.810440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:11.810840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] PATH_INFO: `/v3/users/100765b326e04968a92e981dddecb1f8` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:11.812041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=100765b326e04968a92e981dddecb1f8)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:11.814046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:11.865889 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100765b326e04968a92e981dddecb1f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:11.866652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100765b326e04968a92e981dddecb1f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:11.874126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100765b326e04968a92e981dddecb1f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:11.874850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100765b326e04968a92e981dddecb1f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:11.883699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100765b326e04968a92e981dddecb1f8'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:11.901464 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4171/8432] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:11 2022] DELETE /identity/v3/users/100765b326e04968a92e981dddecb1f8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:11.906343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:11.906848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:11.906848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:11.924351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:11.925571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:11.982634 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4262/8433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:11.992742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:11.994197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:12.055185 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57feac3-f2e1-41e4-9f16-f4fe2ffa5c3a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:12.059833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:12.060513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:12.060779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:12.061055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:12.071176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:12.072629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:12.082441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4172/8434] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:28:12.364354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:12.366119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:12.378866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06899de-fe4d-4369-b555-2512f4a2f2e9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:12.384401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:12.385351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:12.385662 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:12.385910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] PATH_INFO: `/v3/projects/df41679c6b98493f800e1f1adce4270b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:12.387211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df41679c6b98493f800e1f1adce4270b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:12.389346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:12.442453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df41679c6b98493f800e1f1adce4270b', 'request_id': 'req-a571af34-9904-4d6c-94e3-25c74adceed8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.447985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df41679c6b98493f800e1f1adce4270b', 'request_id': 'req-a571af34-9904-4d6c-94e3-25c74adceed8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.458883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df41679c6b98493f800e1f1adce4270b', 'request_id': 'req-a571af34-9904-4d6c-94e3-25c74adceed8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.470683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] The token cache is being invalidate because project df41679c6b98493f800e1f1adce4270b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:12.470990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.471633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.473354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4263/8435] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:12 2022] DELETE /identity/v3/projects/df41679c6b98493f800e1f1adce4270b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:12.477459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:12.487585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6a6d8-c82a-4da1-85c1-bb0174097d08 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:12.551795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:12.552653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:12.552931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:12.553254 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] PATH_INFO: `/v3/users/910044161c1144e0b5e1102914c3ff16` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:12.554442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=910044161c1144e0b5e1102914c3ff16)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:12.556385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:12.608010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910044161c1144e0b5e1102914c3ff16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.608687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910044161c1144e0b5e1102914c3ff16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.615979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910044161c1144e0b5e1102914c3ff16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.616624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910044161c1144e0b5e1102914c3ff16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.628854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-876508ed-db50-47a7-9b38-d0e3e75692bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910044161c1144e0b5e1102914c3ff16'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.646713 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4173/8436] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:12 2022] DELETE /identity/v3/users/910044161c1144e0b5e1102914c3ff16 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:12.821990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:12.823528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:12.836896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571af34-9904-4d6c-94e3-25c74adceed8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:12.892991 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:12.893900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:12.894221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:12.894496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] PATH_INFO: `/v3/projects/f15110a9921f40fc94b367ac1399336d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:12.895698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15110a9921f40fc94b367ac1399336d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:12.897673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:12.944097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15110a9921f40fc94b367ac1399336d', 'request_id': 'req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.949461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15110a9921f40fc94b367ac1399336d', 'request_id': 'req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.959905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15110a9921f40fc94b367ac1399336d', 'request_id': 'req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.972000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] The token cache is being invalidate because project f15110a9921f40fc94b367ac1399336d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:12.972323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.973064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7e7f1fd8-95bc-43ba-bdbb-f3285e3a911c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:12.974658 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4264/8437] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:12 2022] DELETE /identity/v3/projects/f15110a9921f40fc94b367ac1399336d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:12.979905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b9b51-4acd-4d72-a889-80dd3145cb9d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:12.980529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b9b51-4acd-4d72-a889-80dd3145cb9d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:12.980808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b9b51-4acd-4d72-a889-80dd3145cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.000094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2d2b9b51-4acd-4d72-a889-80dd3145cb9d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:13.001321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2d2b9b51-4acd-4d72-a889-80dd3145cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:13.063702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4174/8438] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:13.071788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261cb4-29c5-4638-982e-30d3fb17550e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.072182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261cb4-29c5-4638-982e-30d3fb17550e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.072462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261cb4-29c5-4638-982e-30d3fb17550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.092230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-67261cb4-29c5-4638-982e-30d3fb17550e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:13.093472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-67261cb4-29c5-4638-982e-30d3fb17550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:13.102597 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4265/8439] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:13.106862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b9b51-4acd-4d72-a889-80dd3145cb9d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:13.116591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b9b51-4acd-4d72-a889-80dd3145cb9d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:13.121691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:13.122345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.122619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.122884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.123608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:13.123909 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:13.125543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:13.136978 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4175/8440] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:28:13.141292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67261cb4-29c5-4638-982e-30d3fb17550e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:13.150855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67261cb4-29c5-4638-982e-30d3fb17550e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:13.155873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:13.156551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.156828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.157128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.157821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:13.159823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:13.188077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4266/8441] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:13 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:13.192414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:13.203036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23721c20-2479-4aa5-ba6a-20ff457741cd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:13.260993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:13.261697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.261979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.262245 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.262929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:13.264887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:13.287011 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4176/8442] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:13 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:13.291237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:13.301449 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6402cf-7cdb-4f55-878f-d1c3b2189198 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:13.306623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:13.307292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.307557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.307823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.308544 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:13.310187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:13.320736 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4267/8443] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:28:13.324905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:13.335324 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1ff89-8022-4697-812a-97162687b39a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:13.340671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4185e-ff7a-46d6-9b23-0b4ef87fe08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:13.341387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4185e-ff7a-46d6-9b23-0b4ef87fe08c admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.341665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4185e-ff7a-46d6-9b23-0b4ef87fe08c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.342026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4185e-ff7a-46d6-9b23-0b4ef87fe08c admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.342677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4185e-ff7a-46d6-9b23-0b4ef87fe08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:13.344282 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4185e-ff7a-46d6-9b23-0b4ef87fe08c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:13.354683 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4177/8444] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:13.358851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:13.369068 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef30dfe-b2e1-4b64-94f4-aca726f2dce2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:13.374209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:13.375105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.375386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.375642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] PATH_INFO: `/v3/projects/c44b960603b34b788486f8bbcf0e1e14/users/6152eecc63334f909c2968a763aab88a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.391619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44b960603b34b788486f8bbcf0e1e14, user_id=6152eecc63334f909c2968a763aab88a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:13.394418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:13.411052 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4268/8445] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:13 2022] PUT /identity/v3/projects/c44b960603b34b788486f8bbcf0e1e14/users/6152eecc63334f909c2968a763aab88a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:13.422480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea754f-70a9-41f4-ae89-324bc853ab8b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.422770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea754f-70a9-41f4-ae89-324bc853ab8b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.423040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea754f-70a9-41f4-ae89-324bc853ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.450932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9fea754f-70a9-41f4-ae89-324bc853ab8b None None] MFA Rules not processed for user `6152eecc63334f909c2968a763aab88a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:13.452256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9fea754f-70a9-41f4-ae89-324bc853ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:13.517403 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4178/8446] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:13.528400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:13.530224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:13.589701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8b039-10b9-41e2-a306-0d2255b4541a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:13.593911 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:13.594682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:13.594959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:13.595227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:13.604295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:13.605776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:13.614905 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4269/8447] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:19.716759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7a14-0f6f-4f85-9641-7d0339e0f077 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:19.717297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7a14-0f6f-4f85-9641-7d0339e0f077 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:19.717406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7a14-0f6f-4f85-9641-7d0339e0f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:19.735012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5d5e7a14-0f6f-4f85-9641-7d0339e0f077 None None] MFA Rules not processed for user `aabb89139f3c48c1a70b7cb01f214f73`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:19.736136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5d5e7a14-0f6f-4f85-9641-7d0339e0f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:19.790922 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4179/8448] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:24.871506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:24.933944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf6fa-0da8-4721-b16d-68e46840a071 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:24.939253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:24.940142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:24.940442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:24.940806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] PATH_INFO: `/v3/users/6152eecc63334f909c2968a763aab88a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:24.942134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6152eecc63334f909c2968a763aab88a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:24.944354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:24.999594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6152eecc63334f909c2968a763aab88a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.000424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6152eecc63334f909c2968a763aab88a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.007457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6152eecc63334f909c2968a763aab88a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.016486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6152eecc63334f909c2968a763aab88a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.017240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6152eecc63334f909c2968a763aab88a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.036367 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4270/8449] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:24 2022] DELETE /identity/v3/users/6152eecc63334f909c2968a763aab88a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:25.040986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.041527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.041624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.059148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:25.060336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:25.119159 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4180/8450] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:25.128725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.130314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:25.190210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eb196-1ff5-4a8a-9ad8-3a9c22f19152 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.194815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c351c-9310-4c64-9c21-3eaadb9f9b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.195502 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c351c-9310-4c64-9c21-3eaadb9f9b8e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.195776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c351c-9310-4c64-9c21-3eaadb9f9b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.196060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c351c-9310-4c64-9c21-3eaadb9f9b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.206162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c351c-9310-4c64-9c21-3eaadb9f9b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.207624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c351c-9310-4c64-9c21-3eaadb9f9b8e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.217885 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4271/8451] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:25.394808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.396697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:25.410918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502c80-ef0e-44f4-b19f-2b43212f3671 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.416790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.417700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.417976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.418291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] PATH_INFO: `/v3/projects/c44b960603b34b788486f8bbcf0e1e14` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.419564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44b960603b34b788486f8bbcf0e1e14)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.421476 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.473236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44b960603b34b788486f8bbcf0e1e14', 'request_id': 'req-203f490a-7c41-424a-a2e0-5bd10569be67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.478782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44b960603b34b788486f8bbcf0e1e14', 'request_id': 'req-203f490a-7c41-424a-a2e0-5bd10569be67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.488075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44b960603b34b788486f8bbcf0e1e14', 'request_id': 'req-203f490a-7c41-424a-a2e0-5bd10569be67'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.499576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] The token cache is being invalidate because project c44b960603b34b788486f8bbcf0e1e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:25.499865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.500507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-203f490a-7c41-424a-a2e0-5bd10569be67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:25.502136 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4181/8452] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:25 2022] DELETE /identity/v3/projects/c44b960603b34b788486f8bbcf0e1e14 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:28:25.507325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572e8e-e431-4864-9dad-3d4478461887 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.507694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572e8e-e431-4864-9dad-3d4478461887 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.507980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572e8e-e431-4864-9dad-3d4478461887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.526717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ec572e8e-e431-4864-9dad-3d4478461887 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:25.527958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ec572e8e-e431-4864-9dad-3d4478461887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:25.591106 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4272/8453] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:25.599959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6ddb-d2ef-4186-a5fd-8b46345da554 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.600329 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6ddb-d2ef-4186-a5fd-8b46345da554 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.600700 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6ddb-d2ef-4186-a5fd-8b46345da554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.624724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fa9e6ddb-d2ef-4186-a5fd-8b46345da554 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:25.625978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fa9e6ddb-d2ef-4186-a5fd-8b46345da554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:25.635504 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4182/8454] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:25.640004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572e8e-e431-4864-9dad-3d4478461887 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.649876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572e8e-e431-4864-9dad-3d4478461887 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.654960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.655588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.655859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.656132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.656852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:25.657187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.658817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.670249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4273/8455] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:28:25.674380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e6ddb-d2ef-4186-a5fd-8b46345da554 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.684624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e6ddb-d2ef-4186-a5fd-8b46345da554 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.691075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.691737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.692030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.692305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.693022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.694958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.722933 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4183/8456] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:25 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:25.727395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.737822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd88e6-837c-4f14-8c32-a97abb19cc8b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.793667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.794392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.794667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.794935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.795648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.797628 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.819171 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4274/8457] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:25 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:25.823507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.834725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c9cf3-b7d3-4ee1-bab5-d708f68cbc98 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.839943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.840618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.840898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.841206 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.841943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.843549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.854459 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4184/8458] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:28:25.858645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.868599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cccb6c-d557-495c-a62d-3580c4a3ac2a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.873840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a7dc3-da2e-4fe9-a40e-8058b9780dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.874602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a7dc3-da2e-4fe9-a40e-8058b9780dca admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.874945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a7dc3-da2e-4fe9-a40e-8058b9780dca admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.875337 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a7dc3-da2e-4fe9-a40e-8058b9780dca admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.876142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a7dc3-da2e-4fe9-a40e-8058b9780dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.877951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a7dc3-da2e-4fe9-a40e-8058b9780dca admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.888039 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4275/8459] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:25.892631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:25.903119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb481379-5ed0-45ef-8187-f725cef5bdc3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:25.908219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:25.909152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.909446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.909713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] PATH_INFO: `/v3/projects/396c8723ddd349b9bbfdedd5ef04cafb/users/9bea19dd72bf4788ab1bbefef9c524f2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.924291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396c8723ddd349b9bbfdedd5ef04cafb, user_id=9bea19dd72bf4788ab1bbefef9c524f2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:25.926998 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:25.942376 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4185/8460] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:25 2022] PUT /identity/v3/projects/396c8723ddd349b9bbfdedd5ef04cafb/users/9bea19dd72bf4788ab1bbefef9c524f2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:25.953020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40d4f-18e2-4cd2-b6a2-71a8030db8ea None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:25.953338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40d4f-18e2-4cd2-b6a2-71a8030db8ea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:25.953612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40d4f-18e2-4cd2-b6a2-71a8030db8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:25.980060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-abd40d4f-18e2-4cd2-b6a2-71a8030db8ea None None] MFA Rules not processed for user `9bea19dd72bf4788ab1bbefef9c524f2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:25.981303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-abd40d4f-18e2-4cd2-b6a2-71a8030db8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:26.048249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4276/8461] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:26.059150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:26.061299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:26.124031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f004b5-388f-42a0-8270-cbf5c2a45fb2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:26.128416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69779b-36d2-4870-a23b-09bfd2099da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:26.129133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69779b-36d2-4870-a23b-09bfd2099da0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:26.129425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69779b-36d2-4870-a23b-09bfd2099da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:26.129692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69779b-36d2-4870-a23b-09bfd2099da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:26.139209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69779b-36d2-4870-a23b-09bfd2099da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:26.140706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69779b-36d2-4870-a23b-09bfd2099da0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:26.151100 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4186/8462] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:33.968768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd40d4f-18e2-4cd2-b6a2-71a8030db8ea None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.031930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd40d4f-18e2-4cd2-b6a2-71a8030db8ea None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.036710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.037649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.037938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.038203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] PATH_INFO: `/v3/users/9bea19dd72bf4788ab1bbefef9c524f2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.039799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bea19dd72bf4788ab1bbefef9c524f2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:34.041788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:34.091619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bea19dd72bf4788ab1bbefef9c524f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.092275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bea19dd72bf4788ab1bbefef9c524f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.098913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bea19dd72bf4788ab1bbefef9c524f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.107155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bea19dd72bf4788ab1bbefef9c524f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.107781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bea19dd72bf4788ab1bbefef9c524f2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.124262 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4277/8463] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:33 2022] DELETE /identity/v3/users/9bea19dd72bf4788ab1bbefef9c524f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:34.129160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.129684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.129684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.147395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:34.148610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:34.213090 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4187/8464] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:34.224985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.226474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:34.287923 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde10574-0bba-4ef9-bff9-60b83b282a77 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.291766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc85215-70b1-4181-b265-13d39e212e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.292434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85215-70b1-4181-b265-13d39e212e8f service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.292712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85215-70b1-4181-b265-13d39e212e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.292979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85215-70b1-4181-b265-13d39e212e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.302621 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc85215-70b1-4181-b265-13d39e212e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:34.304084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc85215-70b1-4181-b265-13d39e212e8f service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:34.315304 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4278/8465] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:28:34.514778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.516453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:34.532414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ea57-36da-4e99-916a-e92f084e7d4e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.536979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.537878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.538153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.538481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] PATH_INFO: `/v3/projects/396c8723ddd349b9bbfdedd5ef04cafb` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.540557 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=396c8723ddd349b9bbfdedd5ef04cafb)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:34.541947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:34.592603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396c8723ddd349b9bbfdedd5ef04cafb', 'request_id': 'req-c0302871-d411-40b6-aaf7-26db0e011c7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.597872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396c8723ddd349b9bbfdedd5ef04cafb', 'request_id': 'req-c0302871-d411-40b6-aaf7-26db0e011c7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.606690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396c8723ddd349b9bbfdedd5ef04cafb', 'request_id': 'req-c0302871-d411-40b6-aaf7-26db0e011c7d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.618411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] The token cache is being invalidate because project 396c8723ddd349b9bbfdedd5ef04cafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:34.618694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.619332 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-c0302871-d411-40b6-aaf7-26db0e011c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:34.624321 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4188/8466] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:34 2022] DELETE /identity/v3/projects/396c8723ddd349b9bbfdedd5ef04cafb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:34.626047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940e445-2eab-46de-8ca3-4b5a61ac961e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.626358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940e445-2eab-46de-8ca3-4b5a61ac961e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.626709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940e445-2eab-46de-8ca3-4b5a61ac961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.644612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5940e445-2eab-46de-8ca3-4b5a61ac961e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:34.645890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5940e445-2eab-46de-8ca3-4b5a61ac961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:34.704492 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4279/8467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:34.712278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473037c-4582-41f4-a0ea-033d186f061a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.712567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473037c-4582-41f4-a0ea-033d186f061a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.712843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473037c-4582-41f4-a0ea-033d186f061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.731318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8473037c-4582-41f4-a0ea-033d186f061a None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:34.732531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8473037c-4582-41f4-a0ea-033d186f061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:34.740817 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4189/8468] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:28:34.744880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940e445-2eab-46de-8ca3-4b5a61ac961e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.754352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940e445-2eab-46de-8ca3-4b5a61ac961e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.758998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.759600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.759877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.760147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.760867 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:34.761203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:34.762815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:34.774236 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4280/8469] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:28:34.778574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473037c-4582-41f4-a0ea-033d186f061a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.788121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473037c-4582-41f4-a0ea-033d186f061a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.793080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.793765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.794030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.794301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.794997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:34.796913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:34.826730 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4190/8470] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:34 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:28:34.827865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.838427 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693aca7-0a38-4866-9fa3-7ddfb6ca15c6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.895739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.896478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.896728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.897023 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.897746 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:34.899716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:34.920325 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4281/8471] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:34 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:28:34.924679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.935881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5f82-8868-41a7-8193-3238dc196ca4 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.941609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.942405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.942610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:34.942877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:34.944406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:34.946093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:34.970759 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4191/8472] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:34.974699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:34.987421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490852a8-e4d7-4cc2-82a0-8feef9cf9787 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:34.994610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3acbea-2344-4aaa-87e3-435b0cbe112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:34.995561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3acbea-2344-4aaa-87e3-435b0cbe112c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:34.995902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3acbea-2344-4aaa-87e3-435b0cbe112c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:35.002735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3acbea-2344-4aaa-87e3-435b0cbe112c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:35.005402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3acbea-2344-4aaa-87e3-435b0cbe112c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:35.007086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3acbea-2344-4aaa-87e3-435b0cbe112c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:35.025479 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4282/8473] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:35.026651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:35.044148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb70d49-a50a-4ab4-aacb-ba1fa5177ac0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:35.049844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:35.051080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:35.051397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:35.051948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] PATH_INFO: `/v3/projects/e2c0d0739f2d42b2ae4a2dd686f53092/users/b4e3dde10b77465c98160660e10459a2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:35.068572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c0d0739f2d42b2ae4a2dd686f53092, user_id=b4e3dde10b77465c98160660e10459a2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:35.071302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:35.089940 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4192/8474] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:35 2022] PUT /identity/v3/projects/e2c0d0739f2d42b2ae4a2dd686f53092/users/b4e3dde10b77465c98160660e10459a2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:28:35.100290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:35.100587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:35.100864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:35.130210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] MFA Rules not processed for user `b4e3dde10b77465c98160660e10459a2`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:35.131439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:35.196318 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4283/8475] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:35.206356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:35.208284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:35.269544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a60324-fd83-47c5-9030-f5bb10754daa admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:35.273573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:35.274237 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:35.274522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:35.274803 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:35.283309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:35.284764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:35.293620 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4193/8476] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:43.803750 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:43.808205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:43.881972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a873dc3-a320-4e3c-87c5-26681006616d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:43.886941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:43.887875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:43.888147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:43.888408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] PATH_INFO: `/v3/users/aabb89139f3c48c1a70b7cb01f214f73` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:43.889810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabb89139f3c48c1a70b7cb01f214f73)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:43.892064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:43.960017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabb89139f3c48c1a70b7cb01f214f73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:43.960999 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabb89139f3c48c1a70b7cb01f214f73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:43.969616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabb89139f3c48c1a70b7cb01f214f73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:43.979743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabb89139f3c48c1a70b7cb01f214f73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:43.980533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabb89139f3c48c1a70b7cb01f214f73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.003513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4284/8477] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:43 2022] DELETE /identity/v3/users/aabb89139f3c48c1a70b7cb01f214f73 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:44.204936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:44.219743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1175d-17f4-43a9-830b-37ce3a64accb service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:44.285770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:44.287470 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:44.287816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:44.288017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] PATH_INFO: `/v3/projects/4c30644570a142579638908937b6ccac` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:44.289330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c30644570a142579638908937b6ccac)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:44.291537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:44.358153 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c30644570a142579638908937b6ccac', 'request_id': 'req-dcb354ba-965e-4359-9198-5d269a1973d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.364397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c30644570a142579638908937b6ccac', 'request_id': 'req-dcb354ba-965e-4359-9198-5d269a1973d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.375006 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c30644570a142579638908937b6ccac', 'request_id': 'req-dcb354ba-965e-4359-9198-5d269a1973d9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.396799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] The token cache is being invalidate because project 4c30644570a142579638908937b6ccac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:44.397069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.397682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.399322 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4194/8478] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:44 2022] DELETE /identity/v3/projects/4c30644570a142579638908937b6ccac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:44.404322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:44.406164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:44.421472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106ec2c-fca8-4c9e-a040-6d9a548f7126 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:44.495812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:44.496726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:44.497113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:44.497623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] PATH_INFO: `/v3/users/c90ad32122404dd59aeead26f9764953` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:44.499046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90ad32122404dd59aeead26f9764953)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:44.501617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:44.571214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90ad32122404dd59aeead26f9764953'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.571907 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90ad32122404dd59aeead26f9764953'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.579640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90ad32122404dd59aeead26f9764953'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.590626 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90ad32122404dd59aeead26f9764953'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.591704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-e0a9d181-caf2-4a0d-8dbc-11b48e16f1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90ad32122404dd59aeead26f9764953'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:44.613125 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4285/8479] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:28:44 2022] DELETE /identity/v3/users/c90ad32122404dd59aeead26f9764953 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:44.814456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:44.816950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:44.844625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354ba-965e-4359-9198-5d269a1973d9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:44.940787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:44.942032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:44.942310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:44.942584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] PATH_INFO: `/v3/projects/f9c697ea47df45069a2be9e2124600f9` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:44.943938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c697ea47df45069a2be9e2124600f9)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:44.945964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.006437 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c697ea47df45069a2be9e2124600f9', 'request_id': 'req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:45.016615 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c697ea47df45069a2be9e2124600f9', 'request_id': 'req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:45.026250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c697ea47df45069a2be9e2124600f9', 'request_id': 'req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:45.043896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] The token cache is being invalidate because project f9c697ea47df45069a2be9e2124600f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:28:45.044190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:45.044953 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-21b16e01-a5ef-4b45-88f9-1cf64a80d28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:28:45.046660 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4195/8480] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:28:44 2022] DELETE /identity/v3/projects/f9c697ea47df45069a2be9e2124600f9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:45.052379 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690bfb-e5a7-4af8-9bbc-aacf98e9ec48 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.052843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690bfb-e5a7-4af8-9bbc-aacf98e9ec48 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.052938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690bfb-e5a7-4af8-9bbc-aacf98e9ec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.090773 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-72690bfb-e5a7-4af8-9bbc-aacf98e9ec48 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:45.092014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-72690bfb-e5a7-4af8-9bbc-aacf98e9ec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:45.161310 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4286/8481] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:45.170011 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654edb48-6d38-41ec-a9a1-d97c234e6ff0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.170284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654edb48-6d38-41ec-a9a1-d97c234e6ff0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.170782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654edb48-6d38-41ec-a9a1-d97c234e6ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.195196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-654edb48-6d38-41ec-a9a1-d97c234e6ff0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:45.196533 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-654edb48-6d38-41ec-a9a1-d97c234e6ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:45.204980 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4196/8482] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:45.209533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72690bfb-e5a7-4af8-9bbc-aacf98e9ec48 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:45.220523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72690bfb-e5a7-4af8-9bbc-aacf98e9ec48 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:45.227084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:45.227979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.228350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.228714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.229605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:28:45.230072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:45.232582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.249732 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4287/8483] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:28:45.254565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654edb48-6d38-41ec-a9a1-d97c234e6ff0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:45.270645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654edb48-6d38-41ec-a9a1-d97c234e6ff0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:45.281742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:45.282444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.282762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.282992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.283796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:45.286229 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.321157 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4197/8484] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:45 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:45.325459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:45.336669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9094-1099-44b9-aed7-62364b3b06f3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:45.399932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:45.400632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.400916 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.401289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.402059 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:45.404039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.430062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:45.430907 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4288/8485] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:45 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:28:45.443914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7221279-9a83-4902-a7f6-9ee944616fa0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:45.454765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:45.456257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.456732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.457095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.458091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:45.459802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.472561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4198/8486] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:45.477641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:45.497240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8461b7-c00b-4f86-9565-20b10bf23a65 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:45.505344 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcac26a-5e84-44b2-93fa-18d9dfe99d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:45.505882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcac26a-5e84-44b2-93fa-18d9dfe99d27 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.506312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcac26a-5e84-44b2-93fa-18d9dfe99d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.506729 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcac26a-5e84-44b2-93fa-18d9dfe99d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.507495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcac26a-5e84-44b2-93fa-18d9dfe99d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:45.509473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcac26a-5e84-44b2-93fa-18d9dfe99d27 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.521474 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4289/8487] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:45.525741 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:45.536579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb291c-7c29-4c5d-a4da-3162a20284b8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:45.542956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:45.544597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.545108 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.545594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] PATH_INFO: `/v3/projects/5e1063334e4a426eb70eec5ed1578744/users/2e9bbd737ff54225a549f072976ef296/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.564886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1063334e4a426eb70eec5ed1578744, user_id=2e9bbd737ff54225a549f072976ef296, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:45.568137 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.601072 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4199/8488] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:45 2022] PUT /identity/v3/projects/5e1063334e4a426eb70eec5ed1578744/users/2e9bbd737ff54225a549f072976ef296/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:28:45.606492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049588-ae22-47be-8f17-699fbdc84253 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.606861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049588-ae22-47be-8f17-699fbdc84253 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.607230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049588-ae22-47be-8f17-699fbdc84253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.630579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-e6049588-ae22-47be-8f17-699fbdc84253 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:45.632151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e6049588-ae22-47be-8f17-699fbdc84253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:45.711719 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4290/8489] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:28:45.723672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:45.725543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:45.804899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d72a-1aa3-4204-b1b9-5c51f8492ba8 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:45.809504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:45.810528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:45.810955 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:45.811368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:45.823051 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:45.824525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:45.839124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4200/8490] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:51.129247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6ab44-e4f6-4365-99b8-3a63dd428976 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:51.129791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6ab44-e4f6-4365-99b8-3a63dd428976 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:51.129791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6ab44-e4f6-4365-99b8-3a63dd428976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:51.164009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-04c6ab44-e4f6-4365-99b8-3a63dd428976 None None] MFA Rules not processed for user `2e9bbd737ff54225a549f072976ef296`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:51.165401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-04c6ab44-e4f6-4365-99b8-3a63dd428976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:51.258767 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4291/8491] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:51.262973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:51.274610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269233ce-7850-4b1f-8792-679ac15c6f56 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:51.282145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:51.283427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:51.284182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:51.284691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:51.286481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:51.288946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:51.336457 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4201/8492] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:28:51 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:28:51.340702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6ab44-e4f6-4365-99b8-3a63dd428976 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:51.352181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6ab44-e4f6-4365-99b8-3a63dd428976 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:51.415002 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:51.415820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:51.416315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:51.416657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:51.417629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:51.419685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:51.444298 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4292/8493] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:28:51 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:28:51.448027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:51.459684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7daf-7ca2-44d8-9066-bdb29bfcfa30 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:51.465785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:51.466634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:51.467007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:51.467363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:51.468220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:51.469994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:51.482054 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4202/8494] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:28:51.486967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:51.497814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc815e2-75c4-4613-85b2-a07a580b2cf9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:51.504900 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:51.506193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:51.506564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:51.507219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] PATH_INFO: `/v3/projects/ec99183f7ad64fb18fcc3672cc0375e5/users/187354a71c68448283879970b388063c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:51.529653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec99183f7ad64fb18fcc3672cc0375e5, user_id=187354a71c68448283879970b388063c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:51.532482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:51.550198 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4293/8495] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:51 2022] PUT /identity/v3/projects/ec99183f7ad64fb18fcc3672cc0375e5/users/187354a71c68448283879970b388063c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:51.554063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:51.564979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba234-bb6f-4060-81a3-28dca76d07b6 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:51.631528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce9544-3b22-44a9-9b2d-1de49e7a1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:51.632215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce9544-3b22-44a9-9b2d-1de49e7a1ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:51.632494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce9544-3b22-44a9-9b2d-1de49e7a1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:51.633391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce9544-3b22-44a9-9b2d-1de49e7a1ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:51.633505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce9544-3b22-44a9-9b2d-1de49e7a1ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:51.635120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce9544-3b22-44a9-9b2d-1de49e7a1ac0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:51.648773 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4203/8496] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:28:51.650842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:51.662440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43b99b-8f6e-41dc-a31b-2ee0f26afe86 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:51.674552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:51.675491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:51.675768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:51.676083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] PATH_INFO: `/v3/projects/ec99183f7ad64fb18fcc3672cc0375e5/users/187354a71c68448283879970b388063c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:51.679221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec99183f7ad64fb18fcc3672cc0375e5, user_id=187354a71c68448283879970b388063c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:51.682195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:51.699344 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4294/8497] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:28:51 2022] PUT /identity/v3/projects/ec99183f7ad64fb18fcc3672cc0375e5/users/187354a71c68448283879970b388063c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:28:57.887377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:57.888257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:57.889356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:57.937142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] MFA Rules not processed for user `187354a71c68448283879970b388063c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:28:57.939007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:58.043242 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4204/8498] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:28:58.057777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:58.060278 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:58.165990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333d15d-a840-4035-b829-276ffbbe160c admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:58.170687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7f9a7-760f-4d30-baec-4d9504d15135 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:58.171798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f9a7-760f-4d30-baec-4d9504d15135 service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:58.172270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f9a7-760f-4d30-baec-4d9504d15135 service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:58.172699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f9a7-760f-4d30-baec-4d9504d15135 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:58.245248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7f9a7-760f-4d30-baec-4d9504d15135 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:58.246895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7f9a7-760f-4d30-baec-4d9504d15135 service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:58.257124 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4295/8499] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:28:59.349390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:28:59.351365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:59.516395 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38298f-2b33-4f19-ae04-ecb3ae6e3043 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:28:59.528316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:28:59.529194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:28:59.530316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:28:59.530602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:28:59.534516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:28:59.560031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:28:59.562802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:28:59.582569 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4205/8500] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:28:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:02.735117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19ca8-ce40-4c5b-b563-44187be78e5b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:02.735805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19ca8-ce40-4c5b-b563-44187be78e5b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:02.735805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19ca8-ce40-4c5b-b563-44187be78e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:02.753273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a5a19ca8-ce40-4c5b-b563-44187be78e5b None None] MFA Rules not processed for user `2e9bbd737ff54225a549f072976ef296`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:02.754554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a5a19ca8-ce40-4c5b-b563-44187be78e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:02.761872 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4296/8501] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:03.760482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:03.762789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:03.842316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d12067-c27b-465b-8a9e-2c5cc897ce46 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:03.847640 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:03.848918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:03.849773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:03.850412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] PATH_INFO: `/v3/users/b4e3dde10b77465c98160660e10459a2` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:03.851703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e3dde10b77465c98160660e10459a2)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:03.854536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:03.911444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e3dde10b77465c98160660e10459a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:03.913323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e3dde10b77465c98160660e10459a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:03.920863 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e3dde10b77465c98160660e10459a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:03.921854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e3dde10b77465c98160660e10459a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:03.932033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e3dde10b77465c98160660e10459a2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:03.953881 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4206/8502] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:29:03 2022] DELETE /identity/v3/users/b4e3dde10b77465c98160660e10459a2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:03.957436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:03.957927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:03.958011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:03.980146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:03.981649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:04.044556 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4297/8503] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:04.055068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.056514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:04.116746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ee337-95a4-445b-a102-0dc0a90a569a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.120677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08a45-e5c6-467e-bc66-80cfb1c0d6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.121370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08a45-e5c6-467e-bc66-80cfb1c0d6ea service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.121658 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08a45-e5c6-467e-bc66-80cfb1c0d6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.121925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08a45-e5c6-467e-bc66-80cfb1c0d6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.132386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08a45-e5c6-467e-bc66-80cfb1c0d6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.133873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08a45-e5c6-467e-bc66-80cfb1c0d6ea service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.144135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4207/8504] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:04.341961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.343380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:04.362035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd2bb-9bba-42d6-9dcf-af7cb5b27a84 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.369378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.370467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.370815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.371297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] PATH_INFO: `/v3/projects/e2c0d0739f2d42b2ae4a2dd686f53092` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.372526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c0d0739f2d42b2ae4a2dd686f53092)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.374529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.423215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c0d0739f2d42b2ae4a2dd686f53092', 'request_id': 'req-b80e8a72-46a0-44e8-88fa-7cc508129dab'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:04.428609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c0d0739f2d42b2ae4a2dd686f53092', 'request_id': 'req-b80e8a72-46a0-44e8-88fa-7cc508129dab'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:04.437897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c0d0739f2d42b2ae4a2dd686f53092', 'request_id': 'req-b80e8a72-46a0-44e8-88fa-7cc508129dab'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:04.454719 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] The token cache is being invalidate because project e2c0d0739f2d42b2ae4a2dd686f53092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:29:04.455004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:04.455666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-b80e8a72-46a0-44e8-88fa-7cc508129dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:04.457346 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4298/8505] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:29:04 2022] DELETE /identity/v3/projects/e2c0d0739f2d42b2ae4a2dd686f53092 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:04.462799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff31a-1600-4c97-9e38-768cf32f8e80 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.463088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff31a-1600-4c97-9e38-768cf32f8e80 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.463366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff31a-1600-4c97-9e38-768cf32f8e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.481349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5dfff31a-1600-4c97-9e38-768cf32f8e80 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:04.482410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5dfff31a-1600-4c97-9e38-768cf32f8e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:04.549836 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4208/8506] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:29:04.561683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476bd9-f78d-499f-b563-29e8b2a6cb99 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.561969 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476bd9-f78d-499f-b563-29e8b2a6cb99 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.562323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476bd9-f78d-499f-b563-29e8b2a6cb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.582150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5d476bd9-f78d-499f-b563-29e8b2a6cb99 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:04.583401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5d476bd9-f78d-499f-b563-29e8b2a6cb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:04.593467 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4299/8507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:04.598361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff31a-1600-4c97-9e38-768cf32f8e80 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.609757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff31a-1600-4c97-9e38-768cf32f8e80 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.622154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.623199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.623522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.623848 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.624685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:29:04.625084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.626912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.643828 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4209/8508] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:29:04.648350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d476bd9-f78d-499f-b563-29e8b2a6cb99 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.665979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d476bd9-f78d-499f-b563-29e8b2a6cb99 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.671118 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.671898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.672248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.672640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.673652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.682196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.716174 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4300/8509] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:29:04 2022] POST /identity/v3/projects => generated 359 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:29:04.720376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.737004 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c217-dec9-44d4-85f9-8634f14160ec admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.813797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.814631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.815630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.815975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.816742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.818918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.849256 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4210/8510] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:29:04 2022] POST /identity/v3/users => generated 280 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:29:04.851334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.862481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1de49-79c5-455a-9843-d4992aa0ee60 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.867431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.868123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.868399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.868668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.869438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.871065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.886655 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4301/8511] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:29:04.891084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.903196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc895ee8-d23b-4ebc-8184-7c1f29607aa3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.908961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69061a5d-aae9-4227-b6ce-de1cf2783100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.909826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061a5d-aae9-4227-b6ce-de1cf2783100 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.910198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061a5d-aae9-4227-b6ce-de1cf2783100 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.910561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061a5d-aae9-4227-b6ce-de1cf2783100 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.911405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69061a5d-aae9-4227-b6ce-de1cf2783100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.913193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69061a5d-aae9-4227-b6ce-de1cf2783100 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.927292 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4211/8512] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:04.929256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:04.939178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a8157-2e0d-4636-9854-00e2a44fd9cf admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:04.945712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:04.946827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.947200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.947543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] PATH_INFO: `/v3/projects/fa3a9378873c4f9f8ffc4917f687eb9d/users/4cc0b5300aac4247b8f5415954b27180/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:04.964462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3a9378873c4f9f8ffc4917f687eb9d, user_id=4cc0b5300aac4247b8f5415954b27180, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:04.967186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:04.981431 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4302/8513] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:04 2022] PUT /identity/v3/projects/fa3a9378873c4f9f8ffc4917f687eb9d/users/4cc0b5300aac4247b8f5415954b27180/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:04.991956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96743f-c727-4a4c-8286-7d5b49d59174 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:04.992243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96743f-c727-4a4c-8286-7d5b49d59174 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:04.992520 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96743f-c727-4a4c-8286-7d5b49d59174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:05.022969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2a96743f-c727-4a4c-8286-7d5b49d59174 None None] MFA Rules not processed for user `4cc0b5300aac4247b8f5415954b27180`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:05.024280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2a96743f-c727-4a4c-8286-7d5b49d59174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:05.098834 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4212/8514] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:29:05.110321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:05.112396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:05.218421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9241b-3451-454b-a0a4-148c6e6f8966 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:05.226811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489478-90b7-46f3-8581-cc1897ca48af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:05.228186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489478-90b7-46f3-8581-cc1897ca48af service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:05.228757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489478-90b7-46f3-8581-cc1897ca48af service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:05.229315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489478-90b7-46f3-8581-cc1897ca48af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:05.239895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b489478-90b7-46f3-8581-cc1897ca48af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:05.241820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b489478-90b7-46f3-8581-cc1897ca48af service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:05.250844 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4303/8515] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:05 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:14.375211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96743f-c727-4a4c-8286-7d5b49d59174 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:14.442636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96743f-c727-4a4c-8286-7d5b49d59174 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:14.447152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:14.448040 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:14.448319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:14.448588 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] PATH_INFO: `/v3/users/4cc0b5300aac4247b8f5415954b27180` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:14.449826 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc0b5300aac4247b8f5415954b27180)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:14.451752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:14.499213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc0b5300aac4247b8f5415954b27180'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:14.499860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc0b5300aac4247b8f5415954b27180'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:14.506423 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc0b5300aac4247b8f5415954b27180'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:14.507036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc0b5300aac4247b8f5415954b27180'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:14.514636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc0b5300aac4247b8f5415954b27180'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:14.531602 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4213/8516] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:29:14 2022] DELETE /identity/v3/users/4cc0b5300aac4247b8f5415954b27180 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:14.536566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:14.537057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:14.537150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:14.557268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:14.558472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:14.619063 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4304/8517] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:14.630973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:14.632422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:14.699154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc3ac-c8ea-4795-a4e2-5cc117cc1225 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:14.703834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14eba-113c-4518-b969-f923012e46a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:14.704496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14eba-113c-4518-b969-f923012e46a5 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:14.704810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14eba-113c-4518-b969-f923012e46a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:14.705100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14eba-113c-4518-b969-f923012e46a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:14.715708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14eba-113c-4518-b969-f923012e46a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:14.717243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14eba-113c-4518-b969-f923012e46a5 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:14.727028 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4214/8518] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:29:14.903299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:14.904828 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:14.919665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb5d30-1846-4161-964a-509a7d7e7fa9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:14.925372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:14.926402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:14.926711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:14.927004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] PATH_INFO: `/v3/projects/fa3a9378873c4f9f8ffc4917f687eb9d` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:14.928383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3a9378873c4f9f8ffc4917f687eb9d)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:14.930354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:14.979361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3a9378873c4f9f8ffc4917f687eb9d', 'request_id': 'req-3ee96d56-f831-48b3-b8ea-60b4b159d07b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:14.985157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3a9378873c4f9f8ffc4917f687eb9d', 'request_id': 'req-3ee96d56-f831-48b3-b8ea-60b4b159d07b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:14.996323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3a9378873c4f9f8ffc4917f687eb9d', 'request_id': 'req-3ee96d56-f831-48b3-b8ea-60b4b159d07b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:15.008348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] The token cache is being invalidate because project fa3a9378873c4f9f8ffc4917f687eb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:29:15.008623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:15.009412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-3ee96d56-f831-48b3-b8ea-60b4b159d07b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:15.011127 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4305/8519] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:29:14 2022] DELETE /identity/v3/projects/fa3a9378873c4f9f8ffc4917f687eb9d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:15.017566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66feca-f2d6-48f4-a208-1d764548c785 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.018109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66feca-f2d6-48f4-a208-1d764548c785 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.018487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66feca-f2d6-48f4-a208-1d764548c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.037071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6b66feca-f2d6-48f4-a208-1d764548c785 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:15.038333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6b66feca-f2d6-48f4-a208-1d764548c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:15.098445 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4215/8520] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:15.106471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39497a-f7d1-41d4-89af-ac983da91617 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.106758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39497a-f7d1-41d4-89af-ac983da91617 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.107031 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39497a-f7d1-41d4-89af-ac983da91617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.125001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ff39497a-f7d1-41d4-89af-ac983da91617 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:15.126235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ff39497a-f7d1-41d4-89af-ac983da91617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:15.134594 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4306/8521] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:15.139069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66feca-f2d6-48f4-a208-1d764548c785 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:15.148860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66feca-f2d6-48f4-a208-1d764548c785 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:15.153643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:15.154297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.154574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.154844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.155552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:29:15.155855 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:15.157480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:15.169172 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4216/8522] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:29:15.173731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39497a-f7d1-41d4-89af-ac983da91617 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:15.183117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39497a-f7d1-41d4-89af-ac983da91617 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:15.187889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:15.188993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.189672 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.190150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.191390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:15.194723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:15.221513 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4307/8523] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:29:15 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:29:15.225890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:15.235871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42e2d-3898-4946-b8dd-93d721b5b13e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:15.298551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:15.299244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.299530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.299869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.300562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:15.302548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:15.328920 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4217/8524] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:29:15 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:29:15.332133 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:15.343979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80abf-0df4-43f8-b3d6-15fcd477f3b7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:15.350704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:15.351731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.351972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.352312 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.353165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:15.354885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:15.366644 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4308/8525] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:15.371347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:15.381792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9bba-a14d-4eb8-952e-716f6e6ae4db admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:15.387231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cc10f-210f-4a60-9e3c-63ae3d4efebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:15.388037 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cc10f-210f-4a60-9e3c-63ae3d4efebb admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.388382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cc10f-210f-4a60-9e3c-63ae3d4efebb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.388662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cc10f-210f-4a60-9e3c-63ae3d4efebb admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.389465 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cc10f-210f-4a60-9e3c-63ae3d4efebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:15.391161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cc10f-210f-4a60-9e3c-63ae3d4efebb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:15.403825 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4218/8526] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:15.408331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:15.420045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8a47-c7f0-4bea-b619-c2d8bb060311 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:15.424824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:15.425774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.426038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.426315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] PATH_INFO: `/v3/projects/c2f4a5d8476f48828d3bf6816ac0d864/users/a4bc643e662c4873a068f6a09663aef2/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.442223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f4a5d8476f48828d3bf6816ac0d864, user_id=a4bc643e662c4873a068f6a09663aef2, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:15.444915 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:15.460218 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4309/8527] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:15 2022] PUT /identity/v3/projects/c2f4a5d8476f48828d3bf6816ac0d864/users/a4bc643e662c4873a068f6a09663aef2/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:15.465512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717a089-2965-4924-9403-d97bd2524e53 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.465844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717a089-2965-4924-9403-d97bd2524e53 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.466139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717a089-2965-4924-9403-d97bd2524e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.483110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-2717a089-2965-4924-9403-d97bd2524e53 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:15.484315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2717a089-2965-4924-9403-d97bd2524e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:15.545242 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4219/8528] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:29:15.556100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:15.558032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:15.621824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dddf0f-c089-49f3-a301-faa8cc77dc1d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:15.626437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:15.627097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:15.627374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:15.627641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:15.637945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:15.639414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:15.649483 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4310/8529] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:16.280544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac70c0-fa67-409f-bfb3-0c10e9dfea7b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:16.280858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac70c0-fa67-409f-bfb3-0c10e9dfea7b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:16.281179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac70c0-fa67-409f-bfb3-0c10e9dfea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:16.311258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-40ac70c0-fa67-409f-bfb3-0c10e9dfea7b None None] MFA Rules not processed for user `a4bc643e662c4873a068f6a09663aef2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:16.312474 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-40ac70c0-fa67-409f-bfb3-0c10e9dfea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:16.384011 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4220/8530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:16.388490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:16.399001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6bf3-7417-4345-9cbe-8311616d2dfa service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:16.403498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:16.404179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:16.404460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:16.404734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:16.405560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:16.407506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:16.441766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac70c0-fa67-409f-bfb3-0c10e9dfea7b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:16.449532 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4311/8531] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:29:16 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:29:16.454068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac70c0-fa67-409f-bfb3-0c10e9dfea7b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:16.510466 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:16.511203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:16.511488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:16.511762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:16.512458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:16.514516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:16.535086 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4221/8532] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:29:16 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:29:16.538872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:16.550833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266147a8-6c6b-48f9-8337-aa5154205316 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:16.555755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:16.556436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:16.557009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:16.557009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:16.557733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:16.559361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:16.570678 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4312/8533] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:16.574709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:16.584948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651fe79-39da-4551-8c0b-32c66360ab4b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:16.589720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:16.590604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:16.590876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:16.591142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] PATH_INFO: `/v3/projects/be3919a8a0914ed2aa60a5c0213ef0c4/users/cd438f473e1a4802b294e27eea098d33/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:16.607965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3919a8a0914ed2aa60a5c0213ef0c4, user_id=cd438f473e1a4802b294e27eea098d33, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:16.611017 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:16.629273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4222/8534] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:16 2022] PUT /identity/v3/projects/be3919a8a0914ed2aa60a5c0213ef0c4/users/cd438f473e1a4802b294e27eea098d33/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:29:16.633308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:16.643469 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb28438-3899-415f-b45b-14d2d6d1d731 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:16.698365 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c46edd-35a1-4908-a5c7-6a4655300a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:16.699057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c46edd-35a1-4908-a5c7-6a4655300a59 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:16.699351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c46edd-35a1-4908-a5c7-6a4655300a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:16.699638 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c46edd-35a1-4908-a5c7-6a4655300a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:16.700459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c46edd-35a1-4908-a5c7-6a4655300a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:16.702107 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c46edd-35a1-4908-a5c7-6a4655300a59 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:16.713082 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4313/8535] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:29:16.717268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:16.728529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ae272-1088-4afd-9c5d-9285a6126306 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:16.733265 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34350b83-0e24-4a05-b8d2-e1bbfda03535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:16.734226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350b83-0e24-4a05-b8d2-e1bbfda03535 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:16.734570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350b83-0e24-4a05-b8d2-e1bbfda03535 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:16.734902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350b83-0e24-4a05-b8d2-e1bbfda03535 admin admin] PATH_INFO: `/v3/projects/be3919a8a0914ed2aa60a5c0213ef0c4/users/cd438f473e1a4802b294e27eea098d33/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:16.736965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34350b83-0e24-4a05-b8d2-e1bbfda03535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3919a8a0914ed2aa60a5c0213ef0c4, user_id=cd438f473e1a4802b294e27eea098d33, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:16.739885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34350b83-0e24-4a05-b8d2-e1bbfda03535 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:16.750341 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4223/8536] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:16 2022] PUT /identity/v3/projects/be3919a8a0914ed2aa60a5c0213ef0c4/users/cd438f473e1a4802b294e27eea098d33/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:17.401183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:17.401444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:17.401755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:17.428079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] MFA Rules not processed for user `cd438f473e1a4802b294e27eea098d33`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:17.429340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:17.500242 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4314/8537] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:17.510943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e645-0740-4735-8333-877df43157f7 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:17.511524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e645-0740-4735-8333-877df43157f7 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:17.511524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e645-0740-4735-8333-877df43157f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:17.528985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-db03e645-0740-4735-8333-877df43157f7 None None] MFA Rules not processed for user `a4bc643e662c4873a068f6a09663aef2`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:17.530139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-db03e645-0740-4735-8333-877df43157f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:17.586001 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4224/8538] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:17.598264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:17.599754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:17.682827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8e583-c668-47ec-af3b-7c24943a592b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:17.689897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:17.690617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:17.690863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:17.691129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:17.699696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:17.701339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:17.711141 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4315/8539] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:26.487606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99b23-5312-4fbb-857f-b5ed0d6c36e1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:26.488174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99b23-5312-4fbb-857f-b5ed0d6c36e1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:26.488274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99b23-5312-4fbb-857f-b5ed0d6c36e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:26.505930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-93a99b23-5312-4fbb-857f-b5ed0d6c36e1 None None] MFA Rules not processed for user `2e9bbd737ff54225a549f072976ef296`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:26.507159 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-93a99b23-5312-4fbb-857f-b5ed0d6c36e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:26.561806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4225/8540] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:31.016726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:31.018246 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:31.089180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1e640-9a76-4507-9f19-b42e0634a4f0 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:31.093286 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:31.093966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:31.094241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:31.094512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:31.104615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:31.106377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:31.116418 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4316/8541] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:38.920086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbc6a-2ade-4b96-8c11-7dc7efdc2496 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:38.920575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbc6a-2ade-4b96-8c11-7dc7efdc2496 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:38.920672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbc6a-2ade-4b96-8c11-7dc7efdc2496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:38.974150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ec2dbc6a-2ade-4b96-8c11-7dc7efdc2496 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:38.975337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ec2dbc6a-2ade-4b96-8c11-7dc7efdc2496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:39.030521 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4226/8542] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:39.077440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:39.078945 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:39.172836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d203fb0-fa88-44a3-b111-3c2b838bf8f0 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:39.181205 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:39.182005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:39.182647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:39.183040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:39.192509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:39.194419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:39.204443 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4317/8543] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:29:39.465342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4cdb-c5e6-432d-b606-dc8d4a19ed00 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:39.465602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4cdb-c5e6-432d-b606-dc8d4a19ed00 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:39.465886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4cdb-c5e6-432d-b606-dc8d4a19ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:39.484904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4c4e4cdb-c5e6-432d-b606-dc8d4a19ed00 None None] MFA Rules not processed for user `2e9bbd737ff54225a549f072976ef296`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:39.486148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4c4e4cdb-c5e6-432d-b606-dc8d4a19ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:39.493493 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4227/8544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:50.829660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:50.892667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2595d5-88bf-45a2-ac57-9e293f2bbbfb service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:50.897343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:50.898230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:50.898508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:50.898780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] PATH_INFO: `/v3/users/a4bc643e662c4873a068f6a09663aef2` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:50.899972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4bc643e662c4873a068f6a09663aef2)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:50.901963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:50.951098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4bc643e662c4873a068f6a09663aef2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:50.951756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4bc643e662c4873a068f6a09663aef2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:50.959745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4bc643e662c4873a068f6a09663aef2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:50.969181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4bc643e662c4873a068f6a09663aef2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:50.970117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4bc643e662c4873a068f6a09663aef2'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:50.994451 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4318/8545] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:29:50 2022] DELETE /identity/v3/users/a4bc643e662c4873a068f6a09663aef2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:51.188272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e4cdb-c5e6-432d-b606-dc8d4a19ed00 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:51.204019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e4cdb-c5e6-432d-b606-dc8d4a19ed00 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:51.274243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:51.275107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:51.275378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:51.275645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] PATH_INFO: `/v3/projects/c2f4a5d8476f48828d3bf6816ac0d864` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:51.277633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f4a5d8476f48828d3bf6816ac0d864)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:51.279659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:51.327039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f4a5d8476f48828d3bf6816ac0d864', 'request_id': 'req-a3bbff17-7cb7-488c-b493-970abdde8331'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.332566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f4a5d8476f48828d3bf6816ac0d864', 'request_id': 'req-a3bbff17-7cb7-488c-b493-970abdde8331'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.342197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f4a5d8476f48828d3bf6816ac0d864', 'request_id': 'req-a3bbff17-7cb7-488c-b493-970abdde8331'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.354192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] The token cache is being invalidate because project c2f4a5d8476f48828d3bf6816ac0d864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:29:51.354480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.355661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.356859 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4228/8546] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:29:51 2022] DELETE /identity/v3/projects/c2f4a5d8476f48828d3bf6816ac0d864 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:51.361167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:51.362625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:51.376254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5154b55-6170-46e2-8ee5-cfe5bab82e0a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:51.431426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:51.432326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:51.432600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:51.432891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] PATH_INFO: `/v3/users/cd438f473e1a4802b294e27eea098d33` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:51.434111 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd438f473e1a4802b294e27eea098d33)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:51.436691 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:51.487452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd438f473e1a4802b294e27eea098d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.488171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd438f473e1a4802b294e27eea098d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.494763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd438f473e1a4802b294e27eea098d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.503355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd438f473e1a4802b294e27eea098d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.504052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-70c8b11a-a603-4577-92c9-6912d1bdca92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd438f473e1a4802b294e27eea098d33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.520391 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4319/8547] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:29:51 2022] DELETE /identity/v3/users/cd438f473e1a4802b294e27eea098d33 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:51.719696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:51.721339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:51.734888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbff17-7cb7-488c-b493-970abdde8331 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:51.794070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:51.794958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:51.795233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:51.795526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] PATH_INFO: `/v3/projects/be3919a8a0914ed2aa60a5c0213ef0c4` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:51.796672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3919a8a0914ed2aa60a5c0213ef0c4)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:51.798621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:51.849374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3919a8a0914ed2aa60a5c0213ef0c4', 'request_id': 'req-165be397-6124-463b-8ad5-528521f72366'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.855859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3919a8a0914ed2aa60a5c0213ef0c4', 'request_id': 'req-165be397-6124-463b-8ad5-528521f72366'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.866543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3919a8a0914ed2aa60a5c0213ef0c4', 'request_id': 'req-165be397-6124-463b-8ad5-528521f72366'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.878305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] The token cache is being invalidate because project be3919a8a0914ed2aa60a5c0213ef0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:29:51.878609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.879226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-165be397-6124-463b-8ad5-528521f72366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:51.880843 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4229/8548] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:29:51 2022] DELETE /identity/v3/projects/be3919a8a0914ed2aa60a5c0213ef0c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:51.886138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf881a8-6d20-43f8-a160-1a7ac481626d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:51.886623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf881a8-6d20-43f8-a160-1a7ac481626d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:51.886756 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf881a8-6d20-43f8-a160-1a7ac481626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:51.905329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3bf881a8-6d20-43f8-a160-1a7ac481626d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:51.906528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3bf881a8-6d20-43f8-a160-1a7ac481626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:51.964896 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4320/8549] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:51.973585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebea2b-4b91-4d6f-b15d-c718e4b623f2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:51.973966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebea2b-4b91-4d6f-b15d-c718e4b623f2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:51.974338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebea2b-4b91-4d6f-b15d-c718e4b623f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:51.995461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a7ebea2b-4b91-4d6f-b15d-c718e4b623f2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:51.996655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a7ebea2b-4b91-4d6f-b15d-c718e4b623f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:52.004900 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4230/8550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:52.010768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf881a8-6d20-43f8-a160-1a7ac481626d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.020993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf881a8-6d20-43f8-a160-1a7ac481626d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.026612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.027292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.027572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.027844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.028660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:29:52.028965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.030642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.042578 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4321/8551] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:29:52.047018 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebea2b-4b91-4d6f-b15d-c718e4b623f2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.056820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebea2b-4b91-4d6f-b15d-c718e4b623f2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.063016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.063678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.063960 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.064230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.064919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.066906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.106395 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4231/8552] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:29:52 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:29:52.110634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.120806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d6ba-039e-458c-abbb-26962c0282ce admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.190513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.191115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.191395 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.191668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.192350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.194334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.219790 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4322/8553] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:29:52 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:29:52.224080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.235189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222c6cb-4494-420d-a250-493db6ee27df admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.241189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.241847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.242144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.242412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.243161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.244761 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.255044 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4232/8554] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:52.259060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.269937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291c47b-5a33-49e5-b765-cf884aa7d626 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.275549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70866739-0c46-4636-b3a8-b3ad11ffe428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.276222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70866739-0c46-4636-b3a8-b3ad11ffe428 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.276499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70866739-0c46-4636-b3a8-b3ad11ffe428 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.276768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70866739-0c46-4636-b3a8-b3ad11ffe428 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.277589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70866739-0c46-4636-b3a8-b3ad11ffe428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.279334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70866739-0c46-4636-b3a8-b3ad11ffe428 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.290004 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4323/8555] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:52.294024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.304659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c4f7c-c495-41a8-8129-5e0c042ec075 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.310396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.311327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.311606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.311880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] PATH_INFO: `/v3/projects/f49c048d7943447da35f5e12790dcd1b/users/f2f03c792aaa4d3380ddfe073fef7904/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.328009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49c048d7943447da35f5e12790dcd1b, user_id=f2f03c792aaa4d3380ddfe073fef7904, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.330736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.346856 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4233/8556] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:52 2022] PUT /identity/v3/projects/f49c048d7943447da35f5e12790dcd1b/users/f2f03c792aaa4d3380ddfe073fef7904/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:52.357054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96e03f-8409-4bff-a6df-b07dde201644 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.357375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96e03f-8409-4bff-a6df-b07dde201644 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.357692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96e03f-8409-4bff-a6df-b07dde201644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.387745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9d96e03f-8409-4bff-a6df-b07dde201644 None None] MFA Rules not processed for user `f2f03c792aaa4d3380ddfe073fef7904`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:52.388980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9d96e03f-8409-4bff-a6df-b07dde201644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:52.457230 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4324/8557] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:29:52.462110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.523887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24696c-162b-437f-beca-532d2baee971 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.528945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.529653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.529933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.530202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.530890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.532812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.563273 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4234/8558] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:29:52 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:29:52.564552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96e03f-8409-4bff-a6df-b07dde201644 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.576938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96e03f-8409-4bff-a6df-b07dde201644 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.633675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.634343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.634620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.634890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.635573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.637592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.659333 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4325/8559] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:29:52 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:29:52.664023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.676418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99e85-90e3-4114-b9a4-4da3b5051189 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.681241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.681917 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.682197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.682467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.683201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.684877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.695497 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4235/8560] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:52.700431 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.716334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10046d93-12c6-4833-aee7-b40116c0f4d2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.721895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.722818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.723100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.723372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] PATH_INFO: `/v3/projects/c9fba9d1c78f4624bc456e57f68cc4a8/users/a9ba0a8143fa4855a3dbd40f43bf959a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.740624 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9fba9d1c78f4624bc456e57f68cc4a8, user_id=a9ba0a8143fa4855a3dbd40f43bf959a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.743406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.759516 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4326/8561] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:52 2022] PUT /identity/v3/projects/c9fba9d1c78f4624bc456e57f68cc4a8/users/a9ba0a8143fa4855a3dbd40f43bf959a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:52.763569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.773881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3753b-7f02-41a4-9ae2-6676b13522e2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.830259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f6b2-dbcf-46ec-b661-69519bce05b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.831035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f6b2-dbcf-46ec-b661-69519bce05b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.831318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f6b2-dbcf-46ec-b661-69519bce05b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.831589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f6b2-dbcf-46ec-b661-69519bce05b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.832313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f6b2-dbcf-46ec-b661-69519bce05b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.834342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f6b2-dbcf-46ec-b661-69519bce05b7 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.844930 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4236/8562] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:52.849280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:52.859817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8306e-37d0-45d4-9d81-91f50bbff374 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:52.864993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:52.865913 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.866186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.866481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] PATH_INFO: `/v3/projects/c9fba9d1c78f4624bc456e57f68cc4a8/users/a9ba0a8143fa4855a3dbd40f43bf959a/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.868559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9fba9d1c78f4624bc456e57f68cc4a8, user_id=a9ba0a8143fa4855a3dbd40f43bf959a, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:52.871263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:52.881572 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4327/8563] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:52 2022] PUT /identity/v3/projects/c9fba9d1c78f4624bc456e57f68cc4a8/users/a9ba0a8143fa4855a3dbd40f43bf959a/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:52.892672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fae3-c146-496a-8e5d-27dbe09a9515 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:52.892959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fae3-c146-496a-8e5d-27dbe09a9515 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:52.893269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fae3-c146-496a-8e5d-27dbe09a9515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:52.921354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-1d63fae3-c146-496a-8e5d-27dbe09a9515 None None] MFA Rules not processed for user `a9ba0a8143fa4855a3dbd40f43bf959a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:52.923312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1d63fae3-c146-496a-8e5d-27dbe09a9515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:52.996945 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4237/8564] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:53.008578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:53.010432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:53.069693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d433e6-7166-4891-9148-3514763c8ac6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:53.073685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c1ae-8b4c-4a99-a994-fd85264bfc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:53.074388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c1ae-8b4c-4a99-a994-fd85264bfc03 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:53.074670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c1ae-8b4c-4a99-a994-fd85264bfc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:53.074970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c1ae-8b4c-4a99-a994-fd85264bfc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:53.134826 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971c1ae-8b4c-4a99-a994-fd85264bfc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:53.136299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971c1ae-8b4c-4a99-a994-fd85264bfc03 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:53.145229 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4328/8565] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:55.690580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63fae3-c146-496a-8e5d-27dbe09a9515 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:55.758464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63fae3-c146-496a-8e5d-27dbe09a9515 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:55.763216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:55.764100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:55.764369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:55.764632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] PATH_INFO: `/v3/users/f2f03c792aaa4d3380ddfe073fef7904` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:55.765893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f03c792aaa4d3380ddfe073fef7904)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:55.768158 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:55.821360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f03c792aaa4d3380ddfe073fef7904'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:55.822248 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f03c792aaa4d3380ddfe073fef7904'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:55.830807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f03c792aaa4d3380ddfe073fef7904'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:55.831943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f03c792aaa4d3380ddfe073fef7904'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:55.843042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f03c792aaa4d3380ddfe073fef7904'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:55.863310 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4238/8566] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:29:55 2022] DELETE /identity/v3/users/f2f03c792aaa4d3380ddfe073fef7904 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:55.867785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:55.868328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:55.868720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:55.889610 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:55.890889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:55.953103 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4329/8567] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:55.963680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:55.965347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:56.029451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa29fa-bf2f-42a7-99be-54dd533c333c admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:56.033022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:56.033704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:56.033981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:56.034251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:56.043275 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:56.044726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:56.053917 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4239/8568] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:29:56.333806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:56.335491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:56.348674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de68564-82f7-486d-a5ca-3d46fd31c89e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:56.354302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:56.355186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:56.356051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:56.356051 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] PATH_INFO: `/v3/projects/f49c048d7943447da35f5e12790dcd1b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:56.357049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49c048d7943447da35f5e12790dcd1b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:56.359013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:56.413981 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49c048d7943447da35f5e12790dcd1b', 'request_id': 'req-c57f1572-be22-4e64-b347-f22949c86864'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.419854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49c048d7943447da35f5e12790dcd1b', 'request_id': 'req-c57f1572-be22-4e64-b347-f22949c86864'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.428897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49c048d7943447da35f5e12790dcd1b', 'request_id': 'req-c57f1572-be22-4e64-b347-f22949c86864'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.440211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] The token cache is being invalidate because project f49c048d7943447da35f5e12790dcd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:29:56.440501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.441226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.443108 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4330/8569] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:29:56 2022] DELETE /identity/v3/projects/f49c048d7943447da35f5e12790dcd1b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:56.447545 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:56.459078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f052e-b050-410d-b47d-64ef27b688fc service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:56.515379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:56.516272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:56.516553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:56.516830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] PATH_INFO: `/v3/users/a9ba0a8143fa4855a3dbd40f43bf959a` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:56.518057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ba0a8143fa4855a3dbd40f43bf959a)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:56.520043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:56.569723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ba0a8143fa4855a3dbd40f43bf959a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.570388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ba0a8143fa4855a3dbd40f43bf959a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.577454 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ba0a8143fa4855a3dbd40f43bf959a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.578114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ba0a8143fa4855a3dbd40f43bf959a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.586189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-13541330-8dd4-4fd5-a9da-401c52098992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ba0a8143fa4855a3dbd40f43bf959a'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:56.604578 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4240/8570] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:29:56 2022] DELETE /identity/v3/users/a9ba0a8143fa4855a3dbd40f43bf959a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:57.155076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.157140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:57.170396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f1572-be22-4e64-b347-f22949c86864 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.244240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:57.245167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.245447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.245723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] PATH_INFO: `/v3/projects/c9fba9d1c78f4624bc456e57f68cc4a8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.246964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9fba9d1c78f4624bc456e57f68cc4a8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:57.248941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:57.296901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9fba9d1c78f4624bc456e57f68cc4a8', 'request_id': 'req-f5de2558-484e-434e-9612-c8ce53ce9e73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:57.301960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9fba9d1c78f4624bc456e57f68cc4a8', 'request_id': 'req-f5de2558-484e-434e-9612-c8ce53ce9e73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:57.312220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9fba9d1c78f4624bc456e57f68cc4a8', 'request_id': 'req-f5de2558-484e-434e-9612-c8ce53ce9e73'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:57.325176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] The token cache is being invalidate because project c9fba9d1c78f4624bc456e57f68cc4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:29:57.325575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:57.326375 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-f5de2558-484e-434e-9612-c8ce53ce9e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:29:57.328559 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4331/8571] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:29:57 2022] DELETE /identity/v3/projects/c9fba9d1c78f4624bc456e57f68cc4a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:57.334178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f122f-95d6-497a-803e-0b7a2b1cc899 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.334661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f122f-95d6-497a-803e-0b7a2b1cc899 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.334757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f122f-95d6-497a-803e-0b7a2b1cc899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.355357 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ab6f122f-95d6-497a-803e-0b7a2b1cc899 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:57.356699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab6f122f-95d6-497a-803e-0b7a2b1cc899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:57.421504 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4241/8572] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:57.429342 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9348-7ff9-44c2-9374-d6b7e64f18ce None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.429639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9348-7ff9-44c2-9374-d6b7e64f18ce None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.429925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9348-7ff9-44c2-9374-d6b7e64f18ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.450439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c12c9348-7ff9-44c2-9374-d6b7e64f18ce None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:57.451684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c12c9348-7ff9-44c2-9374-d6b7e64f18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:57.461463 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4332/8573] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:57.465947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f122f-95d6-497a-803e-0b7a2b1cc899 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.476302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f122f-95d6-497a-803e-0b7a2b1cc899 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.482003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:57.484149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.484440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.484718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.485524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:29:57.485813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:57.487528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:57.503492 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4242/8574] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:29:57.504726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9348-7ff9-44c2-9374-d6b7e64f18ce None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.514299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9348-7ff9-44c2-9374-d6b7e64f18ce None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.521642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:57.522325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.522634 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.522904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.523599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:57.525676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:57.558202 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4333/8575] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:29:57 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:29:57.559713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.570644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b254a1d-35b7-4d3b-9051-0a87726e4741 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.629418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:57.630107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.630505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.630787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.631507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:57.633499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:57.658381 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4243/8576] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:29:57 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:29:57.660198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.670665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864bd0-9fb2-46fe-9d5e-202699ee3168 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.675488 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:57.676175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.676453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.676741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.677512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:57.679146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:57.689642 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4334/8577] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:57.693811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.706462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b65a2-bba9-4006-a74c-fb2d751deb7d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.713023 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b05e55-97d0-49d3-aae0-3fb865c2b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:57.713883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05e55-97d0-49d3-aae0-3fb865c2b0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.714160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05e55-97d0-49d3-aae0-3fb865c2b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.714431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05e55-97d0-49d3-aae0-3fb865c2b0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.715154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05e55-97d0-49d3-aae0-3fb865c2b0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:57.716906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05e55-97d0-49d3-aae0-3fb865c2b0e0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:57.727958 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4244/8578] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:29:57.732260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.742143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fdc2-ff1a-4744-832d-565e185a279e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.746870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:57.747771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.748071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.748410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] PATH_INFO: `/v3/projects/9a1e134964d24ff89caaf84a52590601/users/cbd52b74730348139214b0c383944286/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.763754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1e134964d24ff89caaf84a52590601, user_id=cbd52b74730348139214b0c383944286, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:57.766471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:57.780478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4335/8579] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:29:57 2022] PUT /identity/v3/projects/9a1e134964d24ff89caaf84a52590601/users/cbd52b74730348139214b0c383944286/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:29:57.790558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507bff-ecc7-4453-8afc-350f03fac5d8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:57.790835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507bff-ecc7-4453-8afc-350f03fac5d8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:57.791134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507bff-ecc7-4453-8afc-350f03fac5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:57.819110 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-21507bff-ecc7-4453-8afc-350f03fac5d8 None None] MFA Rules not processed for user `cbd52b74730348139214b0c383944286`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:29:57.820482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-21507bff-ecc7-4453-8afc-350f03fac5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:57.905252 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4245/8580] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:29:57.913558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:29:57.915922 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:29:57.993976 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28da4da-6292-4c63-a13d-30c99e41d96f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:29:57.998779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd973720-e7b4-424a-a95c-6b658c14c27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:29:58.000033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973720-e7b4-424a-a95c-6b658c14c27c service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:29:58.000723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973720-e7b4-424a-a95c-6b658c14c27c service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:29:58.001221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973720-e7b4-424a-a95c-6b658c14c27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:29:58.013876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd973720-e7b4-424a-a95c-6b658c14c27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:29:58.015822 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd973720-e7b4-424a-a95c-6b658c14c27c service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:29:58.048667 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4336/8581] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:29:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:30:05.305326 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507bff-ecc7-4453-8afc-350f03fac5d8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:05.378393 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507bff-ecc7-4453-8afc-350f03fac5d8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:05.383549 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:05.384480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:05.384744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:05.385012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] PATH_INFO: `/v3/users/cbd52b74730348139214b0c383944286` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:05.386352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd52b74730348139214b0c383944286)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:05.388333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:05.442440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd52b74730348139214b0c383944286'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:05.443297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd52b74730348139214b0c383944286'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:05.452801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd52b74730348139214b0c383944286'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:05.453742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd52b74730348139214b0c383944286'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:05.464662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd52b74730348139214b0c383944286'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:05.485981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4246/8582] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:30:05 2022] DELETE /identity/v3/users/cbd52b74730348139214b0c383944286 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:30:05.491859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:05.492760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:05.493084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:05.512964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:05.514340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:05.580810 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4337/8583] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:30:05.591956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:05.595371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:05.666840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7cd06-3523-46b7-9824-bf2ab03b2706 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:05.670780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e21a0-2616-46bf-9c3f-613ff3f95f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:05.671478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e21a0-2616-46bf-9c3f-613ff3f95f4c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:05.671898 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e21a0-2616-46bf-9c3f-613ff3f95f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:05.672425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e21a0-2616-46bf-9c3f-613ff3f95f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:05.683686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e21a0-2616-46bf-9c3f-613ff3f95f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:05.685236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e21a0-2616-46bf-9c3f-613ff3f95f4c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:05.698259 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4247/8584] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:30:06.018287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.019979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:06.034995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc479-b1c2-49dc-892a-4c0c234d6977 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.041454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.042564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.042955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.043325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] PATH_INFO: `/v3/projects/9a1e134964d24ff89caaf84a52590601` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.044821 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1e134964d24ff89caaf84a52590601)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.047790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.104099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1e134964d24ff89caaf84a52590601', 'request_id': 'req-bd45185b-1e79-4387-97a4-eff19e3ed0d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:06.110321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1e134964d24ff89caaf84a52590601', 'request_id': 'req-bd45185b-1e79-4387-97a4-eff19e3ed0d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:06.119831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1e134964d24ff89caaf84a52590601', 'request_id': 'req-bd45185b-1e79-4387-97a4-eff19e3ed0d4'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:06.132353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] The token cache is being invalidate because project 9a1e134964d24ff89caaf84a52590601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:30:06.132637 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:06.133415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-bd45185b-1e79-4387-97a4-eff19e3ed0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:06.135011 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4338/8585] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:30:06 2022] DELETE /identity/v3/projects/9a1e134964d24ff89caaf84a52590601 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:30:06.140463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef4a6-c771-47be-963b-24286ef913a5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.140785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef4a6-c771-47be-963b-24286ef913a5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.141099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef4a6-c771-47be-963b-24286ef913a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.159431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7adef4a6-c771-47be-963b-24286ef913a5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:06.160683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7adef4a6-c771-47be-963b-24286ef913a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:06.227318 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4248/8586] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:06.235240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc904-0265-457d-a309-853285aac670 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.235495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc904-0265-457d-a309-853285aac670 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.235769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc904-0265-457d-a309-853285aac670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.254770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7b4bc904-0265-457d-a309-853285aac670 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:06.256094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b4bc904-0265-457d-a309-853285aac670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:06.265122 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4339/8587] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:06.269794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef4a6-c771-47be-963b-24286ef913a5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.280616 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef4a6-c771-47be-963b-24286ef913a5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.286705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.287390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.287669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.288095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.288912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:30:06.289280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.291059 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.308529 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4249/8588] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:30:06.309696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bc904-0265-457d-a309-853285aac670 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.320397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bc904-0265-457d-a309-853285aac670 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.325757 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.326482 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.327018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.327147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.327778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.329985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.358130 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4340/8589] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:30:06 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:30:06.363288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.374439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692a51-3158-45e8-8b38-a6e55d3d75ff admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.443392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.443757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.444043 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.444365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.445114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.447330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.469932 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4250/8590] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:30:06 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:30:06.474167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.485723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b184-a11b-43a8-acdd-cd33fd22074f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.491367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.492100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.492655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.492655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.493497 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.495215 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.507575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4341/8591] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:30:06.511774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.522900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143874d-4fe1-4234-b2ea-c8c8ea0c57fd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.528367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc4381-134e-43c1-bea1-828e6a8244ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.529161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4381-134e-43c1-bea1-828e6a8244ea admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.529469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4381-134e-43c1-bea1-828e6a8244ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.529819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4381-134e-43c1-bea1-828e6a8244ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.530632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc4381-134e-43c1-bea1-828e6a8244ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.532388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc4381-134e-43c1-bea1-828e6a8244ea admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.545069 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4251/8592] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:30:06.548418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.560380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061b5e3-df53-485a-9b9c-cc7609febd84 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.566407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.567396 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.567619 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.567849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] PATH_INFO: `/v3/projects/12c2722cae9e4b4a979b5a23ffd211f5/users/95eba67fe59f4248a99483f457a083ed/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.584701 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c2722cae9e4b4a979b5a23ffd211f5, user_id=95eba67fe59f4248a99483f457a083ed, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.587461 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.601894 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4342/8593] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:30:06 2022] PUT /identity/v3/projects/12c2722cae9e4b4a979b5a23ffd211f5/users/95eba67fe59f4248a99483f457a083ed/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:30:06.612820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059ba-dd43-42e0-ab35-f17c83e3c1e6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.613306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059ba-dd43-42e0-ab35-f17c83e3c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.613678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059ba-dd43-42e0-ab35-f17c83e3c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.646190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4a7059ba-dd43-42e0-ab35-f17c83e3c1e6 None None] MFA Rules not processed for user `95eba67fe59f4248a99483f457a083ed`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:06.647887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4a7059ba-dd43-42e0-ab35-f17c83e3c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:06.734560 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4252/8594] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:06.746523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:06.748580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:06.818403 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ca4f-121f-4aeb-991f-f07376d67d5f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:06.822629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677ab06-b103-4219-941a-fc281663548e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:06.823363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677ab06-b103-4219-941a-fc281663548e service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:06.823615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677ab06-b103-4219-941a-fc281663548e service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:06.823932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677ab06-b103-4219-941a-fc281663548e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:06.834415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677ab06-b103-4219-941a-fc281663548e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:06.835985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677ab06-b103-4219-941a-fc281663548e service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:06.846505 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4343/8595] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:30:28.298782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059ba-dd43-42e0-ab35-f17c83e3c1e6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:28.369580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059ba-dd43-42e0-ab35-f17c83e3c1e6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:28.375370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:28.376360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:28.376644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:28.377022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] PATH_INFO: `/v3/users/95eba67fe59f4248a99483f457a083ed` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:28.378736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95eba67fe59f4248a99483f457a083ed)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:28.380967 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:28.430296 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95eba67fe59f4248a99483f457a083ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:28.430961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95eba67fe59f4248a99483f457a083ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:28.444747 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95eba67fe59f4248a99483f457a083ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:28.445548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95eba67fe59f4248a99483f457a083ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:28.454260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95eba67fe59f4248a99483f457a083ed'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:28.476350 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4253/8596] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:30:28 2022] DELETE /identity/v3/users/95eba67fe59f4248a99483f457a083ed => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:30:28.481026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:28.481596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:28.481596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:28.500853 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:28.502102 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:28.566318 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4344/8597] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:28.576344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:28.578031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:28.640104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764e74-590b-4473-9285-35c235afb217 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:28.644327 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e59e82-bf1a-4d71-8193-fbe949c1858a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:28.645005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59e82-bf1a-4d71-8193-fbe949c1858a service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:28.645320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59e82-bf1a-4d71-8193-fbe949c1858a service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:28.645592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59e82-bf1a-4d71-8193-fbe949c1858a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:28.655816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e59e82-bf1a-4d71-8193-fbe949c1858a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:28.657304 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e59e82-bf1a-4d71-8193-fbe949c1858a service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:28.667403 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4254/8598] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:30:28.941255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:28.942968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:28.956738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17da80-ba59-4f28-81f5-257d3e86cf45 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:28.963583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:28.964565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:28.964840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:28.965182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] PATH_INFO: `/v3/projects/12c2722cae9e4b4a979b5a23ffd211f5` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:28.966374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c2722cae9e4b4a979b5a23ffd211f5)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:28.968444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.019899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c2722cae9e4b4a979b5a23ffd211f5', 'request_id': 'req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:29.026318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c2722cae9e4b4a979b5a23ffd211f5', 'request_id': 'req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:29.035064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c2722cae9e4b4a979b5a23ffd211f5', 'request_id': 'req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:29.048764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] The token cache is being invalidate because project 12c2722cae9e4b4a979b5a23ffd211f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:30:29.049166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:29.049952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-453b9a79-9a2c-412b-bbcf-68d1f1dfa1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:30:29.051742 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4345/8599] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:30:28 2022] DELETE /identity/v3/projects/12c2722cae9e4b4a979b5a23ffd211f5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:30:29.057205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218823-2eee-4371-8c0b-8248046f91d6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.057497 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218823-2eee-4371-8c0b-8248046f91d6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.057881 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218823-2eee-4371-8c0b-8248046f91d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.077563 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-78218823-2eee-4371-8c0b-8248046f91d6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:29.078782 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78218823-2eee-4371-8c0b-8248046f91d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:29.144163 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4255/8600] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:29.156099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33571612-6e9b-4f82-8b1a-44fbbc402bc0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.156401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33571612-6e9b-4f82-8b1a-44fbbc402bc0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.156685 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33571612-6e9b-4f82-8b1a-44fbbc402bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.177308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-33571612-6e9b-4f82-8b1a-44fbbc402bc0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:29.178565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-33571612-6e9b-4f82-8b1a-44fbbc402bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:29.187354 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4346/8601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:29.192090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78218823-2eee-4371-8c0b-8248046f91d6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:29.203386 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78218823-2eee-4371-8c0b-8248046f91d6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:29.209079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:29.209871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.210168 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.210444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.211235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:30:29.211656 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:29.213641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.227065 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4256/8602] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:30:29.231789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33571612-6e9b-4f82-8b1a-44fbbc402bc0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:29.241929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33571612-6e9b-4f82-8b1a-44fbbc402bc0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:29.247839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:29.248536 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.248783 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.249126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.249782 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:29.251754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.279502 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4347/8603] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:30:29 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:30:29.284259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:29.295659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958737-e5c2-468d-8f7f-5cd4d5301b0e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:29.358380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:29.359126 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.359379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.359647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.360360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:29.362342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.391823 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4257/8604] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:30:29 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:30:29.393421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:29.404420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252504d-c1e2-4bb0-8124-9329a41fe90a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:29.409390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:29.410143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.410425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.410762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.411530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:29.413216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.424342 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4348/8605] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:30:29.428704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:29.439697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525758a4-3f00-4c68-aee9-7704af389e41 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:29.444924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec6fb2-4685-4033-a852-91eec3c70d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:29.445765 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6fb2-4685-4033-a852-91eec3c70d63 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.446241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6fb2-4685-4033-a852-91eec3c70d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.446582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6fb2-4685-4033-a852-91eec3c70d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.447292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec6fb2-4685-4033-a852-91eec3c70d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:29.448907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec6fb2-4685-4033-a852-91eec3c70d63 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.461261 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4258/8606] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:30:29.465761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:29.477192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343847-fde0-46aa-8b81-000f0195e342 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:29.482506 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:29.483596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.483838 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.484143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] PATH_INFO: `/v3/projects/3e1e5cc7222142ab82cd6a857f7be3de/users/f858bd78e1794185a908d3372a7359dd/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.500460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1e5cc7222142ab82cd6a857f7be3de, user_id=f858bd78e1794185a908d3372a7359dd, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:29.503199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.518788 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4349/8607] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:30:29 2022] PUT /identity/v3/projects/3e1e5cc7222142ab82cd6a857f7be3de/users/f858bd78e1794185a908d3372a7359dd/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:30:29.524585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa710-579a-4429-a86f-b2ef06e9981f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.524879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa710-579a-4429-a86f-b2ef06e9981f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.525766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa710-579a-4429-a86f-b2ef06e9981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.544846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-a5aaa710-579a-4429-a86f-b2ef06e9981f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:29.546293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a5aaa710-579a-4429-a86f-b2ef06e9981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:29.614994 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4259/8608] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:29.626132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:29.628072 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:29.697163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3059bb-2009-4510-9a21-ea7d5ba98f35 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:29.702251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:29.703521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:29.703521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:29.703727 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:29.716683 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:29.718521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:29.730620 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4350/8609] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:30:30.409924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611f39-1117-4516-a801-8fb0ef798b2a None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:30.410370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611f39-1117-4516-a801-8fb0ef798b2a None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:30.410468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611f39-1117-4516-a801-8fb0ef798b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:30.448439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-e4611f39-1117-4516-a801-8fb0ef798b2a None None] MFA Rules not processed for user `f858bd78e1794185a908d3372a7359dd`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:30.450009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e4611f39-1117-4516-a801-8fb0ef798b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:30.537010 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4260/8610] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:30.549316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:30.551539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:30.632493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c45b2-3e61-4331-901b-ec3e9a79d158 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:30.636450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:30.637182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:30.637454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:30.637903 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:30.648711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:30.650296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:30.660336 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4351/8611] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:30:30.671569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4611f39-1117-4516-a801-8fb0ef798b2a None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:30.685647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4611f39-1117-4516-a801-8fb0ef798b2a None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:30.690182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2ea8a-397b-4aef-8b2b-b5b5907f5410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:30.690843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2ea8a-397b-4aef-8b2b-b5b5907f5410 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:30.691121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2ea8a-397b-4aef-8b2b-b5b5907f5410 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:30.691396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2ea8a-397b-4aef-8b2b-b5b5907f5410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:30.693284 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1cf2ea8a-397b-4aef-8b2b-b5b5907f5410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:30.775800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2ea8a-397b-4aef-8b2b-b5b5907f5410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:30.777335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2ea8a-397b-4aef-8b2b-b5b5907f5410 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:30.791776 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4261/8612] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:30:31.996605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:32.008939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9cc1-473f-4d94-af65-1a5a41779fc1 service cinder] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:32.013703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:32.014361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:32.014636 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:32.014908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:32.016764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:32.038386 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:32.040754 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:32.055270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4352/8613] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:30:34.564641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41962df6-8657-4a90-ba78-d10f4c9f4f17 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:34.565154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41962df6-8657-4a90-ba78-d10f4c9f4f17 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:34.565244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41962df6-8657-4a90-ba78-d10f4c9f4f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:34.583411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-41962df6-8657-4a90-ba78-d10f4c9f4f17 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:34.584618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-41962df6-8657-4a90-ba78-d10f4c9f4f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:34.641369 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4262/8614] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:30:34.654062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:34.655743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:34.729608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76095e-58ce-4581-91de-a2dacf3108ae service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:34.736183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc1d11-ee1f-40af-b195-81d0163762aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:34.736874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc1d11-ee1f-40af-b195-81d0163762aa service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:34.737185 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc1d11-ee1f-40af-b195-81d0163762aa service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:34.737456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc1d11-ee1f-40af-b195-81d0163762aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:34.746623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc1d11-ee1f-40af-b195-81d0163762aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:34.748245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc1d11-ee1f-40af-b195-81d0163762aa service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:34.756291 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4353/8615] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:30:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:30:38.843216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:38.843877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:38.843877 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:38.863973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] MFA Rules not processed for user `2e9bbd737ff54225a549f072976ef296`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:38.865336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:38.937155 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4263/8616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:47.978887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0edaa9-2236-4015-b866-6cc847034b2f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:47.979474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0edaa9-2236-4015-b866-6cc847034b2f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:47.979474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0edaa9-2236-4015-b866-6cc847034b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:48.018736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3d0edaa9-2236-4015-b866-6cc847034b2f None None] MFA Rules not processed for user `f858bd78e1794185a908d3372a7359dd`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:30:48.020320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3d0edaa9-2236-4015-b866-6cc847034b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:48.037651 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4354/8617] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:30:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:30:52.348822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:30:52.350422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:52.366149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ef47-01aa-4649-882c-fc004cf31cf3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:30:52.370303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:30:52.371064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:30:52.371342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:30:52.371611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:30:52.373600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:30:52.435431 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:30:52.436981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:30:52.447716 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4264/8618] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:30:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:31:05.203948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0edaa9-2236-4015-b866-6cc847034b2f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:31:05.217358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0edaa9-2236-4015-b866-6cc847034b2f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:31:05.221937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:31:05.222677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:31:05.222952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:31:05.223217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:31:05.225437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:31:05.238208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:31:05.239712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:31:05.253572 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4355/8619] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:31:06.716195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:31:06.727796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795a578-22e1-4a9e-acc9-eba886c09fcd service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:31:06.732404 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b8dd5-9787-4d03-bbbe-7f40f7f04594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:31:06.733063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b8dd5-9787-4d03-bbbe-7f40f7f04594 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:31:06.733346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b8dd5-9787-4d03-bbbe-7f40f7f04594 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:31:06.733642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b8dd5-9787-4d03-bbbe-7f40f7f04594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:31:06.735802 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bd7b8dd5-9787-4d03-bbbe-7f40f7f04594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:31:06.748692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b8dd5-9787-4d03-bbbe-7f40f7f04594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:31:06.750213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b8dd5-9787-4d03-bbbe-7f40f7f04594 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:31:06.761337 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4265/8620] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:32:43.375370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:32:43.377162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:32:43.397178 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739d945-5460-4e86-8dae-394e53a3507a service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:32:43.403320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:32:43.403974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:32:43.404259 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:32:43.404615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:32:43.406463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:32:43.422474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:32:43.424522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:32:43.441299 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4356/8621] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:32:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:32:48.575471 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:32:48.576737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:32:48.577021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:32:48.597793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] MFA Rules not processed for user `f858bd78e1794185a908d3372a7359dd`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:32:48.599488 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:32:48.608500 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4266/8622] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:32:48.867476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:32:48.881778 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbfc64-1332-4212-9900-f2ac4787a453 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:32:48.885669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:32:48.886322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:32:48.886601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:32:48.886873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:32:48.888678 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:32:48.901338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:32:48.902806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:32:48.913425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4357/8623] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:32:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:32:49.245692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:32:49.247277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:32:49.327667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074442b2-dc5b-443c-a9d2-de7fdc3f277b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:32:49.334027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:32:49.334723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:32:49.334986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:32:49.335259 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:32:49.337279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:32:49.352528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:32:49.354192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:32:49.371199 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4267/8624] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:32:57.089849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:32:57.109241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4974ef5-099f-4397-b93f-552856ecada6 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:32:57.121817 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:32:57.122598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:32:57.122941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:32:57.123339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:32:57.125694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:32:57.143927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:32:57.145764 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:32:57.159445 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4358/8625] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:32:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:33:03.484991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:33:03.486624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:33:03.504604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d278bd-6193-4be9-9631-09e51d945d8a service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:33:03.511755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb834a9-c999-4b23-abf7-cfbc1bbd4dac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:33:03.516346 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb834a9-c999-4b23-abf7-cfbc1bbd4dac service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:33:03.516870 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb834a9-c999-4b23-abf7-cfbc1bbd4dac service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:33:03.517257 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb834a9-c999-4b23-abf7-cfbc1bbd4dac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:33:03.519447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7cb834a9-c999-4b23-abf7-cfbc1bbd4dac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:33:03.535422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb834a9-c999-4b23-abf7-cfbc1bbd4dac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:33:03.537523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb834a9-c999-4b23-abf7-cfbc1bbd4dac service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:33:03.554500 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4268/8626] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:33:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:33:03.875275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:33:03.892865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8009-e400-4e10-bfad-b793ec0573f1 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:33:03.899726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:33:03.901426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:33:03.901712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:33:03.903340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:33:03.906172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:33:03.922928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:33:03.924765 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:33:03.942083 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4359/8627] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:33:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:33:05.537067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34243-2502-4c03-9526-70237ad19d95 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:33:05.537598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34243-2502-4c03-9526-70237ad19d95 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:33:05.537598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34243-2502-4c03-9526-70237ad19d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:33:05.556418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-4bd34243-2502-4c03-9526-70237ad19d95 None None] MFA Rules not processed for user `2e9bbd737ff54225a549f072976ef296`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:33:05.557670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4bd34243-2502-4c03-9526-70237ad19d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:33:05.566214 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4269/8628] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:33:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:34:01.982280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:34:01.996585 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f9dcf-8ec0-4130-b793-b8b18d622e55 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:34:02.003204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:34:02.003933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:34:02.004213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:34:02.004529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:34:02.006898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:34:02.022805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:34:02.024426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:34:02.040840 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4360/8629] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:34:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:35:03.281619 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34243-2502-4c03-9526-70237ad19d95 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:03.316513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34243-2502-4c03-9526-70237ad19d95 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:03.321514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:03.322401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:03.322677 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:03.322948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] PATH_INFO: `/v3/users/f858bd78e1794185a908d3372a7359dd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:03.324253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f858bd78e1794185a908d3372a7359dd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:03.326631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:03.374269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f858bd78e1794185a908d3372a7359dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.374913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f858bd78e1794185a908d3372a7359dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.382238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f858bd78e1794185a908d3372a7359dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.382941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f858bd78e1794185a908d3372a7359dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.391880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-917db782-84f5-4ac9-a74d-4b18f62b81b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f858bd78e1794185a908d3372a7359dd'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.408920 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4270/8630] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:35:03 2022] DELETE /identity/v3/users/f858bd78e1794185a908d3372a7359dd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:35:03.587709 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:03.621943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ceb24-8008-486a-a506-08cd63e84df2 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:03.675938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:03.676820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:03.677098 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:03.677406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] PATH_INFO: `/v3/projects/3e1e5cc7222142ab82cd6a857f7be3de` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:03.678663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1e5cc7222142ab82cd6a857f7be3de)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:03.680604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:03.731164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1e5cc7222142ab82cd6a857f7be3de', 'request_id': 'req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.736639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1e5cc7222142ab82cd6a857f7be3de', 'request_id': 'req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.747071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1e5cc7222142ab82cd6a857f7be3de', 'request_id': 'req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.758519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] The token cache is being invalidate because project 3e1e5cc7222142ab82cd6a857f7be3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:35:03.758808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.759540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ea8cfef2-c8e2-4745-a3ad-3e41340e8686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:35:03.761245 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4361/8631] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:35:03 2022] DELETE /identity/v3/projects/3e1e5cc7222142ab82cd6a857f7be3de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:35:03.766845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b296-2c8d-4205-89b8-fba663f4a1b5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:03.767134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b296-2c8d-4205-89b8-fba663f4a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:03.767410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b296-2c8d-4205-89b8-fba663f4a1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:03.794974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8716b296-2c8d-4205-89b8-fba663f4a1b5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:35:03.796138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8716b296-2c8d-4205-89b8-fba663f4a1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:03.860442 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4271/8632] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:35:03.867932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea5b2-9a88-4583-82b6-fdeb9eaf4788 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:03.868241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea5b2-9a88-4583-82b6-fdeb9eaf4788 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:03.868521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea5b2-9a88-4583-82b6-fdeb9eaf4788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:03.887653 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-569ea5b2-9a88-4583-82b6-fdeb9eaf4788 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:35:03.888877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-569ea5b2-9a88-4583-82b6-fdeb9eaf4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:03.898249 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4362/8633] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:35:03.902623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b296-2c8d-4205-89b8-fba663f4a1b5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:03.912350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b296-2c8d-4205-89b8-fba663f4a1b5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:03.917453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:03.918157 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:03.918543 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:03.918824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:03.919567 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:35:03.919856 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:03.921501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:03.933916 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4272/8634] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:35:03.938271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea5b2-9a88-4583-82b6-fdeb9eaf4788 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:03.948169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea5b2-9a88-4583-82b6-fdeb9eaf4788 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:03.954306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:03.954964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:03.955206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:03.955486 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:03.956175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:03.958130 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:03.985836 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4363/8635] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:35:03 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:35:03.990133 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.000263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59309c9-8abc-4014-a274-248a496584b9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.059352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.059940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.060216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.060485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.061194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.063135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.086160 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4273/8636] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:35:03 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:35:04.090434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.101220 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c319-46aa-4257-9426-f3320f07e5a5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.105994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.106668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.106949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.107225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.107956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.109665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.121241 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4364/8637] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:35:04.125387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.135838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d367b-95c8-466e-a98c-69f41ea70f7b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.141226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111410-034c-4491-b050-c421fd72d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.141888 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111410-034c-4491-b050-c421fd72d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.142173 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111410-034c-4491-b050-c421fd72d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.142452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111410-034c-4491-b050-c421fd72d0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.143205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111410-034c-4491-b050-c421fd72d0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.144810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111410-034c-4491-b050-c421fd72d0dc admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.155284 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4274/8638] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:35:04.159583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.169575 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b842e5-8bc9-4c69-9863-481f7fd388c5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.174799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.175686 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.175965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.176236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] PATH_INFO: `/v3/projects/2307958edd534abb847445b0e1dd954d/users/f0203027cfe84e548c0b541f545585a1/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.190689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2307958edd534abb847445b0e1dd954d, user_id=f0203027cfe84e548c0b541f545585a1, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.193481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.209465 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4365/8639] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:35:04 2022] PUT /identity/v3/projects/2307958edd534abb847445b0e1dd954d/users/f0203027cfe84e548c0b541f545585a1/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:35:04.220044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50460-a5d3-4f7f-8174-66f1df62a319 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.220333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50460-a5d3-4f7f-8174-66f1df62a319 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.220609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50460-a5d3-4f7f-8174-66f1df62a319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.247925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-76a50460-a5d3-4f7f-8174-66f1df62a319 None None] MFA Rules not processed for user `f0203027cfe84e548c0b541f545585a1`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:35:04.249169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-76a50460-a5d3-4f7f-8174-66f1df62a319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:04.313429 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4275/8640] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:35:04.317937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.380814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7b7b-9ae1-4196-82e9-30ca560058d6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.386896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.387567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.387841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.388129 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.388811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.390832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.419360 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4366/8641] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:35:04 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:35:04.423587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50460-a5d3-4f7f-8174-66f1df62a319 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.434585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50460-a5d3-4f7f-8174-66f1df62a319 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.493420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.494121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.494402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.494669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.495350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.497313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.518494 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4276/8642] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:35:04 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:35:04.522741 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.533243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142aaf-6ada-48b8-bae2-3fa5787c8180 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.538062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.538726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.538995 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.539271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.539986 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.541640 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.551879 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4367/8643] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:35:04.555948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.566188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71625-dd5f-46a6-b4e6-2f21c062eaf0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.571213 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.572093 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.572384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.572663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] PATH_INFO: `/v3/projects/267e9b3492cf43bd818a3edd86f80b25/users/2a824bdb82f142c892b659415a866e33/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.588200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] RBAC: Authorizing `identity:create_grant(project_id=267e9b3492cf43bd818a3edd86f80b25, user_id=2a824bdb82f142c892b659415a866e33, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.591008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.605402 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4277/8644] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:35:04 2022] PUT /identity/v3/projects/267e9b3492cf43bd818a3edd86f80b25/users/2a824bdb82f142c892b659415a866e33/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:35:04.609561 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.619527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b531-6340-4311-b379-3256255feb87 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.680328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dc122-38a5-4470-bf95-645248768e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.681010 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dc122-38a5-4470-bf95-645248768e8f admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.681330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dc122-38a5-4470-bf95-645248768e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.681607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dc122-38a5-4470-bf95-645248768e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.682332 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dc122-38a5-4470-bf95-645248768e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.683965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dc122-38a5-4470-bf95-645248768e8f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.693933 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4368/8645] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:35:04.698681 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.711810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257577-538b-4eea-a685-b3b82f96495d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.717383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.718269 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.718569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.718815 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] PATH_INFO: `/v3/projects/267e9b3492cf43bd818a3edd86f80b25/users/2a824bdb82f142c892b659415a866e33/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.720878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267e9b3492cf43bd818a3edd86f80b25, user_id=2a824bdb82f142c892b659415a866e33, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:04.723580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:04.734095 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4278/8646] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:35:04 2022] PUT /identity/v3/projects/267e9b3492cf43bd818a3edd86f80b25/users/2a824bdb82f142c892b659415a866e33/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:35:04.748885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.749283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.749646 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:04.780861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] MFA Rules not processed for user `2a824bdb82f142c892b659415a866e33`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:35:04.782142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:04.854322 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4369/8647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:35:04.865592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:04.867580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:04.943546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb89385-ce8e-4e13-96d7-f3b74c5407e3 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:04.947781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd9f20-c35b-4cfc-b6c6-6648bd826441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:04.948421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9f20-c35b-4cfc-b6c6-6648bd826441 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:04.948696 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9f20-c35b-4cfc-b6c6-6648bd826441 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:04.948964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9f20-c35b-4cfc-b6c6-6648bd826441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:05.010757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd9f20-c35b-4cfc-b6c6-6648bd826441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:05.012207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd9f20-c35b-4cfc-b6c6-6648bd826441 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:05.021565 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4279/8648] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:35:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:35:07.088416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:07.089985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:07.108726 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212809cf-3283-427c-9b58-f9747ff844e0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:07.113238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:07.113751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:07.114028 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:07.114300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:07.123695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:07.125295 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:07.135089 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4370/8649] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:35:12.095196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:12.095736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:12.095736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:12.114686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] MFA Rules not processed for user `f0203027cfe84e548c0b541f545585a1`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:35:12.115902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:12.123062 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4280/8650] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:35:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:35:12.469565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:12.480926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8c2b-d9ea-42e9-94b8-2f6e72d1500e service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:12.484752 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d110c-e2a1-469a-b48b-d9cb863282a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:12.485593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d110c-e2a1-469a-b48b-d9cb863282a6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:12.485966 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d110c-e2a1-469a-b48b-d9cb863282a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:12.486327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d110c-e2a1-469a-b48b-d9cb863282a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:12.488384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-831d110c-e2a1-469a-b48b-d9cb863282a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:12.501320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d110c-e2a1-469a-b48b-d9cb863282a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:12.502944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d110c-e2a1-469a-b48b-d9cb863282a6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:12.514566 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4371/8651] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:35:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:35:13.065359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:13.066766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:13.149539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3f611-209c-439c-a0e2-04588fa2d0e2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:13.153600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6504d578b1b64feb93ba69d947a971e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:13.154463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:13.154919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:13.155322 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:13.157334 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:13.226931 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:13.228399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:13.240004 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4281/8652] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:35:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:35:16.951376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6130a5-bced-4695-bf13-d6d3f7457161 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:16.951932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6130a5-bced-4695-bf13-d6d3f7457161 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:16.951932 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6130a5-bced-4695-bf13-d6d3f7457161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:16.970804 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0c6130a5-bced-4695-bf13-d6d3f7457161 None None] MFA Rules not processed for user `2e9bbd737ff54225a549f072976ef296`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:35:16.972306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c6130a5-bced-4695-bf13-d6d3f7457161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:16.979680 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4372/8653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:35:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:35:29.680606 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:35:29.694911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee93d-47d7-48df-bcd5-5002daaee35f service cinder] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:35:29.700308 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:35:29.700965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:35:29.701281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:35:29.701553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:35:29.703729 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:35:29.808798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:35:29.810300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:35:29.824334 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4282/8654] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:35:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:36:02.210483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fde3-6459-45a3-b130-2612a32c172d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:36:02.211134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fde3-6459-45a3-b130-2612a32c172d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:36:02.211134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fde3-6459-45a3-b130-2612a32c172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:36:02.230036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-ce93fde3-6459-45a3-b130-2612a32c172d None None] MFA Rules not processed for user `f0203027cfe84e548c0b541f545585a1`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:36:02.231237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-ce93fde3-6459-45a3-b130-2612a32c172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:36:02.238084 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4373/8655] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:36:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:36:02.277016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:36:02.278603 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:36:02.352446 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de46fa-27e5-4cc8-a648-1c97b1fa89a1 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:36:02.356482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:36:02.357182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:36:02.357487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:36:02.357798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:36:02.359660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:36:02.377723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:36:02.379190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:36:02.393076 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4283/8656] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:36:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:36:07.772279 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93fde3-6459-45a3-b130-2612a32c172d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:36:07.785500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93fde3-6459-45a3-b130-2612a32c172d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:36:07.790132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5937355-6782-4f94-8f66-5f3e4ae2db1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:36:07.790790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937355-6782-4f94-8f66-5f3e4ae2db1e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:36:07.791070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937355-6782-4f94-8f66-5f3e4ae2db1e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:36:07.791331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937355-6782-4f94-8f66-5f3e4ae2db1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:36:07.793451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b5937355-6782-4f94-8f66-5f3e4ae2db1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:36:07.820980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5937355-6782-4f94-8f66-5f3e4ae2db1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:36:07.822464 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5937355-6782-4f94-8f66-5f3e4ae2db1e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:36:07.832794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4374/8657] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:36:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:36:13.185218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:36:13.197652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1911854-57e0-4f38-bc13-d1e41d98b32e service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:36:13.202781 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:36:13.203443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:36:13.203728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:36:13.203999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:36:13.206160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:36:13.219522 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:36:13.220980 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:36:13.232622 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4284/8658] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:36:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:37:08.911832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb2f4-0e96-4c39-a4ce-3a7791056ecb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:37:08.912423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb2f4-0e96-4c39-a4ce-3a7791056ecb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:37:08.912423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb2f4-0e96-4c39-a4ce-3a7791056ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:37:08.929935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-971cb2f4-0e96-4c39-a4ce-3a7791056ecb None None] MFA Rules not processed for user `f0203027cfe84e548c0b541f545585a1`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:37:08.931807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-971cb2f4-0e96-4c39-a4ce-3a7791056ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:37:08.945621 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4375/8659] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:37:52.688337 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:37:52.689806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:37:52.724526 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2e2c-78be-4413-be62-80a0783f609f service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:37:52.730578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487225d-1275-4ff5-90b8-e071900a3fbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:37:52.731222 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487225d-1275-4ff5-90b8-e071900a3fbe service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:37:52.731514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487225d-1275-4ff5-90b8-e071900a3fbe service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:37:52.731768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487225d-1275-4ff5-90b8-e071900a3fbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:37:52.733746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d487225d-1275-4ff5-90b8-e071900a3fbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:37:52.749464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487225d-1275-4ff5-90b8-e071900a3fbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:37:52.751178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487225d-1275-4ff5-90b8-e071900a3fbe service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:37:52.765021 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4285/8660] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:37:59.786477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cb2f4-0e96-4c39-a4ce-3a7791056ecb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:37:59.869444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cb2f4-0e96-4c39-a4ce-3a7791056ecb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:37:59.874597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:37:59.875609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:37:59.876016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:37:59.876390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] PATH_INFO: `/v3/users/f0203027cfe84e548c0b541f545585a1` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:37:59.877738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0203027cfe84e548c0b541f545585a1)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:37:59.879843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:37:59.946145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0203027cfe84e548c0b541f545585a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:37:59.947499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0203027cfe84e548c0b541f545585a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:37:59.955639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0203027cfe84e548c0b541f545585a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:37:59.969569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0203027cfe84e548c0b541f545585a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:37:59.970319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0203027cfe84e548c0b541f545585a1'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:37:59.995794 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4376/8661] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:37:59 2022] DELETE /identity/v3/users/f0203027cfe84e548c0b541f545585a1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:37:59.997544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:37:59.998024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:37:59.998374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:00.045406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:00.050177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:00.129769 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4286/8662] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:00.139775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:00.141234 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:00.215629 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a65d-093f-4857-a9dd-41f365838da5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:00.220874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:00.221950 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:00.222382 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:00.222898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:00.234110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:00.235589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:00.246304 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4377/8663] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:38:00.427975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:00.429426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:00.441902 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aedf86-b835-44ee-84f2-e07d5f9668c5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:00.455717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:00.456991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:00.457512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:00.458302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] PATH_INFO: `/v3/projects/2307958edd534abb847445b0e1dd954d` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:00.460859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2307958edd534abb847445b0e1dd954d)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:00.470757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:00.531528 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2307958edd534abb847445b0e1dd954d', 'request_id': 'req-eea939e4-1c44-409f-9312-1fc6deb021b2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.538080 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2307958edd534abb847445b0e1dd954d', 'request_id': 'req-eea939e4-1c44-409f-9312-1fc6deb021b2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.547883 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2307958edd534abb847445b0e1dd954d', 'request_id': 'req-eea939e4-1c44-409f-9312-1fc6deb021b2'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.569316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] The token cache is being invalidate because project 2307958edd534abb847445b0e1dd954d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:38:00.570104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.571457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.573124 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4287/8664] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:38:00 2022] DELETE /identity/v3/projects/2307958edd534abb847445b0e1dd954d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:00.577227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:00.586893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb90a-b13c-4c60-9246-68c486fc8d67 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:00.644816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:00.645812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:00.646079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:00.646359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] PATH_INFO: `/v3/users/2a824bdb82f142c892b659415a866e33` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:00.647604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a824bdb82f142c892b659415a866e33)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:00.649597 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:00.698429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a824bdb82f142c892b659415a866e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.699146 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a824bdb82f142c892b659415a866e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.706425 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a824bdb82f142c892b659415a866e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.715423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a824bdb82f142c892b659415a866e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.716237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a824bdb82f142c892b659415a866e33'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:00.734032 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4378/8665] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:38:00 2022] DELETE /identity/v3/users/2a824bdb82f142c892b659415a866e33 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:01.366333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:01.367873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:01.382032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea939e4-1c44-409f-9312-1fc6deb021b2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:01.445832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:01.446735 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:01.447021 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:01.447299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] PATH_INFO: `/v3/projects/267e9b3492cf43bd818a3edd86f80b25` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:01.448540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=267e9b3492cf43bd818a3edd86f80b25)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:01.450518 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:01.498938 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267e9b3492cf43bd818a3edd86f80b25', 'request_id': 'req-4590e4e7-db53-48bf-964f-ff935dd9a80b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:01.504243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267e9b3492cf43bd818a3edd86f80b25', 'request_id': 'req-4590e4e7-db53-48bf-964f-ff935dd9a80b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:01.513515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267e9b3492cf43bd818a3edd86f80b25', 'request_id': 'req-4590e4e7-db53-48bf-964f-ff935dd9a80b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:01.526447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] The token cache is being invalidate because project 267e9b3492cf43bd818a3edd86f80b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:38:01.526731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:01.527539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:01.529441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4288/8666] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:38:01 2022] DELETE /identity/v3/projects/267e9b3492cf43bd818a3edd86f80b25 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:05.679856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:05.681414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:05.742935 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394ede-9711-451e-918b-7e56020067a8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:05.794194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:05.794863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:05.795138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:05.795389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:05.797574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:05.862177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:05.863648 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:05.873498 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4379/8667] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:09.408192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:09.409851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:09.502573 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e4e7-db53-48bf-964f-ff935dd9a80b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:09.507804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:09.508462 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:09.508739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:09.509012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:09.510807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:09.524569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:09.526176 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:09.538344 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4289/8668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:12.262630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:12.264173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:12.277775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0b41-758f-40db-85ca-bf9c2e61e4f4 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:12.283559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:12.284454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:12.284745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:12.285012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] PATH_INFO: `/v3/users/2e9bbd737ff54225a549f072976ef296` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:12.286285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9bbd737ff54225a549f072976ef296)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:12.288328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:12.339787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9bbd737ff54225a549f072976ef296'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.340456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9bbd737ff54225a549f072976ef296'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.347451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9bbd737ff54225a549f072976ef296'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.357026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9bbd737ff54225a549f072976ef296'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.357910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9bbd737ff54225a549f072976ef296'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.375219 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4380/8669] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:38:12 2022] DELETE /identity/v3/users/2e9bbd737ff54225a549f072976ef296 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:12.572491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:12.583398 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a324-359f-4015-ba16-bffa2cefccce service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:12.642231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:12.643216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:12.643491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:12.643762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] PATH_INFO: `/v3/projects/5e1063334e4a426eb70eec5ed1578744` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:12.645109 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1063334e4a426eb70eec5ed1578744)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:12.647073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:12.696361 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1063334e4a426eb70eec5ed1578744', 'request_id': 'req-55629f9c-87f1-4923-a12e-53364d8f95be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.701491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1063334e4a426eb70eec5ed1578744', 'request_id': 'req-55629f9c-87f1-4923-a12e-53364d8f95be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.710502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1063334e4a426eb70eec5ed1578744', 'request_id': 'req-55629f9c-87f1-4923-a12e-53364d8f95be'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.720999 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] The token cache is being invalidate because project 5e1063334e4a426eb70eec5ed1578744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:38:12.721311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.721926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.723476 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4290/8670] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:38:12 2022] DELETE /identity/v3/projects/5e1063334e4a426eb70eec5ed1578744 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:38:12.727788 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:12.729336 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:12.743786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e306b7-36b6-4b63-898d-0df10fbb5038 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:12.802712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:12.803522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:12.803863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:12.804134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] PATH_INFO: `/v3/users/187354a71c68448283879970b388063c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:12.805526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187354a71c68448283879970b388063c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:12.807515 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:12.857138 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187354a71c68448283879970b388063c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.857854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187354a71c68448283879970b388063c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.865247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187354a71c68448283879970b388063c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.874941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187354a71c68448283879970b388063c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.875655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7fbe1c82-03aa-4dcb-a1e4-a1facfb03c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187354a71c68448283879970b388063c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:12.892408 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4381/8671] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:38:12 2022] DELETE /identity/v3/users/187354a71c68448283879970b388063c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:13.073880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:13.075397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:13.089192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55629f9c-87f1-4923-a12e-53364d8f95be admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:13.146478 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:13.147371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:13.147660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:13.147935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] PATH_INFO: `/v3/projects/ec99183f7ad64fb18fcc3672cc0375e5` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:13.149161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec99183f7ad64fb18fcc3672cc0375e5)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:13.151092 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:13.197495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec99183f7ad64fb18fcc3672cc0375e5', 'request_id': 'req-f077f624-a9f7-408d-809d-b783ddbdd6ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:13.202838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec99183f7ad64fb18fcc3672cc0375e5', 'request_id': 'req-f077f624-a9f7-408d-809d-b783ddbdd6ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:13.212565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec99183f7ad64fb18fcc3672cc0375e5', 'request_id': 'req-f077f624-a9f7-408d-809d-b783ddbdd6ce'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:13.226166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] The token cache is being invalidate because project ec99183f7ad64fb18fcc3672cc0375e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:38:13.226542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:13.227608 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f077f624-a9f7-408d-809d-b783ddbdd6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:13.230262 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4291/8672] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:38:13 2022] DELETE /identity/v3/projects/ec99183f7ad64fb18fcc3672cc0375e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:23.606781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9581-cb1f-42e0-9761-6a32baaa3687 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:23.607419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9581-cb1f-42e0-9761-6a32baaa3687 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:23.607419 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9581-cb1f-42e0-9761-6a32baaa3687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:23.665370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3fac9581-cb1f-42e0-9761-6a32baaa3687 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:23.666577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3fac9581-cb1f-42e0-9761-6a32baaa3687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:23.730496 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4382/8673] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:23.741378 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec6e7-1074-4603-afa9-04f7ac68165e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:23.741932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec6e7-1074-4603-afa9-04f7ac68165e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:23.742067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec6e7-1074-4603-afa9-04f7ac68165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:23.761749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-33aec6e7-1074-4603-afa9-04f7ac68165e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:23.762961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-33aec6e7-1074-4603-afa9-04f7ac68165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:23.771145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4292/8674] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:23.775933 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac9581-cb1f-42e0-9761-6a32baaa3687 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:23.785850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac9581-cb1f-42e0-9761-6a32baaa3687 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:23.790548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:23.791214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:23.791496 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:23.791771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:23.792501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:38:23.792810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:23.794478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:23.806065 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4383/8675] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:38:23.815276 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec6e7-1074-4603-afa9-04f7ac68165e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:23.825303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec6e7-1074-4603-afa9-04f7ac68165e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:23.830992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:23.831651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:23.831928 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:23.832203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:23.832891 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:23.834840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:23.863940 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4293/8676] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:38:23 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:38:23.868339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:23.878816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6de00-c4c8-41b1-8323-f53ac52a069a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:23.937307 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:23.937988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:23.938263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:23.938537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:23.939222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:23.941186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:23.962873 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4384/8677] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:38:23 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:38:23.967416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:23.978381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2083d6-17aa-4520-895d-89dae4e97335 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:23.983633 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:23.984234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:23.984514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:23.984787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:23.985570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:23.987208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:23.998232 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4294/8678] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:38:24.002254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.012385 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662fa2-d2bc-4495-9d65-3feb6377f9ad admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.017443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84481bf-4b0f-4bb3-be92-7def02915d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.018110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84481bf-4b0f-4bb3-be92-7def02915d81 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.018400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84481bf-4b0f-4bb3-be92-7def02915d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.018657 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84481bf-4b0f-4bb3-be92-7def02915d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.019401 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84481bf-4b0f-4bb3-be92-7def02915d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.021011 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84481bf-4b0f-4bb3-be92-7def02915d81 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.030970 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4385/8679] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:38:24.035293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.045508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5b54-4847-4143-86a3-2e33d0f5040e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.050537 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.051409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.051685 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.051952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] PATH_INFO: `/v3/projects/c029d816337b4a5d97fa5fc881203e5f/users/bcd63823db1446db8425ef68cc834956/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.067678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c029d816337b4a5d97fa5fc881203e5f, user_id=bcd63823db1446db8425ef68cc834956, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.070847 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.087244 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4295/8680] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:38:24 2022] PUT /identity/v3/projects/c029d816337b4a5d97fa5fc881203e5f/users/bcd63823db1446db8425ef68cc834956/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:24.103645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc274-cd18-4faf-a1c9-e46c46a2884f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.103974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc274-cd18-4faf-a1c9-e46c46a2884f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.104243 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc274-cd18-4faf-a1c9-e46c46a2884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.132069 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fe3bc274-cd18-4faf-a1c9-e46c46a2884f None None] MFA Rules not processed for user `bcd63823db1446db8425ef68cc834956`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:24.133426 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fe3bc274-cd18-4faf-a1c9-e46c46a2884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:24.206593 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4386/8681] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:24.212833 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.275174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e59ec-8ff3-4b07-83ea-18c12fc17390 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.280420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.281070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.281381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.281650 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.282342 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.284272 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.311310 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4296/8682] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:38:24 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:38:24.315525 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc274-cd18-4faf-a1c9-e46c46a2884f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.326645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc274-cd18-4faf-a1c9-e46c46a2884f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.394416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.395075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.395357 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.395632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.396314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.398323 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.420387 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4387/8683] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:38:24 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:38:24.424693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.435313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2fae0-43a7-4f0d-a700-ea426c5c5154 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.440461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.441728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.441728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.441728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.442442 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.444400 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.455990 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4297/8684] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:38:24.460380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.470468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be9399-9bca-4dbc-8d7e-dc91ca829059 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.475961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.476877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.477189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.477460 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] PATH_INFO: `/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6/users/d4335119f9aa45cbae9193e2df99a25c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.491908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddc9f4e4ff74c56b88bd20d4e303bf6, user_id=d4335119f9aa45cbae9193e2df99a25c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.494583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.513075 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4388/8685] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:38:24 2022] PUT /identity/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6/users/d4335119f9aa45cbae9193e2df99a25c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:24.518886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.530020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6776d-f1bd-4f9a-8f56-c68be9cbe21a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.590722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620eab-a4f4-49c6-8b77-4ff7056bbb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.591388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620eab-a4f4-49c6-8b77-4ff7056bbb2a admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.591662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620eab-a4f4-49c6-8b77-4ff7056bbb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.591932 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620eab-a4f4-49c6-8b77-4ff7056bbb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.592674 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620eab-a4f4-49c6-8b77-4ff7056bbb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.594306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620eab-a4f4-49c6-8b77-4ff7056bbb2a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.605417 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4298/8686] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:38:24.610551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.621725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfcc7c-51dc-4cf2-9b84-ff2980420a24 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.626781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead1176-155e-4275-8569-d44383cf391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.627676 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead1176-155e-4275-8569-d44383cf391d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.627947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead1176-155e-4275-8569-d44383cf391d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.628211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead1176-155e-4275-8569-d44383cf391d admin admin] PATH_INFO: `/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6/users/d4335119f9aa45cbae9193e2df99a25c/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.630253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead1176-155e-4275-8569-d44383cf391d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddc9f4e4ff74c56b88bd20d4e303bf6, user_id=d4335119f9aa45cbae9193e2df99a25c, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.632894 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead1176-155e-4275-8569-d44383cf391d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.643196 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4389/8687] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:38:24 2022] PUT /identity/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6/users/d4335119f9aa45cbae9193e2df99a25c/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:24.654744 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.655146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.655426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.683746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] MFA Rules not processed for user `d4335119f9aa45cbae9193e2df99a25c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:24.684962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:24.754450 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4299/8688] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:24.767437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.767751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.768119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.793961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] MFA Rules not processed for user `bcd63823db1446db8425ef68cc834956`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:24.795163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:24.851472 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4390/8689] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:24.863678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:24.865260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:24.946410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6608a0-913e-42e2-871b-de0c14b9c481 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:24.952824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:24.953516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:24.953795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:24.954063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:24.962989 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:24.964604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:24.973809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4300/8690] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:26.818091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:26.820513 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:26.902052 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb864d-f0c2-4656-aed2-c26b40c00afe None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:26.907091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:26.907758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:26.908091 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:26.908372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:26.910244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:26.924599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:26.926443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:26.939476 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4391/8691] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:36.550491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:36.565239 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1b648-a945-44de-b122-f1abe49bbe8a service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:36.572026 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb285e6-668e-4aa3-a960-3f2d2648a2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:36.572683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb285e6-668e-4aa3-a960-3f2d2648a2ac service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:36.572972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb285e6-668e-4aa3-a960-3f2d2648a2ac service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:36.573266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb285e6-668e-4aa3-a960-3f2d2648a2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:36.575163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-dbb285e6-668e-4aa3-a960-3f2d2648a2ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:36.590469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb285e6-668e-4aa3-a960-3f2d2648a2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:36.592262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb285e6-668e-4aa3-a960-3f2d2648a2ac service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:36.605573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4301/8692] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:38.547359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:38.549659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:38.571699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7a16-4b98-4fa8-a6c9-bc893895016e service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:38.578793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:38.579442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:38.579721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:38.579985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:38.588372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:38.590012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:38.599632 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4392/8693] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:38.613947 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706639b-2b14-4bc0-b84a-e5d901cb51e0 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:38.614427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706639b-2b14-4bc0-b84a-e5d901cb51e0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:38.614427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706639b-2b14-4bc0-b84a-e5d901cb51e0 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:38.615797 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4302/8694] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:38:38.620352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] Authenticating service token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:38:38.634081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:38.642364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58be26-570e-4bd4-91be-e269ab75b619 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:38.647443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bee81f-9c23-4cef-ac5f-8e46da78eef7 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4335119f9aa45cbae9193e2df99a25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ddc9f4e4ff74c56b88bd20d4e303bf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:38.648303 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bee81f-9c23-4cef-ac5f-8e46da78eef7 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:38.648579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bee81f-9c23-4cef-ac5f-8e46da78eef7 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:38.648850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bee81f-9c23-4cef-ac5f-8e46da78eef7 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] PATH_INFO: `/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:38.650113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bee81f-9c23-4cef-ac5f-8e46da78eef7 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] RBAC: Authorizing `identity:get_project(project_id=3ddc9f4e4ff74c56b88bd20d4e303bf6)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:38.651908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bee81f-9c23-4cef-ac5f-8e46da78eef7 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:38.653689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4393/8695] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:38:38 2022] GET /identity/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6 => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 09 21:38:38.811191 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706639b-2b14-4bc0-b84a-e5d901cb51e0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:38.813072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c706639b-2b14-4bc0-b84a-e5d901cb51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:38.876354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706639b-2b14-4bc0-b84a-e5d901cb51e0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:38.880335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:38.880983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:38.881289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:38.881565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:38.883371 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:38.895331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:38.896760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:38.907231 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4303/8696] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:39.053615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14af0a-d192-4520-a538-3a6aa4af3923 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:39.053971 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14af0a-d192-4520-a538-3a6aa4af3923 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:39.054360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14af0a-d192-4520-a538-3a6aa4af3923 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:39.057072 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4394/8697] 10.222.0.30 () {54 vars in 912 bytes} [Sat Apr 9 21:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:38:39.062653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] Authenticating service token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 09 21:38:39.079129 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:39.088748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9256-61b6-4eb9-8a05-f8180fc82d5f service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:39.093427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5834d-46c3-49a8-ac34-de914ffaa02e tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4335119f9aa45cbae9193e2df99a25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ddc9f4e4ff74c56b88bd20d4e303bf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:39.094289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5834d-46c3-49a8-ac34-de914ffaa02e tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:39.094566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5834d-46c3-49a8-ac34-de914ffaa02e tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:39.094831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5834d-46c3-49a8-ac34-de914ffaa02e tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] PATH_INFO: `/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:39.096036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5834d-46c3-49a8-ac34-de914ffaa02e tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] RBAC: Authorizing `identity:get_project(project_id=3ddc9f4e4ff74c56b88bd20d4e303bf6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:39.097862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5834d-46c3-49a8-ac34-de914ffaa02e tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:39.099584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4304/8698] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Apr 9 21:38:39 2022] GET /identity/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6 => generated 391 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:38:42.003775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14af0a-d192-4520-a538-3a6aa4af3923 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:42.078988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14af0a-d192-4520-a538-3a6aa4af3923 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:42.084963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:42.085902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:42.086123 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:42.086398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] PATH_INFO: `/v3/users/bcd63823db1446db8425ef68cc834956` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:42.087669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd63823db1446db8425ef68cc834956)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:42.089651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:42.138499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd63823db1446db8425ef68cc834956'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.139261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd63823db1446db8425ef68cc834956'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.146402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd63823db1446db8425ef68cc834956'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.155735 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd63823db1446db8425ef68cc834956'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.156452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd63823db1446db8425ef68cc834956'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.173720 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4395/8699] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:38:42 2022] DELETE /identity/v3/users/bcd63823db1446db8425ef68cc834956 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:42.178617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:42.179104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:42.179201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:42.198409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:42.199592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:42.259079 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4305/8700] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:42.269563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:42.271343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:42.335949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd50e-0ec5-46a6-be3f-bd6bead09202 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:42.340194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:42.340856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:42.341167 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:42.341437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:42.351937 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:42.353439 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:42.363309 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4396/8701] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:42.555417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:42.557156 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:42.569787 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d427bd-d02e-472d-a36b-33046c75ac36 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:42.575297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:42.576183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:42.576448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:42.576714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] PATH_INFO: `/v3/projects/c029d816337b4a5d97fa5fc881203e5f` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:42.578219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c029d816337b4a5d97fa5fc881203e5f)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:42.580374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:42.633452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c029d816337b4a5d97fa5fc881203e5f', 'request_id': 'req-abe49164-fd1a-4cde-95ed-bea139c1fb57'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.638854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c029d816337b4a5d97fa5fc881203e5f', 'request_id': 'req-abe49164-fd1a-4cde-95ed-bea139c1fb57'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.648495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c029d816337b4a5d97fa5fc881203e5f', 'request_id': 'req-abe49164-fd1a-4cde-95ed-bea139c1fb57'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.659925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] The token cache is being invalidate because project c029d816337b4a5d97fa5fc881203e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:38:42.660209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.660901 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.662574 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4306/8702] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:38:42 2022] DELETE /identity/v3/projects/c029d816337b4a5d97fa5fc881203e5f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:42.666730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:42.676862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a43f-12e0-4efc-8188-f8e10a1dd1a6 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:42.734453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:42.735335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:42.735605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:42.735868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] PATH_INFO: `/v3/users/d4335119f9aa45cbae9193e2df99a25c` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:42.737195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4335119f9aa45cbae9193e2df99a25c)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:42.739160 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:42.792759 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4335119f9aa45cbae9193e2df99a25c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.793841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4335119f9aa45cbae9193e2df99a25c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.801583 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4335119f9aa45cbae9193e2df99a25c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.810772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4335119f9aa45cbae9193e2df99a25c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.811580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-38201e27-e730-434f-bce9-967b0b4089d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4335119f9aa45cbae9193e2df99a25c'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:42.828767 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4397/8703] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:38:42 2022] DELETE /identity/v3/users/d4335119f9aa45cbae9193e2df99a25c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:43.116880 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.118434 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:43.131372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe49164-fd1a-4cde-95ed-bea139c1fb57 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.189180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.190081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.190359 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.190628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] PATH_INFO: `/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.191825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddc9f4e4ff74c56b88bd20d4e303bf6)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.194120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.240874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddc9f4e4ff74c56b88bd20d4e303bf6', 'request_id': 'req-9f0b2d3a-c733-4534-9047-408032e5c0a6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:43.246823 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddc9f4e4ff74c56b88bd20d4e303bf6', 'request_id': 'req-9f0b2d3a-c733-4534-9047-408032e5c0a6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:43.256062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddc9f4e4ff74c56b88bd20d4e303bf6', 'request_id': 'req-9f0b2d3a-c733-4534-9047-408032e5c0a6'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:43.268035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] The token cache is being invalidate because project 3ddc9f4e4ff74c56b88bd20d4e303bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:38:43.268315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:43.268964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-9f0b2d3a-c733-4534-9047-408032e5c0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:38:43.270724 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4307/8704] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:38:43 2022] DELETE /identity/v3/projects/3ddc9f4e4ff74c56b88bd20d4e303bf6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:43.277024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb49f02-0abb-4cd3-868b-2ef830733de9 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.277625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb49f02-0abb-4cd3-868b-2ef830733de9 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.277625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb49f02-0abb-4cd3-868b-2ef830733de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.296021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-fcb49f02-0abb-4cd3-868b-2ef830733de9 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:43.297276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-fcb49f02-0abb-4cd3-868b-2ef830733de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:43.356258 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4398/8705] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:43.364854 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3baea8-e656-453f-9767-ec6db10f3a11 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.365171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3baea8-e656-453f-9767-ec6db10f3a11 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.365447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3baea8-e656-453f-9767-ec6db10f3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.384022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6d3baea8-e656-453f-9767-ec6db10f3a11 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:43.385343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6d3baea8-e656-453f-9767-ec6db10f3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:43.394557 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4308/8706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:38:43.399046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb49f02-0abb-4cd3-868b-2ef830733de9 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.409944 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb49f02-0abb-4cd3-868b-2ef830733de9 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.416416 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.417077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.417361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.417632 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.418359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:38:43.418665 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.420345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.432893 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4399/8707] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:38:43.437439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3baea8-e656-453f-9767-ec6db10f3a11 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.448764 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3baea8-e656-453f-9767-ec6db10f3a11 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.454689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.455373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.455637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.455908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.456598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.458555 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.488818 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4309/8708] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:38:43 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:38:43.494579 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.507940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdff1c-0310-4763-875b-3fc163a0ff27 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.570081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.570771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.571076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.571348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.572035 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.574058 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.601263 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4400/8709] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:38:43 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:38:43.605535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.616495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379642-ac27-46a2-829c-9397def42597 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.622102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.622770 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.623053 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.623320 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.624068 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.625709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.638634 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4310/8710] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:38:43.643070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.653673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862032f-4978-488e-baad-d0cf2318e3dd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.659309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c511d-898d-4945-87bd-a35617a678af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.659980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c511d-898d-4945-87bd-a35617a678af admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.660253 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c511d-898d-4945-87bd-a35617a678af admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.660649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c511d-898d-4945-87bd-a35617a678af admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.663569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c511d-898d-4945-87bd-a35617a678af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.663569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c511d-898d-4945-87bd-a35617a678af admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.674428 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4401/8711] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:38:43.678175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.688820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e465e18-7920-4e32-ae3c-6bd479823994 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.694089 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.694975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.695249 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.695519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] PATH_INFO: `/v3/projects/8c47c6b05b064cc6b8e62b875f3a9450/users/36f5c38ad8044ad7a21c100af55f9fe7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.709575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c47c6b05b064cc6b8e62b875f3a9450, user_id=36f5c38ad8044ad7a21c100af55f9fe7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.712220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.727780 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4311/8712] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:38:43 2022] PUT /identity/v3/projects/8c47c6b05b064cc6b8e62b875f3a9450/users/36f5c38ad8044ad7a21c100af55f9fe7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:38:43.733056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2fcb0-791f-4c8f-8265-eff84545a740 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.733381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2fcb0-791f-4c8f-8265-eff84545a740 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.733663 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2fcb0-791f-4c8f-8265-eff84545a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.752789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0bb2fcb0-791f-4c8f-8265-eff84545a740 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:43.754053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0bb2fcb0-791f-4c8f-8265-eff84545a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:43.820729 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4402/8713] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:43.830690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:43.832483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:43.892146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7512b06-3a28-4ed8-855a-c856de795870 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:43.896846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854ac30-f31e-45ed-9c96-31f8d150bd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:43.897548 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ac30-f31e-45ed-9c96-31f8d150bd7b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:43.897831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ac30-f31e-45ed-9c96-31f8d150bd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:43.898105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ac30-f31e-45ed-9c96-31f8d150bd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:43.908427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854ac30-f31e-45ed-9c96-31f8d150bd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:43.909908 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854ac30-f31e-45ed-9c96-31f8d150bd7b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:43.919850 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4312/8714] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:38:44.564890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:44.565494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:44.565494 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:44.593415 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] MFA Rules not processed for user `36f5c38ad8044ad7a21c100af55f9fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:44.594904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:44.662942 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4403/8715] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:44.674312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:44.674893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:44.674893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:44.692356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] MFA Rules not processed for user `36f5c38ad8044ad7a21c100af55f9fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:44.693864 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:44.701472 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4313/8716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:38:44.717712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:44.719182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:44.794447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbbc45-925e-477f-a5e8-856c1cfd40cb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:44.800144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3ae1-d49f-4065-be0b-bde36fe0fda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:44.800798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3ae1-d49f-4065-be0b-bde36fe0fda4 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:44.801104 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3ae1-d49f-4065-be0b-bde36fe0fda4 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:44.801376 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3ae1-d49f-4065-be0b-bde36fe0fda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:44.809086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3ae1-d49f-4065-be0b-bde36fe0fda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:44.810815 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3ae1-d49f-4065-be0b-bde36fe0fda4 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:44.819889 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4404/8717] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:55.078124 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:55.079613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:55.095260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cb202-ea32-4063-af83-2ea8fdcd7928 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:55.099552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdac01-516b-40eb-858c-9f18f618d71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:55.100341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdac01-516b-40eb-858c-9f18f618d71f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:55.100647 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdac01-516b-40eb-858c-9f18f618d71f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:55.100918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdac01-516b-40eb-858c-9f18f618d71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:55.102739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26cdac01-516b-40eb-858c-9f18f618d71f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:55.115013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdac01-516b-40eb-858c-9f18f618d71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:55.116467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdac01-516b-40eb-858c-9f18f618d71f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:55.127112 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4314/8718] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:55.216181 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ec2ac-a17b-47b8-a302-9133bb6f9e1a None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:55.216785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ec2ac-a17b-47b8-a302-9133bb6f9e1a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:55.216785 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ec2ac-a17b-47b8-a302-9133bb6f9e1a None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:55.218241 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4405/8719] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:38:55.223061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71cb21-c8f4-4282-8748-b7f7aa4fc2ae None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:55.223355 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71cb21-c8f4-4282-8748-b7f7aa4fc2ae None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:55.223639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71cb21-c8f4-4282-8748-b7f7aa4fc2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:55.268473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5f71cb21-c8f4-4282-8748-b7f7aa4fc2ae None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:38:55.269723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5f71cb21-c8f4-4282-8748-b7f7aa4fc2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:55.335440 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4315/8720] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:38:55.356077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ec2ac-a17b-47b8-a302-9133bb6f9e1a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:55.357844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3f5ec2ac-a17b-47b8-a302-9133bb6f9e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:55.376975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ec2ac-a17b-47b8-a302-9133bb6f9e1a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:55.382126 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:55.382766 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:55.383040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:55.383306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:55.393919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:55.395551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:55.405729 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4406/8721] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:38:55.575511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71cb21-c8f4-4282-8748-b7f7aa4fc2ae None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:38:55.587598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71cb21-c8f4-4282-8748-b7f7aa4fc2ae None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:38:55.591831 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:38:55.592584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:38:55.592871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:38:55.593217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:38:55.595482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:38:55.613345 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:38:55.614763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:38:55.628212 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4316/8722] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:38:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:39:07.108843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:07.122353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c573e-e13f-47b0-bb39-d2a35c31bcef service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:07.128794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:07.129481 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:07.129805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:07.130082 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:07.132229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:07.147192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:07.148796 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:07.161329 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4407/8723] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:39:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:39:24.440413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:24.442439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:24.459309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42042bda-ad8a-4551-8a86-5532e8e0b025 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:24.465243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:24.465940 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:24.466241 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:24.466517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:24.468502 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:24.483468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:24.485742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:24.500410 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4317/8724] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:39:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:39:33.009615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.020604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431fda-ff57-4888-a5ac-3a6e26314b92 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.026018 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.027156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.027367 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.027647 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] PATH_INFO: `/v3/users/36f5c38ad8044ad7a21c100af55f9fe7` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.029587 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f5c38ad8044ad7a21c100af55f9fe7)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.032786 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.084562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f5c38ad8044ad7a21c100af55f9fe7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.085265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f5c38ad8044ad7a21c100af55f9fe7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.092700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f5c38ad8044ad7a21c100af55f9fe7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.101868 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f5c38ad8044ad7a21c100af55f9fe7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.102584 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-283104e9-94c2-4739-a48d-c077dcf4e01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f5c38ad8044ad7a21c100af55f9fe7'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.119607 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4408/8725] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:39:33 2022] DELETE /identity/v3/users/36f5c38ad8044ad7a21c100af55f9fe7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:39:33.304832 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.316046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dd9e3-18e8-48e9-a292-b665d1b77038 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.374776 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.375643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.375924 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.376200 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] PATH_INFO: `/v3/projects/8c47c6b05b064cc6b8e62b875f3a9450` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.377444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c47c6b05b064cc6b8e62b875f3a9450)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.379368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.431440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c47c6b05b064cc6b8e62b875f3a9450', 'request_id': 'req-b1876e5d-cdb1-4aba-96d3-282079d0647d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.437028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c47c6b05b064cc6b8e62b875f3a9450', 'request_id': 'req-b1876e5d-cdb1-4aba-96d3-282079d0647d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.447148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c47c6b05b064cc6b8e62b875f3a9450', 'request_id': 'req-b1876e5d-cdb1-4aba-96d3-282079d0647d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.459755 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] The token cache is being invalidate because project 8c47c6b05b064cc6b8e62b875f3a9450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:39:33.460049 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.460712 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-b1876e5d-cdb1-4aba-96d3-282079d0647d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:39:33.462344 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4318/8726] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:39:33 2022] DELETE /identity/v3/projects/8c47c6b05b064cc6b8e62b875f3a9450 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:39:33.467600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22800c4a-e3a1-45dd-b35a-6587d96efbc3 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.467887 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22800c4a-e3a1-45dd-b35a-6587d96efbc3 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.468163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22800c4a-e3a1-45dd-b35a-6587d96efbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.486315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-22800c4a-e3a1-45dd-b35a-6587d96efbc3 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:39:33.487436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-22800c4a-e3a1-45dd-b35a-6587d96efbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:33.548217 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4409/8727] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:39:33.557076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947bd50-54d1-4249-9681-362be86e7370 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.557374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947bd50-54d1-4249-9681-362be86e7370 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.557690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947bd50-54d1-4249-9681-362be86e7370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.576751 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9947bd50-54d1-4249-9681-362be86e7370 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:39:33.578106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9947bd50-54d1-4249-9681-362be86e7370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:33.586685 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4319/8728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:39:33.590965 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22800c4a-e3a1-45dd-b35a-6587d96efbc3 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.601519 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22800c4a-e3a1-45dd-b35a-6587d96efbc3 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.606687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.607414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.607692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.607980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.608910 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:39:33.609304 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.611186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.623175 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4410/8729] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:39:33.627643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947bd50-54d1-4249-9681-362be86e7370 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.637205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947bd50-54d1-4249-9681-362be86e7370 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.642599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.643260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.643541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.643796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.644480 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.646424 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.673932 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4320/8730] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:39:33 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:39:33.678302 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.688471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0379-2051-46cc-8a44-6c1a462d2c03 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.749193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.749791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.750070 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.750352 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.751071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.753145 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.776723 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4411/8731] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:39:33 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:39:33.782311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.794238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed336d6c-6a41-42c5-bf75-1e8101ddcf38 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.800365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.801067 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.801353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.801629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.802358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.803985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.815407 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4321/8732] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:39:33.820255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.832985 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c08730-1cf4-437b-9aba-78506de260e7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.841263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b3a4c-ad17-4d42-9866-ac188b245c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.842361 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b3a4c-ad17-4d42-9866-ac188b245c24 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.842645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b3a4c-ad17-4d42-9866-ac188b245c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.842918 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b3a4c-ad17-4d42-9866-ac188b245c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.843650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b3a4c-ad17-4d42-9866-ac188b245c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.845320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b3a4c-ad17-4d42-9866-ac188b245c24 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.859456 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4412/8733] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:39:33.860727 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:33.872007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d78a91-2fdc-481c-ba2b-68a4b1cc91c0 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:33.877595 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:33.878519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.878800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.879070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] PATH_INFO: `/v3/projects/3b7ac04d687340c8a08ac58bdde56a67/users/ef047f7b0e534c059c06045004189775/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.894726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7ac04d687340c8a08ac58bdde56a67, user_id=ef047f7b0e534c059c06045004189775, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:33.897529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:33.913247 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4322/8734] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:39:33 2022] PUT /identity/v3/projects/3b7ac04d687340c8a08ac58bdde56a67/users/ef047f7b0e534c059c06045004189775/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:39:33.918661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16738ed-bc48-4f1a-9c70-b049cb4257a0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:33.918962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16738ed-bc48-4f1a-9c70-b049cb4257a0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:33.919254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16738ed-bc48-4f1a-9c70-b049cb4257a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:33.938321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a16738ed-bc48-4f1a-9c70-b049cb4257a0 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:39:33.939539 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a16738ed-bc48-4f1a-9c70-b049cb4257a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:33.999762 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4413/8735] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:39:34.009790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:34.011866 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:34.072149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d89f44-5266-4011-bedb-2423820b5d7b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:34.076147 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9e377-6b9a-43e6-b5ee-f2c90e8c9c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:34.076804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9e377-6b9a-43e6-b5ee-f2c90e8c9c52 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:34.077228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9e377-6b9a-43e6-b5ee-f2c90e8c9c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:34.077614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9e377-6b9a-43e6-b5ee-f2c90e8c9c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:34.087388 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9e377-6b9a-43e6-b5ee-f2c90e8c9c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:34.088875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9e377-6b9a-43e6-b5ee-f2c90e8c9c52 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:34.098806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4323/8736] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:39:34.753116 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:34.753650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:34.753650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:34.781172 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] MFA Rules not processed for user `ef047f7b0e534c059c06045004189775`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:39:34.782345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:34.848774 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4414/8737] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:39:34.859559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918551f7-a31c-4ef3-acca-82ac888f95ef None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:34.860100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918551f7-a31c-4ef3-acca-82ac888f95ef None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:34.860100 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918551f7-a31c-4ef3-acca-82ac888f95ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:34.878014 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-918551f7-a31c-4ef3-acca-82ac888f95ef None None] MFA Rules not processed for user `ef047f7b0e534c059c06045004189775`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:39:34.879215 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-918551f7-a31c-4ef3-acca-82ac888f95ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:34.886630 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4324/8738] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:39:34.897475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:34.899453 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:34.976309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dc414-e435-4bd0-b00c-f03a25cd976e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:34.982174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6309-378a-4838-b93f-b6e545b9872d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:34.982844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6309-378a-4838-b93f-b6e545b9872d service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:34.983124 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6309-378a-4838-b93f-b6e545b9872d service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:34.983400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6309-378a-4838-b93f-b6e545b9872d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:34.992370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6309-378a-4838-b93f-b6e545b9872d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:34.994173 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6309-378a-4838-b93f-b6e545b9872d service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:35.003886 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4415/8739] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:39:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:39:47.103381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7442cb-399d-446a-9c4b-357c9d551a1f None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:47.103996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7442cb-399d-446a-9c4b-357c9d551a1f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:47.103996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7442cb-399d-446a-9c4b-357c9d551a1f None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:47.105340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4325/8740] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:39:47.110696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01f5ce-251e-48a8-9c7a-926bd51406ec None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:47.111267 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01f5ce-251e-48a8-9c7a-926bd51406ec None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:47.111418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01f5ce-251e-48a8-9c7a-926bd51406ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:47.129612 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0c01f5ce-251e-48a8-9c7a-926bd51406ec None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:39:47.130819 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c01f5ce-251e-48a8-9c7a-926bd51406ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:47.192456 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4416/8741] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:39:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:39:47.215598 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7442cb-399d-446a-9c4b-357c9d551a1f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:39:47.217385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1f7442cb-399d-446a-9c4b-357c9d551a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:39:47.237072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7442cb-399d-446a-9c4b-357c9d551a1f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:39:47.242373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:39:47.243013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:39:47.243295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:39:47.243570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:39:47.252035 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:39:47.253692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:39:47.263484 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4326/8742] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:40:21.325056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd497f-a75f-44ff-a823-521de17b4449 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:40:21.325641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd497f-a75f-44ff-a823-521de17b4449 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:40:21.325641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd497f-a75f-44ff-a823-521de17b4449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:40:21.343462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-09fd497f-a75f-44ff-a823-521de17b4449 None None] MFA Rules not processed for user `ef047f7b0e534c059c06045004189775`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:40:21.344687 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-09fd497f-a75f-44ff-a823-521de17b4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:40:21.352180 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4417/8743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:40:31.369991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:40:31.371824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:40:31.388858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620e063-9f5d-4ed7-b2c5-145817b45d00 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:40:31.393690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508f471-2a80-4fcc-9cca-d44ebe9318f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:40:31.394336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f471-2a80-4fcc-9cca-d44ebe9318f0 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:40:31.394641 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f471-2a80-4fcc-9cca-d44ebe9318f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:40:31.394893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f471-2a80-4fcc-9cca-d44ebe9318f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:40:31.396986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a508f471-2a80-4fcc-9cca-d44ebe9318f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:40:31.414443 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508f471-2a80-4fcc-9cca-d44ebe9318f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:40:31.415878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508f471-2a80-4fcc-9cca-d44ebe9318f0 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:40:31.431645 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4327/8744] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:40:31.978855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e47b-ea80-43b0-8ea8-70240326fc49 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:40:31.979451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e47b-ea80-43b0-8ea8-70240326fc49 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:40:31.979563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e47b-ea80-43b0-8ea8-70240326fc49 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:40:31.981059 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4418/8745] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:40:31.985956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ce27-dd26-48ea-bd49-b250f4f0feb2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:40:31.986333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ce27-dd26-48ea-bd49-b250f4f0feb2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:40:31.986705 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ce27-dd26-48ea-bd49-b250f4f0feb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:40:32.005316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f377ce27-dd26-48ea-bd49-b250f4f0feb2 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:40:32.006561 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f377ce27-dd26-48ea-bd49-b250f4f0feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:40:32.015166 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4328/8746] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:40:32.036384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3e47b-ea80-43b0-8ea8-70240326fc49 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:40:32.038239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9bd3e47b-ea80-43b0-8ea8-70240326fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:40:32.057390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3e47b-ea80-43b0-8ea8-70240326fc49 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:40:32.062874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:40:32.063521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:40:32.063800 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:40:32.064071 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:40:32.072645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:40:32.074321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:40:32.086887 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4419/8747] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:40:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:41:03.213278 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ce27-dd26-48ea-bd49-b250f4f0feb2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:03.226127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ce27-dd26-48ea-bd49-b250f4f0feb2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:03.230703 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:03.231618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:03.231897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:03.232169 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:03.234358 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:03.251152 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:03.252544 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:03.266636 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4329/8748] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:41:10.888127 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:10.899191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522fd17-2bb9-4f0f-90eb-bb7ce1085ea0 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:10.903725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:10.904613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:10.904883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:10.905193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] PATH_INFO: `/v3/users/ef047f7b0e534c059c06045004189775` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:10.906350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef047f7b0e534c059c06045004189775)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:10.908276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:10.956809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef047f7b0e534c059c06045004189775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:10.957510 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef047f7b0e534c059c06045004189775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:10.964199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef047f7b0e534c059c06045004189775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:10.973257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef047f7b0e534c059c06045004189775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:10.973902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-48580309-fcd9-40b0-b8c8-cd6689881b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef047f7b0e534c059c06045004189775'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:10.991191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4420/8749] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:41:10 2022] DELETE /identity/v3/users/ef047f7b0e534c059c06045004189775 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:41:11.169726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.181791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d953-f88a-4bc2-a70a-98aa1a777c9c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.238385 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.239256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.239532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.239809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] PATH_INFO: `/v3/projects/3b7ac04d687340c8a08ac58bdde56a67` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.241002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7ac04d687340c8a08ac58bdde56a67)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.242926 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.292020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7ac04d687340c8a08ac58bdde56a67', 'request_id': 'req-229d5029-31ea-47d6-a628-dc9592cd9352'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:11.297513 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7ac04d687340c8a08ac58bdde56a67', 'request_id': 'req-229d5029-31ea-47d6-a628-dc9592cd9352'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:11.308387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7ac04d687340c8a08ac58bdde56a67', 'request_id': 'req-229d5029-31ea-47d6-a628-dc9592cd9352'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:11.320684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] The token cache is being invalidate because project 3b7ac04d687340c8a08ac58bdde56a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:41:11.320973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:11.321746 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-229d5029-31ea-47d6-a628-dc9592cd9352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:41:11.323441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4330/8750] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:41:11 2022] DELETE /identity/v3/projects/3b7ac04d687340c8a08ac58bdde56a67 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:41:11.328871 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a7f5-058e-44b8-879e-58e4293fc166 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.329316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a7f5-058e-44b8-879e-58e4293fc166 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.329591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a7f5-058e-44b8-879e-58e4293fc166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.349142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0c06a7f5-058e-44b8-879e-58e4293fc166 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:41:11.350363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0c06a7f5-058e-44b8-879e-58e4293fc166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:11.412829 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4421/8751] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:41:11.421062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c087e-15ae-480f-818f-f82f5ae58621 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.421403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c087e-15ae-480f-818f-f82f5ae58621 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.421709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c087e-15ae-480f-818f-f82f5ae58621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.441724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5a6c087e-15ae-480f-818f-f82f5ae58621 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:41:11.442643 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a6c087e-15ae-480f-818f-f82f5ae58621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:11.453883 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4331/8752] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:41:11.458972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a7f5-058e-44b8-879e-58e4293fc166 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.471161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a7f5-058e-44b8-879e-58e4293fc166 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.476806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.477501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.477775 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.478030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.478753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:41:11.479055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.480681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.492405 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4422/8753] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:41:11.496968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c087e-15ae-480f-818f-f82f5ae58621 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.506835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c087e-15ae-480f-818f-f82f5ae58621 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.512985 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.513683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.513965 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.514236 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.514927 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.516816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.560210 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4332/8754] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:41:11 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:41:11.564946 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.580327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68fd78-eb5c-43b0-87e6-8a357c8e0e36 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.639650 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.640333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.640613 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.640888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.641611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.643576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.666453 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4423/8755] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:41:11 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:41:11.670869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.681772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e162d4-430a-490a-8e75-68fcb6331cc5 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.687382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.688082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.688362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.688637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.689412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.691033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.701789 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4333/8756] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:41:11.705927 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.716273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780e28-1d17-4706-86ee-cab8b3d23328 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.721614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e88237-c3af-4d01-b4ec-ed1cda686d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.722290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e88237-c3af-4d01-b4ec-ed1cda686d51 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.722560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e88237-c3af-4d01-b4ec-ed1cda686d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.722843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e88237-c3af-4d01-b4ec-ed1cda686d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.723593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e88237-c3af-4d01-b4ec-ed1cda686d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.725248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e88237-c3af-4d01-b4ec-ed1cda686d51 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.735674 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4424/8757] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:41:11.739959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.750353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aba508-7ede-47f8-8187-e00e109712ab admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.755453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.756343 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.756626 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.756910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] PATH_INFO: `/v3/projects/67f62a23dbf04cfca2a3403c6a2186b0/users/bc98c87ca47647008da1ddc42a738b29/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.771876 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f62a23dbf04cfca2a3403c6a2186b0, user_id=bc98c87ca47647008da1ddc42a738b29, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.774592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.789812 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4334/8758] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:41:11 2022] PUT /identity/v3/projects/67f62a23dbf04cfca2a3403c6a2186b0/users/bc98c87ca47647008da1ddc42a738b29/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:41:11.795055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726e2f-e949-4d98-bf5e-22e84d22f1ca None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.795340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726e2f-e949-4d98-bf5e-22e84d22f1ca None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.795611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726e2f-e949-4d98-bf5e-22e84d22f1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.813891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-19726e2f-e949-4d98-bf5e-22e84d22f1ca None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:41:11.814997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-19726e2f-e949-4d98-bf5e-22e84d22f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:11.874755 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4425/8759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:41:11.885663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:11.887602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:11.952221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56a126-8476-4b1b-97e4-c96875e8f415 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:11.956760 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:11.957577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:11.957853 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:11.958121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:11.968807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:11.970307 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:11.980413 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4335/8760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:41:16.514301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ec01e-9575-47f1-b4cc-a2ae40c6b13c None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:16.514802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ec01e-9575-47f1-b4cc-a2ae40c6b13c None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:16.515062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ec01e-9575-47f1-b4cc-a2ae40c6b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:16.543408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-278ec01e-9575-47f1-b4cc-a2ae40c6b13c None None] MFA Rules not processed for user `bc98c87ca47647008da1ddc42a738b29`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:41:16.544656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-278ec01e-9575-47f1-b4cc-a2ae40c6b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:16.615228 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4426/8761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:41:16.627422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:16.628905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:16.708489 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f879-9a15-447d-b89f-57bf6a33e7f9 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:16.714095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:16.714887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:16.715300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:16.715580 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:16.724339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:16.726161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:16.735644 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4336/8762] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:41:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:41:18.275022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6362-df35-4264-8a04-0afd54ed67cb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:18.275570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6362-df35-4264-8a04-0afd54ed67cb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:18.275570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6362-df35-4264-8a04-0afd54ed67cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:18.293980 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a92a6362-df35-4264-8a04-0afd54ed67cb None None] MFA Rules not processed for user `bc98c87ca47647008da1ddc42a738b29`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:41:18.295202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a92a6362-df35-4264-8a04-0afd54ed67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:18.302520 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4427/8763] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:41:18.630564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:18.632372 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:18.649645 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697cc5-b598-4412-88c6-7065a2da6543 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:18.654577 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c464c-510f-43c9-9154-86037a9bee15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:18.655311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c464c-510f-43c9-9154-86037a9bee15 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:18.655844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c464c-510f-43c9-9154-86037a9bee15 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:18.656184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c464c-510f-43c9-9154-86037a9bee15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:18.658106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c7c464c-510f-43c9-9154-86037a9bee15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:18.672122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c464c-510f-43c9-9154-86037a9bee15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:18.673918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c464c-510f-43c9-9154-86037a9bee15 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:18.688336 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4337/8764] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:41:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:41:20.861576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6362-df35-4264-8a04-0afd54ed67cb None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:20.874732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6362-df35-4264-8a04-0afd54ed67cb None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:20.879064 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6424-f0a3-4dc1-b73a-b4d9ef98f5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:20.879774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6424-f0a3-4dc1-b73a-b4d9ef98f5ba service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:20.880047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6424-f0a3-4dc1-b73a-b4d9ef98f5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:20.880301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6424-f0a3-4dc1-b73a-b4d9ef98f5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:20.882269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-729a6424-f0a3-4dc1-b73a-b4d9ef98f5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:20.895857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6424-f0a3-4dc1-b73a-b4d9ef98f5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:20.897407 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6424-f0a3-4dc1-b73a-b4d9ef98f5ba service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:20.909194 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4428/8765] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:41:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:41:33.314942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963eae-eb32-4f0c-bcbc-328d5a8084fd None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:33.315492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963eae-eb32-4f0c-bcbc-328d5a8084fd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:33.315593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963eae-eb32-4f0c-bcbc-328d5a8084fd None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:33.316948 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4338/8766] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 21:41:33.322523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848b777-82ca-4064-aaf8-ba0a9f4c08bb None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:33.323003 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848b777-82ca-4064-aaf8-ba0a9f4c08bb None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:33.323198 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848b777-82ca-4064-aaf8-ba0a9f4c08bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:33.341345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5848b777-82ca-4064-aaf8-ba0a9f4c08bb None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:41:33.342625 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5848b777-82ca-4064-aaf8-ba0a9f4c08bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:33.405499 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4429/8767] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:41:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:41:33.429491 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf963eae-eb32-4f0c-bcbc-328d5a8084fd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:41:33.431387 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bf963eae-eb32-4f0c-bcbc-328d5a8084fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:41:33.452291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf963eae-eb32-4f0c-bcbc-328d5a8084fd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:41:33.458535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:41:33.459187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:41:33.459464 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:41:33.459732 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:41:33.468531 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:41:33.470217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:41:33.480381 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4339/8768] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:41:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:42:08.082219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e962fbb-4b82-41a9-a37e-8235d0a2a9b2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:08.082859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e962fbb-4b82-41a9-a37e-8235d0a2a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:08.082859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e962fbb-4b82-41a9-a37e-8235d0a2a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:08.121444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-0e962fbb-4b82-41a9-a37e-8235d0a2a9b2 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:42:08.122714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-0e962fbb-4b82-41a9-a37e-8235d0a2a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:42:08.130000 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4430/8769] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Apr 9 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:42:08.136201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:42:08.145978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04226b51-b88c-426a-ae01-5f7763e7c83f service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:42:08.150127 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512afef-abf3-4dec-8c2d-91553b165f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:42:08.150768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512afef-abf3-4dec-8c2d-91553b165f77 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:08.151045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512afef-abf3-4dec-8c2d-91553b165f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:08.151338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512afef-abf3-4dec-8c2d-91553b165f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:08.153198 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-1512afef-abf3-4dec-8c2d-91553b165f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:42:08.165298 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512afef-abf3-4dec-8c2d-91553b165f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:42:08.166728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512afef-abf3-4dec-8c2d-91553b165f77 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:42:08.176814 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4340/8770] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:42:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:42:19.402982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadb5b-872c-4e67-b327-66cbac0fd899 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:19.403537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadb5b-872c-4e67-b327-66cbac0fd899 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:19.403537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadb5b-872c-4e67-b327-66cbac0fd899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:19.421658 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d9cadb5b-872c-4e67-b327-66cbac0fd899 None None] MFA Rules not processed for user `bc98c87ca47647008da1ddc42a738b29`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:42:19.422869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d9cadb5b-872c-4e67-b327-66cbac0fd899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:42:19.430253 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4431/8771] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:42:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:42:57.823479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dac8a0-2cd3-4f92-af84-a95457428d00 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:57.824210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dac8a0-2cd3-4f92-af84-a95457428d00 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:57.824210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dac8a0-2cd3-4f92-af84-a95457428d00 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:57.825454 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4341/8772] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:42:57.830816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660189e9-dee0-43e2-901a-2e95cb0892ea None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:57.831281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660189e9-dee0-43e2-901a-2e95cb0892ea None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:57.831417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660189e9-dee0-43e2-901a-2e95cb0892ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:57.849113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-660189e9-dee0-43e2-901a-2e95cb0892ea None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:42:57.850311 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-660189e9-dee0-43e2-901a-2e95cb0892ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:42:57.859133 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4432/8773] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:42:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:42:57.879494 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dac8a0-2cd3-4f92-af84-a95457428d00 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:42:57.881360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d1dac8a0-2cd3-4f92-af84-a95457428d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:42:57.900087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dac8a0-2cd3-4f92-af84-a95457428d00 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:42:57.905210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:42:57.905858 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:57.906139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:57.906414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:57.914850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:42:57.916438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:42:57.926100 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4342/8774] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:42:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:42:58.144039 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924d2a9-7fd8-4404-a6b7-35995092b389 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:58.144330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924d2a9-7fd8-4404-a6b7-35995092b389 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:58.144603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924d2a9-7fd8-4404-a6b7-35995092b389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:58.163014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f924d2a9-7fd8-4404-a6b7-35995092b389 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:42:58.164227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f924d2a9-7fd8-4404-a6b7-35995092b389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:42:58.173383 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4433/8775] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:42:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:42:58.185382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:42:58.198952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2fa6-0aaa-4241-a2f5-aa3d5a81f6f2 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:42:58.204768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:42:58.205459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:42:58.205743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:42:58.206030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:42:58.215118 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:42:58.216663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:42:58.226917 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4343/8776] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:42:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:43:14.215690 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8921d9-898f-4e55-b72b-2e886cd4f03b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:14.216305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8921d9-898f-4e55-b72b-2e886cd4f03b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:14.216305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8921d9-898f-4e55-b72b-2e886cd4f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:14.234581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-9c8921d9-898f-4e55-b72b-2e886cd4f03b None None] MFA Rules not processed for user `bc98c87ca47647008da1ddc42a738b29`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:43:14.235809 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9c8921d9-898f-4e55-b72b-2e886cd4f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:43:14.243230 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4434/8777] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:43:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:43:14.446219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:43:14.460773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fb7ac-ac90-4205-a82a-2e9116c175d1 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:43:14.467383 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:43:14.468399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:14.468679 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:14.468946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:14.471281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:43:14.493352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:43:14.495190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:43:14.508780 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4344/8778] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:43:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:43:14.896309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7fb17-baa6-4ec0-b91e-619d024a749d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:14.896620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7fb17-baa6-4ec0-b91e-619d024a749d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:14.896892 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7fb17-baa6-4ec0-b91e-619d024a749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:14.916238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-26b7fb17-baa6-4ec0-b91e-619d024a749d None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:43:14.917505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-26b7fb17-baa6-4ec0-b91e-619d024a749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:43:14.926847 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4435/8779] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:43:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:43:14.940042 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:43:14.952991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c99e9-4d57-4161-92ee-173d733069ef service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:43:14.959001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92d13-fedc-4061-a994-39bfb602842d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:43:14.959655 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92d13-fedc-4061-a994-39bfb602842d service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:14.959929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92d13-fedc-4061-a994-39bfb602842d service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:14.960228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92d13-fedc-4061-a994-39bfb602842d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:14.969414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92d13-fedc-4061-a994-39bfb602842d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:43:14.971107 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92d13-fedc-4061-a994-39bfb602842d service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:43:14.981428 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4345/8780] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:43:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:43:17.417540 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7fb17-baa6-4ec0-b91e-619d024a749d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:43:17.453660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7fb17-baa6-4ec0-b91e-619d024a749d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:43:17.459859 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996373a-a64a-4e8b-b11a-430a1f67bfd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:43:17.460552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996373a-a64a-4e8b-b11a-430a1f67bfd0 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:17.460833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996373a-a64a-4e8b-b11a-430a1f67bfd0 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:17.461149 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996373a-a64a-4e8b-b11a-430a1f67bfd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:17.463014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5996373a-a64a-4e8b-b11a-430a1f67bfd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:43:17.480033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996373a-a64a-4e8b-b11a-430a1f67bfd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:43:17.481854 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996373a-a64a-4e8b-b11a-430a1f67bfd0 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:43:17.497233 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4436/8781] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:43:26.111452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebee62-6dab-4bb2-8b0d-6320ac1bfaa5 None None] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:26.112078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebee62-6dab-4bb2-8b0d-6320ac1bfaa5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:26.112078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebee62-6dab-4bb2-8b0d-6320ac1bfaa5 None None] PATH_INFO: `/` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:26.113718 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4346/8782] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 09 21:43:26.121516 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:26.122151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:26.122261 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:26.146392 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:43:26.148053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:43:26.158800 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4437/8783] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:43:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:43:26.181166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebee62-6dab-4bb2-8b0d-6320ac1bfaa5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:43:26.198984 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebee62-6dab-4bb2-8b0d-6320ac1bfaa5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:43:26.205550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:43:26.206499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:43:26.207013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:43:26.207493 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:43:26.216516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:43:26.219323 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:43:26.236184 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4347/8784] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:43:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:44:05.880745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:44:05.882289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:05.902959 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078956f7-377b-48b6-846c-2055f5e4a95a None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:44:05.909744 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d35d-1745-455b-b04f-20e69f6eb097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:44:05.911242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d35d-1745-455b-b04f-20e69f6eb097 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:05.912271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d35d-1745-455b-b04f-20e69f6eb097 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:05.912642 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d35d-1745-455b-b04f-20e69f6eb097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:05.914848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1638d35d-1745-455b-b04f-20e69f6eb097 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:05.931144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638d35d-1745-455b-b04f-20e69f6eb097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:44:05.932943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638d35d-1745-455b-b04f-20e69f6eb097 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:44:05.946945 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4438/8785] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:44:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:44:07.716971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:44:07.736177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11a4bf-078b-47ff-a1b2-25b2263d461b service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:44:07.745553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:44:07.746330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:07.746661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:07.746942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:07.750002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:07.770445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:44:07.772073 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:44:07.789665 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4348/8786] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:44:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:44:16.064049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6341e-2fab-4c88-a33b-c3434f50974a None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:16.064602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6341e-2fab-4c88-a33b-c3434f50974a None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:16.064602 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6341e-2fab-4c88-a33b-c3434f50974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:16.082240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f5b6341e-2fab-4c88-a33b-c3434f50974a None None] MFA Rules not processed for user `bc98c87ca47647008da1ddc42a738b29`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:44:16.083770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f5b6341e-2fab-4c88-a33b-c3434f50974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:16.091123 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4439/8787] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:44:31.963435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:44:31.972482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf3342-e840-42dd-9b26-d61597523a13 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:44:31.976704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9c8b8-6077-4e37-8434-7bc04140350d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:44:31.977397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9c8b8-6077-4e37-8434-7bc04140350d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:31.977680 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9c8b8-6077-4e37-8434-7bc04140350d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:31.977957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9c8b8-6077-4e37-8434-7bc04140350d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:31.979763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-31d9c8b8-6077-4e37-8434-7bc04140350d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:31.991995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9c8b8-6077-4e37-8434-7bc04140350d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:44:31.993604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9c8b8-6077-4e37-8434-7bc04140350d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:44:32.004486 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4349/8788] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:44:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:44:32.085237 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c81f-0bc4-4fc0-a055-6877d2bc4049 None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:32.085763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c81f-0bc4-4fc0-a055-6877d2bc4049 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:32.085874 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c81f-0bc4-4fc0-a055-6877d2bc4049 None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:32.087204 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4440/8789] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 21:44:32.091885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1bd05-1631-4fa4-b6b3-85c538e6ec84 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:32.092171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1bd05-1631-4fa4-b6b3-85c538e6ec84 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:32.092447 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1bd05-1631-4fa4-b6b3-85c538e6ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:32.110811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5ae1bd05-1631-4fa4-b6b3-85c538e6ec84 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:44:32.112187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5ae1bd05-1631-4fa4-b6b3-85c538e6ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:32.121216 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4350/8790] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:44:32.140951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2c81f-0bc4-4fc0-a055-6877d2bc4049 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:44:32.157873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2c81f-0bc4-4fc0-a055-6877d2bc4049 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:44:32.164075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:44:32.164737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:32.165000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:32.165305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:32.174408 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:44:32.176041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:44:32.186140 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4441/8791] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:44:32.350519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1bd05-1631-4fa4-b6b3-85c538e6ec84 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:44:32.360087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1bd05-1631-4fa4-b6b3-85c538e6ec84 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:44:32.363749 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:44:32.364390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:32.364666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:32.364935 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:32.366842 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:32.382670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:44:32.384106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:44:32.397274 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4351/8792] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:44:51.839738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:44:51.855608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662550a-386b-4693-a712-2a20b8be952f service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:44:51.861389 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:44:51.862165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:44:51.862445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:44:51.862716 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:44:51.864623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:44:51.888410 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:44:51.890306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:44:51.905095 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4442/8793] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:44:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:45:17.829350 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:17.864317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4d4e-4358-4c82-9093-a7776633ed60 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:17.869154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:17.870031 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:17.870314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:17.870594 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] PATH_INFO: `/v3/users/bc98c87ca47647008da1ddc42a738b29` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:17.871808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc98c87ca47647008da1ddc42a738b29)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:17.873801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:17.925283 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc98c87ca47647008da1ddc42a738b29'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:17.926076 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc98c87ca47647008da1ddc42a738b29'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:17.933390 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc98c87ca47647008da1ddc42a738b29'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:17.934075 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc98c87ca47647008da1ddc42a738b29'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:17.943377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-e31092b0-9870-4912-98af-501f706bb419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc98c87ca47647008da1ddc42a738b29'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:17.967546 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4352/8794] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:45:17 2022] DELETE /identity/v3/users/bc98c87ca47647008da1ddc42a738b29 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:45:18.146781 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:18.183036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343628b-da5f-433e-aad2-11460e59a0c9 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:18.240086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:18.240973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.241283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.241556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] PATH_INFO: `/v3/projects/67f62a23dbf04cfca2a3403c6a2186b0` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.242797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f62a23dbf04cfca2a3403c6a2186b0)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:18.244738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:18.302222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f62a23dbf04cfca2a3403c6a2186b0', 'request_id': 'req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:18.307742 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f62a23dbf04cfca2a3403c6a2186b0', 'request_id': 'req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:18.317281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f62a23dbf04cfca2a3403c6a2186b0', 'request_id': 'req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:18.328861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] The token cache is being invalidate because project 67f62a23dbf04cfca2a3403c6a2186b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:45:18.329189 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:18.329835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-2f5c0a65-b54e-4467-b7ff-7f6f473dea3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:18.331421 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4443/8795] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:45:18 2022] DELETE /identity/v3/projects/67f62a23dbf04cfca2a3403c6a2186b0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:45:18.336614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0bf7-125c-49a1-9cc1-cb0d8a35b3e6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.337288 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0bf7-125c-49a1-9cc1-cb0d8a35b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.337572 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0bf7-125c-49a1-9cc1-cb0d8a35b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.366407 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cd4e0bf7-125c-49a1-9cc1-cb0d8a35b3e6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:18.367635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cd4e0bf7-125c-49a1-9cc1-cb0d8a35b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:18.430573 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4353/8796] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:18.439269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68877-4fe5-472a-abe6-32999d7e74ad None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.439558 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68877-4fe5-472a-abe6-32999d7e74ad None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.439833 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68877-4fe5-472a-abe6-32999d7e74ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.459473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-90c68877-4fe5-472a-abe6-32999d7e74ad None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:18.460677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-90c68877-4fe5-472a-abe6-32999d7e74ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:18.469265 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4444/8797] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:18.475438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e0bf7-125c-49a1-9cc1-cb0d8a35b3e6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:18.486767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e0bf7-125c-49a1-9cc1-cb0d8a35b3e6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:18.493003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:18.493683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.493970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.494233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.494977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:45:18.495306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:18.496929 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:18.509346 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4354/8798] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:45:18.515885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68877-4fe5-472a-abe6-32999d7e74ad None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:18.528223 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68877-4fe5-472a-abe6-32999d7e74ad None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:18.534275 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:18.534967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.535248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.535531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.536219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:18.538219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:18.566896 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4445/8799] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:45:18 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:45:18.571857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:18.588256 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7483f-450e-495f-8614-a0ed97100d21 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:18.659687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:18.660456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.660852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.661175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] PATH_INFO: `/v3/users` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.661943 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:18.663896 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:18.685171 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4355/8800] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:45:18 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:45:18.689377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:18.699909 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c5b4-b7f1-4654-9e50-8a08e8ade6b0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:18.705521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:18.706188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.706466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.706733 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.707472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:18.709618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:18.721586 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4446/8801] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:45:18.726519 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:18.740347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce4a3a-e5b3-47d2-bfa3-9e99d7904bdd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:18.745997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c3b96-d317-4e74-9a9d-eebb75354b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:18.746663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3b96-d317-4e74-9a9d-eebb75354b5d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.746942 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3b96-d317-4e74-9a9d-eebb75354b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.747212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3b96-d317-4e74-9a9d-eebb75354b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.747969 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c3b96-d317-4e74-9a9d-eebb75354b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:18.749617 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c3b96-d317-4e74-9a9d-eebb75354b5d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:18.759806 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4356/8802] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:45:18.763852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:18.773708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cf9ee-cd81-4928-b198-175064c7d8fd admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:18.778614 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7461a-55ee-42a9-894f-36390e4f9cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:18.779504 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7461a-55ee-42a9-894f-36390e4f9cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.779779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7461a-55ee-42a9-894f-36390e4f9cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.780101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7461a-55ee-42a9-894f-36390e4f9cf6 admin admin] PATH_INFO: `/v3/projects/0e6a8f7f65fb4473bb5959c88ee7b03e/users/a175b2076a734c37b6596e0e6c543253/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.794912 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7461a-55ee-42a9-894f-36390e4f9cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6a8f7f65fb4473bb5959c88ee7b03e, user_id=a175b2076a734c37b6596e0e6c543253, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:18.797776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7461a-55ee-42a9-894f-36390e4f9cf6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:18.813256 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4447/8803] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:45:18 2022] PUT /identity/v3/projects/0e6a8f7f65fb4473bb5959c88ee7b03e/users/a175b2076a734c37b6596e0e6c543253/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:45:18.819786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e9dca-b262-46fe-b099-dd6d3689cc9c None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.820106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e9dca-b262-46fe-b099-dd6d3689cc9c None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.820377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e9dca-b262-46fe-b099-dd6d3689cc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.839225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b99e9dca-b262-46fe-b099-dd6d3689cc9c None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:18.840481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b99e9dca-b262-46fe-b099-dd6d3689cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:18.902182 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4357/8804] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:18.911674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c83516-5b1b-4e38-a26c-14aac2b2151e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:18.911967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c83516-5b1b-4e38-a26c-14aac2b2151e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:18.912249 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c83516-5b1b-4e38-a26c-14aac2b2151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:18.930229 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-a6c83516-5b1b-4e38-a26c-14aac2b2151e None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:18.931420 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-a6c83516-5b1b-4e38-a26c-14aac2b2151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:19.004980 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4448/8805] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Apr 9 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:19.011718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e9dca-b262-46fe-b099-dd6d3689cc9c None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:19.024460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e9dca-b262-46fe-b099-dd6d3689cc9c None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:19.029216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8551862-8d96-4a47-b70e-5a67b08b0180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:19.029849 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8551862-8d96-4a47-b70e-5a67b08b0180 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:19.030148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8551862-8d96-4a47-b70e-5a67b08b0180 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:19.030421 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8551862-8d96-4a47-b70e-5a67b08b0180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:19.041366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8551862-8d96-4a47-b70e-5a67b08b0180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:19.043695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8551862-8d96-4a47-b70e-5a67b08b0180 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:19.055990 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4358/8806] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:45:19.681846 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:19.682725 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:19.683005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:19.709797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] MFA Rules not processed for user `a175b2076a734c37b6596e0e6c543253`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:19.711306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:19.775689 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4449/8807] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:19.785682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a009ce-4d8c-41f4-96f3-2961c73196ba None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:19.785970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a009ce-4d8c-41f4-96f3-2961c73196ba None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:19.786243 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a009ce-4d8c-41f4-96f3-2961c73196ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:19.804457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-b9a009ce-4d8c-41f4-96f3-2961c73196ba None None] MFA Rules not processed for user `a175b2076a734c37b6596e0e6c543253`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:19.805628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b9a009ce-4d8c-41f4-96f3-2961c73196ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:19.813981 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4359/8808] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:19.825417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:19.826879 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:19.901571 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939df49-c5b3-4832-9a35-1aa5f187ff99 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:19.910030 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:19.911140 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:19.911604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:19.912054 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:19.922032 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:19.923660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:19.935873 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4450/8809] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:45:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:45:30.053150 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4179cb-d18b-4708-94a5-9c051c34cca8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:30.053683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4179cb-d18b-4708-94a5-9c051c34cca8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:30.053683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4179cb-d18b-4708-94a5-9c051c34cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:30.073064 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-9c4179cb-d18b-4708-94a5-9c051c34cca8 None None] MFA Rules not processed for user `a175b2076a734c37b6596e0e6c543253`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:30.074313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9c4179cb-d18b-4708-94a5-9c051c34cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:30.082659 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4360/8810] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:30.332791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:30.343851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4d71e-c4f5-4b6b-aaa6-e9554b241c3e service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:30.348207 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:30.348850 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:30.349162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:30.349432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:30.351547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:30.365972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:30.367721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:30.378438 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4451/8811] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:45:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:45:31.818264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4179cb-d18b-4708-94a5-9c051c34cca8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:31.828069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4179cb-d18b-4708-94a5-9c051c34cca8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:31.831834 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:31.832564 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:31.832914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:31.833312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:31.835149 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:31.873507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:31.874978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:31.889140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4361/8812] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:45:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:45:47.205479 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:47.218097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146257c-c585-4539-ae14-3b6c28e0be0c service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:47.223372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:47.224299 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:47.224577 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:47.224885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] PATH_INFO: `/v3/users/a175b2076a734c37b6596e0e6c543253` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:47.226293 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a175b2076a734c37b6596e0e6c543253)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:47.228346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:47.277570 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a175b2076a734c37b6596e0e6c543253'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.278227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a175b2076a734c37b6596e0e6c543253'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.284884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a175b2076a734c37b6596e0e6c543253'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.295790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a175b2076a734c37b6596e0e6c543253'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.296594 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1926e071-ca1a-4b32-906c-7e2c51812dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a175b2076a734c37b6596e0e6c543253'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.314059 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4452/8813] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:45:47 2022] DELETE /identity/v3/users/a175b2076a734c37b6596e0e6c543253 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:45:47.493212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:47.504389 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1cdf0-95cd-4b0a-a882-e89fa999f0c4 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:47.569979 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:47.571280 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:47.571565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:47.571827 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] PATH_INFO: `/v3/projects/0e6a8f7f65fb4473bb5959c88ee7b03e` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:47.573055 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6a8f7f65fb4473bb5959c88ee7b03e)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:47.574973 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:47.627601 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'request_id': 'req-ac297b38-9439-47c3-afa1-20a4a6fc3e72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.633140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'request_id': 'req-ac297b38-9439-47c3-afa1-20a4a6fc3e72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.642639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'request_id': 'req-ac297b38-9439-47c3-afa1-20a4a6fc3e72'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.657483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] The token cache is being invalidate because project 0e6a8f7f65fb4473bb5959c88ee7b03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:45:47.657773 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.658460 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-ac297b38-9439-47c3-afa1-20a4a6fc3e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:47.660219 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4362/8814] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:45:47 2022] DELETE /identity/v3/projects/0e6a8f7f65fb4473bb5959c88ee7b03e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:45:47.665559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088586-da85-4972-a00a-414ceb0f7d1d None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:47.665848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088586-da85-4972-a00a-414ceb0f7d1d None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:47.666131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088586-da85-4972-a00a-414ceb0f7d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:47.685199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-46088586-da85-4972-a00a-414ceb0f7d1d None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:47.686436 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-46088586-da85-4972-a00a-414ceb0f7d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:47.759267 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4453/8815] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:47.768084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621483c-7551-4984-a5bf-e5dcee700fd5 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:47.768418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621483c-7551-4984-a5bf-e5dcee700fd5 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:47.768695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621483c-7551-4984-a5bf-e5dcee700fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:47.787687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f621483c-7551-4984-a5bf-e5dcee700fd5 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:47.788899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f621483c-7551-4984-a5bf-e5dcee700fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:47.798551 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4363/8816] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:45:47.803150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088586-da85-4972-a00a-414ceb0f7d1d None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:47.814090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088586-da85-4972-a00a-414ceb0f7d1d None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:47.822869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:47.823710 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:47.824022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:47.824381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:47.825508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:45:47.825899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:47.828397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:47.841256 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4454/8817] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:45:47.845713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621483c-7551-4984-a5bf-e5dcee700fd5 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:47.855155 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621483c-7551-4984-a5bf-e5dcee700fd5 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:47.861132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:47.861791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:47.862070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:47.862338 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:47.863027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:47.864970 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:47.895168 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4364/8818] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:45:47 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:45:47.899115 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:47.909554 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bce06-611e-4d1b-ad0d-a35ad69ee2e1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:47.967355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:47.968366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:47.968728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:47.969085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:47.970177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:47.973248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:48.000064 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4455/8819] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:45:47 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:45:48.004475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:48.015492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0c47-61bd-47ec-b10f-fdc5ef18144a admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:48.020972 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:48.021671 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:48.021954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:48.022226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:48.022957 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:48.024664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:48.035106 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4365/8820] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:45:48.039094 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:48.049383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23184d9-03c3-4e0f-b693-311c1d9b989f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:48.054114 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8156c-e8c9-4d77-acfc-7293ffe13d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:48.054771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8156c-e8c9-4d77-acfc-7293ffe13d6b admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:48.055045 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8156c-e8c9-4d77-acfc-7293ffe13d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:48.055322 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8156c-e8c9-4d77-acfc-7293ffe13d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:48.056037 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8156c-e8c9-4d77-acfc-7293ffe13d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:48.057694 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8156c-e8c9-4d77-acfc-7293ffe13d6b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:48.067482 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4456/8821] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:45:48.071670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:48.081818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd79c-8f96-43d5-8df1-f4539d3f5e2f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:48.089203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:48.090587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:48.090956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:48.091333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] PATH_INFO: `/v3/projects/c804050c8d60428088fa9c4ff1926587/users/51dc2586357d485cbe2e55929a491f1f/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:48.107182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c804050c8d60428088fa9c4ff1926587, user_id=51dc2586357d485cbe2e55929a491f1f, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:48.109887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:48.125392 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4366/8822] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:45:48 2022] PUT /identity/v3/projects/c804050c8d60428088fa9c4ff1926587/users/51dc2586357d485cbe2e55929a491f1f/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:45:48.188843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8aef-e568-4fa7-8321-0b547a6c7428 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:48.189262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8aef-e568-4fa7-8321-0b547a6c7428 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:48.189776 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8aef-e568-4fa7-8321-0b547a6c7428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:48.230430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-004a8aef-e568-4fa7-8321-0b547a6c7428 None None] MFA Rules not processed for user `51dc2586357d485cbe2e55929a491f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:48.231659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-004a8aef-e568-4fa7-8321-0b547a6c7428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:48.295004 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4457/8823] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:48.307983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:48.311262 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:48.373819 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09502c-2100-41b2-a05c-b72297153c82 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:48.378203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876acff-5ff8-4a4b-bdee-8a951072cb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:48.378859 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876acff-5ff8-4a4b-bdee-8a951072cb07 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:48.379142 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876acff-5ff8-4a4b-bdee-8a951072cb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:48.379422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876acff-5ff8-4a4b-bdee-8a951072cb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:48.388720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876acff-5ff8-4a4b-bdee-8a951072cb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:48.390263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876acff-5ff8-4a4b-bdee-8a951072cb07 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:48.399741 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4367/8824] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:45:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:45:58.915162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8aef-e568-4fa7-8321-0b547a6c7428 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:58.978675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8aef-e568-4fa7-8321-0b547a6c7428 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:58.983529 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:58.984450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:58.984732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:58.985088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] PATH_INFO: `/v3/users/51dc2586357d485cbe2e55929a491f1f` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:58.986316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51dc2586357d485cbe2e55929a491f1f)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:58.988280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.036186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51dc2586357d485cbe2e55929a491f1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.036880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51dc2586357d485cbe2e55929a491f1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.043715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51dc2586357d485cbe2e55929a491f1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.058457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51dc2586357d485cbe2e55929a491f1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.059153 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51dc2586357d485cbe2e55929a491f1f'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.076660 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4458/8825] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:45:58 2022] DELETE /identity/v3/users/51dc2586357d485cbe2e55929a491f1f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:45:59.081287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.081763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.081865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.099524 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:59.100731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:59.158563 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4368/8826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:59.168475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.169834 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:59.225552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bdf8-ac25-4eb3-8ed0-e2d98bf7c18d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.229586 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a4e0-a5f7-4c27-8620-97bd80cd7de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.230245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a4e0-a5f7-4c27-8620-97bd80cd7de3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.230523 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a4e0-a5f7-4c27-8620-97bd80cd7de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.230795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a4e0-a5f7-4c27-8620-97bd80cd7de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.240187 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a4e0-a5f7-4c27-8620-97bd80cd7de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.241693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a4e0-a5f7-4c27-8620-97bd80cd7de3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.251266 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4459/8827] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:45:59.441224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.442899 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:59.460720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a62d7-acb3-488e-ad58-4a55e41c8761 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.466811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.467726 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.468044 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.468412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] PATH_INFO: `/v3/projects/c804050c8d60428088fa9c4ff1926587` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.469636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c804050c8d60428088fa9c4ff1926587)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.471845 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.520162 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c804050c8d60428088fa9c4ff1926587', 'request_id': 'req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.525475 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c804050c8d60428088fa9c4ff1926587', 'request_id': 'req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.534797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c804050c8d60428088fa9c4ff1926587', 'request_id': 'req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.546050 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] The token cache is being invalidate because project c804050c8d60428088fa9c4ff1926587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:45:59.546335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.546968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-35b380f7-8ea6-4fb8-9f45-0445f5dfad68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:45:59.548599 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4369/8828] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:45:59 2022] DELETE /identity/v3/projects/c804050c8d60428088fa9c4ff1926587 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:45:59.554866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293751bf-e8f4-447e-879f-4c7c8da59ecd None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.555202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293751bf-e8f4-447e-879f-4c7c8da59ecd None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.555599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293751bf-e8f4-447e-879f-4c7c8da59ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.574930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-293751bf-e8f4-447e-879f-4c7c8da59ecd None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:59.576132 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-293751bf-e8f4-447e-879f-4c7c8da59ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:59.639203 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4460/8829] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:45:59.648316 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc458-62b5-453f-8c0c-cc31cddd1bcf None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.648667 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc458-62b5-453f-8c0c-cc31cddd1bcf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.648971 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc458-62b5-453f-8c0c-cc31cddd1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.671797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d09cc458-62b5-453f-8c0c-cc31cddd1bcf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:45:59.673057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d09cc458-62b5-453f-8c0c-cc31cddd1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:45:59.682575 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4370/8830] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:45:59.687254 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293751bf-e8f4-447e-879f-4c7c8da59ecd None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.697627 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293751bf-e8f4-447e-879f-4c7c8da59ecd None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.703790 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.704474 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.704873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.705162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.705878 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:45:59.706184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.707816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.720651 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4461/8831] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:45:59.725171 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc458-62b5-453f-8c0c-cc31cddd1bcf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.734552 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc458-62b5-453f-8c0c-cc31cddd1bcf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.739800 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.740441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.740722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.740993 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.741714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.743635 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.770959 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4371/8832] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:45:59 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:45:59.775174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.785836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42035696-c4c9-47a2-b29a-5103b9844e90 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.842857 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.843591 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.843873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.844156 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.844843 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.846897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.873759 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4462/8833] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:45:59 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:45:59.880003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.895511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb75ca4-7ed7-418f-8255-b292abe42315 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.901459 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.902132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.902411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.902661 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.903370 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.905105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.916417 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4372/8834] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:45:59.920551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.931154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dcfae-fc98-4cf7-b3a2-4f925e9185c1 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.936155 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20e6b0-be29-452e-ae67-3902d678b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.936830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e6b0-be29-452e-ae67-3902d678b763 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.937175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e6b0-be29-452e-ae67-3902d678b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.937520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e6b0-be29-452e-ae67-3902d678b763 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.938183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20e6b0-be29-452e-ae67-3902d678b763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.939841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20e6b0-be29-452e-ae67-3902d678b763 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:45:59.950062 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4463/8835] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:45:59.954409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:45:59.966082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702a21-c1f3-4e80-92c7-ef77d765e50d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:45:59.971684 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:45:59.972591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:45:59.972958 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:45:59.973301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] PATH_INFO: `/v3/projects/81fa89e879b444468d406b7ff567b775/users/f25414a5d44b4ffa94121f9fd049e6d8/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:45:59.988672 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fa89e879b444468d406b7ff567b775, user_id=f25414a5d44b4ffa94121f9fd049e6d8, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:45:59.991481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:00.006739 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4373/8836] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:45:59 2022] PUT /identity/v3/projects/81fa89e879b444468d406b7ff567b775/users/f25414a5d44b4ffa94121f9fd049e6d8/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:46:00.016827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2b072-ac10-497e-af98-ae374c86657f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:00.017177 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2b072-ac10-497e-af98-ae374c86657f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:00.017472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2b072-ac10-497e-af98-ae374c86657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:00.043533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3aa2b072-ac10-497e-af98-ae374c86657f None None] MFA Rules not processed for user `f25414a5d44b4ffa94121f9fd049e6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:00.044739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3aa2b072-ac10-497e-af98-ae374c86657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:00.118978 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4464/8837] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:00.129330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:00.131264 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:00.189535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2970b-1fbc-48b2-b3d6-220f26c2f906 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:00.193541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868a5b-38f0-4309-8fe3-b725425185fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:00.194189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868a5b-38f0-4309-8fe3-b725425185fd service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:00.194467 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868a5b-38f0-4309-8fe3-b725425185fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:00.194739 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868a5b-38f0-4309-8fe3-b725425185fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:00.203433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868a5b-38f0-4309-8fe3-b725425185fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:00.204910 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868a5b-38f0-4309-8fe3-b725425185fd service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:00.213697 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4374/8838] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:46:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:46:04.269652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2b072-ac10-497e-af98-ae374c86657f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:04.332921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2b072-ac10-497e-af98-ae374c86657f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:04.337763 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:04.338652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:04.338942 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:04.339568 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] PATH_INFO: `/v3/users/f25414a5d44b4ffa94121f9fd049e6d8` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:04.340789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25414a5d44b4ffa94121f9fd049e6d8)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:04.342789 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:04.393748 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25414a5d44b4ffa94121f9fd049e6d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.394512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25414a5d44b4ffa94121f9fd049e6d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.401841 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25414a5d44b4ffa94121f9fd049e6d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.411025 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25414a5d44b4ffa94121f9fd049e6d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.411659 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25414a5d44b4ffa94121f9fd049e6d8'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.428886 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4465/8839] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:46:04 2022] DELETE /identity/v3/users/f25414a5d44b4ffa94121f9fd049e6d8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:46:04.433592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:04.434095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:04.434207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:04.451517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:04.452718 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:04.521283 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4375/8840] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:04.534758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:04.536368 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:04.598345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9be778-dca7-4ebc-a601-6ec55dd80113 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:04.602537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81cf09-2154-4eb7-9258-d08d58767689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:04.603196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81cf09-2154-4eb7-9258-d08d58767689 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:04.603476 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81cf09-2154-4eb7-9258-d08d58767689 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:04.603770 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81cf09-2154-4eb7-9258-d08d58767689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:04.613670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81cf09-2154-4eb7-9258-d08d58767689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:04.615131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81cf09-2154-4eb7-9258-d08d58767689 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:04.624708 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4466/8841] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:46:04.802713 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:04.804321 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:04.816766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b68ca-ac17-4d82-ba4e-b30460eea6e2 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:04.822381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:04.823261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:04.823535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:04.823811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] PATH_INFO: `/v3/projects/81fa89e879b444468d406b7ff567b775` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:04.825258 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fa89e879b444468d406b7ff567b775)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:04.827226 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:04.881375 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fa89e879b444468d406b7ff567b775', 'request_id': 'req-0abdeff0-f221-48e7-a12b-ed7b4656af0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.887413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fa89e879b444468d406b7ff567b775', 'request_id': 'req-0abdeff0-f221-48e7-a12b-ed7b4656af0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.896267 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fa89e879b444468d406b7ff567b775', 'request_id': 'req-0abdeff0-f221-48e7-a12b-ed7b4656af0d'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.912490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] The token cache is being invalidate because project 81fa89e879b444468d406b7ff567b775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:46:04.912820 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.913702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-0abdeff0-f221-48e7-a12b-ed7b4656af0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:46:04.916047 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4376/8842] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:46:04 2022] DELETE /identity/v3/projects/81fa89e879b444468d406b7ff567b775 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:46:04.922268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7e6be-d5d1-4fc2-b04a-0af7f951dcd6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:04.922560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7e6be-d5d1-4fc2-b04a-0af7f951dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:04.922848 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7e6be-d5d1-4fc2-b04a-0af7f951dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:04.944204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-75f7e6be-d5d1-4fc2-b04a-0af7f951dcd6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:04.945468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-75f7e6be-d5d1-4fc2-b04a-0af7f951dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:05.004880 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4467/8843] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:46:05.012945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf597f1-2fe4-480c-a9a4-de53edf223b8 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.013263 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf597f1-2fe4-480c-a9a4-de53edf223b8 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.013541 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf597f1-2fe4-480c-a9a4-de53edf223b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.034695 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-7cf597f1-2fe4-480c-a9a4-de53edf223b8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:05.036505 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7cf597f1-2fe4-480c-a9a4-de53edf223b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:05.046480 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4377/8844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:05.050926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7e6be-d5d1-4fc2-b04a-0af7f951dcd6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:05.061103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7e6be-d5d1-4fc2-b04a-0af7f951dcd6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:05.066858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:05.067526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.067802 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.068050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.068768 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:46:05.069096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:05.070777 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:05.082684 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4468/8845] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:46:05.087115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf597f1-2fe4-480c-a9a4-de53edf223b8 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:05.097103 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf597f1-2fe4-480c-a9a4-de53edf223b8 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:05.103352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:05.104019 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.104295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.104562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.105277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:05.107203 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:05.137792 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4378/8846] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:46:05 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:46:05.143324 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:05.154014 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898f030-ec66-43c2-a281-cea1b06463c8 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:05.211074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:05.211876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.212147 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.212418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.213136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:05.215429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:05.237251 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4469/8847] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:46:05 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:46:05.241585 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:05.251992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce633b-95e7-445d-94a0-cc62be31414b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:05.257825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:05.258009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.258207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.258453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.259182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:05.260789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:05.271373 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4379/8848] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:46:05.275560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:05.285564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3df46-54c1-4a77-b3ae-6841b1fcc3a0 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:05.290252 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4354bb-9ab7-4981-b321-a36d239c0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:05.290908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4354bb-9ab7-4981-b321-a36d239c0c5c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.291182 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4354bb-9ab7-4981-b321-a36d239c0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.291454 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4354bb-9ab7-4981-b321-a36d239c0c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.292161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4354bb-9ab7-4981-b321-a36d239c0c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:05.293820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4354bb-9ab7-4981-b321-a36d239c0c5c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:05.303503 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4470/8849] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:46:05.307699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:05.317995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c692c2c-828f-4c20-a599-d07225674e7d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:05.323007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:05.323919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.324196 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.324468 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] PATH_INFO: `/v3/projects/4071a76a44224683a79239cce8574953/users/93a7d4f90ba64dcfaf84d65638e1a652/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.339373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4071a76a44224683a79239cce8574953, user_id=93a7d4f90ba64dcfaf84d65638e1a652, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:05.342120 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:05.358064 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4380/8850] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:46:05 2022] PUT /identity/v3/projects/4071a76a44224683a79239cce8574953/users/93a7d4f90ba64dcfaf84d65638e1a652/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:46:05.363411 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05b4e6-cea7-4370-b44e-6b66a11bbfa8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.363697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05b4e6-cea7-4370-b44e-6b66a11bbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.363974 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05b4e6-cea7-4370-b44e-6b66a11bbfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.382956 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-cc05b4e6-cea7-4370-b44e-6b66a11bbfa8 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:05.384320 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cc05b4e6-cea7-4370-b44e-6b66a11bbfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:05.444149 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4471/8851] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:05.454293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:05.456250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:05.514095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1a0d-aff4-4be0-882e-80ee2ba96d89 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:05.518783 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:05.519439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:05.519717 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:05.519991 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:05.530238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:05.531702 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:05.541809 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4381/8852] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:46:09.691117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259a2b-7cdb-4ff5-9533-16f46030f24b None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:09.691664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259a2b-7cdb-4ff5-9533-16f46030f24b None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:09.697643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259a2b-7cdb-4ff5-9533-16f46030f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:09.727083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-77259a2b-7cdb-4ff5-9533-16f46030f24b None None] MFA Rules not processed for user `93a7d4f90ba64dcfaf84d65638e1a652`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:09.728329 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-77259a2b-7cdb-4ff5-9533-16f46030f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:09.792981 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4472/8853] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:09.797652 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:09.807177 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43591ce9-9d25-4674-a247-07024f2fca3c service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:09.812095 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:09.812759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:09.813204 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:09.813569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:09.814295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:09.816301 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:09.847560 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4382/8854] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:46:09 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:46:09.848994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259a2b-7cdb-4ff5-9533-16f46030f24b None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:09.862377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259a2b-7cdb-4ff5-9533-16f46030f24b None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:09.923852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:09.924552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:09.924832 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:09.925139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:09.925852 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:09.927794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:09.951191 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4473/8855] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:46:09 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:46:09.953599 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:09.964604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa15573-0047-44f4-bf82-5c3f4c51f835 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:09.969507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:09.970175 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:09.970452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:09.970788 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:09.971508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:09.973202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:09.984512 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4383/8856] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:46:09.988808 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:09.999404 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568dcc0-363b-4bd0-ac3f-2179b3fcf826 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:10.004100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:10.005008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:10.005327 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:10.005604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] PATH_INFO: `/v3/projects/a2012d9d066541f5b1ba393a2f0b5145/users/fa4b5fcc14054b55a4ef3dad274eb524/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:10.020615 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2012d9d066541f5b1ba393a2f0b5145, user_id=fa4b5fcc14054b55a4ef3dad274eb524, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:10.023354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:10.038299 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4474/8857] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:46:09 2022] PUT /identity/v3/projects/a2012d9d066541f5b1ba393a2f0b5145/users/fa4b5fcc14054b55a4ef3dad274eb524/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 21:46:10.042419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:10.052586 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb284526-a751-4d4a-bc32-974ebabce61e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:10.114048 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d8bc0-aafb-46c8-a792-aca00cdfde2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:10.114752 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d8bc0-aafb-46c8-a792-aca00cdfde2e admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:10.115039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d8bc0-aafb-46c8-a792-aca00cdfde2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:10.115310 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d8bc0-aafb-46c8-a792-aca00cdfde2e admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:10.116032 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d8bc0-aafb-46c8-a792-aca00cdfde2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:10.117743 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d8bc0-aafb-46c8-a792-aca00cdfde2e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:10.127765 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4384/8858] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:46:10.132152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:10.142780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728295d-1bda-4ad3-a50b-558f07f3b4d5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:10.147603 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242fa9-8c7c-440e-b245-91a6d30332c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:10.149152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242fa9-8c7c-440e-b245-91a6d30332c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:10.149152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242fa9-8c7c-440e-b245-91a6d30332c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:10.149152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242fa9-8c7c-440e-b245-91a6d30332c2 admin admin] PATH_INFO: `/v3/projects/a2012d9d066541f5b1ba393a2f0b5145/users/fa4b5fcc14054b55a4ef3dad274eb524/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:10.151055 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242fa9-8c7c-440e-b245-91a6d30332c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2012d9d066541f5b1ba393a2f0b5145, user_id=fa4b5fcc14054b55a4ef3dad274eb524, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:10.153747 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242fa9-8c7c-440e-b245-91a6d30332c2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:10.164026 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4475/8859] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:46:10 2022] PUT /identity/v3/projects/a2012d9d066541f5b1ba393a2f0b5145/users/fa4b5fcc14054b55a4ef3dad274eb524/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:46:14.503419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbda0-c67e-4207-aa68-f8a14544389b None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:14.504285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbda0-c67e-4207-aa68-f8a14544389b None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:14.504887 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbda0-c67e-4207-aa68-f8a14544389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:14.545569 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-787cbda0-c67e-4207-aa68-f8a14544389b None None] MFA Rules not processed for user `fa4b5fcc14054b55a4ef3dad274eb524`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:14.546897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-787cbda0-c67e-4207-aa68-f8a14544389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:14.662808 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4385/8860] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:14.694012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd276-8586-4a0a-b2e1-28005785b775 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:14.694930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd276-8586-4a0a-b2e1-28005785b775 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:14.695381 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd276-8586-4a0a-b2e1-28005785b775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:14.772472 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-df3fd276-8586-4a0a-b2e1-28005785b775 None None] MFA Rules not processed for user `3efd3561844146239d5a9aa46ff7f401`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:14.773723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-df3fd276-8586-4a0a-b2e1-28005785b775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:14.849642 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4476/8861] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Apr 9 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:14.857516 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cbda0-c67e-4207-aa68-f8a14544389b None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:14.867403 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cbda0-c67e-4207-aa68-f8a14544389b None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:14.871230 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64446066-9db6-45ed-a7b5-5add7d11f358 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:14.871916 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446066-9db6-45ed-a7b5-5add7d11f358 service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:14.872193 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446066-9db6-45ed-a7b5-5add7d11f358 service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:14.872461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446066-9db6-45ed-a7b5-5add7d11f358 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:14.939638 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64446066-9db6-45ed-a7b5-5add7d11f358 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:14.941295 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64446066-9db6-45ed-a7b5-5add7d11f358 service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:14.952581 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4386/8862] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:46:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:46:15.079656 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8ea5-a113-4748-a3a5-34514fe9ff91 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:15.079939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8ea5-a113-4748-a3a5-34514fe9ff91 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:15.080241 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8ea5-a113-4748-a3a5-34514fe9ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:15.133600 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c5dd8ea5-a113-4748-a3a5-34514fe9ff91 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:15.135046 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c5dd8ea5-a113-4748-a3a5-34514fe9ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:15.203425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4477/8863] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:15.258624 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7476-8131-4195-9c77-3c7c50401822 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:15.258914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7476-8131-4195-9c77-3c7c50401822 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:15.259189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7476-8131-4195-9c77-3c7c50401822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:15.307554 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-216a7476-8131-4195-9c77-3c7c50401822 None None] MFA Rules not processed for user `c6ff773b27b94f59b97edddcab55716f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:15.308762 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-216a7476-8131-4195-9c77-3c7c50401822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:15.389958 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4387/8864] 10.222.0.30 () {58 vars in 1039 bytes} [Sat Apr 9 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:15.397623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd8ea5-a113-4748-a3a5-34514fe9ff91 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:15.411455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd8ea5-a113-4748-a3a5-34514fe9ff91 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:15.417305 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:15.418029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:15.418308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:15.418580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:15.427562 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:15.429222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:15.437815 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4478/8865] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:46:25.922540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e625d0-2aa7-4576-930c-ee98423c9c90 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:25.923063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e625d0-2aa7-4576-930c-ee98423c9c90 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:25.923165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e625d0-2aa7-4576-930c-ee98423c9c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:25.941247 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-12e625d0-2aa7-4576-930c-ee98423c9c90 None None] MFA Rules not processed for user `93a7d4f90ba64dcfaf84d65638e1a652`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:25.942499 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-12e625d0-2aa7-4576-930c-ee98423c9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:25.950458 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4388/8866] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:26.536989 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:26.538601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:26.607567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7359e-692d-43ac-87f1-fde8559c1d41 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:26.611328 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:26.612024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:26.612301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:26.612567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:26.614424 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:26.690083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:26.692315 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:26.706791 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4479/8867] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:46:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:46:27.646750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784db41-a4b7-42e0-ab59-043ff1fad156 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:27.647234 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784db41-a4b7-42e0-ab59-043ff1fad156 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:27.647331 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784db41-a4b7-42e0-ab59-043ff1fad156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:27.665742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6784db41-a4b7-42e0-ab59-043ff1fad156 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:46:27.666962 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6784db41-a4b7-42e0-ab59-043ff1fad156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:27.679353 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4389/8868] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:46:27.687000 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:27.698444 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896842cd-b002-4c48-bf45-2b92e3cfebb6 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:27.703484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:27.704152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:27.704432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:27.704705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:27.715438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:27.717195 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:27.725626 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4480/8869] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:46:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 09 21:46:35.452542 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784db41-a4b7-42e0-ab59-043ff1fad156 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:35.462576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784db41-a4b7-42e0-ab59-043ff1fad156 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:35.467235 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:35.467885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:35.468172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:35.468435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:35.470529 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:46:35.482708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:35.484172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:35.494377 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4390/8870] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:46:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:46:49.078970 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:46:49.089131 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535ba9-9710-4aff-a86f-ff09dea4a6e2 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:46:49.094040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207ad41-f91b-4e7f-aef5-228ce49bcb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:46:49.094699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207ad41-f91b-4e7f-aef5-228ce49bcb9e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:46:49.094979 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207ad41-f91b-4e7f-aef5-228ce49bcb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:46:49.095248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207ad41-f91b-4e7f-aef5-228ce49bcb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:46:49.105661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207ad41-f91b-4e7f-aef5-228ce49bcb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:46:49.107152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207ad41-f91b-4e7f-aef5-228ce49bcb9e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:46:49.117305 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4481/8871] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:46:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:48:14.797807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:14.799367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:14.894550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0fdfd-ea1a-4d1b-b5b9-706ca33647ea service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:14.899426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:14.900081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:14.900360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:14.900628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:14.902496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:14.916114 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:14.917763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:14.929819 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4391/8872] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:48:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:48:15.835574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a266f-3698-4c51-8a1c-3c9e2ef3596e None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:15.836108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a266f-3698-4c51-8a1c-3c9e2ef3596e None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:15.836108 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a266f-3698-4c51-8a1c-3c9e2ef3596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:15.855009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-666a266f-3698-4c51-8a1c-3c9e2ef3596e None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:48:15.856219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-666a266f-3698-4c51-8a1c-3c9e2ef3596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:15.864039 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4482/8873] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 21:48:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:48:15.903753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:15.915503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4413da-b8b0-461d-bb7e-6ad1e34f9ff1 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:15.921639 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:15.922290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:15.922614 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:15.922884 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:15.931227 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:15.932829 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:15.941434 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4392/8874] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 21:48:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 21:48:23.070142 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a266f-3698-4c51-8a1c-3c9e2ef3596e None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:23.153084 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a266f-3698-4c51-8a1c-3c9e2ef3596e None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:23.158689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:23.159661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:23.159938 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:23.160211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] PATH_INFO: `/v3/users/93a7d4f90ba64dcfaf84d65638e1a652` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:23.161607 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a7d4f90ba64dcfaf84d65638e1a652)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:23.163581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:23.213021 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a7d4f90ba64dcfaf84d65638e1a652'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.213698 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a7d4f90ba64dcfaf84d65638e1a652'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.221402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a7d4f90ba64dcfaf84d65638e1a652'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.233957 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a7d4f90ba64dcfaf84d65638e1a652'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.234840 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a7d4f90ba64dcfaf84d65638e1a652'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.255901 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4483/8875] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:48:23 2022] DELETE /identity/v3/users/93a7d4f90ba64dcfaf84d65638e1a652 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:48:23.445277 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:23.460914 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced199be-68cb-49fa-a827-1bcd834e667c service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:23.517302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:23.518250 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:23.518535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:23.518809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] PATH_INFO: `/v3/projects/4071a76a44224683a79239cce8574953` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:23.520007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4071a76a44224683a79239cce8574953)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:23.522003 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:23.567954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4071a76a44224683a79239cce8574953', 'request_id': 'req-19e0d986-78b8-465e-955c-43a377a55971'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.574025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4071a76a44224683a79239cce8574953', 'request_id': 'req-19e0d986-78b8-465e-955c-43a377a55971'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.583115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4071a76a44224683a79239cce8574953', 'request_id': 'req-19e0d986-78b8-465e-955c-43a377a55971'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.606451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] The token cache is being invalidate because project 4071a76a44224683a79239cce8574953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:48:23.606733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.607380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.609008 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4393/8876] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:48:23 2022] DELETE /identity/v3/projects/4071a76a44224683a79239cce8574953 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:48:23.613263 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:23.614869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:23.628285 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9b46a-6ecc-45a0-8cb6-41a0ee14e198 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:23.684952 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:23.685873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:23.686171 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:23.686418 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] PATH_INFO: `/v3/users/fa4b5fcc14054b55a4ef3dad274eb524` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:23.687668 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4b5fcc14054b55a4ef3dad274eb524)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:23.689563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:23.739572 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4b5fcc14054b55a4ef3dad274eb524'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.740221 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4b5fcc14054b55a4ef3dad274eb524'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.746982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4b5fcc14054b55a4ef3dad274eb524'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.757242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4b5fcc14054b55a4ef3dad274eb524'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.757893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-ad34c570-b2fd-48e7-b7ec-3e6395e355fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4b5fcc14054b55a4ef3dad274eb524'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:23.775189 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4484/8877] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:48:23 2022] DELETE /identity/v3/users/fa4b5fcc14054b55a4ef3dad274eb524 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:48:23.949618 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:23.951886 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:23.965922 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d986-78b8-465e-955c-43a377a55971 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.030180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.031079 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.031360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.031636 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] PATH_INFO: `/v3/projects/a2012d9d066541f5b1ba393a2f0b5145` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.032939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2012d9d066541f5b1ba393a2f0b5145)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.035145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.085778 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2012d9d066541f5b1ba393a2f0b5145', 'request_id': 'req-d45882f7-d07c-45df-9e5d-980f69789c3b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:24.091669 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2012d9d066541f5b1ba393a2f0b5145', 'request_id': 'req-d45882f7-d07c-45df-9e5d-980f69789c3b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:24.100836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2012d9d066541f5b1ba393a2f0b5145', 'request_id': 'req-d45882f7-d07c-45df-9e5d-980f69789c3b'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:24.112356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] The token cache is being invalidate because project a2012d9d066541f5b1ba393a2f0b5145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:48:24.112637 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:24.113289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-d45882f7-d07c-45df-9e5d-980f69789c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:48:24.114946 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4394/8878] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:48:23 2022] DELETE /identity/v3/projects/a2012d9d066541f5b1ba393a2f0b5145 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:48:24.120227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9170-e1f2-4229-b253-1d1cebf8e524 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.120753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9170-e1f2-4229-b253-1d1cebf8e524 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.120860 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9170-e1f2-4229-b253-1d1cebf8e524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.178958 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-87eb9170-e1f2-4229-b253-1d1cebf8e524 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:48:24.180188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-87eb9170-e1f2-4229-b253-1d1cebf8e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:24.241005 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4485/8879] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:48:24.249481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e5d3-462e-4adb-9605-0c7087a2aedf None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.249774 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e5d3-462e-4adb-9605-0c7087a2aedf None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.250047 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e5d3-462e-4adb-9605-0c7087a2aedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.268882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f489e5d3-462e-4adb-9605-0c7087a2aedf None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:48:24.270161 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f489e5d3-462e-4adb-9605-0c7087a2aedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:24.280772 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4395/8880] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:48:24.287388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb9170-e1f2-4229-b253-1d1cebf8e524 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.300882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb9170-e1f2-4229-b253-1d1cebf8e524 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.318814 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.319509 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.319792 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.320060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.320984 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:48:24.321359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.323112 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.337308 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4486/8881] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:48:24.342094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e5d3-462e-4adb-9605-0c7087a2aedf None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.355289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e5d3-462e-4adb-9605-0c7087a2aedf None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.363078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.363748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.364028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.364306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.364987 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.366951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.397952 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4396/8882] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:48:24 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:48:24.402885 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.418318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7165039-6541-4883-9870-ab95a40a90b7 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.481905 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.482895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.483209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.483493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.484200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.486226 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.510962 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4487/8883] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:48:24 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 21:48:24.515384 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.525912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f997ae-cd24-4c7c-bf76-487afc2d4357 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.530850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.531530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.531812 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.532087 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.532830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.534692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.546015 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4397/8884] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:48:24.550202 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.560714 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3cbd-2050-42fc-b6b4-e152d0ae72a6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.566473 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda276-a7a9-4a17-b247-276f9625889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.567170 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda276-a7a9-4a17-b247-276f9625889c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.567455 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda276-a7a9-4a17-b247-276f9625889c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.567731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda276-a7a9-4a17-b247-276f9625889c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.568445 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda276-a7a9-4a17-b247-276f9625889c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.570103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda276-a7a9-4a17-b247-276f9625889c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.580312 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4488/8885] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:48:24.584893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.597377 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f667-3d5a-4bae-8c62-3b36979f675b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.603039 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.603933 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.604212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.604486 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] PATH_INFO: `/v3/projects/91139f4484934b158e5ee647130aa2cd/users/825f74ae6ae748e2a963ec24f8498b3a/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.620583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91139f4484934b158e5ee647130aa2cd, user_id=825f74ae6ae748e2a963ec24f8498b3a, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.623266 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.638093 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4398/8886] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:48:24 2022] PUT /identity/v3/projects/91139f4484934b158e5ee647130aa2cd/users/825f74ae6ae748e2a963ec24f8498b3a/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:48:24.649673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b33e-272e-48e0-bf98-27a340808b53 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.649961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b33e-272e-48e0-bf98-27a340808b53 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.650238 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b33e-272e-48e0-bf98-27a340808b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.679233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8903b33e-272e-48e0-bf98-27a340808b53 None None] MFA Rules not processed for user `825f74ae6ae748e2a963ec24f8498b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:48:24.680467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8903b33e-272e-48e0-bf98-27a340808b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:24.745713 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4489/8887] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:48:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:48:24.750452 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.812836 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22efd7-72eb-45e2-93dd-22b2ccd18c7e admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.818422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.819084 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.819411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.819675 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.820354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.822314 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.850373 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4399/8888] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:48:24 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:48:24.854537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903b33e-272e-48e0-bf98-27a340808b53 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.865314 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903b33e-272e-48e0-bf98-27a340808b53 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.920751 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.921468 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.921780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.922056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.922738 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.924739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.948203 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4490/8889] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:48:24 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:48:24.952986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:24.964106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8c49-4774-4da0-9254-4730c211d1dd admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:24.969584 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:24.970260 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:24.970575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:24.970850 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:24.971574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:24.973220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:24.986584 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4400/8890] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:48:24.991065 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:25.001590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab631918-614b-4c24-b335-351f01126286 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:25.006962 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:25.007858 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:25.008139 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:25.008412 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] PATH_INFO: `/v3/projects/b54b4c604dd24d47a5c5fd7bb442a428/users/83357100ed1842aeb747bf21a1b81e02/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:25.023136 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54b4c604dd24d47a5c5fd7bb442a428, user_id=83357100ed1842aeb747bf21a1b81e02, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:25.025889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:25.040294 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4491/8891] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:48:24 2022] PUT /identity/v3/projects/b54b4c604dd24d47a5c5fd7bb442a428/users/83357100ed1842aeb747bf21a1b81e02/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:48:25.044381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:25.054632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac4b6-aa47-4eb5-8996-a300dbbbc4da admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:25.110435 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d4f0-5017-4324-b97b-9ff116ef25ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:25.111025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d4f0-5017-4324-b97b-9ff116ef25ad admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:25.111305 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d4f0-5017-4324-b97b-9ff116ef25ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:25.111582 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d4f0-5017-4324-b97b-9ff116ef25ad admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:25.112376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d4f0-5017-4324-b97b-9ff116ef25ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:25.114024 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d4f0-5017-4324-b97b-9ff116ef25ad admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:25.124007 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4401/8892] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:48:25.128611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:25.139056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9dd7-54a8-4b61-9d85-382d17f84451 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:25.144199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:25.145235 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:25.145520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:25.145805 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] PATH_INFO: `/v3/projects/b54b4c604dd24d47a5c5fd7bb442a428/users/83357100ed1842aeb747bf21a1b81e02/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:25.147899 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54b4c604dd24d47a5c5fd7bb442a428, user_id=83357100ed1842aeb747bf21a1b81e02, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:25.150596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:25.161019 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4492/8893] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:48:25 2022] PUT /identity/v3/projects/b54b4c604dd24d47a5c5fd7bb442a428/users/83357100ed1842aeb747bf21a1b81e02/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:48:25.171148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:25.171469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:25.171745 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:25.198981 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] MFA Rules not processed for user `83357100ed1842aeb747bf21a1b81e02`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:48:25.200216 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:25.276606 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4402/8894] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:48:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:48:25.288184 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:25.290050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:25.376670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d9b8-e36f-4cfa-a029-3443f4d9d72d admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:25.382787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2f2d-fd99-4594-9db4-53a4fe82d413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:25.383450 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2f2d-fd99-4594-9db4-53a4fe82d413 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:25.383730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2f2d-fd99-4594-9db4-53a4fe82d413 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:25.384005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2f2d-fd99-4594-9db4-53a4fe82d413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:25.439169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2f2d-fd99-4594-9db4-53a4fe82d413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:25.440851 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2f2d-fd99-4594-9db4-53a4fe82d413 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:25.450400 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4493/8895] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:48:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:48:28.730648 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:28.732211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:28.799413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af695e-6f44-4f51-ab6d-8a2c8b16bf83 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:28.803140 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:28.803785 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:28.804061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:28.804330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:28.813419 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:28.814874 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:28.824225 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4403/8896] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:48:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:48:31.860960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:31.861758 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:31.862296 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:31.882047 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] MFA Rules not processed for user `825f74ae6ae748e2a963ec24f8498b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:48:31.883316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:31.891830 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4494/8897] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:48:32.226336 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:32.227810 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:32.238843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d9a9-d7d9-4a72-92e1-425a99b7e210 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:32.242731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:32.243379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:32.243966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:32.243966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:32.245852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:32.257913 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:32.259369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:32.270041 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4404/8898] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:48:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:48:32.595214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:32.597079 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:32.680797 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d690e-4276-4a39-be0a-1db1208bf7d7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:32.687799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:32.688491 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:32.688798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:32.689087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:32.691026 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:32.704135 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:32.705928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:32.717463 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4495/8899] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:48:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:48:34.511134 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:48:34.523714 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3534ebd-4704-4425-ba76-2f3e2557372e service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:48:34.527646 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:48:34.528335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:48:34.528683 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:48:34.528954 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:48:34.530968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:48:34.544547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:48:34.546061 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:48:34.558627 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4405/8900] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:48:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:49:18.055230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:49:18.068795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4529073-14d1-418f-a1ef-66e7b4cc6210 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:49:18.075527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:49:18.076175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:49:18.076452 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:49:18.076717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:49:18.078961 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:49:18.093811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:49:18.095423 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:49:18.108367 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4496/8901] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:49:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:49:54.926900 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:49:54.943445 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163fb18-2a39-44e6-bcda-fe8333246578 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:49:54.949339 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08c0f3-4f40-4695-a91e-0afddd5eb1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:49:54.950693 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08c0f3-4f40-4695-a91e-0afddd5eb1ed service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:49:54.951020 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08c0f3-4f40-4695-a91e-0afddd5eb1ed service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:49:54.951495 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08c0f3-4f40-4695-a91e-0afddd5eb1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:49:54.953527 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ab08c0f3-4f40-4695-a91e-0afddd5eb1ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:49:54.968992 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08c0f3-4f40-4695-a91e-0afddd5eb1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:49:54.970622 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08c0f3-4f40-4695-a91e-0afddd5eb1ed service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:49:54.985005 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4406/8902] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:49:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:49:57.562700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:49:57.564318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:49:57.582276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57534e-b57a-4725-8ce8-1d71393d37e4 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:49:57.588239 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:49:57.588902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:49:57.589208 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:49:57.589483 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:49:57.591245 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:49:57.607793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:49:57.609655 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:49:57.623302 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4497/8903] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:49:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:50:07.574290 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122481-86b7-45d9-84e3-cc2ea07b7d82 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:50:07.574846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122481-86b7-45d9-84e3-cc2ea07b7d82 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:50:07.574846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122481-86b7-45d9-84e3-cc2ea07b7d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:50:07.592725 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0e122481-86b7-45d9-84e3-cc2ea07b7d82 None None] MFA Rules not processed for user `825f74ae6ae748e2a963ec24f8498b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:50:07.593978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0e122481-86b7-45d9-84e3-cc2ea07b7d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:50:07.601568 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4407/8904] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:50:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:50:08.359402 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:50:08.361681 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:50:08.385484 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3c69-e3c3-4bb3-aecc-e2ec27cabc6c service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:50:08.392967 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:50:08.394799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:50:08.395669 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:50:08.396514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:50:08.400413 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:50:08.415459 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:50:08.418277 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:50:08.457270 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4498/8905] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:50:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:50:16.100228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e122481-86b7-45d9-84e3-cc2ea07b7d82 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:50:16.118164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e122481-86b7-45d9-84e3-cc2ea07b7d82 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:50:16.124428 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcbc80-4b7e-4822-a613-788bf6ae15cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:50:16.125122 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcbc80-4b7e-4822-a613-788bf6ae15cf service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:50:16.125399 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcbc80-4b7e-4822-a613-788bf6ae15cf service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:50:16.125664 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcbc80-4b7e-4822-a613-788bf6ae15cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:50:16.127807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-80fcbc80-4b7e-4822-a613-788bf6ae15cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:50:16.143426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcbc80-4b7e-4822-a613-788bf6ae15cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:50:16.145205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcbc80-4b7e-4822-a613-788bf6ae15cf service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:50:16.160416 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4408/8906] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:50:51.272769 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:50:51.282692 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd0c9-f741-4750-a286-fd52453c5d4c service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:50:51.287319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e59434-e642-44e9-9dea-97012ebba641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:50:51.287964 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59434-e642-44e9-9dea-97012ebba641 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:50:51.288236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59434-e642-44e9-9dea-97012ebba641 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:50:51.288501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59434-e642-44e9-9dea-97012ebba641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:50:51.290689 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-24e59434-e642-44e9-9dea-97012ebba641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:50:51.308210 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e59434-e642-44e9-9dea-97012ebba641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:50:51.309720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e59434-e642-44e9-9dea-97012ebba641 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:50:51.323419 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4499/8907] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:50:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:51:20.944396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4660-9cd0-4b60-8cfd-99dd1bd190bd None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:20.945101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4660-9cd0-4b60-8cfd-99dd1bd190bd None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:20.945101 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4660-9cd0-4b60-8cfd-99dd1bd190bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:20.993757 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-22dd4660-9cd0-4b60-8cfd-99dd1bd190bd None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:51:20.994974 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-22dd4660-9cd0-4b60-8cfd-99dd1bd190bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:51:21.005532 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4409/8908] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Apr 9 21:51:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:51:21.019489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e209-cd23-4f4f-9669-e37d76481c52 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:21.019975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e209-cd23-4f4f-9669-e37d76481c52 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:21.019975 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e209-cd23-4f4f-9669-e37d76481c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:21.039154 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-c496e209-cd23-4f4f-9669-e37d76481c52 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:51:21.040346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c496e209-cd23-4f4f-9669-e37d76481c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:51:21.050058 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4500/8909] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 21:51:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:51:21.056187 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4660-9cd0-4b60-8cfd-99dd1bd190bd None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:51:21.067151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4660-9cd0-4b60-8cfd-99dd1bd190bd None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:51:21.073602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b87c2a-489c-47c3-8f7e-09bc77476f54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:51:21.074242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87c2a-489c-47c3-8f7e-09bc77476f54 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:21.074512 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87c2a-489c-47c3-8f7e-09bc77476f54 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:21.074777 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87c2a-489c-47c3-8f7e-09bc77476f54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:21.083708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b87c2a-489c-47c3-8f7e-09bc77476f54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:51:21.085328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b87c2a-489c-47c3-8f7e-09bc77476f54 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:51:21.095183 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4410/8910] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:51:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:51:21.449255 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0404-e1e8-4b9b-9a5e-412a4abcc857 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:21.449543 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0404-e1e8-4b9b-9a5e-412a4abcc857 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:21.449810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0404-e1e8-4b9b-9a5e-412a4abcc857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:21.469557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-bc1f0404-e1e8-4b9b-9a5e-412a4abcc857 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:51:21.470760 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-bc1f0404-e1e8-4b9b-9a5e-412a4abcc857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:51:21.481509 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4501/8911] 10.222.0.32 () {58 vars in 1015 bytes} [Sat Apr 9 21:51:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:51:21.517063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44bae4-e1e9-4585-bd15-a2175a31d510 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:21.517376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44bae4-e1e9-4585-bd15-a2175a31d510 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:21.517644 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44bae4-e1e9-4585-bd15-a2175a31d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:21.537225 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-ba44bae4-e1e9-4585-bd15-a2175a31d510 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:51:21.538408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ba44bae4-e1e9-4585-bd15-a2175a31d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:51:21.548663 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4411/8912] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 21:51:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:51:21.554660 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0404-e1e8-4b9b-9a5e-412a4abcc857 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:51:21.565673 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0404-e1e8-4b9b-9a5e-412a4abcc857 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:51:21.571990 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:51:21.572644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:21.572921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:21.573225 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:21.582163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:51:21.583798 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:51:21.593621 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4502/8913] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:51:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:51:35.092483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44bae4-e1e9-4585-bd15-a2175a31d510 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:51:35.102948 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44bae4-e1e9-4585-bd15-a2175a31d510 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:51:35.107461 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9732856-adeb-4776-a24c-8cab0dc68ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:51:35.108113 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732856-adeb-4776-a24c-8cab0dc68ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:35.108391 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732856-adeb-4776-a24c-8cab0dc68ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:35.108660 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732856-adeb-4776-a24c-8cab0dc68ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:35.110799 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e9732856-adeb-4776-a24c-8cab0dc68ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:51:35.116865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:51:35.124138 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9732856-adeb-4776-a24c-8cab0dc68ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:51:35.125719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9732856-adeb-4776-a24c-8cab0dc68ba4 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:51:35.126217 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b125013-14fe-4513-bd59-bb2cd0cf01b6 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:51:35.130086 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:51:35.130736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:35.131012 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:35.131289 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:35.133186 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:51:35.136971 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4412/8914] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:51:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:51:35.152150 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:51:35.153680 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:51:35.167696 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4503/8915] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:51:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:51:47.171978 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f83a3e-41cd-4a01-98e9-b3e12cb3abad None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:51:47.172612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f83a3e-41cd-4a01-98e9-b3e12cb3abad None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:51:47.172612 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f83a3e-41cd-4a01-98e9-b3e12cb3abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:51:47.194921 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-f3f83a3e-41cd-4a01-98e9-b3e12cb3abad None None] MFA Rules not processed for user `825f74ae6ae748e2a963ec24f8498b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:51:47.196328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f3f83a3e-41cd-4a01-98e9-b3e12cb3abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:51:47.204108 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4413/8916] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:51:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:04.853433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:04.856623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1756-a69b-4632-9efa-420e2e55591d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:04.857125 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1756-a69b-4632-9efa-420e2e55591d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:04.857253 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1756-a69b-4632-9efa-420e2e55591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:04.862902 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c7bab-3ac1-420e-a437-f1b562502dc3 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:04.867939 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dd99f-d0f9-4dfd-b5b9-890510483898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:04.868674 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd99f-d0f9-4dfd-b5b9-890510483898 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:04.868953 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd99f-d0f9-4dfd-b5b9-890510483898 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:04.869280 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd99f-d0f9-4dfd-b5b9-890510483898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:04.871438 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-432dd99f-d0f9-4dfd-b5b9-890510483898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:04.884204 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd99f-d0f9-4dfd-b5b9-890510483898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:04.885715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd99f-d0f9-4dfd-b5b9-890510483898 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:04.896641 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4504/8917] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:53:04.897330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-cc3f1756-a69b-4632-9efa-420e2e55591d None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:04.898659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc3f1756-a69b-4632-9efa-420e2e55591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:04.909135 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4414/8918] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 21:53:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:04.915271 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411883-a673-410c-bea7-15adf7dc67f4 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:04.915566 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411883-a673-410c-bea7-15adf7dc67f4 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:04.915849 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411883-a673-410c-bea7-15adf7dc67f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:04.935500 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-4d411883-a673-410c-bea7-15adf7dc67f4 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:04.936715 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-4d411883-a673-410c-bea7-15adf7dc67f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:04.947209 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4505/8919] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:53:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:53:04.960132 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f1756-a69b-4632-9efa-420e2e55591d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:04.970121 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f1756-a69b-4632-9efa-420e2e55591d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:04.974293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:04.975420 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:04.975759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:04.976309 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:04.987013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:04.988485 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:04.992592 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f2862-6e28-4a1d-ad78-1cd15388dc0f None None] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:04.992875 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f2862-6e28-4a1d-ad78-1cd15388dc0f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:04.993183 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f2862-6e28-4a1d-ad78-1cd15388dc0f None None] PATH_INFO: `/` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:04.994591 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4506/8920] 10.222.0.30 () {54 vars in 921 bytes} [Sat Apr 9 21:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 09 21:53:04.999604 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f410-2796-47c5-84f7-e046e3ccbee0 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:04.999884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f410-2796-47c5-84f7-e046e3ccbee0 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:05.000162 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f410-2796-47c5-84f7-e046e3ccbee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:05.002923 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4415/8921] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:53:05.019165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-6b79f410-2796-47c5-84f7-e046e3ccbee0 None None] MFA Rules not processed for user `d46de1b79f16410fbd8dc2d1c1ecc29d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:05.020378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6b79f410-2796-47c5-84f7-e046e3ccbee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:05.029946 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4507/8922] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:53:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:05.050411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:05.063919 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d66916-8e18-4475-be86-43f59233e8b9 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:05.070013 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c743e-5bf9-4b0f-a75e-d7d41b435f48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:05.070689 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c743e-5bf9-4b0f-a75e-d7d41b435f48 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:05.070951 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c743e-5bf9-4b0f-a75e-d7d41b435f48 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:05.071653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c743e-5bf9-4b0f-a75e-d7d41b435f48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:05.080538 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c743e-5bf9-4b0f-a75e-d7d41b435f48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:05.082210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c743e-5bf9-4b0f-a75e-d7d41b435f48 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:05.092441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4416/8923] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:53:05.260240 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79f410-2796-47c5-84f7-e046e3ccbee0 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:05.271816 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79f410-2796-47c5-84f7-e046e3ccbee0 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:05.274521 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06064d5b-c985-42be-9e53-c61c5a490521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:05.275166 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06064d5b-c985-42be-9e53-c61c5a490521 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:05.275440 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06064d5b-c985-42be-9e53-c61c5a490521 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:05.275708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06064d5b-c985-42be-9e53-c61c5a490521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:05.277477 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-06064d5b-c985-42be-9e53-c61c5a490521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:05.292886 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06064d5b-c985-42be-9e53-c61c5a490521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:05.294378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06064d5b-c985-42be-9e53-c61c5a490521 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:05.307677 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4508/8924] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:53:06.175341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ebed-43cd-405a-8d37-f27c395d0a6d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:06.175801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ebed-43cd-405a-8d37-f27c395d0a6d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:06.175911 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ebed-43cd-405a-8d37-f27c395d0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:06.195352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-66d3ebed-43cd-405a-8d37-f27c395d0a6d None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:06.196694 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-66d3ebed-43cd-405a-8d37-f27c395d0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:06.206791 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4417/8925] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Apr 9 21:53:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:06.212960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5293-ca9d-47fd-bd6f-cacfd4215603 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:06.213606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5293-ca9d-47fd-bd6f-cacfd4215603 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:06.213606 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5293-ca9d-47fd-bd6f-cacfd4215603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:06.231929 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-484b5293-ca9d-47fd-bd6f-cacfd4215603 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:06.233300 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-484b5293-ca9d-47fd-bd6f-cacfd4215603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:06.242738 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4509/8926] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:53:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:06.253806 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3ebed-43cd-405a-8d37-f27c395d0a6d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:06.263487 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3ebed-43cd-405a-8d37-f27c395d0a6d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:06.267441 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:06.268165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:06.268600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:06.268851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:06.279627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:06.281081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:06.297596 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4418/8927] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:53:18.684432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57079f31-083d-4f76-a6f7-27173551b8e8 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:18.685176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57079f31-083d-4f76-a6f7-27173551b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:18.685176 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57079f31-083d-4f76-a6f7-27173551b8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:18.723771 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-57079f31-083d-4f76-a6f7-27173551b8e8 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:18.725414 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-57079f31-083d-4f76-a6f7-27173551b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:18.733472 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4510/8928] 10.222.0.32 () {58 vars in 1015 bytes} [Sat Apr 9 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:18.745733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:18.755112 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9568-6487-43d0-8fea-f39f7c50a57d service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:18.759587 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:18.760217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:18.760496 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:18.760814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:18.768396 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:18.769873 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:18.777911 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4419/8929] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:53:21.344383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a5a7a-2cc4-49cb-9152-927c02761b41 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:21.344926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a5a7a-2cc4-49cb-9152-927c02761b41 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:21.344926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a5a7a-2cc4-49cb-9152-927c02761b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:21.365471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-b16a5a7a-2cc4-49cb-9152-927c02761b41 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:21.366666 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b16a5a7a-2cc4-49cb-9152-927c02761b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:21.374300 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4511/8930] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Apr 9 21:53:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:21.386406 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:21.395530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c6179-3bc9-4135-a710-9512ec28230d service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:21.399804 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c16988-a77e-4660-aab2-3480e8350e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:21.400451 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16988-a77e-4660-aab2-3480e8350e7c service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:21.400731 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16988-a77e-4660-aab2-3480e8350e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:21.401002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16988-a77e-4660-aab2-3480e8350e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:21.408801 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c16988-a77e-4660-aab2-3480e8350e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:21.410315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c16988-a77e-4660-aab2-3480e8350e7c service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:21.418507 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4420/8931] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:53:24.629343 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a5a7a-2cc4-49cb-9152-927c02761b41 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:24.643326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a5a7a-2cc4-49cb-9152-927c02761b41 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:24.650273 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:24.651044 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:24.651339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:24.651595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:24.660096 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:24.661779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:24.671077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4512/8932] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:53:54.220160 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832ac8-d71b-4b29-a3cb-742a4d6593e9 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:54.221163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832ac8-d71b-4b29-a3cb-742a4d6593e9 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:54.221709 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832ac8-d71b-4b29-a3cb-742a4d6593e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:54.245504 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3d832ac8-d71b-4b29-a3cb-742a4d6593e9 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:53:54.247201 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3d832ac8-d71b-4b29-a3cb-742a4d6593e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:53:54.257475 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4421/8933] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:53:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:53:54.272693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:53:54.286598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c39a3-6997-41cb-9708-a6a1f2cadf7c service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:53:54.292677 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c45844-aa70-4f57-baf2-a41b8c8716c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:53:54.293480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c45844-aa70-4f57-baf2-a41b8c8716c9 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:53:54.293818 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c45844-aa70-4f57-baf2-a41b8c8716c9 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:53:54.294157 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c45844-aa70-4f57-baf2-a41b8c8716c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:53:54.305723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c45844-aa70-4f57-baf2-a41b8c8716c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:53:54.307530 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c45844-aa70-4f57-baf2-a41b8c8716c9 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:53:54.320687 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4513/8934] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:53:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:54:03.401912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d832ac8-d71b-4b29-a3cb-742a4d6593e9 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:54:03.412088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d832ac8-d71b-4b29-a3cb-742a4d6593e9 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:54:03.416503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a095a-679b-4b4a-9748-1d6d6ff48fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:54:03.417292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a095a-679b-4b4a-9748-1d6d6ff48fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:03.417575 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a095a-679b-4b4a-9748-1d6d6ff48fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:03.417846 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a095a-679b-4b4a-9748-1d6d6ff48fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:03.427682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a095a-679b-4b4a-9748-1d6d6ff48fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:54:03.429214 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a095a-679b-4b4a-9748-1d6d6ff48fa5 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:54:03.439452 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4422/8935] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:54:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:54:06.309622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7d4ca-10b3-4907-91b1-2280a17f3c38 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:06.310165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7d4ca-10b3-4907-91b1-2280a17f3c38 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:06.310165 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7d4ca-10b3-4907-91b1-2280a17f3c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:06.331569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-eed7d4ca-10b3-4907-91b1-2280a17f3c38 None None] MFA Rules not processed for user `825f74ae6ae748e2a963ec24f8498b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:54:06.334495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-eed7d4ca-10b3-4907-91b1-2280a17f3c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:54:06.342569 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4514/8936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:54:06.694224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43411a4-87b0-4006-aaec-4ea6fd938ea0 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:06.694843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43411a4-87b0-4006-aaec-4ea6fd938ea0 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:06.694843 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43411a4-87b0-4006-aaec-4ea6fd938ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:06.720934 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-c43411a4-87b0-4006-aaec-4ea6fd938ea0 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:54:06.723596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-c43411a4-87b0-4006-aaec-4ea6fd938ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:54:06.734922 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4423/8937] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:54:06.752193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7d4ca-10b3-4907-91b1-2280a17f3c38 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:54:06.764526 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7d4ca-10b3-4907-91b1-2280a17f3c38 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:54:06.770283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9f6e9-7a7b-44a6-97e9-98c50d05afe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:54:06.771001 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f6e9-7a7b-44a6-97e9-98c50d05afe9 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:06.771283 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f6e9-7a7b-44a6-97e9-98c50d05afe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:06.771547 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f6e9-7a7b-44a6-97e9-98c50d05afe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:06.782041 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f6e9-7a7b-44a6-97e9-98c50d05afe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:54:06.783823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f6e9-7a7b-44a6-97e9-98c50d05afe9 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:54:06.794703 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4515/8938] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:54:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:54:07.193885 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43411a4-87b0-4006-aaec-4ea6fd938ea0 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:54:07.206682 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43411a4-87b0-4006-aaec-4ea6fd938ea0 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:54:07.215135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:54:07.215814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:07.216090 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:07.216368 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:07.227001 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:54:07.228687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:54:07.246912 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4424/8939] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:54:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:54:10.020723 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8af0-20bd-4dd4-9a91-d8ae272bf5e1 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:10.021366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8af0-20bd-4dd4-9a91-d8ae272bf5e1 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:10.021732 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8af0-20bd-4dd4-9a91-d8ae272bf5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:10.058721 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5beb8af0-20bd-4dd4-9a91-d8ae272bf5e1 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:54:10.060216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5beb8af0-20bd-4dd4-9a91-d8ae272bf5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:54:10.076128 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4516/8940] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:54:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:54:10.101224 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:54:10.114381 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361901d6-7088-4312-a590-6bd1c346bf64 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:54:10.120418 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:54:10.121335 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:10.121607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:10.122069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:10.133202 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:54:10.135233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:54:10.147567 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4425/8941] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:54:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:54:16.834667 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e415-1e4a-43f9-98e6-a2636d1367de None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:16.835248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e415-1e4a-43f9-98e6-a2636d1367de None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:16.835248 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e415-1e4a-43f9-98e6-a2636d1367de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:16.856578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8c33e415-1e4a-43f9-98e6-a2636d1367de None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:54:16.858432 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8c33e415-1e4a-43f9-98e6-a2636d1367de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:54:16.869478 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4517/8942] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 21:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:54:16.900306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:54:16.911742 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0d1aa-4506-4c35-879f-577c1619350b service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:54:16.919723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:54:16.920532 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:54:16.920818 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:54:16.921154 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:54:16.931178 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:54:16.932796 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:54:16.943441 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4426/8943] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:56:24.981016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e415-1e4a-43f9-98e6-a2636d1367de None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:56:25.023895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e415-1e4a-43f9-98e6-a2636d1367de None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:56:25.030103 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e2c36-f5e6-494f-808d-2fc316e997f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:56:25.030743 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2c36-f5e6-494f-808d-2fc316e997f1 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:56:25.031020 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2c36-f5e6-494f-808d-2fc316e997f1 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:56:25.031287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2c36-f5e6-494f-808d-2fc316e997f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:56:25.040374 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e2c36-f5e6-494f-808d-2fc316e997f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:56:25.042036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e2c36-f5e6-494f-808d-2fc316e997f1 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:56:25.052022 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4518/8944] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:56:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:56:30.439665 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:56:30.484591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3026-74fe-4ba3-ac93-c8a68029134f service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:56:30.490458 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2216b1f-b305-4be1-b513-840bf6f0e921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:56:30.491105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216b1f-b305-4be1-b513-840bf6f0e921 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:56:30.491380 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216b1f-b305-4be1-b513-840bf6f0e921 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:56:30.491654 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216b1f-b305-4be1-b513-840bf6f0e921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:56:30.500517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2216b1f-b305-4be1-b513-840bf6f0e921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:56:30.502165 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2216b1f-b305-4be1-b513-840bf6f0e921 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:56:30.512000 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4427/8945] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:56:47.423576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5200c6-0529-44c2-9d9d-a178f2d6f117 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:56:47.423576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5200c6-0529-44c2-9d9d-a178f2d6f117 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:56:47.423576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5200c6-0529-44c2-9d9d-a178f2d6f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:56:47.460836 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-8a5200c6-0529-44c2-9d9d-a178f2d6f117 None None] MFA Rules not processed for user `825f74ae6ae748e2a963ec24f8498b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:56:47.463555 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-8a5200c6-0529-44c2-9d9d-a178f2d6f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:56:47.478362 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4519/8946] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:56:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:56:47.794918 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bcfcb-19fb-48d8-b201-8fc93b2b1626 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:56:47.795483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bcfcb-19fb-48d8-b201-8fc93b2b1626 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:56:47.795483 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bcfcb-19fb-48d8-b201-8fc93b2b1626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:56:47.826547 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-184bcfcb-19fb-48d8-b201-8fc93b2b1626 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:56:47.827754 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-184bcfcb-19fb-48d8-b201-8fc93b2b1626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:56:47.844298 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4428/8947] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 21:56:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:56:47.857281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5200c6-0529-44c2-9d9d-a178f2d6f117 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:56:47.866736 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5200c6-0529-44c2-9d9d-a178f2d6f117 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:56:47.870276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:56:47.870921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:56:47.871194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:56:47.871463 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:56:47.878963 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:56:47.880421 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:56:47.889078 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4520/8948] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:56:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 21:56:48.231576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bcfcb-19fb-48d8-b201-8fc93b2b1626 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:56:48.244968 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bcfcb-19fb-48d8-b201-8fc93b2b1626 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:56:48.250139 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d27b05-d147-44c3-8022-4c35d3760fed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:56:48.250798 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d27b05-d147-44c3-8022-4c35d3760fed service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:56:48.251072 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d27b05-d147-44c3-8022-4c35d3760fed service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:56:48.251353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d27b05-d147-44c3-8022-4c35d3760fed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:56:48.261207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d27b05-d147-44c3-8022-4c35d3760fed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:56:48.262837 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d27b05-d147-44c3-8022-4c35d3760fed service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:56:48.288760 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4429/8949] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:56:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:57:48.757363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:48.818260 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa3429-5361-4bd8-acbc-9f293727b207 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:48.822883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:48.823774 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:48.824049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:48.824318 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] PATH_INFO: `/v3/users/825f74ae6ae748e2a963ec24f8498b3a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:48.825563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825f74ae6ae748e2a963ec24f8498b3a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:48.827505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:48.885353 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825f74ae6ae748e2a963ec24f8498b3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:48.886076 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825f74ae6ae748e2a963ec24f8498b3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:48.893193 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825f74ae6ae748e2a963ec24f8498b3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:48.903458 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825f74ae6ae748e2a963ec24f8498b3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:48.904351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825f74ae6ae748e2a963ec24f8498b3a'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:48.922609 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4521/8950] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:57:48 2022] DELETE /identity/v3/users/825f74ae6ae748e2a963ec24f8498b3a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:57:48.927481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:48.928030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:48.928030 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:48.946720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:57:48.948016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:49.008348 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4430/8951] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:57:49.018528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:49.020190 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:49.081406 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e33f-ce72-4b42-88cb-dff93e207fa6 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:49.086287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:49.086940 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:49.087211 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:49.087492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:49.097268 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:49.098728 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:49.108575 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4522/8952] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:57:49.286559 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:49.288046 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:49.300686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b017fe-2c87-4f2c-a409-2c5e6d48df2e None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:49.306492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:49.307525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:49.308033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:49.308330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] PATH_INFO: `/v3/projects/91139f4484934b158e5ee647130aa2cd` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:49.309740 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91139f4484934b158e5ee647130aa2cd)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:49.311651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:49.370706 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91139f4484934b158e5ee647130aa2cd', 'request_id': 'req-6e0af2ea-d696-410f-aa75-b3110f4b0126'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.376027 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91139f4484934b158e5ee647130aa2cd', 'request_id': 'req-6e0af2ea-d696-410f-aa75-b3110f4b0126'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.385632 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91139f4484934b158e5ee647130aa2cd', 'request_id': 'req-6e0af2ea-d696-410f-aa75-b3110f4b0126'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.396906 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] The token cache is being invalidate because project 91139f4484934b158e5ee647130aa2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:57:49.397238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.397875 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.399452 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4431/8953] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:57:49 2022] DELETE /identity/v3/projects/91139f4484934b158e5ee647130aa2cd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:57:49.403888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:49.414008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9029a-7543-4327-9d09-a66be0339a1d service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:49.474364 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:49.475362 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:49.475630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:49.476227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] PATH_INFO: `/v3/users/83357100ed1842aeb747bf21a1b81e02` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:49.477633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83357100ed1842aeb747bf21a1b81e02)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:49.479712 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:49.528611 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83357100ed1842aeb747bf21a1b81e02'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.529294 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83357100ed1842aeb747bf21a1b81e02'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.535998 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83357100ed1842aeb747bf21a1b81e02'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.546649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83357100ed1842aeb747bf21a1b81e02'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.547369 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-362a3ec9-6d1b-4ca8-a870-1b221408b7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83357100ed1842aeb747bf21a1b81e02'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.565671 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4523/8954] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 21:57:49 2022] DELETE /identity/v3/users/83357100ed1842aeb747bf21a1b81e02 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:57:49.843151 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:49.844882 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:49.864212 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af2ea-d696-410f-aa75-b3110f4b0126 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:49.932576 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:49.933530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:49.933813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:49.934086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] PATH_INFO: `/v3/projects/b54b4c604dd24d47a5c5fd7bb442a428` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:49.935425 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54b4c604dd24d47a5c5fd7bb442a428)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:49.937416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:49.992135 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54b4c604dd24d47a5c5fd7bb442a428', 'request_id': 'req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:49.998490 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54b4c604dd24d47a5c5fd7bb442a428', 'request_id': 'req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:50.008146 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54b4c604dd24d47a5c5fd7bb442a428', 'request_id': 'req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:50.019925 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] The token cache is being invalidate because project b54b4c604dd24d47a5c5fd7bb442a428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 21:57:50.020219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:50.020878 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-4770c9d8-3f7c-4d66-9651-f0a214e39aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 21:57:50.022721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4432/8955] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:57:49 2022] DELETE /identity/v3/projects/b54b4c604dd24d47a5c5fd7bb442a428 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:57:50.028429 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4b86-62dd-45d0-bb37-c09b7990bb6f None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.029024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4b86-62dd-45d0-bb37-c09b7990bb6f None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.029024 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4b86-62dd-45d0-bb37-c09b7990bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.048552 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-f8dd4b86-62dd-45d0-bb37-c09b7990bb6f None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:57:50.049823 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-f8dd4b86-62dd-45d0-bb37-c09b7990bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:50.116365 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4524/8956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:57:50.125119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575560d-78cd-417b-88a5-71ce1efa09c6 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.125408 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575560d-78cd-417b-88a5-71ce1efa09c6 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.125686 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575560d-78cd-417b-88a5-71ce1efa09c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.144268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-0575560d-78cd-417b-88a5-71ce1efa09c6 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:57:50.145507 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-0575560d-78cd-417b-88a5-71ce1efa09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:50.153948 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4433/8957] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:57:50.158292 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4b86-62dd-45d0-bb37-c09b7990bb6f None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:50.168661 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4b86-62dd-45d0-bb37-c09b7990bb6f None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:50.173891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:50.174596 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.174876 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.175151 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.175883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 21:57:50.176191 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:50.177906 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:50.190462 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4525/8958] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 21:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 21:57:50.195022 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575560d-78cd-417b-88a5-71ce1efa09c6 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:50.204719 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575560d-78cd-417b-88a5-71ce1efa09c6 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:50.210062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:50.210723 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.211010 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.211285 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.212128 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:50.214209 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:50.256648 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4434/8959] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:57:50 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:57:50.262036 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:50.272492 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e66ce-8c56-4637-bf60-051fdbf26d49 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:50.330588 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15057697-270a-415d-9994-45418beebf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:50.331346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057697-270a-415d-9994-45418beebf86 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.331784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057697-270a-415d-9994-45418beebf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.332062 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057697-270a-415d-9994-45418beebf86 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.332755 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15057697-270a-415d-9994-45418beebf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:50.334811 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15057697-270a-415d-9994-45418beebf86 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:50.360310 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4526/8960] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:57:50 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:57:50.361699 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:50.372964 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07313a3-7166-43e6-b075-6d9da1b3d724 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:50.378835 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:50.379511 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.379793 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.380063 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.380795 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:50.382463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:50.393112 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4435/8961] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:57:50.397321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15057697-270a-415d-9994-45418beebf86 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:50.407550 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15057697-270a-415d-9994-45418beebf86 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:50.412321 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbf47c-cf50-4745-8d16-19b238fcf46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:50.413022 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbf47c-cf50-4745-8d16-19b238fcf46c admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.413325 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbf47c-cf50-4745-8d16-19b238fcf46c admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.413599 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbf47c-cf50-4745-8d16-19b238fcf46c admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.414380 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbf47c-cf50-4745-8d16-19b238fcf46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:50.416029 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbf47c-cf50-4745-8d16-19b238fcf46c admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:50.426054 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4527/8962] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:57:50.430106 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:50.440824 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f939556-4529-4acd-8fa0-c6a973b7754d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:50.445907 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:50.446809 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.447088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.447362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] PATH_INFO: `/v3/projects/b5b6456b64b3420cb9fd86fb1cb15247/users/9c33fcbaf68845b686f70eb205fa1e5b/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.462539 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b6456b64b3420cb9fd86fb1cb15247, user_id=9c33fcbaf68845b686f70eb205fa1e5b, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:50.465303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:50.481041 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4436/8963] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:57:50 2022] PUT /identity/v3/projects/b5b6456b64b3420cb9fd86fb1cb15247/users/9c33fcbaf68845b686f70eb205fa1e5b/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:57:50.486447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e335c9b-19d3-4b8c-85ca-0abbac42f519 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.486737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e335c9b-19d3-4b8c-85ca-0abbac42f519 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.487013 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e335c9b-19d3-4b8c-85ca-0abbac42f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.513641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1e335c9b-19d3-4b8c-85ca-0abbac42f519 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:57:50.514982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1e335c9b-19d3-4b8c-85ca-0abbac42f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:50.576696 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4528/8964] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:57:50.587098 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:50.589062 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:50.647086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c57dce-49a4-4ef3-ae91-8c3f4c31de4b admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:50.651347 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:50.651990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:50.652273 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:50.652546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:50.662025 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:50.663479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:50.673020 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4437/8965] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:57:54.778869 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d4d00-abe1-4ede-b1dd-ce1615eb9d09 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:54.779390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d4d00-abe1-4ede-b1dd-ce1615eb9d09 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:54.779514 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d4d00-abe1-4ede-b1dd-ce1615eb9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:54.806560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1a8d4d00-abe1-4ede-b1dd-ce1615eb9d09 None None] MFA Rules not processed for user `9c33fcbaf68845b686f70eb205fa1e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:57:54.807682 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1a8d4d00-abe1-4ede-b1dd-ce1615eb9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:57:54.876916 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4529/8966] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:57:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:57:54.881631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:54.891736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2bb9d-8753-43b4-8591-1e32fb1dbf0b service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:54.897440 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:54.898117 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:54.898401 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:54.898678 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:54.899374 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:54.901365 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:54.930072 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4438/8967] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 21:57:54 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:57:54.934338 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d4d00-abe1-4ede-b1dd-ce1615eb9d09 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:54.945372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d4d00-abe1-4ede-b1dd-ce1615eb9d09 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:55.019428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:55.020134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:55.020456 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:55.020730 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:55.021451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:55.023704 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:55.049325 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4530/8968] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 21:57:54 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 21:57:55.050536 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:55.063750 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2425-ffbc-4626-97ee-21602e76ab5f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:55.068604 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:55.069514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:55.069862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:55.070219 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:55.071008 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:55.072814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:55.084212 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4439/8969] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 21:57:55.088762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:55.099265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5bb1f-8b61-464b-b0c7-1f9a66f3337b admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:55.105326 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:55.106270 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:55.106549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:55.106813 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] PATH_INFO: `/v3/projects/3b560dddcc3f4c39ad38682586bcdaee/users/4423821e70684b209df595d109cea989/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:55.122870 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b560dddcc3f4c39ad38682586bcdaee, user_id=4423821e70684b209df595d109cea989, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:55.125684 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:55.142673 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4531/8970] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:57:55 2022] PUT /identity/v3/projects/3b560dddcc3f4c39ad38682586bcdaee/users/4423821e70684b209df595d109cea989/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:57:55.147352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:55.165506 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bca3c-f6a8-4c96-9215-10dc33caa7ba admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:55.240411 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a563974-8572-4532-aebb-2106fd877769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:55.241221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a563974-8572-4532-aebb-2106fd877769 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:55.241583 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a563974-8572-4532-aebb-2106fd877769 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:55.242091 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a563974-8572-4532-aebb-2106fd877769 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:55.242890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a563974-8572-4532-aebb-2106fd877769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:55.244721 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a563974-8572-4532-aebb-2106fd877769 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:55.257074 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4440/8971] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 21:57:55.260670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:57:55.271693 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a700f02-97e1-4132-9d82-7e60b361270f admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:57:55.276617 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:57:55.277644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:55.277921 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:55.278192 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] PATH_INFO: `/v3/projects/3b560dddcc3f4c39ad38682586bcdaee/users/4423821e70684b209df595d109cea989/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:55.280257 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b560dddcc3f4c39ad38682586bcdaee, user_id=4423821e70684b209df595d109cea989, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:57:55.282988 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:57:55.296238 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4532/8972] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 21:57:55 2022] PUT /identity/v3/projects/3b560dddcc3f4c39ad38682586bcdaee/users/4423821e70684b209df595d109cea989/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 21:57:59.909394 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e536ee1-6985-44df-b4a2-1cce85394c03 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:57:59.909939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e536ee1-6985-44df-b4a2-1cce85394c03 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:57:59.909939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e536ee1-6985-44df-b4a2-1cce85394c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:57:59.936082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5e536ee1-6985-44df-b4a2-1cce85394c03 None None] MFA Rules not processed for user `4423821e70684b209df595d109cea989`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:57:59.937197 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5e536ee1-6985-44df-b4a2-1cce85394c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:58:00.005753 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4441/8973] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:57:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 21:58:00.017351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:58:00.019231 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:58:00.112462 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1036e4-8efd-48a9-b333-8dacefdb9940 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:58:00.118608 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:58:00.119281 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:58:00.119564 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:58:00.119842 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:58:00.178590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:58:00.180264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:58:00.190077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4533/8974] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:58:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:58:01.426623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546c2e-cbf3-4187-b7ba-d28afe2bc3e1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:58:01.427210 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546c2e-cbf3-4187-b7ba-d28afe2bc3e1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:58:01.427410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546c2e-cbf3-4187-b7ba-d28afe2bc3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:58:01.446306 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-d3546c2e-cbf3-4187-b7ba-d28afe2bc3e1 None None] MFA Rules not processed for user `9c33fcbaf68845b686f70eb205fa1e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 21:58:01.447868 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-d3546c2e-cbf3-4187-b7ba-d28afe2bc3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:58:01.458714 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4442/8975] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 21:58:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 21:58:06.742835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:58:06.796997 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ee123-8977-4297-a06b-d22e83fd713f service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:58:06.801206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:58:06.801839 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:58:06.802110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:58:06.802378 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:58:06.804393 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:58:06.817799 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:58:06.819242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:58:06.830086 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4534/8976] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:58:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:58:08.010438 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3546c2e-cbf3-4187-b7ba-d28afe2bc3e1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:58:08.020450 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3546c2e-cbf3-4187-b7ba-d28afe2bc3e1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:58:08.024123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:58:08.024768 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:58:08.025190 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:58:08.025463 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:58:08.027501 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:58:08.043895 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:58:08.045367 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:58:08.056215 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4443/8977] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:58:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:58:14.290175 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:58:14.299498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b49ad-a746-4144-acd1-61103cc1430e service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:58:14.304119 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:58:14.304780 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:58:14.305074 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:58:14.305363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:58:14.315334 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:58:14.316793 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:58:14.326686 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4535/8978] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:58:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 21:58:32.211287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 21:58:32.212975 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:58:32.234670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050647-8cf4-471a-97cb-4d3e2fbc4a53 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 21:58:32.239293 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e2d87-bd41-48b6-8e4c-3aa6a79582b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 21:58:32.239950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2d87-bd41-48b6-8e4c-3aa6a79582b6 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 21:58:32.240232 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2d87-bd41-48b6-8e4c-3aa6a79582b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 21:58:32.240503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2d87-bd41-48b6-8e4c-3aa6a79582b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 21:58:32.242670 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-f73e2d87-bd41-48b6-8e4c-3aa6a79582b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 21:58:32.252535 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e2d87-bd41-48b6-8e4c-3aa6a79582b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 21:58:32.254002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e2d87-bd41-48b6-8e4c-3aa6a79582b6 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 21:58:32.261997 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4444/8979] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 21:58:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:00:59.032807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:00:59.058707 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c66423-f2e2-40ed-b281-bed63550e548 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:00:59.064534 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:00:59.065222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:00:59.065501 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:00:59.065772 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:00:59.067573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:00:59.079855 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:00:59.081533 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:00:59.091909 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4536/8980] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:00:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:00:59.488194 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0a64-1a07-42b6-b9cf-76f3d0b7e4e3 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:00:59.488697 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0a64-1a07-42b6-b9cf-76f3d0b7e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:00:59.488814 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0a64-1a07-42b6-b9cf-76f3d0b7e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:00:59.538426 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bbdf0a64-1a07-42b6-b9cf-76f3d0b7e4e3 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:00:59.539687 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bbdf0a64-1a07-42b6-b9cf-76f3d0b7e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:00:59.606140 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4445/8981] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 22:00:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:00:59.659306 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:00:59.660872 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:00:59.750397 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac4e5-0182-4429-bee8-0d51c80b0b25 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:00:59.757652 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a444c6-6290-4da1-a9cd-59160e8fcc4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:00:59.758339 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a444c6-6290-4da1-a9cd-59160e8fcc4d service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:00:59.758618 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a444c6-6290-4da1-a9cd-59160e8fcc4d service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:00:59.758890 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a444c6-6290-4da1-a9cd-59160e8fcc4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:00:59.768264 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a444c6-6290-4da1-a9cd-59160e8fcc4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:00:59.769904 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a444c6-6290-4da1-a9cd-59160e8fcc4d service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:00:59.778031 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4537/8982] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:00:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:01:11.650593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0a64-1a07-42b6-b9cf-76f3d0b7e4e3 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:11.660857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0a64-1a07-42b6-b9cf-76f3d0b7e4e3 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:11.665508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea00a-9bab-4607-9862-2e068704c163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:11.666086 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea00a-9bab-4607-9862-2e068704c163 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:11.666366 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea00a-9bab-4607-9862-2e068704c163 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:11.666613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea00a-9bab-4607-9862-2e068704c163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:11.668779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-26fea00a-9bab-4607-9862-2e068704c163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:11.678915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fea00a-9bab-4607-9862-2e068704c163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:11.680352 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fea00a-9bab-4607-9862-2e068704c163 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:11.688642 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4446/8983] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:01:11.788316 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31431d39-d747-426c-9bfc-0d20fb315ed7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:11.788884 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31431d39-d747-426c-9bfc-0d20fb315ed7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:11.789005 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31431d39-d747-426c-9bfc-0d20fb315ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:11.819057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-31431d39-d747-426c-9bfc-0d20fb315ed7 None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:01:11.820398 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-31431d39-d747-426c-9bfc-0d20fb315ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:11.831712 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4538/8984] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:01:11.844634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73231660-b0d7-460f-a664-739bfed0d187 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:11.844946 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73231660-b0d7-460f-a664-739bfed0d187 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:11.845279 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73231660-b0d7-460f-a664-739bfed0d187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:11.896412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-73231660-b0d7-460f-a664-739bfed0d187 None None] MFA Rules not processed for user `3efd3561844146239d5a9aa46ff7f401`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:01:11.897690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-73231660-b0d7-460f-a664-739bfed0d187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:11.957686 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4447/8985] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Apr 9 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:01:11.964090 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31431d39-d747-426c-9bfc-0d20fb315ed7 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:11.973705 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31431d39-d747-426c-9bfc-0d20fb315ed7 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:11.978578 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:11.979457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:11.979844 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:11.980247 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:11.991214 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:11.992688 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:12.004069 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4539/8986] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:01:12.069691 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e11cb-2956-46a5-abe8-b18f631e3c84 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:12.069986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e11cb-2956-46a5-abe8-b18f631e3c84 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:12.070268 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e11cb-2956-46a5-abe8-b18f631e3c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:12.089997 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-596e11cb-2956-46a5-abe8-b18f631e3c84 None None] MFA Rules not processed for user `504db2ec734c46999530ed037dc0330c`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:01:12.091220 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-596e11cb-2956-46a5-abe8-b18f631e3c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:12.102939 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4448/8987] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:01:12.114152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:12.123882 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6d6ab-991d-4742-8884-7a1b7306148a service glance] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:12.128053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:12.128753 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:12.129057 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:12.129346 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:12.137009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:12.138480 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:12.146698 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4540/8988] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:01:12.219565 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d743e9-b17f-4677-9770-b405807af47f None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:12.219857 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d743e9-b17f-4677-9770-b405807af47f None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:12.220136 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d743e9-b17f-4677-9770-b405807af47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:12.240172 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-91d743e9-b17f-4677-9770-b405807af47f None None] MFA Rules not processed for user `d3a4c68c9de346219732fa8f9f6df17f`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:01:12.241473 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-91d743e9-b17f-4677-9770-b405807af47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:12.252702 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4449/8989] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Apr 9 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:01:12.262889 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:12.272528 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ceaf-1597-44c2-a5e6-f00e3c680b7a service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:12.277580 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:12.278227 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:12.278503 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:12.278779 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:12.291100 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:12.292548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:12.303659 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4541/8990] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:01:13.123508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d743e9-b17f-4677-9770-b405807af47f None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:13.132653 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d743e9-b17f-4677-9770-b405807af47f None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:13.136409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601945c1-ff86-423f-bba1-c3d288852c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:13.137163 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601945c1-ff86-423f-bba1-c3d288852c3d service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:13.137510 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601945c1-ff86-423f-bba1-c3d288852c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:13.137844 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601945c1-ff86-423f-bba1-c3d288852c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:13.139861 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-601945c1-ff86-423f-bba1-c3d288852c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:13.149792 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601945c1-ff86-423f-bba1-c3d288852c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:13.151242 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601945c1-ff86-423f-bba1-c3d288852c3d service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:13.159041 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4450/8991] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:01:14.015520 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:14.018806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:14.034982 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c14c-f9a0-48aa-9f0e-283dea2cef41 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:14.042372 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:14.043269 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:14.043623 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:14.043960 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:14.045968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:14.066581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:14.068443 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:14.081753 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4542/8992] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:01:14.757936 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dfbfc-8bd6-46d9-bf06-f756714d16cc None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:14.758439 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dfbfc-8bd6-46d9-bf06-f756714d16cc None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:14.758568 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dfbfc-8bd6-46d9-bf06-f756714d16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:14.776838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-700dfbfc-8bd6-46d9-bf06-f756714d16cc None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:01:14.778195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-700dfbfc-8bd6-46d9-bf06-f756714d16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:14.785744 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4451/8993] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:01:14.797791 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:14.808943 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9acf2e-2691-41aa-8683-47e96bd9575b service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:14.814433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:14.815085 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:14.815363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:14.815643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:14.824053 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:14.825700 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:14.834425 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4543/8994] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:01:28.214988 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:28.215579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:28.215579 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:28.251786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:01:28.253002 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:28.262133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4452/8995] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:01:28.278016 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:28.288717 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f2c37-f8c5-4889-9a84-80b45ce46ef3 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:28.295179 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:28.295837 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:28.296117 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:28.296388 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:28.304866 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:28.306548 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:28.314954 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4544/8996] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:01:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:01:29.866413 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:29.867952 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:29.964353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beca219-9ade-4e6e-873a-83bd1d4447b1 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:29.969822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe9c46-0369-4851-9bf2-736aac5ecedf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:29.970479 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe9c46-0369-4851-9bf2-736aac5ecedf service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:29.970763 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe9c46-0369-4851-9bf2-736aac5ecedf service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:29.971333 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe9c46-0369-4851-9bf2-736aac5ecedf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:29.973195 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-7afe9c46-0369-4851-9bf2-736aac5ecedf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:29.985759 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe9c46-0369-4851-9bf2-736aac5ecedf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:29.987455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe9c46-0369-4851-9bf2-736aac5ecedf service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:29.997786 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4453/8997] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:01:35.418428 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:01:35.420203 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:35.439448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a963758-4591-4dbc-bc29-e48be1b698ad service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:01:35.445947 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:01:35.446639 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:01:35.446908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:01:35.447159 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:01:35.449384 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:01:35.462134 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:01:35.463737 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:01:35.473802 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4545/8998] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:01:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:02:46.032481 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f112f-4ef1-4077-9d69-44f1ce3a7952 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:02:46.033180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f112f-4ef1-4077-9d69-44f1ce3a7952 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:02:46.033180 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f112f-4ef1-4077-9d69-44f1ce3a7952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:02:46.052045 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-963f112f-4ef1-4077-9d69-44f1ce3a7952 None None] MFA Rules not processed for user `9c33fcbaf68845b686f70eb205fa1e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:02:46.053318 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-963f112f-4ef1-4077-9d69-44f1ce3a7952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:02:46.061277 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4454/8999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:02:49.708345 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:02:49.719695 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bb7b9-f706-44a9-a1da-3e5a08194f80 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:02:49.726630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:02:49.727290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:02:49.727574 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:02:49.727880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:02:49.730060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:02:49.741949 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:02:49.743620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:02:49.754382 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4546/9000] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:02:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:02:55.127525 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f112f-4ef1-4077-9d69-44f1ce3a7952 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:02:55.153414 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f112f-4ef1-4077-9d69-44f1ce3a7952 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:02:55.160994 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:02:55.162115 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:02:55.162711 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:02:55.163221 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:02:55.165369 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:02:55.179530 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:02:55.181865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:02:55.193544 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4455/9001] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:02:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:02:59.946194 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:02:59.959569 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547b675-808a-44ca-a005-35e7438715a6 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:02:59.966696 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:02:59.967354 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:02:59.967643 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:02:59.967925 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:02:59.977049 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:02:59.978664 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:02:59.988185 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4547/9002] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:02:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:03:36.156508 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:03:36.166941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02939-d351-4431-b40b-be5e1f0f5bd9 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:03:36.171071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:03:36.172300 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:03:36.172620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:03:36.173060 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:03:36.182207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:03:36.183930 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:03:36.193145 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4456/9003] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:03:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:05:19.520478 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:05:19.530865 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05812831-b69a-4a2b-87d8-8e0ec54690f1 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:05:19.535242 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:05:19.535893 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:05:19.536174 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:05:19.536447 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:05:19.547004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:05:19.548457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:05:19.560237 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4548/9004] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:05:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:05:20.762009 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:05:20.774054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8048e-807f-4af9-95ca-2be9c3bc8bca service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:05:20.779807 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:05:20.780453 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:05:20.780724 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:05:20.780990 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:05:20.792662 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:05:20.794144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:05:20.805386 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4457/9005] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:05:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:05:33.055442 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:05:33.067377 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8674ec-9d31-4577-983a-355f0dd2d31c service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:05:33.073635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:05:33.074301 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:05:33.074605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:05:33.074880 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:05:33.076973 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:05:33.090308 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:05:33.092180 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:05:33.103510 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4549/9006] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:05:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:06:34.878410 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:06:34.924261 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e407-9980-473d-a3ea-c0170e132798 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:06:34.932376 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:06:34.933016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:06:34.933328 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:06:34.933597 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:06:34.942609 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:06:34.944211 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:06:34.954340 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4458/9007] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:06:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:06:39.423033 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:06:39.467633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d7ae-79d3-411c-9bf0-5e5ba04de40d service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:06:39.474355 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:06:39.475009 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:06:39.475288 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:06:39.475549 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:06:39.484565 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:06:39.486236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:06:39.496104 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4550/9008] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:06:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:06:47.792995 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:06:47.803666 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570515c6-4300-448e-a16b-004a2596dc0e service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:06:47.808708 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:06:47.809469 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:06:47.809786 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:06:47.810088 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:06:47.818821 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:06:47.820274 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:06:47.828963 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4459/9009] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:06:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:07:13.849527 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:13.863141 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191f33b-dad1-4076-8e00-e033ba313dd9 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:13.869531 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:13.870236 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:13.870556 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:13.870883 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:13.880703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:13.882863 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:13.893994 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4551/9010] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:07:15.649607 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:15.658704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285a06d-8812-43ab-a157-7c83b3ae6dc6 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:15.663188 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:15.663865 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:15.664145 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:15.664412 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:15.736251 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:15.737753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:15.757113 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4460/9011] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 22:07:22.545993 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:22.556740 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26789153-b344-4458-9875-14715b90a7c0 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:22.562363 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:22.563262 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:22.563537 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:22.563806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] PATH_INFO: `/v3/users/9c33fcbaf68845b686f70eb205fa1e5b` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:22.565101 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c33fcbaf68845b686f70eb205fa1e5b)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:22.567169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:22.617244 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c33fcbaf68845b686f70eb205fa1e5b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:22.617898 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c33fcbaf68845b686f70eb205fa1e5b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:22.624485 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c33fcbaf68845b686f70eb205fa1e5b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:22.633128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c33fcbaf68845b686f70eb205fa1e5b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:22.633734 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c33fcbaf68845b686f70eb205fa1e5b'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:22.651048 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4552/9012] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 22:07:22 2022] DELETE /identity/v3/users/9c33fcbaf68845b686f70eb205fa1e5b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:07:22.837218 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:22.849303 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7430db-0795-4c7c-bf5e-7fc34233a701 service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:22.915123 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:22.916007 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:22.916281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:22.916550 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] PATH_INFO: `/v3/projects/b5b6456b64b3420cb9fd86fb1cb15247` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:22.917790 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b6456b64b3420cb9fd86fb1cb15247)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:22.919736 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:22.970405 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b6456b64b3420cb9fd86fb1cb15247', 'request_id': 'req-176ea21c-89ac-4786-874f-fedf1c58f6b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:22.976733 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b6456b64b3420cb9fd86fb1cb15247', 'request_id': 'req-176ea21c-89ac-4786-874f-fedf1c58f6b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:22.986354 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b6456b64b3420cb9fd86fb1cb15247', 'request_id': 'req-176ea21c-89ac-4786-874f-fedf1c58f6b9'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.014784 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] The token cache is being invalidate because project b5b6456b64b3420cb9fd86fb1cb15247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 22:07:23.015077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.015779 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.020450 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4461/9013] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 22:07:22 2022] DELETE /identity/v3/projects/b5b6456b64b3420cb9fd86fb1cb15247 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:07:23.021895 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.023433 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:23.047810 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c606f0-6df4-45e3-a050-68010e001dd2 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.104703 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.105645 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.105896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.106169 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] PATH_INFO: `/v3/users/4423821e70684b209df595d109cea989` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.107430 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4423821e70684b209df595d109cea989)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.109495 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:23.166390 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4423821e70684b209df595d109cea989'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.167083 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4423821e70684b209df595d109cea989'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.174008 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4423821e70684b209df595d109cea989'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.183017 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4423821e70684b209df595d109cea989'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.183708 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-73ba941a-e3d7-4cda-ade6-52c532394f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4423821e70684b209df595d109cea989'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.201077 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4553/9014] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 22:07:23 2022] DELETE /identity/v3/users/4423821e70684b209df595d109cea989 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:07:23.374427 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.376111 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:23.392996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea21c-89ac-4786-874f-fedf1c58f6b9 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.452313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.453208 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.453492 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.453780 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] PATH_INFO: `/v3/projects/3b560dddcc3f4c39ad38682586bcdaee` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.455094 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b560dddcc3f4c39ad38682586bcdaee)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.457057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:23.504349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b560dddcc3f4c39ad38682586bcdaee', 'request_id': 'req-f40484f3-5058-4429-af0e-13ca0bac3254'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.509558 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b560dddcc3f4c39ad38682586bcdaee', 'request_id': 'req-f40484f3-5058-4429-af0e-13ca0bac3254'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.520069 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b560dddcc3f4c39ad38682586bcdaee', 'request_id': 'req-f40484f3-5058-4429-af0e-13ca0bac3254'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.531005 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] The token cache is being invalidate because project 3b560dddcc3f4c39ad38682586bcdaee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 22:07:23.531292 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.531956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-f40484f3-5058-4429-af0e-13ca0bac3254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:07:23.533627 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4462/9015] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 22:07:23 2022] DELETE /identity/v3/projects/3b560dddcc3f4c39ad38682586bcdaee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:07:23.538830 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b7dd9-c494-4807-a8a9-c6cc77cbab66 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.539113 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b7dd9-c494-4807-a8a9-c6cc77cbab66 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.539360 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b7dd9-c494-4807-a8a9-c6cc77cbab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.586038 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-489b7dd9-c494-4807-a8a9-c6cc77cbab66 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:07:23.587313 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-489b7dd9-c494-4807-a8a9-c6cc77cbab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:23.653640 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4554/9016] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 22:07:23.661591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519f39-03cd-4af0-a833-6b8f76b492b4 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.661872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519f39-03cd-4af0-a833-6b8f76b492b4 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.662148 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519f39-03cd-4af0-a833-6b8f76b492b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.680852 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-6b519f39-03cd-4af0-a833-6b8f76b492b4 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:07:23.682082 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6b519f39-03cd-4af0-a833-6b8f76b492b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:23.691260 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4463/9017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:07:23.695641 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b7dd9-c494-4807-a8a9-c6cc77cbab66 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.705977 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b7dd9-c494-4807-a8a9-c6cc77cbab66 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.711930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.712598 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.712914 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.713222 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] PATH_INFO: `/v3/domains` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.713951 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 09 22:07:23.714256 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.715896 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:23.729316 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4555/9018] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Apr 9 22:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 09 22:07:23.733710 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519f39-03cd-4af0-a833-6b8f76b492b4 None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.743097 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519f39-03cd-4af0-a833-6b8f76b492b4 None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.747983 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.748642 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.748920 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.749228 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.749915 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.751822 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:23.784750 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4464/9019] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 22:07:23 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 22:07:23.785930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.796941 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ffb83-5f2c-4da7-ae81-345680793379 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.857888 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.858567 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.858835 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.859099 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.859787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.861862 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:23.886324 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4556/9020] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 22:07:23 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 09 22:07:23.888199 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.898869 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfc44-7a9c-4541-9ef0-55a645e3d7a2 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.903546 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.904313 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.904589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.904860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.905621 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.907231 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:23.917513 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4465/9021] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 22:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 22:07:23.921622 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.932948 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24213-0449-4602-b7f4-e0bf13dbd1d3 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.938616 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b622bc-d54d-4325-9ad7-0cfbd3d8a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.939282 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b622bc-d54d-4325-9ad7-0cfbd3d8a1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.939593 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b622bc-d54d-4325-9ad7-0cfbd3d8a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.939801 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b622bc-d54d-4325-9ad7-0cfbd3d8a1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.940551 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b622bc-d54d-4325-9ad7-0cfbd3d8a1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.942200 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b622bc-d54d-4325-9ad7-0cfbd3d8a1c9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:23.953494 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4557/9022] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 22:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 22:07:23.957966 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:23.967893 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fea3d-dc0f-480d-82ba-810b1fd8c9e1 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:23.972838 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:23.973753 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] REQUEST_METHOD: `PUT` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:23.974056 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:23.974319 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] PATH_INFO: `/v3/projects/52dbb1e4cff34771b0db6a1505243d94/users/0f3bac3d534c4762920afdb1215c22b7/roles/873544593d0a49c4bcb7d1582e9f0759` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:23.988941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dbb1e4cff34771b0db6a1505243d94, user_id=0f3bac3d534c4762920afdb1215c22b7, role_id=873544593d0a49c4bcb7d1582e9f0759)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:23.991688 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:24.006671 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4466/9023] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 22:07:23 2022] PUT /identity/v3/projects/52dbb1e4cff34771b0db6a1505243d94/users/0f3bac3d534c4762920afdb1215c22b7/roles/873544593d0a49c4bcb7d1582e9f0759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 22:07:24.011787 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670db11-5bcd-47b9-99c9-e6eb7b6339c7 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:24.012073 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670db11-5bcd-47b9-99c9-e6eb7b6339c7 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:24.012351 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670db11-5bcd-47b9-99c9-e6eb7b6339c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:24.030508 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-1670db11-5bcd-47b9-99c9-e6eb7b6339c7 None None] MFA Rules not processed for user `81850984797948c9a3a57c5bfc417a12`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:07:24.031711 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1670db11-5bcd-47b9-99c9-e6eb7b6339c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:24.093918 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4558/9024] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:07:24.104961 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:24.107904 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:24.194613 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fdb1a-c89b-40c1-bb69-d29340339710 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:24.198944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:24.199620 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:24.199897 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:24.200166 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:24.210302 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:24.211772 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:24.221500 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4467/9025] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:07:28.017417 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344cfa-cb36-4985-8b1d-3e7482a1cedc None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:28.018309 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344cfa-cb36-4985-8b1d-3e7482a1cedc None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:28.018590 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344cfa-cb36-4985-8b1d-3e7482a1cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:28.045213 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-19344cfa-cb36-4985-8b1d-3e7482a1cedc None None] MFA Rules not processed for user `0f3bac3d534c4762920afdb1215c22b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:07:28.046366 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-19344cfa-cb36-4985-8b1d-3e7482a1cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:28.113395 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4559/9026] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:07:28.117631 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:28.128963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b522ae2-c59a-4c62-a9e3-80e0742b0efb service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:28.135402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:28.136070 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:28.136353 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:28.136629 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] PATH_INFO: `/v3/projects` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:28.137455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:28.139291 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:28.170192 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4468/9027] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Apr 9 22:07:28 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 22:07:28.174968 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344cfa-cb36-4985-8b1d-3e7482a1cedc None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:28.185972 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344cfa-cb36-4985-8b1d-3e7482a1cedc None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:28.243557 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:28.244559 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:28.244928 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:28.245143 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] PATH_INFO: `/v3/users` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:28.245845 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:28.247827 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:28.273590 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4560/9028] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Apr 9 22:07:28 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 09 22:07:28.274905 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:28.285704 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487f3ca-817f-49d1-844d-bed2bc610147 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:28.290551 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:28.291238 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:28.291517 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:28.291789 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:28.292534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:28.294217 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:28.305221 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4469/9029] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 22:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 09 22:07:28.309644 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:28.319908 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f8d5c-cee9-4515-bb6b-ee46e52abbdc admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:28.324631 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:28.325589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:28.325861 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:28.326576 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] PATH_INFO: `/v3/projects/d7c228acaa9a4739a53e1533b89cf69a/users/4420d8c3476a4d649a74d35090218146/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:28.341739 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c228acaa9a4739a53e1533b89cf69a, user_id=4420d8c3476a4d649a74d35090218146, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:28.344409 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:28.359210 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4561/9030] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 22:07:28 2022] PUT /identity/v3/projects/d7c228acaa9a4739a53e1533b89cf69a/users/4420d8c3476a4d649a74d35090218146/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:07:28.363449 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:28.374012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c95ac-de26-4c5b-80be-d17d0732643d admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:28.456766 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c346eb-d6cc-4f48-bf1f-c99715b9bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:28.457956 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c346eb-d6cc-4f48-bf1f-c99715b9bcdb admin admin] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:28.458959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c346eb-d6cc-4f48-bf1f-c99715b9bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:28.459183 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c346eb-d6cc-4f48-bf1f-c99715b9bcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:28.459871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c346eb-d6cc-4f48-bf1f-c99715b9bcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:28.461939 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c346eb-d6cc-4f48-bf1f-c99715b9bcdb admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:28.473854 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4470/9031] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 22:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 09 22:07:28.478206 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:28.489635 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b01f85-6bf4-4d9c-b8bf-51ab2694823e admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:28.495216 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:28.496164 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:28.496437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:28.496706 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] PATH_INFO: `/v3/projects/d7c228acaa9a4739a53e1533b89cf69a/users/4420d8c3476a4d649a74d35090218146/roles/342abca02a8e4f5b9ce622af865ffa78` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:28.498930 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c228acaa9a4739a53e1533b89cf69a, user_id=4420d8c3476a4d649a74d35090218146, role_id=342abca02a8e4f5b9ce622af865ffa78)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:28.501697 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:28.513475 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4562/9032] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Apr 9 22:07:28 2022] PUT /identity/v3/projects/d7c228acaa9a4739a53e1533b89cf69a/users/4420d8c3476a4d649a74d35090218146/roles/342abca02a8e4f5b9ce622af865ffa78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:07:33.468057 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda77b8-e8d5-4a87-94a9-835621509643 None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:33.468602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda77b8-e8d5-4a87-94a9-835621509643 None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:33.468602 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda77b8-e8d5-4a87-94a9-835621509643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:33.496630 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-bbda77b8-e8d5-4a87-94a9-835621509643 None None] MFA Rules not processed for user `4420d8c3476a4d649a74d35090218146`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:07:33.497890 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-bbda77b8-e8d5-4a87-94a9-835621509643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:33.567021 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4471/9033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:07:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 22:07:33.578331 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:33.580232 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:33.662298 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b4925-b411-4619-a192-4d415a851f5a admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:33.668319 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:33.668994 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:33.669573 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:33.670067 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:33.734078 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:33.735749 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:33.746226 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4563/9034] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:07:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:07:34.976192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f8e3-550f-4512-85e9-c2dd108ea5ea None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:34.976728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f8e3-550f-4512-85e9-c2dd108ea5ea None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:34.976728 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f8e3-550f-4512-85e9-c2dd108ea5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:34.998791 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-3fa3f8e3-550f-4512-85e9-c2dd108ea5ea None None] MFA Rules not processed for user `0f3bac3d534c4762920afdb1215c22b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:07:35.000041 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-3fa3f8e3-550f-4512-85e9-c2dd108ea5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:35.012882 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4472/9035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:07:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:07:35.335224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:35.391434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5799-da24-4f16-b951-7245d2b3ff33 service nova] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:35.395287 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:35.395954 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:35.396230 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:35.396499 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:35.398350 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:35.408812 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:35.410522 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:35.420250 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4564/9036] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:07:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:07:43.318872 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f8e3-550f-4512-85e9-c2dd108ea5ea None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:43.334330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f8e3-550f-4512-85e9-c2dd108ea5ea None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:43.339758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:43.340409 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:43.340794 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:43.341078 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:43.342860 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:07:43.356503 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:43.358244 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:43.369133 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4473/9037] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:07:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:07:45.768675 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:07:45.777873 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ed198-77d3-4271-991a-c16ec81b05d9 service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:07:45.782391 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6b8d7-5be2-4dfc-9dc3-150a08ca9e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:07:45.783050 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6b8d7-5be2-4dfc-9dc3-150a08ca9e2b service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:07:45.783358 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6b8d7-5be2-4dfc-9dc3-150a08ca9e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:07:45.783633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6b8d7-5be2-4dfc-9dc3-150a08ca9e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:07:45.793745 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6b8d7-5be2-4dfc-9dc3-150a08ca9e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:07:45.795209 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6b8d7-5be2-4dfc-9dc3-150a08ca9e2b service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:07:45.805060 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4565/9038] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:07:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:08:43.636192 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:08:43.638553 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:08:43.665986 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4194bc-55bb-4fd0-802f-06e20ab97e2f service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:08:43.672627 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:08:43.673596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:08:43.673892 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:08:43.674205 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:08:43.677373 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:08:43.688663 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:08:43.690184 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:08:43.698815 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4474/9039] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:08:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:10:22.968512 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f87de-b180-4a0a-940e-fa1b33b93ed2 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:22.968992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f87de-b180-4a0a-940e-fa1b33b93ed2 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:22.968992 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f87de-b180-4a0a-940e-fa1b33b93ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:22.987601 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-be3f87de-b180-4a0a-940e-fa1b33b93ed2 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:10:22.988820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-be3f87de-b180-4a0a-940e-fa1b33b93ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:23.054949 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4566/9040] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 22:10:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:10:23.104941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:10:23.106416 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:23.174540 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8e0e-f460-4ca0-9689-1f248b47924e service neutron] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:10:23.179628 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:10:23.180287 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:23.180566 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:23.180963 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:23.189758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:10:23.191392 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:10:23.199820 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4475/9041] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:10:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:10:32.447620 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:32.448448 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:32.448731 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:32.466901 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] MFA Rules not processed for user `0f3bac3d534c4762920afdb1215c22b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:10:32.468087 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:32.475412 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4567/9042] 10.222.0.30 () {58 vars in 957 bytes} [Sat Apr 9 22:10:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:10:32.514959 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:10:32.516692 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:32.575944 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a62605-a70b-4715-80b8-e8433d9bee69 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:10:32.580592 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efd3561844146239d5a9aa46ff7f401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:10:32.581289 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:32.581570 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:32.581840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:32.584297 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:32.612722 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:10:32.614233 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:10:32.628201 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4476/9043] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:10:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:10:33.278040 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:10:33.279649 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:33.286102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:10:33.295186 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7cf5-d352-4822-a516-478189dd5aca service glance] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:10:33.299104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfff18d-6dfd-477d-8ba9-96b92c97b63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:10:33.299748 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfff18d-6dfd-477d-8ba9-96b92c97b63f service neutron] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:33.300028 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfff18d-6dfd-477d-8ba9-96b92c97b63f service neutron] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:33.300299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfff18d-6dfd-477d-8ba9-96b92c97b63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:33.302315 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cdfff18d-6dfd-477d-8ba9-96b92c97b63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:33.316879 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfff18d-6dfd-477d-8ba9-96b92c97b63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:10:33.318363 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfff18d-6dfd-477d-8ba9-96b92c97b63f service neutron] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:10:33.329491 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4477/9044] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:10:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 09 22:10:33.353383 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07dd6-53fb-4c3a-8df5-3fb1ef469c47 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:10:33.358545 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:10:33.359219 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:33.359505 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:33.359784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:33.361762 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:33.374161 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:10:33.375795 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:10:33.386574 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4568/9045] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:10:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:10:34.532578 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] REQUEST_METHOD: `POST` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:34.533074 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:34.533223 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:34.551720 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.auth.core [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:10:34.552950 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:34.561677 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4478/9046] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 22:10:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 09 22:10:34.573864 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:10:34.585467 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3dcce-2630-4583-9373-c20e88aa1c3e service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:10:34.591437 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:10:34.592330 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:34.592651 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:34.592924 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:34.602265 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:10:34.603891 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:10:34.612725 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4569/9047] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:10:54.914179 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:10:54.922099 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:54.938033 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54166401-13aa-4aa6-afb9-e5ae9bec418d None None] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:10:54.944356 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:10:54.944996 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:10:54.945360 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:10:54.945758 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:10:54.947715 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:10:54.959941 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:10:54.961596 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:10:54.972561 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4479/9048] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:10:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:11:42.922075 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:11:42.944489 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca9218-1fb8-4227-8d80-64cf9468f6e9 service swift] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:11:42.951152 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:11:42.951806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:11:42.952092 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:11:42.952347 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:11:42.954498 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:11:42.980400 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:11:42.982080 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:11:42.992544 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4570/9049] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:11:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:11:43.419611 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:11:43.421312 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:11:43.436105 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af445c62-33e3-485f-913c-c7ad5d8a7e80 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:11:43.442651 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:11:43.443311 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:11:43.443591 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:11:43.443862 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:11:43.445976 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:11:43.458330 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:11:43.460144 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:11:43.470641 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4480/9050] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:11:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:11:53.145451 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:11:53.155475 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8b79-d9bd-4e98-997d-9f3276e126a8 service placement] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:11:53.159457 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d5c36-6787-44af-970d-142645cfb21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:11:53.160144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5c36-6787-44af-970d-142645cfb21f service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:11:53.160405 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5c36-6787-44af-970d-142645cfb21f service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:11:53.160670 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5c36-6787-44af-970d-142645cfb21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:11:53.162582 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-039d5c36-6787-44af-970d-142645cfb21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:11:53.173335 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d5c36-6787-44af-970d-142645cfb21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:11:53.174831 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d5c36-6787-44af-970d-142645cfb21f service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:11:53.183315 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4571/9051] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:11:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:12:35.559422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:12:35.587444 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b8a57-36e0-45f7-9680-3269b49a2d85 service placement] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:12:35.594808 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:12:35.595456 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:35.595738 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:35.596015 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:35.604317 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:12:35.605977 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:12:35.615360 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4481/9052] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:12:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:12:38.934560 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570662-1650-4859-bb5f-6f8b90517416 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:38.935137 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570662-1650-4859-bb5f-6f8b90517416 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:38.935224 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570662-1650-4859-bb5f-6f8b90517416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:39.004168 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-3a570662-1650-4859-bb5f-6f8b90517416 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:12:39.006188 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-3a570662-1650-4859-bb5f-6f8b90517416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:12:39.024306 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4572/9053] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Apr 9 22:12:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:12:39.066659 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:12:39.088189 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c28c-960d-4ce1-bee3-10a5a1faac99 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:12:39.093912 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:12:39.094562 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:39.094851 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:39.095131 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:39.103430 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:12:39.105071 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:12:39.113721 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4482/9054] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:12:48.344056 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facbb5-fea5-4150-9234-73bbbc6712d6 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:48.344563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facbb5-fea5-4150-9234-73bbbc6712d6 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:48.344563 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facbb5-fea5-4150-9234-73bbbc6712d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:48.362340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-d0facbb5-fea5-4150-9234-73bbbc6712d6 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:12:48.374541 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-d0facbb5-fea5-4150-9234-73bbbc6712d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:12:48.383062 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4573/9055] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 22:12:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:12:48.395341 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:12:48.406104 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a54f1-aa60-4ae4-9347-ce2a4412ae7f service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:12:48.411813 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:12:48.412457 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:48.412737 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:48.413012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:48.421417 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:12:48.423012 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:12:48.430911 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4483/9056] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:12:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:12:50.592955 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0facbb5-fea5-4150-9234-73bbbc6712d6 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:12:50.611702 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0facbb5-fea5-4150-9234-73bbbc6712d6 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:12:50.618348 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741c402-7775-4c0d-98c5-f68bebe06708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:12:50.619105 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741c402-7775-4c0d-98c5-f68bebe06708 service nova] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:50.619434 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741c402-7775-4c0d-98c5-f68bebe06708 service nova] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:50.619699 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741c402-7775-4c0d-98c5-f68bebe06708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:50.629297 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741c402-7775-4c0d-98c5-f68bebe06708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:12:50.630926 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741c402-7775-4c0d-98c5-f68bebe06708 service nova] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:12:50.642171 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4574/9057] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:12:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:12:51.861610 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:12:51.875945 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdd96f-62f9-462b-b329-b26e403f36d0 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:12:51.882141 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a4c68c9de346219732fa8f9f6df17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:12:51.882825 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:51.883102 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:51.883397 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:51.886344 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:12:51.901119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:12:51.902830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:12:51.914922 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4484/9058] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:12:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:12:53.436784 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2003-709a-4cb1-9aee-c23cb2319939 None None] REQUEST_METHOD: `POST` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:53.437290 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2003-709a-4cb1-9aee-c23cb2319939 None None] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:53.437373 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2003-709a-4cb1-9aee-c23cb2319939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:53.456097 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.auth.core [None req-5f6c2003-709a-4cb1-9aee-c23cb2319939 None None] MFA Rules not processed for user `65106688ce7b496880f3b7753f766f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 09 22:12:53.457333 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-5f6c2003-709a-4cb1-9aee-c23cb2319939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:12:53.464782 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4575/9059] 10.222.0.30 () {58 vars in 967 bytes} [Sat Apr 9 22:12:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 09 22:12:53.477514 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:12:53.489797 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee4c70-8dcb-436a-9462-bc39d7c61e80 service nova] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:12:53.495379 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ff773b27b94f59b97edddcab55716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:12:53.496016 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:53.496299 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:53.496574 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:53.504701 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:12:53.506402 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:12:53.514394 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4485/9060] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Apr 9 22:12:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 09 22:12:57.903163 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c2003-709a-4cb1-9aee-c23cb2319939 None None] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:12:57.913061 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c2003-709a-4cb1-9aee-c23cb2319939 None None] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:12:57.916897 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504db2ec734c46999530ed037dc0330c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:12:57.917581 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:12:57.917856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:12:57.918125 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:12:57.979128 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:12:57.980605 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:12:57.990420 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4576/9061] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:13:04.420840 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:13:04.433556 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2474f-176f-43ae-aab4-2be910ebfad6 service swift] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:13:04.439690 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:13:04.440593 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:13:04.440871 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:13:04.441164 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] PATH_INFO: `/v3/users/0f3bac3d534c4762920afdb1215c22b7` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:13:04.442455 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3bac3d534c4762920afdb1215c22b7)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:13:04.444382 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:13:04.495767 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3bac3d534c4762920afdb1215c22b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.496349 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3bac3d534c4762920afdb1215c22b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.503448 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3bac3d534c4762920afdb1215c22b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.504077 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3bac3d534c4762920afdb1215c22b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.512515 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3bac3d534c4762920afdb1215c22b7'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.529720 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4486/9062] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 22:13:04 2022] DELETE /identity/v3/users/0f3bac3d534c4762920afdb1215c22b7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 22:13:04.709060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:13:04.721466 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657875-62a7-4962-a664-30d93e6592fd service neutron] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:13:04.784251 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:13:04.785060 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:13:04.785359 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:13:04.785633 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] PATH_INFO: `/v3/projects/52dbb1e4cff34771b0db6a1505243d94` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:13:04.786877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52dbb1e4cff34771b0db6a1505243d94)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:13:04.788824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:13:04.838820 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dbb1e4cff34771b0db6a1505243d94', 'request_id': 'req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.845088 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dbb1e4cff34771b0db6a1505243d94', 'request_id': 'req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.853877 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dbb1e4cff34771b0db6a1505243d94', 'request_id': 'req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.865199 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] The token cache is being invalidate because project 52dbb1e4cff34771b0db6a1505243d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 22:13:04.865487 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.866144 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:04.867748 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4577/9063] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 22:13:04 2022] DELETE /identity/v3/projects/52dbb1e4cff34771b0db6a1505243d94 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:13:04.872058 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:13:04.873589 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:13:04.886433 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c7be-b84e-46c8-a2e9-d91f92456e4f admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:13:04.946207 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:13:04.947081 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:13:04.947362 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:13:04.947634 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] PATH_INFO: `/v3/users/4420d8c3476a4d649a74d35090218146` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:13:04.948816 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4420d8c3476a4d649a74d35090218146)` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:13:04.950811 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:13:05.001054 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4420d8c3476a4d649a74d35090218146'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.001771 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4420d8c3476a4d649a74d35090218146'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.008600 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4420d8c3476a4d649a74d35090218146'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.009281 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4420d8c3476a4d649a74d35090218146'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.018182 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.notifications [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4420d8c3476a4d649a74d35090218146'} {{(pid=102531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.035315 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4487/9064] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 22:13:04 2022] DELETE /identity/v3/users/4420d8c3476a4d649a74d35090218146 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 09 22:13:05.210077 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:13:05.211609 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:13:05.227493 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a3e3-16dc-451b-b79e-374e93cdbfa5 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:13:05.284595 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81850984797948c9a3a57c5bfc417a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac45ac4c5799419597fa1b4dd7090c85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:13:05.285589 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:13:05.285806 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:13:05.286081 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] PATH_INFO: `/v3/projects/d7c228acaa9a4739a53e1533b89cf69a` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:13:05.287370 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c228acaa9a4739a53e1533b89cf69a)` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:13:05.289399 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:13:05.339110 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c228acaa9a4739a53e1533b89cf69a', 'request_id': 'req-366ee4c4-5bc0-41d9-a101-ae496a040aa9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.344794 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c228acaa9a4739a53e1533b89cf69a', 'request_id': 'req-366ee4c4-5bc0-41d9-a101-ae496a040aa9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.353761 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c228acaa9a4739a53e1533b89cf69a', 'request_id': 'req-366ee4c4-5bc0-41d9-a101-ae496a040aa9'} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.364720 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] The token cache is being invalidate because project d7c228acaa9a4739a53e1533b89cf69a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 09 22:13:05.365004 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.365807 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.notifications [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 09 22:13:05.367363 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4578/9065] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 22:13:05 2022] DELETE /identity/v3/projects/d7c228acaa9a4739a53e1533b89cf69a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 09 22:16:46.880625 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Authenticating user token {{(pid=102531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:16:46.882482 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:16:46.988036 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f348c-ec60-4ea2-b273-24610d7d9b19 admin admin] Validating token access rules against request {{(pid=102531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:16:47.057623 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ccf3-414c-48a2-9455-97777d6f10bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:16:47.058534 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ccf3-414c-48a2-9455-97777d6f10bb service placement] REQUEST_METHOD: `GET` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:16:47.058830 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ccf3-414c-48a2-9455-97777d6f10bb service placement] SCRIPT_NAME: `/identity` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:16:47.059119 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ccf3-414c-48a2-9455-97777d6f10bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:16:47.062422 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.fernet_utils [None req-ea59ccf3-414c-48a2-9455-97777d6f10bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:16:47.076523 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ccf3-414c-48a2-9455-97777d6f10bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:16:47.078174 ncdv-master-1 devstack@keystone.service[102531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ccf3-414c-48a2-9455-97777d6f10bb service placement] RBAC: Authorization granted {{(pid=102531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:16:47.087993 ncdv-master-1 devstack@keystone.service[102531]: [pid: 102531|app: 0|req: 4488/9066] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:16:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 09 22:16:48.416630 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Authenticating user token {{(pid=102532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 09 22:16:48.418276 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:16:48.460824 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ee4c4-5bc0-41d9-a101-ae496a040aa9 admin admin] Validating token access rules against request {{(pid=102532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 09 22:16:48.466233 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57253fde-a824-4583-958c-334c0050e840 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46de1b79f16410fbd8dc2d1c1ecc29d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 09 22:16:48.466919 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57253fde-a824-4583-958c-334c0050e840 service placement] REQUEST_METHOD: `GET` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 09 22:16:48.467196 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57253fde-a824-4583-958c-334c0050e840 service placement] SCRIPT_NAME: `/identity` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 09 22:16:48.467471 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57253fde-a824-4583-958c-334c0050e840 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 09 22:16:48.469340 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.fernet_utils [None req-57253fde-a824-4583-958c-334c0050e840 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 09 22:16:48.481856 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57253fde-a824-4583-958c-334c0050e840 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 09 22:16:48.483490 ncdv-master-1 devstack@keystone.service[102532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57253fde-a824-4583-958c-334c0050e840 service placement] RBAC: Authorization granted {{(pid=102532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 09 22:16:48.493930 ncdv-master-1 devstack@keystone.service[102532]: [pid: 102532|app: 0|req: 4579/9067] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Apr 9 22:16:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)